CN111163296A - High-concurrency video data network transmission method and system - Google Patents
High-concurrency video data network transmission method and system Download PDFInfo
- Publication number
- CN111163296A CN111163296A CN202010019653.XA CN202010019653A CN111163296A CN 111163296 A CN111163296 A CN 111163296A CN 202010019653 A CN202010019653 A CN 202010019653A CN 111163296 A CN111163296 A CN 111163296A
- Authority
- CN
- China
- Prior art keywords
- network
- video
- distribution
- distribution node
- nodes
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
- H04N21/23106—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/262—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists
- H04N21/26208—Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists the scheduling operation being performed under constraints
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47202—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting content on demand, e.g. video on demand
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a high-concurrency video data network transmission method and device. The method comprises the following steps: acquiring video access data sent by a user; analyzing a distribution node with relatively low flow cost of network data transmission, and confirming that the distribution node is a first distribution node group; screening out distribution nodes with relatively low operation complex loads, and determining the distribution nodes as a second distribution node group; comprehensively separating out the distribution nodes with the highest priority; and sending a video transmission instruction to the distribution node with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data sent to the user. The invention can improve the processing efficiency and reliability of the system when the system responds to the high concurrent video data request, and avoid the poor use experience generated by the user when the system enters a state of being incapable of responding in time.
Description
Technical Field
The invention relates to the technical field of Wen-Bochen exhibition, in particular to a high-concurrency video data network transmission method and system.
Background
With the development of the times, the number of intelligent monitoring cameras connected with the WeChat exhibition system is increasing day by day. Meanwhile, a remote intelligent terminal connected with the WeChao exhibition system can check live videos and historical videos shot by any one camera in real time. The above operations are implemented by scheduling resources through a server group. Network broadband occupied by video resource transmission and many I/O operations are performed, and when users send out a large amount of video resource requests explosively in a short time, the system may not respond in a short time, or the users find that the downloading speed of the video resource is too slow. How to properly handle the above situation through the server group becomes a problem to be solved in the industry.
Disclosure of Invention
The invention provides a high-concurrency video data network transmission method and system, which are used for improving the processing efficiency and reliability of the system when the system responds to a high-concurrency video data request and avoiding poor user experience caused by the fact that the system enters a state that the system cannot respond to the video data request of a user in time.
According to a first aspect of the embodiments of the present invention, there is provided a method for high concurrency video data network transmission, including:
acquiring video access data sent by a user, wherein the video access data comprises an on-demand video and IP information of the user;
analyzing a distribution node with relatively low flow cost of network data transmission according to the video access data and the network attribute of the distribution node in the distributed network, and confirming that the distribution node is a first distribution node group;
acquiring real-time operation load data of all distribution nodes of the distributed network, screening out the distribution nodes with relatively low operation complex load, and confirming that the distribution nodes are a second distribution node group;
performing intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separating out distribution nodes with the highest priority in the third distribution node group;
and sending a video transmission instruction to the distribution node with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data sent to the user.
In one embodiment, the acquiring video access data sent by a user, where the video access data includes an on-demand video and IP information of the user, includes:
acquiring video access data sent by a user, wherein the video access data comprises an on-demand video and IP information of the user;
and analyzing the IP information of the user to further acquire the network attribute of the user, wherein the network attribute comprises the network service provider and the network downloading speed of the user.
In one embodiment, the analyzing, according to the video access data and a network attribute of a distribution node in a distributed network, a distribution node with a relatively low traffic cost for network data transmission to determine that the distribution node is a first distribution node group includes:
the flow cost comprises transmission speed, network delay and packet loss rate;
analyzing the distribution nodes with relatively high transmission speed of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
analyzing the distributed nodes with relatively low network delay of network data transmission according to the video access data and the network attributes of the distributed nodes in the distributed network;
analyzing the distribution nodes with relatively low packet loss rate of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
and confirming that the distribution node is a first distribution node group, wherein the number of the first part of node groups is more than an integer of three.
In one embodiment, the obtaining real-time operation load data of each total distributed node of the distributed network, screening out a distributed node with a relatively low operation complex load, and determining that the distributed node is a second distributed node group includes:
the operational load data comprises I/O load data and operational load data;
screening out the distributed nodes with relatively low operation complex load according to the real-time I/O operation load data of each distributed node of the distributed network;
screening out distributed nodes with relatively low operation complex load according to real-time operation load data of all distributed nodes of the distributed network;
and confirming that the distribution node is a second distribution node group, wherein the number of the second part of node groups is more than three.
In one embodiment, further comprising:
analyzing the on-demand video with higher access frequency of the distributed network in the current time period, and transmitting the on-demand video with higher access frequency to a cache node;
the transmission priority of the video-on-demand set at the cache node is higher than the transmission priority of the same video-on-demand in the distribution node.
According to a second aspect of the embodiments of the present invention, there is provided a high concurrency video data network transmission system, including:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring video access data sent by a user, and the video access data comprises video on demand and IP information of the user;
the analysis module is used for analyzing the distribution nodes with relatively low flow cost of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network, and confirming that the distribution nodes are a first distribution node group;
the screening module is used for acquiring real-time operation load data of all distribution nodes of the distributed network, screening out the distribution nodes with relatively low operation complex load, and confirming that the distribution nodes are a second distribution node group;
the intersection module is used for performing intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separating out distribution nodes with the highest priority in the third distribution node group;
and the sending module is used for sending a video transmission instruction to the distribution node with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data sent to the user.
In one embodiment, the obtaining module includes:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring video access data sent by a user, and the video access data comprises video on demand and IP information of the user;
and the first analysis unit is used for analyzing the IP information of the user and further acquiring the network attribute of the user, wherein the network attribute comprises the network service provider and the network downloading speed of the user.
In one embodiment, the analysis module comprises:
the second analysis unit is used for analyzing the distribution nodes with relatively high transmission speed of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
the third analysis unit is used for analyzing the distribution nodes with relatively low network delay of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
the fourth analysis unit is used for analyzing the distribution nodes with relatively low packet loss rate of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
a first confirming unit, configured to confirm that the distribution node is a first distribution node group, where the number of the first part node group is greater than an integer of three.
In one embodiment, the screening module includes:
the first screening unit is used for screening out the distribution nodes with relatively low operation complex load according to the real-time I/O operation load data of each distribution node of the distributed network;
the second screening unit is used for screening out the distributed nodes with relatively low operation complex load according to the real-time operation load data of all the distributed nodes of the distributed network;
and a second confirming unit, configured to confirm that the distribution node is a second distribution node group, where the number of the second distribution node group is greater than an integer of three.
In one embodiment, further comprising:
the transmission module is used for analyzing the on-demand video with higher access frequency of the distributed network in the current time period and transmitting the on-demand video with higher access frequency to the cache node;
and the setting module is used for setting the transmission priority of the on-demand video at the cache node to be higher than the transmission priority of the same on-demand video in the distribution node.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a flow chart illustrating a method for high concurrency video data network transmission in accordance with an exemplary embodiment of the present invention;
fig. 2 is a flowchart illustrating a step S11 of a method for high concurrency video data network transmission according to an exemplary embodiment of the present invention;
fig. 3 is a flowchart illustrating a step S12 of a method for high concurrency video data network transmission according to an exemplary embodiment of the present invention;
fig. 4 is a flowchart illustrating a step S13 of a method for high concurrency video data network transmission according to an exemplary embodiment of the present invention;
FIG. 5 is a flow chart illustrating a method for high concurrency video data network transmission in accordance with another exemplary embodiment of the present invention;
FIG. 6 is a block diagram illustrating a system for high concurrency video data network transmission in accordance with an exemplary embodiment of the present invention;
fig. 7 is a block diagram of an acquisition module 61 of a system for high-concurrency video data network transmission according to an exemplary embodiment of the present invention;
FIG. 8 is a block diagram illustrating an analysis module 62 of a system for high concurrency video data network transmission in accordance with an exemplary embodiment of the present invention;
fig. 9 is a block diagram illustrating a screening module 63 of a system for high concurrency video data network transmission in accordance with an exemplary embodiment of the present invention;
fig. 10 is a block diagram illustrating a system for high concurrency video data network transmission according to another exemplary embodiment of the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Fig. 1 is a flowchart illustrating a high concurrency video data network transmission method according to an exemplary embodiment, as shown in fig. 1, the high concurrency video data network transmission method includes the following steps S11-S14:
in step S11, video access data sent by the user is obtained, where the video access data includes the video on demand and the IP information of the user;
in step S12, analyzing a distribution node with a relatively low traffic cost for network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network, and determining that the distribution node is a first distribution node group;
in step S13, acquiring real-time operation load data of each distribution node of the distributed network, screening out a distribution node with a relatively low operation complex load, and determining that the distribution node is a second distribution node group;
in step S14, performing intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separating a distribution node with the highest priority from the third distribution node group;
in step S15, a video transmission instruction is issued to the distribution node with the highest priority, where the video transmission instruction includes data content for issuing the video-on-demand included in the video access data to the user.
In one embodiment, as the era grows, the number of smart surveillance cameras connected to the wen bo chen exhibition system is increasing. Meanwhile, a remote intelligent terminal connected with the WeChao exhibition system can check live videos and historical videos shot by any one camera in real time. The above operations are implemented by scheduling resources through a server group. Network broadband occupied by video resource transmission and many I/O operations are performed, and when users send out a large amount of video resource requests explosively in a short time, the system may not respond in a short time, or the users find that the downloading speed of the video resource is too slow. The technical scheme in the application can properly handle the situations.
The distributed network adopts a redundancy design, and any one video data is distributed on a plurality of distributed nodes. Each distribution node is composed of one or more servers, each distribution node does not have all video data, and the video data in each distribution node are accumulated to obtain video data with the total amount far more than all videos. The central server is responsible for recording the content of the video data of each distribution node and the related information of each distribution node, processing a request instruction sent by the client, and commanding the appropriate distribution node to send the corresponding data content of the video-on-demand to the corresponding client.
The cache node is a special node and is characterized by supporting high-speed transmission of massive small data. The cache node has extremely high processing capacity for high-concurrency requests for video data with small data volume.
And acquiring video access data sent by a user, wherein the video access data comprises on-demand videos and IP information of the user. The method comprises the steps of acquiring video access data sent by a user, wherein the video access data comprise video on demand and IP information of the user; and analyzing the IP information of the user to further acquire the network attribute of the user, wherein the network attribute comprises the network service provider and the network downloading speed of the user.
And analyzing the distribution nodes with relatively low flow cost of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network, and determining that the distribution nodes are the first distribution node group. The traffic cost includes transmission speed, network delay and packet loss rate; analyzing the distribution nodes with relatively high transmission speed of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network; analyzing the distributed nodes with relatively low network delay of network data transmission according to the video access data and the network attributes of the distributed nodes in the distributed network; analyzing the distribution nodes with relatively low packet loss rate of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network; and confirming that the distribution node is a first distribution node group, wherein the number of the first part of node groups is more than an integer of three.
And acquiring real-time operation load data of each total distributed node of the distributed network, screening out distributed nodes with relatively low operation complex load, and determining that the distributed nodes are a second distributed node group. The method comprises the steps that distributed nodes with relatively low operation complex loads are screened out according to real-time I/O operation load data of all the distributed nodes of the distributed network; screening out distributed nodes with relatively low operation complex load according to real-time operation load data of all distributed nodes of the distributed network; and confirming that the distribution node is a second distribution node group, wherein the number of the second part of node groups is more than an integer of three.
And performing intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separating out the distribution nodes with the highest priority in the third distribution node group.
And sending a video transmission instruction to the distribution node with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data sent to the user.
The technical scheme in the embodiment can improve the processing efficiency and reliability of the system when the system is used for processing high-concurrency video data requests, and avoid poor user experience caused by the fact that the system enters a state that the video data requests of users cannot be responded in time.
In one embodiment, as shown in FIG. 2, step S11 includes the following steps S21-S22:
in step S21, video access data sent by the user is obtained, where the video access data includes the video on demand and the IP information of the user;
in step S22, the IP information of the user is analyzed, and the network attributes of the user are further obtained, where the network attributes include the network service provider and the network download speed of the user.
In one embodiment, the system acquires the video access data sent by the user, and firstly analyzes the corresponding ID of the on-demand video required to be downloaded or live broadcast in the system, so that the accuracy and the efficiency of the subsequent processing of the system are facilitated. Meanwhile, the IP information of the user can be analyzed to obtain the network attribute of the intelligent terminal used by the user, and the comprehensive index of network transmission can be greatly improved by searching for the distributed nodes using the same network service provider. For example, if the video access data of a user zhang is video data of "jin country museum No. 34 intelligent camera reaches 14 hours at 12 hours at 23 days 12 at 5 months in 2018", the system may analyze that the ID corresponding to the video data of "jin country museum No. 34 intelligent camera reaches 14 hours at 12 days at 23 days 12 at 5 months in 2018" is 100342018052306D, and the ID is directly queried in the system, so that faster processing speed and accuracy can be obtained. And meanwhile, analyzing that the network provider used by the user Zhang III is a telecommunication network, the upper limit of the downloading speed is 10Mb/s, the system correspondingly finds out the distribution nodes which also use the telecommunication network, and the video flow sent by the user Zhang III is not more than 10 Mb/s.
In one embodiment, as shown in FIG. 3, step S12 includes the following steps S31-S34:
in step S31, analyzing a distribution node with a relatively high transmission speed of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
in step S32, analyzing a distribution node with relatively low network delay for network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
in step S33, analyzing a distribution node with a relatively low packet loss rate of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
in step S34, it is determined that the distribution node is a first distribution node group, and the number of the first partial node groups is greater than an integer of three.
In one embodiment, the traffic cost includes transmission speed, network delay and packet loss rate, and the video access data and network attributes of the distribution nodes in the distributed network are comprehensively analyzed to obtain the distribution nodes with relatively low traffic cost for network data transmission, where the number of the distribution nodes is usually an integer greater than three. For example, analysis of the transmission speed of network data transmission results in that a, d, f, g, h, k and n in the distribution nodes are the better distribution nodes. Through analysis of network delay of network data transmission, a, b, d, f, g, k, l, m and n are better distribution nodes. By analyzing the packet loss rate of network data transmission, a, c, d, f, g, h, l, m and n are obtained as better distribution nodes. And then the first distribution node group is determined to be { a, d, f, n }. In practical applications, the number of distributed nodes is much larger than the number of data in the above example, and certain simplification is made for convenience of description.
In one embodiment, as shown in FIG. 4, step S13 includes the following steps S41-S43:
in step S41, screening out a distribution node with a relatively low operation complex load according to the real-time I/O operation load data of each distribution node in the distributed network;
in step S42, screening out a distribution node with a relatively low operation complex load according to the real-time operation load data of each distribution node of the distributed network;
in step S43, the distribution node is determined to be a second distribution node group, and the number of the second distribution node group is greater than an integer of three.
In one embodiment, real-time operational load data of each distributed node of a distributed network is analyzed, the operational load data including I/O load data and operational load data. And comprehensively analyzing the real-time I/O operation load data and the operation load data of each distribution node, operating the distribution nodes with relatively low complex load, wherein the number of the distribution nodes is usually an integer greater than three. For example, by analyzing the real-time I/O operation load data, it is obtained that b, d, f, h, k, m, and n in the distribution nodes are the better distribution nodes. And analyzing the real-time operation load data to obtain the optimal distribution nodes of a, c, d, f, k, l and n in the distribution nodes. And then the second distribution node group is determined to be { d, f, k, n }. In combination with the first division node group obtained in the previous embodiment as { a, d, f, n }, the third distribution node group as { d, n } can be obtained by intersection operation. And comprehensively separating the distributed nodes d with the highest priority from the third distributed node group { d, n }. And the system sends a video transmission instruction to the distribution node d with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data to be sent to the user.
In one embodiment, as shown in FIG. 5, the following steps S51-S52 are also included:
in step S51, analyzing the on-demand video with higher access frequency of the distributed network in the current time period, and transmitting the on-demand video with higher access frequency to a cache node;
in step S52, the transmission priority of the on-demand video set at the cache node is higher than the transmission priority of the same on-demand video in the distribution node.
In one embodiment, the current time period may be any time period such as the last week time, the last day time, etc. Some on-demand videos have access frequencies far above average due to some hot events or hot exhibits. In high concurrency situations, the proportion occupied by such on-demand videos is also large. The system transmits such on-demand video to the caching node. The system sets the same on-demand video, and the priority of the on-demand video in the cache node is higher than that of the on-demand video in the distribution node. In the high concurrency situation, if the requested video of the user exists in the cache node, the video on demand is transmitted preferentially through the cache node.
In one embodiment, fig. 6 is a block diagram illustrating a high concurrency video data network transmission system in accordance with an exemplary embodiment. As shown in fig. 6, the system includes an acquisition module 61, an analysis module 62, a filtering module 63, an intersection module 64, and a sending module 65.
The obtaining module 61 is configured to obtain video access data sent by a user, where the video access data includes an on-demand video and IP information of the user;
the analysis module 62 is configured to analyze a distribution node with a relatively low traffic cost for network data transmission according to the video access data and a network attribute of the distribution node in the distributed network, and determine that the distribution node is a first distribution node group;
the screening module 63 is configured to obtain real-time operation load data of each distribution node of the distributed network, screen out a distribution node with a relatively low operation complex load, and determine that the distribution node is a second distribution node group;
the intersection module 64 is configured to perform intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separate out a distribution node with a highest priority from the third distribution node group;
the sending module 65 is configured to send a video transmission instruction to the distribution node with the highest priority, where the video transmission instruction includes data content of an on-demand video included in the video access data sent to the user.
As shown in fig. 7, the acquisition module 61 includes an acquisition unit 71 and a first analysis unit 72.
The acquiring unit 71 is configured to acquire video access data sent by a user, where the video access data includes an on-demand video and IP information of the user;
the first analyzing unit 72 is configured to analyze the IP information of the user, and further obtain a network attribute of the user, where the network attribute includes a network service provider of the user and a network downloading speed.
As shown in fig. 8, the analysis module 62 includes a second analysis unit 81, a third analysis unit 82, a fourth analysis unit 83, and a first confirmation unit 84.
The second analysis unit 81 is configured to analyze a distribution node with a relatively high transmission speed of network data transmission according to the video access data and a network attribute of the distribution node in the distributed network;
the third analyzing unit 82 is configured to analyze a distribution node with relatively low network delay for network data transmission according to the video access data and the network attribute of the distribution node in the distributed network;
the fourth analyzing unit 83 is configured to analyze a distribution node with a relatively low packet loss rate in network data transmission according to the video access data and the network attribute of the distribution node in the distributed network;
the first confirming unit 84 is configured to confirm that the distribution node is a first distribution node group, and the number of the first part node groups is an integer greater than three.
As shown in fig. 9, the screening module 63 includes a first screening unit 91, a second screening unit 92, and a second confirmation unit 93.
The first screening unit 91 is configured to screen out a distribution node with a relatively low operation complex load according to real-time I/O operation load data of each distribution node in the distributed network;
the second screening unit 92 is configured to screen out a distribution node with a relatively low operation complex load according to real-time operation load data of each distribution node of the distributed network;
the second confirming unit 93 is configured to confirm that the distribution node is a second distribution node group, where the number of the second part node group is an integer greater than three.
As shown in fig. 10, the system further includes a transmission module 101 and a setting module 102.
The transmission module 101 is configured to analyze an on-demand video with a higher access frequency of the distributed network in a current time period, and transmit the on-demand video with the higher access frequency to a cache node;
the setting module 102 is configured to set the transmission priority of the video-on-demand at the cache node to be higher than the transmission priority of the same video-on-demand in the distribution node.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a system for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (10)
1. A method for network transmission of high-concurrency video data, comprising:
acquiring video access data sent by a user, wherein the video access data comprises an on-demand video and IP information of the user;
analyzing a distribution node with relatively low flow cost of network data transmission according to the video access data and the network attribute of the distribution node in the distributed network, and confirming that the distribution node is a first distribution node group;
acquiring real-time operation load data of all distribution nodes of the distributed network, screening out the distribution nodes with relatively low operation complex load, and confirming that the distribution nodes are a second distribution node group;
performing intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separating out distribution nodes with the highest priority in the third distribution node group;
and sending a video transmission instruction to the distribution node with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data sent to the user.
2. The method of claim 1, wherein the obtaining video access data sent by a user, the video access data including video on demand and IP information of the user, comprises:
acquiring video access data sent by a user, wherein the video access data comprises an on-demand video and IP information of the user;
and analyzing the IP information of the user to further acquire the network attribute of the user, wherein the network attribute comprises the network service provider and the network downloading speed of the user.
3. The method of claim 2, wherein the analyzing the distribution nodes with relatively low traffic cost for network data transmission according to the video access data and network attributes of the distribution nodes in the distribution network to identify the distribution node as the first distribution node group comprises:
the flow cost comprises transmission speed, network delay and packet loss rate;
analyzing the distribution nodes with relatively high transmission speed of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
analyzing the distributed nodes with relatively low network delay of network data transmission according to the video access data and the network attributes of the distributed nodes in the distributed network;
analyzing the distribution nodes with relatively low packet loss rate of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
and confirming that the distribution node is a first distribution node group, wherein the number of the first part of node groups is more than an integer of three.
4. The method of claim 1, wherein the obtaining real-time operation load data of each distribution node of the distribution network, screening out a distribution node with a relatively low operation complex load, and determining that the distribution node is a second distribution node group comprises:
the operational load data comprises I/O load data and operational load data;
screening out the distributed nodes with relatively low operation complex load according to the real-time I/O operation load data of each distributed node of the distributed network;
screening out distributed nodes with relatively low operation complex load according to real-time operation load data of all distributed nodes of the distributed network;
and confirming that the distribution node is a second distribution node group, wherein the number of the second part of node groups is more than three.
5. The method of claim 1, further comprising:
analyzing the on-demand video with higher access frequency of the distributed network in the current time period, and transmitting the on-demand video with higher access frequency to a cache node;
the transmission priority of the video-on-demand set at the cache node is higher than the transmission priority of the same video-on-demand in the distribution node.
6. A high concurrency video data network transmission system, comprising:
the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring video access data sent by a user, and the video access data comprises video on demand and IP information of the user;
the analysis module is used for analyzing the distribution nodes with relatively low flow cost of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network, and confirming that the distribution nodes are a first distribution node group;
the screening module is used for acquiring real-time operation load data of all distribution nodes of the distributed network, screening out the distribution nodes with relatively low operation complex load, and confirming that the distribution nodes are a second distribution node group;
the intersection module is used for performing intersection operation on the first distribution node group and the second distribution node group to obtain a third distribution node group, and comprehensively separating out distribution nodes with the highest priority in the third distribution node group;
and the sending module is used for sending a video transmission instruction to the distribution node with the highest priority, wherein the video transmission instruction comprises data content of the video-on-demand contained in the video access data sent to the user.
7. The system of claim 6, wherein the acquisition module comprises:
the device comprises an acquisition unit, a processing unit and a processing unit, wherein the acquisition unit is used for acquiring video access data sent by a user, and the video access data comprises video on demand and IP information of the user;
and the first analysis unit is used for analyzing the IP information of the user and further acquiring the network attribute of the user, wherein the network attribute comprises the network service provider and the network downloading speed of the user.
8. The system of claim 7, wherein the analysis module comprises:
the second analysis unit is used for analyzing the distribution nodes with relatively high transmission speed of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
the third analysis unit is used for analyzing the distribution nodes with relatively low network delay of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
the fourth analysis unit is used for analyzing the distribution nodes with relatively low packet loss rate of network data transmission according to the video access data and the network attributes of the distribution nodes in the distributed network;
a first confirming unit, configured to confirm that the distribution node is a first distribution node group, where the number of the first part node group is greater than an integer of three.
9. The system of claim 6, wherein the screening module comprises:
the first screening unit is used for screening out the distribution nodes with relatively low operation complex load according to the real-time I/O operation load data of each distribution node of the distributed network;
the second screening unit is used for screening out the distributed nodes with relatively low operation complex load according to the real-time operation load data of all the distributed nodes of the distributed network;
and a second confirming unit, configured to confirm that the distribution node is a second distribution node group, where the number of the second distribution node group is greater than an integer of three.
10. The system of claim 6, further comprising:
the transmission module is used for analyzing the on-demand video with higher access frequency of the distributed network in the current time period and transmitting the on-demand video with higher access frequency to the cache node;
and the setting module is used for setting the transmission priority of the on-demand video at the cache node to be higher than the transmission priority of the same on-demand video in the distribution node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010019653.XA CN111163296A (en) | 2020-01-08 | 2020-01-08 | High-concurrency video data network transmission method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010019653.XA CN111163296A (en) | 2020-01-08 | 2020-01-08 | High-concurrency video data network transmission method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111163296A true CN111163296A (en) | 2020-05-15 |
Family
ID=70561998
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010019653.XA Pending CN111163296A (en) | 2020-01-08 | 2020-01-08 | High-concurrency video data network transmission method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111163296A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001285846A (en) * | 2000-04-04 | 2001-10-12 | Hitachi Kokusai Electric Inc | Processing method and device for transmitting video |
| CN103747297A (en) * | 2014-01-09 | 2014-04-23 | 能力天空科技（北京）有限公司 | Video dynamic dispatching method, device and video playing system |
| CN104284201A (en) * | 2014-09-26 | 2015-01-14 | 北京奇艺世纪科技有限公司 | Video content processing method and device |
| CN108737544A (en) * | 2018-05-22 | 2018-11-02 | 中国联合网络通信集团有限公司 | CDN node dispatching method and device |
| CN110636339A (en) * | 2019-09-30 | 2019-12-31 | 北京字节跳动网络技术有限公司 | Scheduling method and device based on code rate and electronic equipment |
-
2020
- 2020-01-08 CN CN202010019653.XA patent/CN111163296A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001285846A (en) * | 2000-04-04 | 2001-10-12 | Hitachi Kokusai Electric Inc | Processing method and device for transmitting video |
| CN103747297A (en) * | 2014-01-09 | 2014-04-23 | 能力天空科技（北京）有限公司 | Video dynamic dispatching method, device and video playing system |
| CN104284201A (en) * | 2014-09-26 | 2015-01-14 | 北京奇艺世纪科技有限公司 | Video content processing method and device |
| CN108737544A (en) * | 2018-05-22 | 2018-11-02 | 中国联合网络通信集团有限公司 | CDN node dispatching method and device |
| CN110636339A (en) * | 2019-09-30 | 2019-12-31 | 北京字节跳动网络技术有限公司 | Scheduling method and device based on code rate and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110147398B (en) | Data processing method, device, medium and electronic equipment | |
| CN107943951B (en) | Method and system for retrieving block chain service information | |
| US20140165119A1 (en) | Offline download method, multimedia file download method and system thereof | |
| CN102484740B (en) | Systems and methods for managing video data | |
| US20150237113A1 (en) | Method and system for file transmission | |
| CN113220715B (en) | Data processing method, system, computer and readable storage medium | |
| US20080313207A1 (en) | System and method for collection, retrieval, and distribution of data | |
| CN110460879B (en) | Video request scheduling method, device, server and storage medium | |
| CN112632129A (en) | Code stream data management method, device and storage medium | |
| CN110740293A (en) | data transmission method, system, device and computer storage medium | |
| CN110995566A (en) | Message data pushing method, system and device | |
| CN113505260A (en) | Face recognition method and device, computer readable medium and electronic equipment | |
| US20190297131A1 (en) | System and Method for Querying and Updating a Live Video Stream Using a Structured Query Language | |
| JP5962117B2 (en) | Video selection method in an environment with multiple image compression methods | |
| CN117459536A (en) | Resource distribution method, cloud server, device, electronic equipment and storage medium | |
| CN112035413A (en) | Metadata information query method and device and storage medium | |
| CN111163296A (en) | High-concurrency video data network transmission method and system | |
| CN113965538B (en) | Equipment state message processing method, device and storage medium | |
| CN110535853B (en) | Video request scheduling method, device, server and storage medium | |
| CN103428231A (en) | Offline download method and system | |
| CN115514981A (en) | Video stream scheduling system and related product | |
| JP5734416B2 (en) | Network traffic analysis method, network traffic analysis device, computer program | |
| CN112543354A (en) | Service-aware distributed video cluster efficient scaling method and system | |
| CN111294231A (en) | Resource management method and system | |
| CN109491862A (en) | A kind of service requesting information collection method and device based on cloud platform |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200515 |