CN110876070A - Content distribution system, processing method, and storage medium - Google Patents

Content distribution system, processing method, and storage medium Download PDF

Info

Publication number
CN110876070A
CN110876070A CN201810991285.8A CN201810991285A CN110876070A CN 110876070 A CN110876070 A CN 110876070A CN 201810991285 A CN201810991285 A CN 201810991285A CN 110876070 A CN110876070 A CN 110876070A
Authority
CN
China
Prior art keywords
content
video
request
user
edge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810991285.8A
Other languages
Chinese (zh)
Inventor
罗雨佳
欧亮
唐宏
莫志威
刘汉江
鄢欢
杨宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Telecom Corp Ltd
Original Assignee
China Telecom Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Telecom Corp Ltd filed Critical China Telecom Corp Ltd
Priority to CN201810991285.8A priority Critical patent/CN110876070A/en
Publication of CN110876070A publication Critical patent/CN110876070A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/231Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
    • H04N21/23106Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion involving caching operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution

Abstract

The invention provides a content distribution system, a processing method and a storage medium, wherein the system comprises: a central CDN system and an edge CDN system; the central CDN system includes: a big data analysis engine for determining hot content; the content library pushes a plurality of video files with preset video code rates corresponding to the hot content to an edge CDN system; the edge CDN system includes: the edge cache device judges whether video content corresponding to the user request is stored or not, and if so, obtains a video file and distributes the video file to the user; if not, a content request is sent to the content repository. The content distribution system, the processing method and the storage medium effectively reduce the resource waste caused by IPTV full content storage and ensure the response real-time performance of the video service; the current hot content of the CDN content library can be accurately and efficiently found out; the problem of hot content coverage possibly missed by a big data analysis engine is solved.

Description

Content distribution system, processing method, and storage medium
Technical Field
The present invention relates to the field of communications technologies, and in particular, to a content distribution system, a processing method, and a storage medium.
Background
With the rise of services such as 5G, AR/VR, Internet of things and the like, large videos become important service growth points of current operators. At present, operators in the industry begin to redesign the bearer architecture and operation mode of video services in combination with edge computing technology. The existing IPTV CDN system of an operator uses the proprietary hardware of a manufacturer, and has high cost, long updating period and lack of flexibility. Meanwhile, the CDN system lacks a cache strategy, cache can cache all video contents, and video files with the same contents and different code rates can be stored repeatedly, so that a large amount of hard disk resources are occupied, and the response speed is exchanged for space. The emerging services have higher requirements on video response speed, the types and video contents of terminals are more and more abundant, and the method of the existing special hardware CDN inevitably causes great increase of storage cost and is difficult to flexibly meet the requirements of customers.
Disclosure of Invention
One or more embodiments of the present invention provide a content distribution system, a processing method, and a storage medium.
According to an aspect of the present disclosure, there is provided a content distribution system including: a central CDN system and an edge CDN system; the central CDN system includes: the big data analysis engine is used for acquiring the opening data of the website and determining hot content stored in a content library of the central CDN system based on the opening data; the content library is used for transcoding the video files corresponding to the hot content to obtain a plurality of video files with preset video code rates, and pushing the plurality of video files to an edge cache device of the edge CDN system for storage; the edge CDN system includes: the edge cache device judges whether video content corresponding to a user request is stored or not, if so, the edge cache device determines the video code rate suitable for the user, obtains a video file which corresponds to the video content and has the video code rate and distributes the video file to the user; if not, sending a content request to the content library to acquire the video content;
optionally, the big data analysis engine is configured to periodically obtain the opening data from the website, where the website includes: portal sites, social networking sites; analyzing the opening data to determine trending information, wherein the trending information comprises: hot keywords, hot figures; determining the trending content in the content repository based on the trending information.
Optionally, the edge CDN system includes: a condition monitoring engine; the state monitoring engine is configured to receive a user information query request sent by the edge cache device, acquire link information corresponding to a terminal that sends the user request, and return the link information to the edge cache device, where the link information includes: link bandwidth, transmission quality information; and the edge cache device is used for determining the video code rate suitable for the user based on the link information.
Optionally, the edge CDN system includes: a second scheduling engine; and the second scheduling engine is used for receiving the user request and distributing the user request to the edge cache device with the lightest current load.
Optionally, the edge cache device is configured to determine whether a video file with a video bitrate suitable for the user is stored, and if the video file with the video bitrate suitable for the user is stored, obtain the video file; if not, converting the code rate of the video file corresponding to the video content to obtain the video file with the video code rate suitable for the user.
Optionally, the content library is configured to receive the content request, where the content request includes: request content and request video bitrate; determining whether a video file with the requested video code rate and corresponding to the requested content is stored, if so, acquiring the video file and pushing the video file to the edge cache device; if not, converting the code rate of the video file corresponding to the request content, obtaining the video file with the request video code rate and corresponding to the request content, and pushing the video file to the edge cache device.
Optionally, the content library is configured to determine the number of times of requests for the same requested content by the edge cache device, and if the number of times of requests exceeds a preset number threshold, transcode a video file corresponding to the requested content to obtain multiple video files with preset video code rates, and push the multiple video files to the edge cache device for storage.
Optionally, the central CDN system includes: a first scheduling engine; the first scheduling engine is used for receiving the content request and distributing the content request to the content library with the lightest current load.
Optionally, the central CDN system includes: a content management device; the content management device is used for registering and managing the information of the video content, wherein the information of the video content comprises: content ID, media metadata information, content status.
Optionally, the central CDN system and the edge CDN system are carried using NFVI.
According to another aspect of the present invention, there is provided a content distribution processing method including: a big data analysis engine of a central CDN system acquires open data of a website, and hot content stored in a content library of the central CDN system is determined based on the open data; the content library transcodes the video files corresponding to the hot content to obtain a plurality of video files with preset video code rates, and the plurality of video files are pushed to an edge cache device of the edge CDN system to be stored; the edge cache system judges whether video content corresponding to a user request is stored or not, if so, the video code rate suitable for the user is determined, and a video file which corresponds to the video content and has the video code rate is obtained and distributed to the user; and if not, sending a content request to the content library to acquire the video content.
Optionally, the determining hot content stored in the content library of the central CDN system includes: the big data analysis engine periodically obtains the opening data from the website, wherein the website comprises: portal sites, social networking sites; the big data analysis engine analyzes the opening data to determine hot information, wherein the hot information comprises: hot keywords, hot figures; the big data analysis engine determines the trending content in the content repository based on the trending information.
Optionally, the determining a video bitrate suitable for the user comprises: the edge cache sends a user information query request to a state monitoring engine of the edge CDN system to acquire link information corresponding to a terminal sending the user request, wherein the link information comprises: link bandwidth, transmission quality information; and the edge cache device determines the video code rate suitable for the user based on the link information.
Optionally, a second scheduling engine of the edge CDN system receives the user request, and allocates the user request to the edge cache device with the lightest current load.
Optionally, the obtaining a video file corresponding to the video content and having the video bitrate includes: the edge cache device determines whether a video file with a video code rate suitable for the user is stored, and if so, the video file is obtained; if not, converting the code rate of the video file corresponding to the video content to obtain the video file with the video code rate suitable for the user.
Optionally, the content library receives the content request, where the content request includes: request content and request video bitrate; the content library determines whether a video file with the requested video code rate and corresponding to the requested content is stored, and if so, the video file is acquired and pushed to the edge cache device; if not, converting the code rate of the video file corresponding to the request content, obtaining the video file with the request video code rate and corresponding to the request content, and pushing the video file to the edge cache device.
Optionally, the content library determines the number of times of requests of the edge cache device for the same request content, and if the number of times of requests exceeds a preset number threshold, transcodes the video file corresponding to the request content to obtain a plurality of video files with preset video code rates, and pushes the video files to the edge cache device for storage.
Optionally, a first scheduling engine of the central CDN system receives the content request, and allocates the content request to the content repository with the lightest current load.
Optionally, a content management module of the central CDN system registers and manages information of the video content, where the information of the video content includes: content ID, media metadata information, content status.
Optionally, the central CDN system and the edge CDN system are carried using NFVI.
According to yet another aspect of the invention, there is provided a computer readable storage medium having stored thereon computer program instructions which, when executed by one or more processors, implement the steps of the method as described above.
According to the content distribution system, the processing method and the storage medium, the edge cache stores the hot video files with typical code rates, so that the resource waste caused by IPTV full-content storage is effectively reduced, and the response real-time performance of video services is also ensured; the method is in butt joint with social contact and portal website open data, and the current hot content of a CDN content library can be accurately and efficiently found out; the problem of hot content coverage possibly missed by a big data analysis engine is solved.
Drawings
In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without inventive exercise.
FIG. 1 is a schematic diagram of one embodiment of a content distribution system according to the present disclosure;
FIG. 2 is a schematic diagram of another embodiment of a content distribution system according to the present disclosure;
fig. 3 is a schematic diagram of yet another embodiment of a content distribution system according to the use of NFVI bearer;
FIG. 4 is a schematic flow chart diagram illustrating one embodiment of a content distribution processing method according to the present disclosure;
fig. 5 is a schematic flow chart diagram of another embodiment of a content distribution processing method according to the present disclosure;
fig. 6 is a flowchart illustrating a content distribution processing method according to still another embodiment of the present disclosure.
Detailed Description
The present disclosure now will be described more fully hereinafter with reference to the accompanying drawings, in which exemplary embodiments of the disclosure are shown. The technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is obvious that the described embodiments are only a part of the embodiments of the present disclosure, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
The terms "first", "second", and the like are used hereinafter only for descriptive distinction and not for other specific meanings.
Fig. 1 is a schematic diagram of one embodiment of a content distribution system according to the present disclosure, as shown in fig. 1, the content distribution system including: a central CDN (Content Delivery Network) system 10 and an edge CDN system 11. The central CDN system 10 includes: a big data analysis engine 101 and a content repository 102. The edge CDN system 11 includes an edge cache device 111. The central CDN system 10 may be a provincial CDN system or the like.
The big data analysis engine 101 obtains the opening data of the website, and determines the hot content stored in the content library of the central CDN system based on the opening data. The content library 102 transcodes the video files corresponding to the hot content to obtain a plurality of video files with preset video code rates, and pushes the plurality of video files to an edge cache device of an edge CDN system for storage.
The edge cache device 111 judges whether video content corresponding to the user request is stored, if so, determines the video code rate suitable for the user, obtains a video file corresponding to the video content and having the video code rate, and distributes the video file to the user; if not, the edge cache device 111 sends a content request to the content library 102 to obtain the video content.
In one embodiment, big data analytics engine 101 periodically obtains open data from a website that includes: web portals, social networking sites, and the like. The big data analysis engine 101 analyzes the opening data to determine hot information, which includes: hot keywords, hot characters, etc. Determining topical content in the content repository 102 based on topical information may use a variety of existing methods. For example, the big data analysis engine 101 interfaces with open data of websites such as social networks and portals, analyzes and extracts hot keywords and key characters, interfaces with a content library of the provincial CDN system, and finds hot content in the content library by means of portrait recognition, video metadata keyword matching, and the like.
As shown in fig. 2, the edge CDN system 11 includes: a state monitoring engine 112, where the state monitoring engine 112 receives a user information query request sent by the edge cache device 111, obtains link information corresponding to a terminal that sends the user request, and returns the link information to the edge cache device 111, where the link information includes: link bandwidth, transmission quality information, etc. The edge cache device 111 determines a video bitrate suitable for the user based on the link information.
The state detection engine 112 obtains the access link bandwidth and transmission quality state of the terminal in real time. The edge cache device 111 caches several video files with typical code rates of hot content, and determines the video code rate suitable for the user according to the information fed back by the state monitoring engine 112. The edge CDN system 11 includes: a second scheduler engine 113. The second scheduling engine 113 receives the user request, and distributes the user request to the edge cache device 111 with the lightest current load. The edge cache device 111 determines whether a video file with a video code rate suitable for a user is stored, and if so, acquires the video file; if not, the edge cache device 111 converts the code rate of the video file corresponding to the video content to obtain a video file with a video code rate suitable for the user.
In one embodiment, the content repository 102 receives a content request including: request content and request video bitrate. The content library 102 determines whether a video file with a requested video code rate and corresponding to the requested content is stored, and if so, acquires the video file and pushes the video file to the edge cache device 111; if not, the content library 102 converts the code rate of the video file corresponding to the request content to obtain the video file with the requested video code rate and corresponding to the request content, and pushes the video file to the edge cache device 111.
The content library 102 determines the number of times of requests of the edge cache device for the same request content, and if the number of times of requests exceeds a preset number threshold, the content library 102 transcodes the video files corresponding to the request content to obtain a plurality of video files with preset video code rates, and pushes the video files to the edge cache device 111 for storage.
In one embodiment, the content library 102 stores high-bitrate files of all video contents in the IPTV list, periodically calls a real-time transcoding accelerator card, converts hot contents into video files with several typical bitrates, and pushes the video files to the edge cache device 111 for storage. The content library 102 sets a counter for each non-hot content, when a user request is sent by the edge cache device 111, the counter corresponding to the non-hot content is incremented by 1, when the value of the counter reaches a preset threshold value, the non-hot content is converted into video files with several typical code rates, and the video files are pushed to the edge cache device 111 for storage.
The central CDN system 10 includes: the first scheduling engine 103, the first scheduling engine 103 receives the content request, distributes the content request to the content library 102 with the lightest current load, and extracts the content. The central CDN system 10 includes: a content management device 104, wherein the content management device 104 registers and manages information of video contents, and the information of the video contents comprises: content ID, media metadata information, content status, etc.
In one embodiment, NFVI (network function virtualization infrastructure) is used to carry both central and edge CDN systems. The load bearing of the IPTV CDN is realized based on the NFV technology, the waste of hard disk resources can be reduced, and the hardware binding of a manufacturer to an operator is broken. The Network Function Virtualization (NFV) technology is used for software-converting the special hardware Network element and installing the special hardware Network element in a Virtualization environment based on a general server, so that the resource utilization rate, the expandability and the flexibility are greatly improved, and the marketing period of products/services is shortened.
A CDN system architecture based on the NFVI is shown in fig. 3, where the CDN system is divided into two layers, namely, a provincial CDN (central CDN) and an edge CDN, and CDN systems at different levels contain different functional modules. The 4 main functional modules of the provincial CDN are a first scheduling engine 103, a big data analysis engine 101, a content management device 104, and a content library 102. The 3 main functional modules of the edge CDN system are a state detection engine 112, a second scheduling engine 113, and an edge cache device 111, and these software functional modules are installed in a virtualized general server virtual machine or container to form a resource pool that can be flexibly adjusted.
Fig. 4 is a flowchart illustrating an embodiment of a content distribution processing method according to the present disclosure, as shown in fig. 4:
step 401, a big data analysis engine of the central CDN system obtains open data of the website, and determines popular content stored in a content library of the central CDN system based on the open data. The central CDN system may obtain IPTV video content from a video source cooperating with an operator, and cache high-rate files of all video content in the IPTV application list in a content repository.
Step 402, the content library transcodes the video files corresponding to the hot content to obtain a plurality of video files with preset video code rates, and pushes the plurality of video files to an edge cache device of an edge CDN system for storage.
The content library can call a real-time transcoding accelerator card, convert the current hot content into video files with several typical code rates (covering high, medium and low quality requirements), and push the video files to an edge cache device of an edge CDN system for caching.
Step 403, the edge cache system judges whether video content corresponding to the user request is stored.
Step 404, if yes, determining a video code rate suitable for the user, obtaining a video file corresponding to the video content and having the video code rate, and distributing the video file to the user; if not, a content request is sent to the content library to acquire the video content.
The edge cache device stores video files with several typical code rates corresponding to the same video content, and can ensure the real-time performance of response. If the edge cache device only stores files with one code rate for each video content, the requirements of high, medium and low code rates of most users cannot be met, great pressure is brought to a real-time transcoding acceleration card, a great amount of time delay is introduced, and user experience is influenced.
Fig. 5 is a flowchart illustrating another embodiment of a content distribution processing method according to the present disclosure, as shown in fig. 5:
step 501, a second scheduling engine of the edge CDN system receives a user request, and distributes the user request to an edge cache device with the lightest current load.
Step 502, the edge cache sends a user information query request to a state monitoring engine of the edge CDN system to obtain link information corresponding to a terminal that sends the user request, where the link information includes: link bandwidth, transmission quality information, etc.
In step 503, the edge cache device determines the video code rate suitable for the user based on the link information. After receiving the feedback information of the state monitoring engine, the edge cache device can determine the most suitable video code rate of the user.
Step 504, the edge cache device determines whether video content corresponding to the user request is stored.
Step 505, determine whether the video file is stored, if yes, go to step 506, if no, go to step 509.
Step 506, the edge cache device determines whether a video file with a video code rate suitable for a user is stored, if so, the step 507 is carried out, and the video file is obtained; if not, go to step 508, convert the bitrate of the video file corresponding to the video content to obtain a video file with a video bitrate suitable for the user.
The edge cache devices inquire whether the video content is stored or not, because the content stored by each edge cache device is the same, if the edge cache devices do not store the video content, the fact that all the edge cache devices do not store the video content means that the IPTV video request of the user needs to be sent upwards to the central CDN system.
If the edge cache device determines that the video file with the video code rate suitable for the user is stored, the edge cache device takes out the video file and sends the video file to the user; if the video file with the video code rate suitable for the user is determined not to be stored, the code rate required by the user is not the common code rate, the edge cache device calls the real-time transcoding acceleration card to convert the code rate of the video file corresponding to the video content, and the video file with the optimal code rate for the user is sent to the user.
Step 509, a content request is sent to the content repository for obtaining video content.
Step 510, a first scheduling engine of the central CDN system receives the content request, and distributes the content request to a content repository with the lightest current load.
Step 511, the content library receives a content request, where the content request includes: request content and request video bitrate, etc. The content depot determines whether a video file corresponding to the requested content having the requested video bitrate is stored, and if so, proceeds to step 512, and if not, proceeds to step 513.
Step 512, the video file is obtained and pushed to the edge cache device.
And 513, converting the code rate of the video file corresponding to the request content to obtain the video file with the requested video code rate and corresponding to the request content, and pushing the video file to the edge cache device.
And a scheduling engine of the central CDN system receives a user IPTV request from the edge cache and the video code rate information which is most suitable for the user, and schedules the request to a content library with the lightest current load. And inquiring the video by the content library, if the video code rate of the content library is not consistent with the video code rate of the most suitable user, calling a real-time transcoding acceleration card to convert the video code rate, and then directly sending the content to the IPTV user.
Fig. 6 is a flowchart illustrating a content distribution processing method according to another embodiment of the present disclosure, as shown in fig. 6:
step 601, the content library determines the request times of the edge cache device for the same request content.
Step 602, if the number of requests exceeds a preset number threshold, transcoding the video file corresponding to the request content to obtain a plurality of video files with preset video code rates, and pushing the video files to an edge cache device for storage.
And if the counter value of the video exceeds a preset threshold value, the content is not cached in the edge cache, but the demand is large, the video content needs to be converted into video files with several typical code rates, and the video files are pushed to the edge cache for storage.
A content management module of the central CDN system registers and manages information of the video content, where the information of the video content includes: content ID, media metadata information, content status, etc. The NFVI is used to carry both central and edge CDN systems.
The present disclosure also provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and the instructions, when executed by a processor, implement a video image restoration method according to any of the above embodiments.
The content delivery system, the processing method, and the storage medium in the embodiments described above use NFVI to carry virtualized CDN, and can solve the problem existing in the current CDN system: the hot content is judged only by the number of clicks of the user, and the accuracy and the timeliness are lacked; the existing cache caches all contents of an IPTV list, so that hard disk resources are wasted; the existing CDN system does not provide transcoding service, and the same content with different code rates can be stored repeatedly.
In the content distribution system, the processing method and the storage medium in the embodiment, the edge cache only needs to store the hot video file with the typical code rate, so that the resource waste caused by IPTV full-content storage is effectively reduced, and the response real-time performance of the video service is also ensured; the method is in butt joint with social contact and portal website open data, and the current hot content of a CDN content library can be accurately and efficiently found out; meanwhile, the content library sets a counter for each non-popular content, so that the problem of coverage of popular content possibly omitted by a big data analysis engine is solved; the real-time transcoding accelerator card can effectively reduce the repeated storage of video files with the same content and different code rates, and can effectively utilize idle CPU resources of the general server to assist in transcoding calculation.
The method and system of the present disclosure may be implemented in a number of ways. For example, the methods and systems of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order for the steps of the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above unless specifically stated otherwise. Further, in some embodiments, the present disclosure may also be embodied as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.
The description of the present disclosure has been presented for purposes of illustration and description, and is not intended to be exhaustive or limited to the disclosure in the form disclosed. Many modifications and variations will be apparent to practitioners skilled in this art. The embodiment was chosen and described in order to best explain the principles of the disclosure and the practical application, and to enable others of ordinary skill in the art to understand the disclosure for various embodiments with various modifications as are suited to the particular use contemplated.

Claims (21)

1. A content distribution system comprising:
a central CDN system and an edge CDN system;
the central CDN system includes:
the big data analysis engine is used for acquiring the opening data of the website and determining hot content stored in a content library of the central CDN system based on the opening data;
the content library is used for transcoding the video files corresponding to the hot content to obtain a plurality of video files with preset video code rates, and pushing the plurality of video files to an edge cache device of the edge CDN system for storage;
the edge CDN system includes:
the edge cache device judges whether video content corresponding to a user request is stored or not, if so, the edge cache device determines the video code rate suitable for the user, obtains a video file which corresponds to the video content and has the video code rate and distributes the video file to the user; and if not, sending a content request to the content library to acquire the video content.
2. The system of claim 1, wherein,
the big data analysis engine is configured to periodically obtain the opening data from the website, where the website includes: portal sites, social networking sites; analyzing the opening data to determine trending information, wherein the trending information comprises: hot keywords, hot figures; determining the trending content in the content repository based on the trending information.
3. The system of claim 2, wherein,
the edge CDN system includes: a condition monitoring engine;
the state monitoring engine is configured to receive a user information query request sent by the edge cache device, acquire link information corresponding to a terminal that sends the user request, and return the link information to the edge cache device, where the link information includes: link bandwidth, transmission quality, etc.;
and the edge cache device is used for determining the video code rate suitable for the user based on the link information.
4. The system of claim 3, further comprising:
the edge CDN system includes: a second scheduling engine;
and the second scheduling engine is used for receiving the user request and distributing the user request to the edge cache device with the lightest current load.
5. The system of claim 3, wherein,
the edge cache device is used for determining whether a video file with a video code rate suitable for the user is stored or not, and if so, acquiring the video file; if not, converting the code rate of the video file corresponding to the video content to obtain the video file with the video code rate suitable for the user.
6. The system of claim 3, wherein,
the content library is configured to receive the content request, where the content request includes: request content and request video bitrate; determining whether a video file with the requested video code rate and corresponding to the requested content is stored, if so, acquiring the video file and pushing the video file to the edge cache device; if not, converting the code rate of the video file corresponding to the request content, obtaining the video file with the request video code rate and corresponding to the request content, and pushing the video file to the edge cache device.
7. The system of claim 6, wherein,
and the content library is used for determining the request times of the edge cache device for the same request content, and if the request times exceed a preset time threshold, transcoding the video files corresponding to the request content to obtain a plurality of video files with preset video code rates, and pushing the video files to the edge cache device for storage.
8. The system of claim 6, wherein,
the central CDN system includes: a first scheduling engine;
the first scheduling engine is used for receiving the content request and distributing the content request to the content library with the lightest current load.
9. The system of claim 1, wherein,
the central CDN system includes: a content management device;
the content management device is used for registering and managing the information of the video content, wherein the information of the video content comprises: content ID, media metadata information, content status.
10. The system of any one of claims 1 to 9,
and carrying the central CDN system and the edge CDN system by using NFVI.
11. A content distribution processing method comprising:
a big data analysis engine of a central CDN system acquires open data of a website, and hot content stored in a content library of the central CDN system is determined based on the open data;
the content library transcodes the video files corresponding to the hot content to obtain a plurality of video files with preset video code rates, and the plurality of video files are pushed to an edge cache device of the edge CDN system to be stored;
the edge cache system judges whether video content corresponding to a user request is stored or not, if so, the video code rate suitable for the user is determined, and a video file which corresponds to the video content and has the video code rate is obtained and distributed to the user; and if not, sending a content request to the content library to acquire the video content.
12. The method of claim 11, the determining topical content stored in a content depot of the central CDN system comprising:
the big data analysis engine periodically obtains the opening data from the website, wherein the website comprises: portal sites, social networking sites;
the big data analysis engine analyzes the opening data to determine hot information, wherein the hot information comprises: hot keywords, hot figures;
the big data analysis engine determines the trending content in the content repository based on the trending information.
13. The method of claim 12, wherein determining a video bitrate suitable for the user comprises:
the edge cache sends a user information query request to a state monitoring engine of the edge CDN system to acquire link information corresponding to a terminal sending the user request, wherein the link information comprises: link bandwidth, transmission quality information;
and the edge cache device determines the video code rate suitable for the user based on the link information.
14. The method of claim 13, further comprising:
and a second scheduling engine of the edge CDN system receives the user request and distributes the user request to the edge cache device with the lightest current load.
15. The method of claim 13, the obtaining a video file corresponding to the video content and having the video bitrate comprises:
the edge cache device determines whether a video file with a video code rate suitable for the user is stored, and if so, the video file is obtained; if not, converting the code rate of the video file corresponding to the video content to obtain the video file with the video code rate suitable for the user.
16. The method of claim 13, further comprising:
the content library receives the content request, wherein the content request comprises: request content and request video bitrate;
the content library determines whether a video file with the requested video code rate and corresponding to the requested content is stored, and if so, the video file is acquired and pushed to the edge cache device; if not, converting the code rate of the video file corresponding to the request content, obtaining the video file with the request video code rate and corresponding to the request content, and pushing the video file to the edge cache device.
17. The method of claim 16, further comprising:
and the content library determines the request times of the edge cache device for the same request content, and if the request times exceed a preset time threshold, transcoding the video files corresponding to the request content to obtain a plurality of video files with preset video code rates, and pushing the video files to the edge cache device for storage.
18. The method of claim 16, further comprising:
and a first scheduling engine of the central CDN system receives the content request and distributes the content request to the content library with the lightest current load.
19. The method of claim 11, further comprising:
a content management module of the central CDN system registers and manages information of the video content, where the information of the video content includes: content ID, media metadata information, content status.
20. The method of any one of claims 11 to 19,
and carrying the central CDN system and the edge CDN system by using NFVI.
21. A computer readable storage medium having stored thereon computer program instructions which, when executed by one or more processors, implement the steps of the method of any one of claims 11 to 19.
CN201810991285.8A 2018-08-29 2018-08-29 Content distribution system, processing method, and storage medium Pending CN110876070A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810991285.8A CN110876070A (en) 2018-08-29 2018-08-29 Content distribution system, processing method, and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810991285.8A CN110876070A (en) 2018-08-29 2018-08-29 Content distribution system, processing method, and storage medium

Publications (1)

Publication Number Publication Date
CN110876070A true CN110876070A (en) 2020-03-10

Family

ID=69714140

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810991285.8A Pending CN110876070A (en) 2018-08-29 2018-08-29 Content distribution system, processing method, and storage medium

Country Status (1)

Country Link
CN (1) CN110876070A (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102812450A (en) * 2009-10-30 2012-12-05 时代华纳有线公司 Methods And Apparatus For Packetized Content Delivery Over A Content Delivery Network
CN104581228A (en) * 2015-01-06 2015-04-29 南京爱布谷网络科技有限公司 Bandwidth self-adaptation streaming media system serving various terminals
CN104915447A (en) * 2015-06-30 2015-09-16 北京奇艺世纪科技有限公司 Method and device for tracing hot topics and confirming keywords
US20170048572A1 (en) * 2012-01-12 2017-02-16 Comcast Cable Communications, Llc Methods and systems for content control
CN108270731A (en) * 2016-12-30 2018-07-10 中兴通讯股份有限公司 A kind of data flow transmission method, device and relevant device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102812450A (en) * 2009-10-30 2012-12-05 时代华纳有线公司 Methods And Apparatus For Packetized Content Delivery Over A Content Delivery Network
US20170048572A1 (en) * 2012-01-12 2017-02-16 Comcast Cable Communications, Llc Methods and systems for content control
CN104581228A (en) * 2015-01-06 2015-04-29 南京爱布谷网络科技有限公司 Bandwidth self-adaptation streaming media system serving various terminals
CN104915447A (en) * 2015-06-30 2015-09-16 北京奇艺世纪科技有限公司 Method and device for tracing hot topics and confirming keywords
CN108270731A (en) * 2016-12-30 2018-07-10 中兴通讯股份有限公司 A kind of data flow transmission method, device and relevant device

Similar Documents

Publication Publication Date Title
CN110147398B (en) Data processing method, device, medium and electronic equipment
CN102439578B (en) Dynamic variable rate media delivery system
CN108881944B (en) Method and system for accelerating release of streaming media
US8645504B2 (en) Dynamic chunking for delivery instances
EP1844591B1 (en) System architecture and method for scheduled downloading services
US8533293B1 (en) Client side cache management
US20140165119A1 (en) Offline download method, multimedia file download method and system thereof
US8495171B1 (en) Indiscriminate virtual containers for prioritized content-object distribution
US8346784B1 (en) Java script reductor
US20140365613A1 (en) Defragmentation of adaptive streaming segment files in a content delivery network
AU2013240558B2 (en) Dynamic chunking for delivery instances
Gao et al. vCache: Supporting cost-efficient adaptive bitrate streaming
KR100671635B1 (en) Service management using multiple service location managers
US9633217B2 (en) Indiscriminate virtual containers for prioritized content-object distribution
WO2016180284A1 (en) Service node allocation method, device, cdn management server and system
Van Ma et al. An efficient scheduling multimedia transcoding method for DASH streaming in cloud environment
KR100755617B1 (en) Method for adapting service location placement based on recent data received from service nodes and actions of the service location manager
Kesavaraja et al. Framework for fast and efficient cloud video transcoding system using intelligent splitter and Hadoop MapReduce
CN110876070A (en) Content distribution system, processing method, and storage medium
CN101800751B (en) Distributed real-time data-coding transmission method
CN114268631A (en) Low-delay network system, communication connection method thereof and readable storage medium
CN108667863B (en) WEB service adaptation system and method based on local agent
CN101686156A (en) Terminal and method for realizing local caching of network service data
US11086822B1 (en) Application-based compression
CA2914603A1 (en) Defragmentation of adaptive streaming segment files in a content delivery network

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200310

RJ01 Rejection of invention patent application after publication