CN109769135A - Online Video buffer memory management method and system based on joint-request rate - Google Patents

Online Video buffer memory management method and system based on joint-request rate Download PDF

Info

Publication number
CN109769135A
CN109769135A CN201811491355.XA CN201811491355A CN109769135A CN 109769135 A CN109769135 A CN 109769135A CN 201811491355 A CN201811491355 A CN 201811491355A CN 109769135 A CN109769135 A CN 109769135A
Authority
CN
China
Prior art keywords
video block
video
user
block
request
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811491355.XA
Other languages
Chinese (zh)
Other versions
CN109769135B (en
Inventor
李纯喜
高志朋
赵永祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jiaotong University
Original Assignee
Beijing Jiaotong University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jiaotong University filed Critical Beijing Jiaotong University
Priority to CN201811491355.XA priority Critical patent/CN109769135B/en
Publication of CN109769135A publication Critical patent/CN109769135A/en
Application granted granted Critical
Publication of CN109769135B publication Critical patent/CN109769135B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides a kind of Online Video buffer memory management methods and system based on joint-request rate.This method comprises: video is cut into sequentially in time, multiple byte numbers are identical and continuous video block, after video cache device receives the request for some video block that user sends, some described video block is obtained from remote video server, some described video block is sent to the user;Video cache device watches the historical data information of video according to user, the joint-request rate value for calculating each video block and some video block in its video piece of collection determines the cache way of some video block according to the joint-request rate value of each video block.This method is based on online user's future watching behavior, and the execution of caching method is carried out by calculating joint-request rate, can be obviously improved the buffer efficiency of video.

Description

Online Video buffer memory management method and system based on joint-request rate
Technical field
The present invention relates to video storage tube reason technical field more particularly to it is a kind of based on video block joint-request rate Line video cache management method and system.
Background technique
With the increasing of the number of users of online viewing video more and more and available for download number of videos and size Greatly, video server is faced with huge file storage pressure and bandwidth cost.Text is carried out by file video cache device Part caching is the common method for solving this storage pressure.
In video cache field, existing buffer replacing method includes earliest recent visit (Least Recently Used, LRU) tactful and least referenced frequency (Least Frequently Used, LFU) strategy.Their common ways are all It is assumed that the behavior in user future is similar to behavior over, and then file is predicted to the history access record of file according to user Access module;When spatial cache saturation, these cache policies preferentially reject most unlikely accessed file from caching. Wherein, LRU policy is based on history access record, and the file of last access time at most is preferentially rejected from spatial cache;Its Matter is the access module of short-term Popularity prediction this document file-based, that is, if file is accessed recently, not It is higher come the probability that is accessed.LFU strategy is according to history access record, the requested frequency of statistics file, preferentially from caching The least file of access frequency is rejected in space;Its essence is the visit of this document of the long-term Popularity prediction based on long-term documents Ask mode, it may be assumed that if file is being accessed many times in the past, the frequency that future is accessed is higher.
The shortcomings that buffer replacing method of above-mentioned video in the prior art are as follows: LRU policy and LFU strategy are all with file History be accessed information replace file future be accessed mode, often will appear misjudgment, accuracy is limited.
Summary of the invention
The present invention provides Online Video buffer memory management methods and system based on video block joint-request rate, to improve Buffer efficiency.
To achieve the goals above, this invention takes following technical solutions.
An aspect of of the present present invention provides a kind of Online Video buffer memory management method based on joint-request rate, by video It is cut into that multiple byte numbers are identical and continuous video block, the method include: sequentially in time
S1: after video cache device receives the request for some video block that user sends, from remote video server Some described video block is obtained, some described video block is sent to the user, while recording the history that user watches video Data information;
S2: the video cache device watches the historical data information of video according to user, calculates some described video The joint-request rate JRR of block and each video block in the video cache device, according to the JRR determine it is described certain The cache way of a video block.
Further, video is cut into multiple byte numbers are identical and continuous video block sequentially in time, it is specific to wrap It includes:
Video is divided into that multiple byte numbers are identical and continuous video block by video cache device sequentially in time, and at it Storage and management are carried out to each video in a manner of video block in internal spatial cache, remote video server is with video block All videos of mode storage and management, remote video server carries out data by communication network and each video cache device Communication;
Video cache device storage and management user watches the historical data information of video, the historical data information packet Include: user watches schedule file and video block access count file, and the user watches schedule file and each exists for recording The video block and viewing moment that line user's the last time is watched, the video block access count file is for recording each video Block access times accumulative when each be accessed.
Further, it after video cache device receives the request of some video block that user sends, is taken from long-distance video It is engaged in obtaining some described video block in device, some described video block is sent to the user, comprising:
After video cache device receives the request for some video block that user sends, searches and compare video cache device It whether there is some described video block in the video piece of collection of storage, it, then will be described if there is some described video block Some video block return to user, while updating the historical data information of some video block;
If some video block there is no described in caching, described in video cache device to remote video server acquisition Some video block, and some described video block is returned into the user, then sequence executes step S2.
Further, video cache device watches the historical data information of video according to user, calculates some described view The joint-request rate value JRR of frequency block and each video block in the video cache device, determines institute according to the JRR State the cache way of some video block, comprising:
The memory for some video block that the video cache device caches its idle spatial cache with needs itself is big It is small to be compared, when idle spatial cache is more than or equal to the memory of some video block itself, then the video The buffer storage spatial cache that the deposit of some described video block is idle;
When idle spatial cache is less than the memory of some video block itself, the video cache device is according to it The historical data information of each video block of storage, calculates each video block and some described video in its video piece of collection The JRR of block:
It is when the smallest video block of JRR value is not some described video block, then empty from the caching of the video cache device Between the smallest video block of middle deletion JRR value, and and some described video block is stored on corresponding spatial cache;When JRR value is minimum Video block when being some described video block, then some described video block is stored not in local cache.
Further, the joint of some described video block and each video block in the video cache device is calculated Request rate value JRR, comprising:
The collection of video block and some video block that setting video buffer storage has cached is combined into Γ, to each of Γ Video block gives the observation window of a regular length W:
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block Mouth is online user's observation window, and the joint-request rate is online user's joint-request rate:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'>=W, wherein v ', i ' are respectively The corresponding video number of video block and video block number, Tv'It is the play time length of each video block, the sight of definition (v ', i ') Survey window is [i' × Tv'- W, i ' × Tv');It is assumed that there is online user watching certain videos within the scope of the observation window Block, these specific viewing locations form a set omega={ σk|i'×Tv'- W≤σk<i'×Tv', k=0,1 ..., | Ω |- 1 }, wherein Tv'It is the play time length of each video block, σkFor a video-see position, refer to that user opens from video Beginning position watches a current viewing position σ for 0 secondkSecond, and σ0≤σ1≤…≤σ|Ω|-1
Without loss of generality, each it is in viewing location σkUser, shown in currently watched video block such as following formula (1):
Thereafter centainly to watch probability viewing video block (v', i'), which is denoted as extended meetingIt calculates public Shown in formula such as following formula (4):
Wherein, the molecule in formula and denominator are the video blocks (v', i') obtained respectively according to video block access count file It is continuously watched total degree and video block (v', jk) is continuously watched total degree;The user can request after certain time Δ k (v', i'), Δ k are calculated as the following formula (5):
Δk=i' × Tv'k (6)
Δ k is request time of the user to video block (v', i');
The joint-request probability JRR of video block is in observation window, and all online users request video block (v', i') The ratio of probability and request time and, that is, online user joint-request rate JRR (v ', i ') is such as shown in following formula (4):
Further, the joint of some described video block and each video block in the video cache device is calculated Request rate value JRR, further includes:
The collection of video block and some video block that setting video buffer storage has cached is combined into Γ, to each of Γ Video block gives the observation window of a regular length W:
When the broadcast start time of video block is less than given observation window length W, the observation window of the video block be from Line user observation window and online user's observation window, the joint-request rate are the request rate of offline user and online The sum of request rate of user:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'< W, wherein v ', i ' are view respectively The observation window of frequency block corresponding video number and video block number, definition (v ', i ') is [i' × Tv'- W, i ' × Tv']:
In offline user observation window [i' × Tv'- W, 0) offline user, these offline users are obtained with statistics Arrival rate λ enter system and request video block (v ', 0), note offline user is to the request rate of video block (v ', i ')According to the following formula shown in (5):
Wherein P ((v ', i ') | (v ', 0)) is that the user of viewing video block (v', 0) continues to watch video block (v', i') Probability, λ are obtained according to the data statistics in video block access count file, shown in calculating formula such as following formula (6):
In formula,Indicate historical data information in record by the end of current time video block (v ', 0) by user The total degree of request,When indicating that the video block (v ', 0) recorded in historical data information is once requested earliest by user Total degree, t indicate system current time, t0Indicate that the video block (v ', 0) recorded in video block accounting file is earliest by user System time when primary request;
In online user's observation window [0, i ' × Tv') section online user, these online users ask video block Rate is asked to be denoted asShown in for example described formula (1)-(4) of calculation method;
Therefore, each video block of the observation window length of setting is less than to the broadcast start time of video block, it is described Joint-request rate is JRR (v ', i '), as shown in following formula (7):
That is,
Another aspect provides a kind of joint-request rate Online Video cache management system based on video block System, comprising: remote video server and video cache device;
Remote video server, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video It is logical to carry out data by communication network and each video cache device for block, all videos of storage and management in a manner of video block Letter;
Video cache device, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video Block after the request for receiving some video block that user sends, obtains some described video block from remote video server, will Some described video block is sent to the user;
According to the historical data information of each video block, calculate each video block in spatial cache and it is described some The joint-request rate of video block determines the caching side of some video block according to the joint-request rate of each video block Formula.
Further, video cache device includes video cache module, data information management module, video block transmission mould Block, video block rate calculation module and video block buffer process module;
Video cache module, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video Block passes through the video block of each video of spatial cache storage and management;
Data information management module watches the historical data information of video for storage and management user, and each The update of video block historical data information is carried out at the end of process;The historical data information includes: each online for recording The video block and the user at viewing moment that user's the last time is watched watch schedule file;And it is cut for recording each video block To it is each accessed when accumulative access times be put into video block access count file;
Video block transmission module searches after the request for receiving some video block that user sends and compares video With the presence or absence of some described video block in the video piece of collection of buffer storage storage, if there is some described video block, then will Some described video block returns to user, while updating the historical data information of some video block, this process terminates;Such as Some described video block is not present in fruit, then video cache device to remote video server obtains some described video block, and will Some described video block returns to the user;
Video block rate calculation module calculates sets of video blocks for watching the historical data information of video according to user The joint-request rate JRR of each video block and some video block in conjunction, the video that setting video buffer storage has cached The collection of block and some video block is combined into Γ, to each video block in Γ, gives the observation window of a regular length W Mouthful:
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block Mouth is online user's observation window, and calculated joint-request rate is online user's joint-request rate;When opening for video block Beginning play time is less than given observation window length W, and the observation window of the video block is for offline user observation window and online User's observation window, calculated joint-request rate be offline user request rate and online user request rate it With;
Video block buffer process module, in some video block itself for caching idle spatial cache and needs It deposits size to be compared, when idle spatial cache is more than or equal to the memory of some video block itself, then by institute State the idle spatial cache of some video block deposit;When idle spatial cache is less than the memory of some video block itself When, obtain each video block and some described video block in the calculated video piece of collection of video block rate calculation module JRR value the JRR value is then deleted in spatial cache most when the smallest video block of JRR value is not some described video block Small video block, and return re-start idle spatial cache with the memory size of some video block itself compared with Storage;When the smallest video block of JRR value is some described video block, then some described video is stored not in local cache Block.
As seen from the above technical solution provided by the invention, the present invention is based on the online of video block joint-request rate Video cache management method and system are asked using user's watching behavior characteristic of video-on-demand service system by calculating to combine Rate JRR is sought, so that the importance value of video block and the prediction accuracy of video-see are high, to promote the effect of video cache Rate improves the service quality of user.
The additional aspect of the present invention and advantage will be set forth in part in the description, these will become from the following description Obviously, or practice through the invention is recognized.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, required use in being described below to embodiment Attached drawing be briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for this For the those of ordinary skill of field, without creative efforts, it can also be obtained according to these attached drawings others Attached drawing.
Fig. 1 is a kind of Online Video cache management side for joint-request rate value based on video block that embodiment 1 provides The process flow diagram of method;
Fig. 2 is the signal that the broadcast start time of the video block of embodiment 1 is greater than or equal to the observation window length of setting Figure;
Fig. 3 is the schematic diagram that the broadcast start time of video block is less than the observation window length of setting;
Fig. 4 is a kind of joint-request rate Online Video cache management system based on video block that embodiment 2 provides Structural schematic diagram.
Specific embodiment
Embodiments of the present invention are described below in detail, the example of the embodiment is shown in the accompanying drawings, wherein from beginning Same or similar element or element with the same or similar functions are indicated to same or similar label eventually.Below by ginseng The embodiment for examining attached drawing description is exemplary, and for explaining only the invention, and is not construed as limiting the claims.
Those skilled in the art of the present technique are appreciated that unless expressly stated, singular " one " used herein, " one It is a ", " described " and "the" may also comprise plural form.It is to be further understood that being arranged used in specification of the invention Diction " comprising " refer to that there are the feature, integer, step, operation, element and/or component, but it is not excluded that in the presence of or addition Other one or more features, integer, step, operation, element, component and/or their group.It should be understood that when we claim member Part is " connected " or when " coupled " to another element, it can be directly connected or coupled to other elements, or there may also be Intermediary element.In addition, " connection " used herein or " coupling " may include being wirelessly connected or coupling.Wording used herein "and/or" includes one or more associated any cells for listing item and all combinations.
Those skilled in the art of the present technique are appreciated that unless otherwise defined, all terms used herein (including technology Term and scientific term) there is meaning identical with the general understanding of those of ordinary skill in fields of the present invention.Also answer It should be appreciated that those terms such as defined in the general dictionary should be understood that have in the context of the prior art The consistent meaning of meaning, and unless defined as here, it will not be explained in an idealized or overly formal meaning.
In order to facilitate understanding of embodiments of the present invention, it is done by taking several specific embodiments as an example below in conjunction with attached drawing further Explanation, and each embodiment does not constitute the restriction to the embodiment of the present invention.
Online Video buffer memory management method and system based on joint-request rate of the invention, it is intended to be combined by calculating The method of request rate, the importance of predicted video block, and according to the cache decision of the importance of video block progress video block.
Embodiment 1
In actual line stream media system, user will not usually watch entire video from the beginning to the end, so that same video Different fragments have different popularities.Each video is averagely divided into N according to the natural order of video by the embodiment of the present invention A continuous videos block, for video v, the play time length of each video block after cutting is Tv, number is 0 to sequence respectively, 1,2 ..., N-1 is respectively 0, T at the beginning of corresponding to video block in videov, 2 × Tv..., (N-1) × Tv.It therefore, can be with The popularity of entire video file is refine to the popularity of each video block in video file.
In the present invention, caching system is designed to preferentially store most popular video block, rather than most popular video is whole A video file to improve the utilization rate of spatial cache, and then promotes the overall performance of caching system.
On the one hand, the joint-request rate (Joint Request Rate, JRR) of video block of the embodiment of the present invention is come Measure the importance of video block.It would generally be watched according to the natural order of video after entering system due to user and possible (according to one Determine probability) it leaves halfway, therefore, viewing probability and the beginning of subsequent each video block can be predicted according to its current viewing position At the time of viewing.In view of a certain given current time, there may be multiple users just watching the different positions of same video at the same time It sets.Therefore, for any given video block, possible multiple users (request time) after the regular hour will do it sight It sees.An observation time window is given, the user for being in different viewing progresses, which can be watched with different probability in different moments, to be somebody's turn to do Video block;These viewing probability and request time ratio be exactly in observation window different user in statistical significance to the video block Request rate;Further, request rate of the different user in window to video block is summed, obtains the video block in the sight Survey the joint-request rate JRR on window.In the present invention, the bigger expression of the JRR value of video block has more within the observation period User to watch this video block or/and user it is more urgent need to watch the video block, therefore the video block is important Property is higher.Therefore, the present invention assesses corresponding video block using the JRR value of each video block for the importance of user.
On the other hand, when the position of video block in video is forward enough, so that the broadcast start time of the video block Less than setting observation window length when, only consider that online user is likely to result in the video block joint-request speed being calculated Rate value is too small, therefore also needs to consider offline user to the joint-request rate of the video block.In statistical significance, offline user System can be entered after the regular hour with certain arrival rate, and start to request the starting video block of the video.
In the present invention, a video is given, offline user average arrival rate value was equal in past a period of time Interior, the total degree that the first video block of the video has been watched is divided by the duration of this period, the as offline user of the video Average arrival rate value.
The embodiment of the present invention is mentioned according to video block the location of the in video difference with the relationship of observation window length For different methods, the joint-request rate value of video block is calculated.
The embodiment of the present invention 1 provides a kind of Online Video cache management side of joint-request rate value based on video block The process flow diagram of method, as shown in Figure 1, including the following steps:
Step S110, video cache device receive the request of the video block i of the video v of user's transmission.
Step S120, video cache device respond user's request.
Video cache device judges whether its internal spatial cache has the video block i of video v, referred to as (v, i)).If Have (v, i), then (v, i) is directly returned into user, while triggering and updating the historical data information that user watches video, then Return step S110, to continue waiting for the request next time of users;Otherwise, video cache device will be from remote video server It downloads (v, i), and (v, i) is returned into user, then proceed to execute step S130.
Wherein, it includes that user watches schedule file and video block access count text that user, which watches the historical data information of video, Part, the user watch schedule file and are used to record the video block and viewing moment that each online user's the last time is watched, The video block access count file is used to record each video block access times accumulative when each be accessed.
User involved in the above process watch video historical data information renewal process include:
The renewal process of user's viewing schedule file are as follows: schedule file more new record (u, v, i, t) is watched in user, Middle u is the User ID for requesting video block, and v and i are the video and video block number of user's request respectively, t be system it is current when It carves.
The renewal process of video block access count file are as follows: in (v, i) corresponding first in, first out (First In First Out, abbreviation FIFO) increase a record in data structure, record the return moment of the video block, by the end of the video block at this time Accessed total degree, and the video block is continuously watched the total degree of user's access of the video by the end of current time.
Step S130, the video block (v, i) itself that video cache device caches its idle spatial cache V and needs Memory size J be compared: as v >=j, then video cache device by video block (v, i) be stored in spatial cache in free time Position, while triggering and updating the history access information (the same S120 of update method) that user watches video, process terminates.Then it returns Step S110, to continue waiting for the request next time of users;As v < j, step S140 is triggered.
Step S140, it is different according to the position of video block in video, each video block (packet is calculated using method 1 or 2 Include it is all in video block (v, i) and spatial cache to be cached deposited video block, indicated with video piece of collection Γ) JRR value.So Step S150 will be triggered afterwards.
Fig. 2 is the schematic diagram that the broadcast start time of video block is greater than or equal to the observation window length of setting,
Schematic diagram of the Fig. 3 for the broadcast start time of video block less than the observation window length set, reference Fig. 2 and Fig. 3, The calculating of the JRR of following methods 1 and the progress video block of method 2 is respectively adopted.
Method 1: the collection of video block and some video block that setting video buffer storage has cached is combined into Γ, in Γ Each video block, give a regular length W observation window.
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block Mouth is online user's observation window, and the joint-request rate is online user's joint-request rate, and basic skills is as follows:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'>=W, wherein v ', i ' are respectively The corresponding video number of video block and video block number, Tv'It is the play time length of each video block, the sight of definition (v ', i ') Survey window is [i' × Tv'- W, i ' × Tv');It is assumed that there is online user watching certain videos within the scope of the observation window Block, these specific viewing locations form a set omega={ σk|i'×Tv'- W≤σk<i'×Tv', k=0,1 ..., | Ω |- 1 }, wherein Tv'It is the play time length of each video block, σkFor a video-see position, refer to that user opens from video Beginning position watches a current viewing position σ for 0 secondkSecond, and σ0≤σ1≤…≤σ|Ω|-1
Without loss of generality, each it is in viewing location σkUser, shown in currently watched video block such as following formula (1):
Thereafter centainly to watch probability viewing video block (v', i'), which is denoted as extended meetingIt calculates public Shown in formula such as following formula (7):
Wherein, the molecule in formula and denominator are the video blocks (v', i') obtained respectively according to video block access count file It is continuously watched total degree and video block (v', jk) is continuously watched total degree;The user can request after certain time Δ k (v', i'), Δ k are calculated as the following formula (9):
Δk=i' × Tv'k (10)
Δ k is request time of the user to video block (v', i');
The joint-request probability JRR of video block is in observation window, and all online users request video block (v', i') The ratio of probability and request time and, that is, online user joint-request rate JRR (v ', i ') is such as shown in following formula (4):
Method 2: the collection of video block and some video block that setting video buffer storage has cached is combined into Γ, in Γ Each video block, give a regular length W observation window.
When the broadcast start time of video block is less than given observation window length W, the observation window of the video block be from Line user observation window and online user's observation window, the joint-request rate are the request rate of offline user and online The sum of request rate of user, basic skills are as follows:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'< W, wherein v ', i ' are view respectively The observation window of frequency block corresponding video number and video block number, definition (v ', i ') is [i' × Tv'- W,
i’×Tv'], it is in offline user observation window [i' × Tv'- W, 0) offline user, these offline users are Enter system to count the arrival rate λ that obtains and request video block (v ', 0), note offline user is to video block (v ', i ') Request rate isAccording to the following formula shown in (5):
Wherein P ((v ', i ') | (v ', 0)) is that the user of viewing video block (v', 0) continues to watch video block (v', i') Probability can be calculated according to above formula (2), and λ is obtained according to the data statistics in video block access count file, calculate Shown in formula such as following formula (6):
In formulaIndicate historical data information in record by the end of current time video block (v ', 0) by user The total degree of request,When indicating that the video block (v ', 0) recorded in historical data information is once requested earliest by user Total degree, t indicate system current time, t0Indicate that the video block (v ', 0) recorded in video block accounting file is earliest by user System time when primary request;
In online user's observation window [0, i ' × Tv') section online user, these online users ask video block Rate is asked to be denoted asShown in calculation method such as above-mentioned formula (1)-(4);
Therefore, each video block of the observation window length of setting is less than to the broadcast start time of video block, it is described Joint-request rate is JRR (v ', i '), as shown in following formula (7):
That is,
The JRR value of each video block is obtained as a result, then triggers step S150.
Step S150 carries out caching replacement according to the joint-request rate JRR of the video block calculated in step S140.
According to above-mentioned steps it can be concluded that joint-request rate as video block (v, i) ∈ Γ (including new video block and All deposited video block in caching) importance value, therefrom choose the video block of importance value minimum (importance is minimum) and will It is eliminated, and wherein the smallest video block of importance (v', r') is given by,
(v ', i ')=argmin(v, i) ∈ ΓJRR(v, i) (8)
If (v', r') is exactly then to trigger to storage video block (v, r) and update the history access information that user watches video (the same S120 of update method) and then return step S110;Otherwise, the smallest video block of importance value is deleted, and empty in corresponding caching Between upper storage to storage video block (v, r), while triggering and updating user and watch the history access information of video (update method is same S120)。
The method of the embodiments of the present invention is suitable for the online Streaming Media such as internet, cable television, video and audio and broadcasts Place system.
Those skilled in the art will be understood that the regulative strategy of above-mentioned the lifted joint-request rate according to video block only The technical solution of embodiment in order to better illustrate the present invention, rather than to the restriction that the embodiment of the present invention is made.It is any according to joint The method of request rate regulative strategy, is all contained in the range of the embodiment of the present invention.
Embodiment 2
A kind of structure for joint-request rate Online Video cache management system based on video block that the embodiment 2 provides Schematic diagram is as shown in Figure 4, comprising: video cache device 31 and remote video server 32;
Video cache device 31, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video Block after the request for receiving some video block that user sends, obtains some described video block from remote video server, will Some described video block is sent to the user;
According to the historical data information of each video block, calculate each video block in spatial cache and it is described some The joint-request rate of video block determines the caching side of some video block according to the joint-request rate of each video block Formula.
Remote video server 32, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous view Frequency block, all videos of storage and management in a manner of video block carry out data by communication network and each video cache device Communication;
Preferably, video cache device 31 includes video cache module 311, data information management module 312, video block Transmission module 313, video block rate calculation module 314 and video block buffer process module 315;
Video cache module 311, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous view Frequency block passes through the video block of each video of spatial cache storage and management;
Data information management module 312 watches the historical data information of video for storage and management user, and every The update of video block historical data information is carried out at the end of secondary process;The historical data information includes: each to exist for recording The video block and the user at viewing moment that line user's the last time is watched watch schedule file;And for recording each video block Accumulative access times are put into video block access count file when each be accessed;
Video block transmission module 313 after the request for receiving some video block that user sends, searches and compares view With the presence or absence of some described video block in the video piece of collection of frequency buffer storage storage, if there is some described video block, then Some described video block is returned into user, while updating the historical data information of some video block, this process terminates; If there is no some described video block, then video cache device to remote video server obtains some described video block, and Some described video block is returned into the user;
Video block rate calculation module 314 calculates video block for watching the historical data information of video according to user The joint-request rate JRR of each video block and some video block in set, the view that setting video buffer storage has cached The collection of frequency block and some video block is combined into Γ, to each video block in Γ, gives the observation window of a regular length W Mouthful:
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block Mouth is online user's observation window, and calculated joint-request rate is online user's joint-request rate;When opening for video block Beginning play time is less than given observation window length W, and the observation window of the video block is for offline user observation window and online User's observation window, calculated joint-request rate be offline user request rate and online user request rate it With;
The video block buffer process module 315, some video for caching idle spatial cache and needs The memory size of block itself is compared, when idle spatial cache is more than or equal to the memory of some video block itself When, then by the spatial cache of some described video block deposit free time;When idle spatial cache is less than some described video block sheet When the memory of body, obtain each video block in the calculated video piece of collection of video block rate calculation module and it is described certain The JRR value of a video block then deletes institute when the smallest video block of JRR value is not some described video block in spatial cache State the smallest video block of JRR value, and return re-start idle spatial cache and some video block itself memory it is big Small comparison and storage;When the smallest video block of JRR value is some described video block, then not in local cache described in storage Some video block.
Preferably, video block rate calculation module 314, specifically for calculating video piece of collection according to following two method In each video block and some video block joint-request rate JRR:
Method 1: the collection of video block and some video block that setting video buffer storage has cached is combined into Γ, to described Each video block, give a regular length W observation window.
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block Mouth is online user's observation window, and the joint-request rate is online user's joint-request rate, and basic skills is as follows:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'>=W, wherein v ', i ' are respectively The corresponding video number of video block and video block number, Tv'It is the play time length of each video block, the sight of definition (v ', i ') Survey window is [i' × Tv'- W, i ' × Tv');It is assumed that there is online user watching certain videos within the scope of the observation window Block, these specific viewing locations form a set omega={ σk|i'×Tv'- W≤σk<i'×Tv', k=0,1 ..., | Ω |- 1 }, wherein Tv'It is the play time length of each video block, σkFor a video-see position, refer to that user opens from video Beginning position watches a current viewing position σ for 0 secondkSecond, and σ0≤σ1≤…≤σ|Ω|-1
Without loss of generality, each it is in viewing location σkUser, shown in currently watched video block such as following formula (1):
Thereafter centainly to watch probability viewing video block (v', i'), which is denoted as extended meetingIt calculates public Shown in formula such as following formula (11):
Wherein, molecule and denominator are that the video block (v', i') that is obtained respectively according to video block access count file is continuous Viewing total degree and video block (v', jk) are continuously watched total degree;The user can request (v', i') after certain time Δ k, Δ k is calculated as the following formula (13):
Δk=i' × Tv'k (14)
Δ k is request time of the user to video block (v', i');
The joint-request probability JRR of video block is in observation window, and all online users request video block (v', i') The ratio of probability and request time and, that is, online user joint-request rate JRR (v ', i ') is such as shown in following formula (4):
Method 2: the collection of video block and some video block that setting video buffer storage has cached is combined into Γ, to described Each video block, give a regular length W observation window.
When the broadcast start time of video block is less than given observation window length W, the observation window of the video block be from Line user observation window and online user's observation window, the joint-request rate are the request rate of offline user and online The sum of request rate of user, basic skills are as follows:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'< W, wherein v ', i ' are view respectively The observation window of frequency block corresponding video number and video block number, definition (v ', i ') is [i' × Tv'- W, i ' × Tv'], place In offline user observation window [i' × Tv'- W, 0) offline user, these offline users are to count the arrival rate obtained λ enters system and requests video block (v ', 0), and note offline user is to the request rate of video block (v ', i ')According to the following formula shown in (5):
Wherein P ((v ', i ') | (v ', 0)) is that the user of viewing video block (v', 0) continues to watch video block (v', i') Probability can be calculated according to above formula (2), and λ is obtained according to the data statistics in video block access count file, calculate Shown in formula such as following formula (6):
In formulaIndicate historical data information in record by the end of current time video block (v ', 0) by user The total degree of request,When indicating that the video block (v ', 0) recorded in historical data information is once requested earliest by user Total degree, t indicate system current time, t0Indicate that the video block (v ', 0) recorded in video block accounting file is earliest by user System time when primary request;
In online user's observation window [0, i ' × Tv') section online user, these online users ask video block Rate is asked to be denoted asShown in calculation method such as above-mentioned formula (1)-(4);
Therefore, each video block of the observation window length of setting is less than to the broadcast start time of video block, it is described Joint-request rate is JRR (v ', i '), as shown in following formula (7):
That is,
The tool of the joint-request rate Online Video cache management based on video block is carried out with the method for the embodiment of the present invention Body process is similar to the previous method embodiment, and details are not described herein again.
In conclusion the joint-request rate Online Video buffer memory management method and system of the embodiment of the present invention, are utilized User's watching behavior characteristic of video-on-demand service system can within following a period of time with each video block by video piecemeal The requested joint-request rate of energy is counted as video block importance value, and according to from online user's future watching behavior Joint-request rate is calculated, the execution of cache policy is carried out using joint-request rate value as the importance index of video block, so that The importance value of video block and the prediction accuracy of video-see are high, so as to promote the efficiency of video cache, improve user Service quality.
Those of ordinary skill in the art will appreciate that: attached drawing is the schematic diagram of one embodiment, module in attached drawing or Process is not necessarily implemented necessary to the present invention.
As seen through the above description of the embodiments, those skilled in the art can be understood that the present invention can It realizes by means of software and necessary general hardware platform.Based on this understanding, technical solution of the present invention essence On in other words the part that contributes to existing technology can be embodied in the form of software products, the computer software product It can store in storage medium, such as ROM/RAM, magnetic disk, CD, including some instructions are used so that a computer equipment (can be personal computer, server or the network equipment etc.) executes the certain of each embodiment or embodiment of the invention Method described in part.
All the embodiments in this specification are described in a progressive manner, same and similar portion between each embodiment Dividing may refer to each other, and each embodiment focuses on the differences from other embodiments.Especially for system reality For applying example, since it is substantially similar to the method embodiment, so describing fairly simple, related place is referring to embodiment of the method Part explanation.System embodiment described above is only schematical, can select it according to the actual needs In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness In the case where labour, it can understand and implement.
The foregoing is only a preferred embodiment of the present invention, but scope of protection of the present invention is not limited thereto, In the technical scope disclosed by the present invention, any changes or substitutions that can be easily thought of by anyone skilled in the art, It should be covered by the protection scope of the present invention.Therefore, protection scope of the present invention should be with scope of protection of the claims Subject to.

Claims (8)

1. a kind of Online Video buffer memory management method based on joint-request rate, which is characterized in that video is suitable according to the time Sequence is cut into that multiple byte numbers are identical and continuous video block, the method include:
S1: it after video cache device receives the request for some video block that user sends, is obtained from remote video server Some described video block is sent to the user by some described video block, while recording the historical data that user watches video Information;
S2: the video cache device watches the historical data information of video according to user, calculate some described video block with And the joint-request rate value JRR of each video block in the video cache device, according to the JRR determine it is described some The cache way of video block.
2. the method according to claim 1, wherein described be cut into video multiple words sequentially in time Joint number is identical and continuous video block, specifically includes:
Video is divided into that multiple byte numbers are identical and continuous video block by video cache device sequentially in time, and inside it Spatial cache in a manner of video block to each video carry out storage and management, remote video server is with the side of video block All videos of formula storage and management, remote video server carry out data by communication network and each video cache device and lead to Letter;
Video cache device storage and management user watches the historical data information of video, and the historical data information includes: User watches schedule file and video block access count file, and the user watches schedule file for recording each online use The video block of family the last time viewing and viewing moment, the video block access count file are cut for recording each video block To it is each accessed when accumulative access times.
3. the method according to claim 1, wherein the video cache device receives certain that user sends After the request of a video block, some described video block is obtained from remote video server, some described video block is sent to The user, comprising:
After video cache device receives the request for some video block that user sends, searches and compare the storage of video cache device Video piece of collection in whether there is some described video block, if there is some described video block, then by certain described A video block returns to user, while updating the historical data information of some video block;
If there is no some described video block in caching, video cache device to remote video server obtain described in some Video block, and some described video block is returned into the user, then sequence executes step S2.
4. the method according to claim 1, wherein the video cache device watches going through for video according to user History data information calculates the joint-request speed of some described video block and each video block in the video cache device Rate value JRR determines the cache way of some video block according to the JRR, comprising:
The memory size for some video block that the video cache device caches its idle spatial cache and needs itself into Row compares, when idle spatial cache is more than or equal to the memory of some video block itself, then the video cache The device spatial cache that the deposit of some described video block is idle;
When idle spatial cache is less than the memory of some video block itself, the video cache device is according to its storage Each video block historical data information, calculate each video block in its video piece of collection and some video block JRR:
When the smallest video block of JRR value is not some described video block, then from the spatial cache of the video cache device The smallest video block of JRR value is deleted, and and stores some described video block on corresponding spatial cache;When the smallest view of JRR value When frequency block is some described video block, then some described video block is stored not in local cache.
5. the method according to claim 1, wherein described calculates some described video block and the view The joint-request rate value JRR of each video block in frequency buffer storage, comprising:
The collection of video block and some video block that setting video buffer storage has cached is combined into Γ, to each video in Γ Block gives the observation window of a regular length W:
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block is Online user's observation window, the joint-request rate are online user's joint-request rate:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'>=W, wherein v ', i ' are video respectively The corresponding video number of block and video block number, Tv'It is the play time length of each video block, the observation window of definition (v ', i ') Mouth is [i' × Tv'- W, i ' × Tv');It is assumed that there is online user watching certain video blocks within the scope of the observation window, this A little specific viewing locations form a set omega={ σk|i'×Tv'-W≤σk<i'×Tv', k=0,1 ..., | Ω | -1 }, wherein Tv'It is the play time length of each video block, σkFor a video-see position, refer to user from video starting position 0 Second watches a current viewing position σkSecond, and σ0≤σ1≤…≤σ|Ω|-1
Without loss of generality, each it is in viewing location σkUser, shown in currently watched video block such as following formula (1):
Thereafter centainly to watch probability viewing video block (v', i'), which is denoted as extended meetingCalculation formula is such as Shown in following formula (1):
Wherein, the molecule in formula and denominator are that the video block (v', i') obtained respectively according to video block access count file is connected Continuous viewing total degree and video block (v', jk) are continuously watched total degree;The user can be requested after certain time Δ k (v', I'), Δ k is calculated as the following formula (2):
Δk=i' × Tv'k (3)
Δ k is request time of the user to video block (v', i');
The joint-request probability JRR of video block is in observation window, all online users request the probability of video block (v', i') with The sum of the ratio of request time, that is, online user's joint-request rate JRR(v ', i ')As shown in following formula (4):
6. according to the method described in claim 5, it is characterized in that, described calculates some described video block and the view The joint-request rate value JRR of each video block in frequency buffer storage, further includes:
The collection of video block and some video block that setting video buffer storage has cached is combined into Γ, to each video in Γ Block gives the observation window of a regular length W:
When the broadcast start time of video block is less than given observation window length W, the observation window of the video block is offline uses Family observation window and online user's observation window, the joint-request rate are request rate and the online user of offline user The sum of request rate:
Given current time t, to any one video block (v ', i ') ∈ Γ and i ' × Tv'< W, wherein v ', i ' are video block respectively The observation window of corresponding video number and video block number, definition (v ', i ') is [i' × Tv'- W, i ' × Tv']:
In offline user observation window [i' × Tv'- W, 0) offline user, these offline users are to count arriving of obtaining Enter system up to rate λ and request video block (v ', 0), note offline user is to the request rate of video block (v ', i ')According to the following formula shown in (5):
Wherein P((v ', i ') | (v ', 0))To watch the probability that the user of video block (v', 0) continues viewing video block (v', i'), λ is root It is obtained according to the data statistics in video block access count file, shown in calculating formula such as following formula (6):
In formula,Indicate that is recorded in historical data information is requested by a user by the end of current time video block (v ', 0) Total degree,Indicate total time when the video block (v ', 0) recorded in historical data information is once requested earliest by user Number, t indicate system current time, t0Indicate that the video block (v ', 0) recorded in video block accounting file is once asked earliest by user System time when asking;
In online user's observation window [0, i ' × Tv') section online user, these online users are to the request of video block speed Rate is denoted asShown in for example described formula (1)-(4) of calculation method;
Therefore, each video block of the observation window length of setting, the joint are less than to the broadcast start time of video block Request rate is JRR(v ', i '), as shown in following formula (7):
That is,
7. a kind of joint-request rate Online Video cache management system based on video block characterized by comprising long-range view Frequency server and video cache device;
The remote video server, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video It is logical to carry out data by communication network and each video cache device for block, all videos of storage and management in a manner of video block Letter;
The video cache device, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video Block after the request for receiving some video block that user sends, obtains some described video block from remote video server, will Some described video block is sent to the user;
According to the historical data information of each video block, each video block and some described video in spatial cache are calculated The joint-request rate of block determines the cache way of some video block according to the joint-request rate of each video block.
8. system according to claim 8, which is characterized in that the video cache device include video cache module, Data information management module, video block transmission module, video block rate calculation module and video block buffer process module;
The video cache module, for video to be cut into sequentially in time, multiple byte numbers are identical and continuous video Block passes through the video block of each video of spatial cache storage and management;
The data information management module watches the historical data information of video for storage and management user, and every The update of video block historical data information is carried out at the end of secondary process;The historical data information includes: each to exist for recording The video block and the user at viewing moment that line user's the last time is watched watch schedule file;And for recording each video block Accumulative access times are put into video block access count file when each be accessed;
The video block transmission module after the request for receiving some video block that user sends, searches and compares view With the presence or absence of some described video block in the video piece of collection of frequency buffer storage storage, if there is some described video block, then Some described video block is returned into user, while updating the historical data information of some video block, this process terminates; If there is no some described video block, then video cache device to remote video server obtains some described video block, and Some described video block is returned into the user;
The video block rate calculation module calculates video block for watching the historical data information of video according to user The joint-request rate JRR of each video block and some video block in set, the view that setting video buffer storage has cached The collection of frequency block and some video block is combined into Γ, to each video block in Γ, gives the observation window of a regular length W Mouthful:
When the broadcast start time of video block is greater than or equal to given observation window length W, the observation window of the video block is Online user's observation window, calculated joint-request rate are online user's joint-request rate;Start to broadcast when video block The time is put less than given observation window length W, the observation window of the video block is offline user observation window and online user Observation window, calculated joint-request rate are the sum of request rate and request rate of online user of offline user;
The video block buffer process module, some video block itself for caching idle spatial cache and needs Memory size is compared, and when idle spatial cache is more than or equal to the memory of some video block itself, then will The idle spatial cache of some video block deposit;When idle spatial cache is less than the memory of some video block itself When, obtain each video block and some described video block in the calculated video piece of collection of video block rate calculation module JRR value the JRR value is then deleted in spatial cache most when the smallest video block of JRR value is not some described video block Small video block, and return re-start idle spatial cache with the memory size of some video block itself compared with Storage;When the smallest video block of JRR value is some described video block, then some described video is stored not in local cache Block.
CN201811491355.XA 2018-12-07 2018-12-07 Online video cache management method and system based on joint request rate Active CN109769135B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811491355.XA CN109769135B (en) 2018-12-07 2018-12-07 Online video cache management method and system based on joint request rate

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811491355.XA CN109769135B (en) 2018-12-07 2018-12-07 Online video cache management method and system based on joint request rate

Publications (2)

Publication Number Publication Date
CN109769135A true CN109769135A (en) 2019-05-17
CN109769135B CN109769135B (en) 2021-02-19

Family

ID=66451239

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811491355.XA Active CN109769135B (en) 2018-12-07 2018-12-07 Online video cache management method and system based on joint request rate

Country Status (1)

Country Link
CN (1) CN109769135B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114900732A (en) * 2022-04-25 2022-08-12 北京奇艺世纪科技有限公司 Video caching method and device, electronic equipment and storage medium
CN116700994A (en) * 2023-08-02 2023-09-05 深圳尚米网络技术有限公司 Resource acceleration method and system

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103312776A (en) * 2013-05-08 2013-09-18 青岛海信传媒网络技术有限公司 Method and device for caching contents of videos by edge node server
CN104662528A (en) * 2012-08-07 2015-05-27 谷歌公司 Media content receiving device and distribution of media content utilizing social networks and social circles
CN105812834A (en) * 2016-05-10 2016-07-27 南京大学 Video recommendation server, recommendation method and pre-caching method based on cluster information
CN106462632A (en) * 2014-06-20 2017-02-22 谷歌公司 Media store with a canonical layer for content
CN108259929A (en) * 2017-12-22 2018-07-06 北京交通大学 A kind of prediction of video active period pattern and caching method
US10062414B1 (en) * 2017-08-22 2018-08-28 Futurewei Technologies, Inc. Determining a future field of view (FOV) for a particular user viewing a 360 degree video stream in a network
CN108600836A (en) * 2018-04-03 2018-09-28 北京奇艺世纪科技有限公司 A kind of method for processing video frequency and device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104662528A (en) * 2012-08-07 2015-05-27 谷歌公司 Media content receiving device and distribution of media content utilizing social networks and social circles
CN103312776A (en) * 2013-05-08 2013-09-18 青岛海信传媒网络技术有限公司 Method and device for caching contents of videos by edge node server
CN106462632A (en) * 2014-06-20 2017-02-22 谷歌公司 Media store with a canonical layer for content
CN105812834A (en) * 2016-05-10 2016-07-27 南京大学 Video recommendation server, recommendation method and pre-caching method based on cluster information
US10062414B1 (en) * 2017-08-22 2018-08-28 Futurewei Technologies, Inc. Determining a future field of view (FOV) for a particular user viewing a 360 degree video stream in a network
CN108259929A (en) * 2017-12-22 2018-07-06 北京交通大学 A kind of prediction of video active period pattern and caching method
CN108600836A (en) * 2018-04-03 2018-09-28 北京奇艺世纪科技有限公司 A kind of method for processing video frequency and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
肖敬伟: "基于数据挖掘的缓存替换算法研究", 《中国优秀硕士学位论文全文数据库信息科技辑,2015年第9期》 *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114900732A (en) * 2022-04-25 2022-08-12 北京奇艺世纪科技有限公司 Video caching method and device, electronic equipment and storage medium
CN114900732B (en) * 2022-04-25 2024-01-12 北京奇艺世纪科技有限公司 Video caching method and device, electronic equipment and storage medium
CN116700994A (en) * 2023-08-02 2023-09-05 深圳尚米网络技术有限公司 Resource acceleration method and system
CN116700994B (en) * 2023-08-02 2024-03-12 深圳尚米网络技术有限公司 Resource acceleration method and system

Also Published As

Publication number Publication date
CN109769135B (en) 2021-02-19

Similar Documents

Publication Publication Date Title
US8745262B2 (en) Adaptive network content delivery system
CN104967861B (en) Video caching system and method in CDN network
KR101665542B1 (en) Device and method for optimizing access to contents by users
EP2649792B1 (en) Pre-buffering audio/video stream pairs
CN103634687B (en) The method and system of video search result are provided in intelligent television
US20100235569A1 (en) Storage Optimization System
US9767033B2 (en) Method and apparatus for managing cache memory in communication system
US20110035441A1 (en) Content information display device, content information display system, and content information display method used for the same
CN102067617A (en) Methods and apparatus for self-organized caching in a content delivery network
CN105812834B (en) Video recommendations server, recommended method and pre-cache method based on clustering information
CN108270860A (en) The acquisition system and method for environmental quality online monitoring data
CN109769135A (en) Online Video buffer memory management method and system based on joint-request rate
Baccour et al. Proactive video chunks caching and processing for latency and cost minimization in edge networks
CN108848395A (en) Edge cooperation caching method for arranging based on drosophila optimization algorithm
CN109511009A (en) A kind of video inline cache management method and system
CN108881943B (en) Node cache replacement method based on elimination index in P2P streaming media on-demand system
CN109769136A (en) Online Video buffer memory management method and system based on instantaneous access rate value
Wu et al. Reuse time based caching policy for video streaming
WO2011033565A1 (en) Metadata collecting device
CN115484314B (en) Edge cache optimization method for recommending enabling under mobile edge computing network
Li et al. Alfie: Neural-reinforced adaptive prefetching for short videos
AT&T CMMI10
CN114245147B (en) Streaming media content distribution method and system
CN109743594A (en) The sharing method extracted in wireless video shared system based on similar play mode
CN114302236B (en) Video distribution method and system based on federal learning

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant