CN101521553A - Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof - Google Patents

Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof Download PDF

Info

Publication number
CN101521553A
CN101521553A CN200810034137A CN200810034137A CN101521553A CN 101521553 A CN101521553 A CN 101521553A CN 200810034137 A CN200810034137 A CN 200810034137A CN 200810034137 A CN200810034137 A CN 200810034137A CN 101521553 A CN101521553 A CN 101521553A
Authority
CN
China
Prior art keywords
data fragmentation
data
page
memory device
asked
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN200810034137A
Other languages
Chinese (zh)
Other versions
CN101521553B (en
Inventor
黄琰
彭晓宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SYNAPTIC COMP SYSTEMS SHANGHAI
Original Assignee
SYNAPTIC COMP SYSTEMS SHANGHAI
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SYNAPTIC COMP SYSTEMS SHANGHAI filed Critical SYNAPTIC COMP SYSTEMS SHANGHAI
Priority to CN2008100341373A priority Critical patent/CN101521553B/en
Publication of CN101521553A publication Critical patent/CN101521553A/en
Application granted granted Critical
Publication of CN101521553B publication Critical patent/CN101521553B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention provides a method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and a device thereof; when the terminal equipment receives a request message for the data fragment from other peer terminal equipment, the terminal equipment firstly searches that whether the data fragment exists in cache; if so, the data fragment is read in the cache directly and sent to other peer terminal equipment; if not, the terminal equipment searches hard disk again, and one or more data fragments related to the requested data fragments is/are read into the cache from the hard disk and the requested data fragments are sent to other peer terminal equipment, thus reducing the IO times of the hard disk, prolonging the service life of the hard disk and improving the end user experience.

Description

Be used to provide the method and apparatus of data fragmentation in the peer-to-peer network video on-demand system
Technical field
The present invention relates to terminal equipment in the communication system for other reciprocity terminal equipments provide the method and apparatus of data fragmentation, relate in particular to the method and apparatus that data fragmentation is provided for other reciprocity terminal equipments based on the terminal equipment in the VOD system of peer-peer protocol.
Background technology
Stream media technology is developed along with the generally raising of domestic and international Internet user's bandwidth in recent years rapidly as the main mode of propagating in the Internet based on the multimedia messages of video.Along with the Internet user increases the demand of multimedia messages, (Video on Demand, realization VOD) receives publicity all the more video-on-demand service.
Video-on-demand service can make the user watch the film that service provider provides and not be subjected to the restriction of time, greatly facilitates user's use.Yet traditional video-on-demand service is mainly based on the pattern operation of server/customer end (Server/Client).Multi-medium data (for example, video data), main centralized stores be at server end, and the video index of user by webpage and the respective server also foradownloaded video data that connect reach online purpose of watching.This pattern has realized video-on-demand service to a certain extent, yet under this server/customer end pattern, the number of users that server can carry is very limited, after userbase enlarges, just need add server and corresponding server end bandwidth.And these not only need high fund, also be difficult to adapt to the growth of userbase exponential type, for the increase of number of users short-term burst formula service quality are seriously descended.So we need a kind of extensibility can better video-on-demand service system to satisfy increasing of demand for services.
Peer-to-peer network is as a kind of new-type network transmission technology, and development in these several years rapidly, the peer-to-peer network technology is applied aspect streaming media service gradually, and has embodied effect preferably.The application of this technology aspect Streaming Media makes that each user is online and watches film simultaneously, also can upload data to satisfy other users' video data demand.In the application aspect the VOD,, need to use certain hard drive space stored video data of user, for the peer-to-peer network technology to supply with other users owing to VOD system.If when other reciprocity terminal equipment request msg bursts, directly from hard disk, read the data fragmentation of being asked, so not only can cause the long response time, and, because the disk I of VOD client is too frequent, can reduce the useful life of disk, and excessive frequent IO most of resource that can consume the user, directly have influence on final user experience.
Summary of the invention
In view of there are the problems referred to above in prior art, the invention provides a kind of method and apparatus that in terminal equipment, is used to other reciprocity terminal equipments that the data fragmentation of data file is provided based on the point-to-point transmission agreement.Particularly, behind the data fragmentation request message that receives based on a certain terminal equipment in the video on-demand system of point-to-point transmission agreement from other reciprocity terminal equipments, this terminal equipment at first searches whether there is this data fragmentation in the buffer memory, if there is this data fragmentation in the buffer memory, then directly this data fragmentation is read and sends it to other reciprocity terminal equipments (that is data fragmentation requestor) from buffer memory; If do not have requested data fragmentation (promptly in the buffer memory, cache miss) time, this terminal equipment is searched hard disk again, one or more data fragmentations that will be relevant with the data fragmentation of being asked read in the buffer memory from hard disk, and the data fragmentation of being asked sent to other reciprocity terminal equipments (that is, the data fragmentation requestor), thereby reduced IO number of disk, improve the useful life of disk, promoted final user experience.
According to a first aspect of the invention, a kind of method that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the terminal equipment based on the point-to-point transmission agreement is provided, wherein, may further comprise the steps: receive data fragmentation request message from described other reciprocity terminal equipments; According to described data fragmentation request message, judge the data fragmentation that whether comprises in second memory device that described data fragmentation request message is asked; If comprise the data fragmentation of being asked in described second memory device, then this data fragmentation sent to described other reciprocity terminal equipments; If do not comprise the data fragmentation of being asked in described second memory device, then this data fragmentation of asking and the one or more data fragmentations relevant with the data fragmentation of being asked are read in described second memory device from first memory device, and the data fragmentation of being asked is sent to described other reciprocity terminal equipments.
According to a second aspect of the invention, a kind of generator that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the terminal equipment based on the point-to-point transmission agreement is provided, wherein, comprise: receiving system is used to receive the data fragmentation request message from described other reciprocity terminal equipments; First judgment means is used for judging the data fragmentation that whether comprises in second memory device that described data fragmentation request message is asked according to described data fragmentation request message; Dispensing device is used for then this data fragmentation being sent to described other reciprocity terminal equipments if described second memory device comprises the data fragmentation of being asked; Reading device, be used for if described second memory device does not comprise the data fragmentation of being asked, then this data fragmentation of asking and the one or more data fragmentations relevant with the data fragmentation of being asked are read in described second memory device from first memory device, and the data fragmentation of being asked is sent to described other reciprocity terminal equipments.
Adopt technical scheme of the present invention, behind the data fragmentation request message that receives based on a certain terminal equipment in the video on-demand system of point-to-point transmission agreement from other reciprocity terminal equipments, this terminal equipment is at first searched buffer memory, if when having the data fragmentation of being asked in the buffer memory, then directly from buffer memory, read the data fragmentation of being asked, and send it to other reciprocity terminal equipments (that is data fragmentation requestor); When if there is not the data fragmentation of being asked in buffer memory, this terminal equipment is searched hard disk again, one or more data fragmentations that will be relevant with the data fragmentation of being asked read in the buffer memory from hard disk, and the data fragmentation of being asked sent to other reciprocity terminal equipments (promptly, the data fragmentation requestor), thereby reduced IO number of disk, improved response speed, finally improved user experience.
Description of drawings
Read following detailed description to non-limiting example by the reference accompanying drawing, other features, objects and advantages of the present invention will become more obvious.
Fig. 1 be according to a specific embodiment of the present invention based on point-to-point network topological diagram;
Fig. 2 is according to a specific embodiment of the present invention, to the division of multimedia file;
Fig. 3 provides the systems approach flow chart of the data fragmentation of data file for be used to reciprocity terminal equipment 2 in the terminal equipment 1 based on the point-to-point transmission agreement;
Fig. 4 is the method flow diagram according to the step S13 of a specific embodiment of the present invention;
Fig. 5 shows experiment and uses P2P order video system client program to obtain the comparison diagram that concerns between the cache hit rate of first embodiment of experimental result and second embodiment and the cache size according to this request sequence simulation;
Fig. 6 obtains the comparison diagram that concerns between the hard disk IO time of first embodiment of experimental result and second embodiment and the cache size for simulation;
Fig. 7 obtains the comparison diagram that concerns respectively of experimental result between the cache hit rate of VHI and unexpected winner channel first embodiment and second embodiment and cache size for simulation;
Fig. 8 provides the device block diagram of the data fragmentation of data file for be used to reciprocity terminal equipment 2 in the terminal equipment 1 based on the point-to-point transmission agreement;
Fig. 9 is the sub-device block diagram according to the reading device 103 of a specific embodiment of the present invention.
In the accompanying drawings, identical with similar Reference numeral is represented same or analogous device or method step.
Embodiment
Followingly describe the present invention with reference to accompanying drawing:
Hereinafter related multimedia file includes but not limited to video file, audio file, picture etc., herein only with multimedia file as an example, also can be common data file etc.
Fig. 1 is a network topology schematic diagram of the present invention, shows 4 terminal equipments among Fig. 1 altogether, is respectively terminal equipment 1, terminal equipment 2, terminal equipment 3 and terminal equipment 4.Although only show 4 terminal equipments among Fig. 1, those skilled in the art will be understood that and can comprise N terminal equipment that in peer-to-peer network of the present invention wherein, N is more than or equal to 2.
To be that the center is elaborated to technical scheme of the present invention hereinafter with terminal equipment 1, therefore, corresponding to terminal equipment 1, correspondingly, terminal equipment 2 is reciprocity terminal equipment 2, and terminal equipment 3 is reciprocity terminal equipment 3, and terminal equipment 4 is reciprocity terminal equipment 4.
For simplicity's sake, following description will be primarily aimed at the data fragmentation request message that terminal equipment 1 receives from reciprocity terminal equipment 2, and handle accordingly according to this data fragmentation request message.Those skilled in the art will be understood that, technical scheme of the present invention is equally applicable to the data fragmentation request message that terminal equipment 1 receives from reciprocity terminal equipment 3 or reciprocity terminal equipment 4, and, do not give unnecessary details at this according to the situation that this data fragmentation request message is handled accordingly.
Fig. 2 shows according to a specific embodiment of the present invention, to the division of multimedia file.As shown in Figure 2, be that 265M is example (herein only being an example) with the size of multimedia file, then the size of the raw data file among Fig. 2 is 265M, and wherein, the size of raw data file is the size of this complete file.It will be appreciated by those skilled in the art that reciprocity terminal equipment 2 is a burst to the unit of terminal equipment 1 request msg, preferably, the size of burst can be 16K.In addition, the granularity of definition buffer memory access is the page (also being the burst set), and the page comprises integer number (n 1) burst, preferably, below to comprise 12 bursts with each page be that example describes, also, the size of the page is 192K (12 * 16K).In addition, be appreciated that the optimal value of the number of the data fragmentation that the page comprises in the different systems may be different, can change according to different systems.At last, the granularity of definition disk access is piece (block), and also, a complete multimedia file can be divided into some equal-sized according to the size of piece.Comprise integer number (n in the piece 2) the page.In Fig. 1, one of the big or small deficiency of the final stage data of raw data file, then when dividing this raw data file according to piece, last piece is a complete piece by piece with its polishing.
First embodiment
At first, carry out initialization to system.Initialization n, n are the threshold value that algorithm is used, the page number that the expression algorithm can be investigated, and the page that algorithm can be investigated is the continuous page before the page under the data fragmentation of request.
Initialization n 1And n 2, n 1Be the burst number that a page comprises, n 2It is a number of pages that piece comprises;
The threshold value array a of an initialization n element 1, a 2..., a n, wherein, the threshold value of the access count of the k page or leaf before the page or leaf of requested data fragmentation place is a k,
The array b that looks ahead of an initialization n element 1, b 2..., b n, wherein, surpass threshold value a as the number of times that is requested of the k page or leaf before the page or leaf of requested data fragmentation place k, then under requested data fragmentation the target pages, also should again b that look ahead more kIndividual its continued page.
After having finished above-mentioned initialized step, system begins the request of deal with data burst, as shown in Figure 3.Fig. 3 has described and has been used to reciprocity terminal equipment 2 that the systems approach figure of the data fragmentation of data file is provided in the terminal equipment 1 based on the point-to-point transmission agreement.
In step S1O, terminal equipment 1 receive from reciprocity terminal equipment 2 (the data fragmentation request message.This data fragmentation request message comprises the indication information of the data fragmentation of being asked necessarily, as identification information (ID) of this data fragmentation etc., in addition, the destination address (address of terminal equipment 1) and the source address (address of reciprocity terminal equipment 2) that also should comprise this data fragmentation request message in this data fragmentation request message are so that terminal equipment 1 sends to the data fragmentation of being asked in the reciprocity terminal equipment 2 according to the source address that comprises in this data fragmentation request message.
Terminal equipment 1 is behind the data fragmentation request message that receives from reciprocity terminal equipment 2, in step S11, terminal equipment 1 is judged the data fragmentation that whether comprises in second memory device that this data fragmentation request message is asked according to this data fragmentation request message.Further, second memory device comprises access speed very fast but the limited memory of memory capacity, for example buffer memory.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as second memory device with buffer memory below.
Particularly, terminal equipment 1 can obtain page number (representing with PageID) under the data fragmentation that reciprocity terminal equipment 2 asked by mapping table etc., and judges that according to this PageID this page is whether in buffer memory.Further, each page (promptly, the burst set) a unique page number is all arranged, each burst in each page all has a unique burst numbering, also promptly, in same multi-medium data, the numbering of the page and the numbering of burst all are unique, but a plurality of bursts can belong to a page.Preferably, store a mapping table in the terminal equipment 1, stored the corresponding relation of the burst and the page in this mapping table.In the present embodiment, according to the number order of burst, adjacent per 12 continuous bursts are divided into a page.
If among the step S11, judged result is to comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, then enter step S12, the data fragmentation that terminal equipment 1 will be asked sends to the reciprocity terminal equipment 2 of described request, and the page at this data fragmentation place of asking is requested the number of times increase once.
If among the step S11, judged result is not comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, then enter step S13, this data fragmentation of asking and the one or more data fragmentations relevant with the data fragmentation of being asked are read in the described buffer memory from first memory device, and the data fragmentation of being asked is sent to reciprocity terminal equipment 2.Further, first memory device comprises hard disk (being disk) or the slower high-capacity storage of other access speeds.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as first memory device with disk below.
Following with reference to Fig. 4, S13 is described in detail to step.
In step S130, terminal equipment 1 judges at first whether the data fragmentation of this request is stored in the hard disk.Usually, the resource of in LIST SERVER (tracker), having stored all the reciprocity terminal equipment IP address on this LIST SERVER, logined and port numbers and having had, therefore, by inquiring about to LIST SERVER, which reciprocity terminal equipment the reciprocity terminal equipment of request msg burst (for example reciprocity terminal equipment 2) knows has the data fragmentation that it is asked.Equity terminal equipment 2 learns that by the query directory server terminal equipment 1 has the data fragmentation that it will be asked.But, do not get rid of such situation yet, be that terminal equipment 1 does not in time upgrade the situation that it has change in resources to LIST SERVER, promptly terminal equipment 1 is not reported without delay the message that requested target burst has been wiped to LIST SERVER, and this burst request message this moment incoming terminal equipment 1, therefore, in the hard disk of terminal equipment 1, do not search this target burst, therefore enter S138, abandon this secondary response, enter step S14 again, judge whether to log off.
If when judging among the step S130 that this target burst is in hard disk, then terminal equipment 1 is read into the page (hereinafter to be referred as this page) at the data fragmentation place of being asked in the buffer memory, in addition, terminal equipment 1 also reads in continuous several pages (hereinafter to be referred as the follow-up page) after this page in the buffer memory together in advance.The page number of reading in advance is based on such hypothesis: if the requested number of times of the page (hereinafter to be referred as the previous page) before this page is a lot, then according to the continuity of user to the multimedia file broadcast, request also should have continuity to the data burst for it, then the requested probability of its follow-up page is also bigger, therefore how follow-up page is read in buffer memory as reading the page in advance.
Particularly, system enters step S131, initialization look ahead the page number and will investigate which previous page.The initial number of reading the page in advance is 0 in the present embodiment, and the previous page that will investigate is the 1st page before this page, and its page number is PageID-i, i=1.For example, the page counter of looking ahead (representing with Sum) of number that sign can be read in advance the page be initialized as 0, will be used to identify the cycle counter (representing with i) that the page that will investigate belongs to which page of target pages front and be initialized as 1.
Enter step S132 then, judge whether the number of the previous page investigated surpasses the algorithm threshold value n of examination page number, and judge the 1st page before this page be requested whether number of times surpassed this previous page be requested frequency threshold value a 1Also promptly, judge whether to satisfy condition simultaneously i<n and condition C ounter PageID-iA i, CounterP wherein AgeID-iThe requested number of times (also promptly visiting the number of times of this page) of i the page that the expression target pages is previous.If two conditions satisfy simultaneously, then enter step S133.If two conditions do not satisfy simultaneously, then enter step S134.
In step S133, the number of the page read is in advance increased b 1, promptly the number of pages of the follow-up page of this page of looking ahead together with this page will increase b 1Page or leaf, wherein b 1Number of pages for the 1st page of pairing continued page that should look ahead before this page more.Also promptly, the page counter Sum=Sum+b that looks ahead 1Then, the previous page that setting will be investigated be numbered PageID-i, i=2 promptly investigates the 2nd page before this page, get back to step S132 and restart circulation, particularly:
If satisfy the condition of S132, the number of the previous page of promptly having investigated is no more than the algorithm threshold value n of examination page number, simultaneously the 2nd page before this page be requested that number of times surpasses this previous page be requested frequency threshold value a 2Then continue to forward step S133 to, the number of pages of the page that prestores will increase the number of pages b that looks ahead of the corresponding increase of the 2nd page institute before this page again 2, also the page number of promptly looking ahead this moment is b 1+ b 2, and the PageID-i that is numbered of the previous page that will investigate being set, i=3 promptly investigates the 3rd page before this page, gets back to step S132 and restarts circulation.The rest may be inferred, and circulation execution in step S132 and S133 are satisfied until the condition of S132, also promptly:
Judge when following two kinds of situations have a speciogenesis at least, just do not need to forward to S133, and go to step S134.
1) number of pages of the previous page of Kao Chaing has surpassed the number of the page in the piece that algorithm will investigate, and also is i〉n;
2) number of times that is requested of the previous page that will investigate is requested the threshold value of number of times less than it, also is Counter PageID-i<a i
The number of pages of the subsequent page that step S134 decision will be read in advance, the scope of the subsequent page of wherein reading in advance is no more than the scope of the piece that has comprised target pages.That is: if the number of pages of the page that prestores that goes out of aforementioned calculation less than the number of all pages in this piece behind this page, then enters step S136, the page number of reading in advance is that the number of pages of the page that prestores that goes out of aforementioned calculation is b 1+ b 2+ ...+b kWherein k page is k the page before target pages, and this page is the page of the access thresholds of this page setting for last satisfied number of times that reads to this page has surpassed, for example, target pages is that PageID is 6, be the 6th page, then the 4th page before the target pages is the 2nd page, also be, the 3rd (the 3rd page before the target pages), the number of times that the 4th (the 2nd page before the target pages) and the 5th (the 1st page before the target pages) all satisfy its visit surpasses threshold value, and the number of times of the visit of the 1st page (also being target pages the 5th page before) surpasses this threshold value.
If the number of pages of the page that prestores that goes out of aforementioned calculation then enters step S135 greater than the number of all pages in this piece behind this page, the page of reading in advance for all pages behind this page in this piece, also be
Figure A200810034137D00131
Wherein The integer part (also promptly rounding downwards) that this numerical value is got in expression can obtain the block identification at this target pages place.And
Figure A200810034137D00133
Obtain the numbering of last page in this page place piece, subtract each other with the numbering of described target pages, obtained the number of the page that can read in advance at most, for example, so that a data file is divided into a piece according to the size of 3Mb, and the size of the page is for comprising 12 bursts, and the size of a burst is 16k, then comprising 16 of the pages in each piece, also is n 2=16.The sequence number of supposing the page is that the order according to file begins number consecutively from top of file, for example, for a target pages be numbered 37, also be PageID=37, the numbering of this target pages place piece then
Figure A200810034137D00134
Be the piece under the target pages number, The numbering of last page in the piece under obtaining in the target pages, then
Figure A200810034137D00136
Number for the page that can read in advance at most.Enter step S136 then.
Step S136, the page under the requested date is reached the subsequent page of reading in advance that determines in step S134 or step S135 write in the buffer memory, and the number of times that is requested that will write each subsequent page of buffer memory increases progressively 1, represents that it has been requested once, then enters step S137;
Step S137 according to the source address of data fragmentation request message, is sent to the reciprocity terminal equipment 2 of asking this data fragmentation with the data fragmentation of being asked, and enters step S14 then;
Step S14 judges whether to log off, if, finish, otherwise change step S10, receive data fragmentation request message from reciprocity terminal equipment 2.
Preferably, the number of times that is requested of each page regularly resets to zero, is requested situation about downloading to show it in real time in a period of time.
In the embodiment of a variation, also can walk abreast between the step of the step of the transmission data fragmentation of step S137 and a plurality of data fragmentations of looking ahead of S131 to S136.When also soon the page at target burst place and relative one or more page will read in buffer memory from disk, requested target data burst is sent to reciprocity terminal equipment 2.Order herein only is an example.
Second embodiment
Below, with reference to Fig. 3 the second embodiment of the present invention is described, wherein, identical with similar Reference numeral is represented identical and the similar methods step.
At first, carry out initialization to system.Initialization n, n are the threshold value that algorithm is used, the page number that the expression algorithm can be investigated, and the page that algorithm can be investigated is the continuous page before the page under the data fragmentation of request.
Initialization n 1And n 2, n 1Be the burst number that a page comprises, n 2It is a number of pages that piece comprises;
After having finished above-mentioned initialized step, system begins the request of deal with data burst, as shown in Figure 3.Fig. 3 has described the systems approach figure that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the terminal equipment based on the point-to-point transmission agreement.
In step S10 ', the data fragmentation request message that terminal equipment 1 receives from reciprocity terminal equipment 2.This data fragmentation request message comprises the indication information of the data fragmentation of being asked necessarily, as identification information (ID) of this data fragmentation etc., in addition, the destination address (address of terminal equipment 1) and the source address (address of reciprocity terminal equipment 2) that also should comprise this data fragmentation request message in this data fragmentation request message are so that terminal equipment 1 sends to the data fragmentation of being asked in the reciprocity terminal equipment 2 according to the source address that comprises in this data fragmentation request message.
Terminal equipment 1 is behind the data fragmentation request message that receives from reciprocity terminal equipment 2, in step S11 ', terminal equipment 1 is judged the data fragmentation that whether comprises in second memory device that this data fragmentation request message is asked according to this data fragmentation request message.Further, second memory device comprises access speed very fast but the limited memory of memory capacity, for example buffer memory.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as second memory device with buffer memory below.
Particularly, terminal equipment 1 can obtain page number (representing with PageID) under the data fragmentation that reciprocity terminal equipment 2 asked by mapping table etc., and judges that according to this PageID this page is whether in buffer memory.Further, each page (promptly, the burst set) a unique page number is all arranged, each burst in each page all has a unique burst numbering, also promptly, in same multi-medium data, the numbering of the page and the numbering of burst all are unique, but a plurality of bursts can belong to a page.Preferably, store a mapping table in the terminal equipment 1, stored the corresponding relation of the burst and the page in this mapping table.In the present embodiment, according to the number order of burst, adjacent per 12 continuous bursts are divided into a page.
If among the step S11 ', judged result is to comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, and then the data fragmentation that will ask of terminal equipment 1 sends to the reciprocity terminal equipment 2 of described request.
If among the step S11 ', judged result is not comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, then enter step S13 ', all data fragmentations in the page at the data fragmentation place of being asked are read in the described buffer memory from first memory device, and the data fragmentation of being asked is sent to reciprocity terminal equipment 2.Further, first memory device comprises hard disk (being disk) or the slower high-capacity storage of other access speeds.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as first memory device with disk below.
In the embodiment of a variation, do not need in the system data burst paging, then step S10 ' initialized step before all can be omitted.
At step S11 ', terminal equipment directly judges that according to the identification information (ID) of the data fragmentation in this data fragmentation request message the ID of this data fragmentation is whether in buffer memory.
If among the step S11 ', judged result is not comprise the data fragmentation that described data fragmentation request message is asked in the buffer memory, then enters step S13 ', with continuous n before the target data burst of being asked and the target burst 3Continuous n after individual data burst and the target burst 4Individual data burst.N wherein 3And n 4Be that system is pre-configured, also can adjust according to the actual operation situation of system.
Fig. 5 shows experiment and uses P2P order video system client program, and promptly the ordinary node in the system is caught the real video request of data sequence that this node of data is received, and obtains experimental result according to this request sequence simulation.The video data request sequence has about 200,000 and about 50,000 two kinds of request of data scales, and corresponds respectively in VHI (promptly simultaneously online number more channel) and unexpected winner channel and catch request of data.
Method 1 (also promptly corresponding first embodiment) is according to historical record (also being the situation of the request of the one or more pages before the target pages), the target pages under the target data burst of being asked of looking ahead and the continuous page after a plurality of target pages; Method 2 (also promptly corresponding second embodiment) all bursts in the page under the data fragmentation that comprises request of only looking ahead.And all with LRU (Least Recently Used, least recently used algorithm, when the remaining free space of internal memory is not enough, buffering area keeps user's data of normal use as much as possible earlier, in other words be exactly preferential removing " data of Shi Yonging more seldom ", and discharge its space) as the buffer memory replacement policy.Amount has been used in effect analysis in addition: Hit Rate also is the cache hit rate of request sequence; Time of IO also is the IO time of hard disk.
Can obtain among Fig. 5, when cache size surpasses 30MB, the cache hit rate of method 1 is higher than the cache hit rate of method 2, analyze its reason and be because method 1 is carried out looking ahead of the page according to the historical visit information of the page, if the some pages in front of the page are also in buffer memory under the data fragmentation of request, then user's behavior is the continuous broadcast that does not drag on very big probability, so this page and subsequent page requested probability increase in following a period of time thereof.Therefore it is prefetched to the hit rate that can improve buffer memory in the buffer memory, saves the IO time of disk.The threshold value array a=4 that uses in the experiment, 4,4 ..., 4, the array of looking ahead b=1,1,1,1,1 .., 1.In the system of reality, can flexible definition threshold values array and the value of the array of looking ahead, to reach higher optimization effect.
But method 2 has its superiority under the little situation of buffer memory.Particularly, analysis chart 5 leading portions also are the size of buffer memory during less than 30MB, and the cache hit rate of method 1 is lower than method 2, this is because a large amount of pages that the forecasting method of method 1 reads in, and makes in the also not accessed buffer memory that just swapped out of these pages because spatial cache is too small.When fragment request arrived, the page at this segment place was not in buffer memory.
The result of Fig. 6 shows that when buffer memory was big, the IO time of method 1 reality had been saved IO number of disk effectively far below method 2.Among the figure, the unit of hard disk IO time is a millisecond, and the ordinate of the curve among the figure is represented the IO time sum of all 200,000 request of data.Analyze its reason, the operation of tracking belongs to mechanically actuated operation, occupies sizable ratio in the time in disk I, and this prefetch policy (method 1) has been saved the seek time in the disk I greatly, and then has saved the actual disk I time greatly;
Fig. 7 has then shown the situation of change of the cache hit rate of method 1 and method 2 in VHI and unexpected winner channel with cache size.Here can see the channel of sample whatsoever, when cache size during greater than 30MBytes the cache hit rate of method 1 all be better than method 2.According to the analysis of prior figures 6, can know that the IO time overhead of method 1 is better than method 2 equally.Shoot straight in the cold channel shown in the figure in addition in hot channel, reason is that the request sequence of the video data of cold channel has higher continuity, makes that the effect of looking ahead is more obvious.
According to above-mentioned analysis, because cache hit rate and hard disk IO time overhead directly influence user experience, provided by the present invention minute page buffer memory and the method for looking ahead according to historical visit information, no matter in VHI still at the unexpected winner channel when cache size is moderate, all can improve cache hit rate and hard disk IO time, thereby improve user experience.
The 3rd embodiment
Below, with reference to Fig. 8 and in conjunction with Fig. 1 each specific embodiment of a second aspect of the present invention is described, wherein, Fig. 3, Fig. 4 illustration are incorporated herein by reference.Each terminal equipment that it is example that generator 10 shown in Figure 8 is arranged in terminal equipment 1 shown in Figure 1 wherein, comprises receiving system 100, first judgment means 101, dispensing device 102 and reading device 103.
Fig. 2 shows according to a specific embodiment of the present invention, to the division of multimedia file.As shown in Figure 2, be that 265M is example (herein only being an example) with the size of multimedia file, then the size of the raw data file among Fig. 2 is 265M, and wherein, the size of raw data file is the size of this complete file.It will be appreciated by those skilled in the art that reciprocity terminal equipment 2 is a burst to the unit of terminal equipment 1 request msg, preferably, the size of burst can be 16K.In addition, the granularity of definition buffer memory access is the page (also being the burst set), and the page comprises integer number (n 1) burst, preferably, below to comprise 12 bursts with each page be that example describes, also, the size of the page is 192K (12 * 16K).In addition, be appreciated that the optimal value of the number of the data fragmentation that the page comprises in the different systems may be different, can change according to different systems.At last, the granularity of definition disk access is piece (block), and also, a complete multimedia file can be divided into some equal-sized according to the size of piece.Comprise integer number (n in the piece 2) the page.In Fig. 1, one of the big or small deficiency of the final stage data of raw data file, then when dividing this raw data file according to piece, last piece is a complete piece by piece with its polishing.
At first, first apparatus for initializing (not shown among Fig. 8) will carry out initialization to system.First apparatus for initializing is initialization n at first, and n is the threshold value that algorithm is used, the page number that the expression algorithm can be investigated, and the page that algorithm can be investigated is the continuous page before the page under the data fragmentation of request.
First apparatus for initializing n that reinitializes 1And n 2, n 1Be the burst number that a page comprises, n2 is a number of pages that piece comprises;
First apparatus for initializing is followed the threshold value array a of an initialization n element 1, a 2..., a n, wherein, the threshold value of the access count of the k page or leaf before the page or leaf of requested data fragmentation place is a k,
First apparatus for initializing is also wanted the array b that looks ahead of an initialization n element 1, b 2..., b n, wherein, surpass threshold value a as the number of times that is requested of the k page or leaf before the page or leaf of requested data fragmentation place k, then except that the target pages of requested data fragmentation place, b also should look ahead again kIndividual its continued page.
First apparatus for initializing is after having finished above-mentioned initialized step, and system begins the request of deal with data burst, as shown in Figure 8.Fig. 8 has described at the reciprocity terminal equipment 2 that is used to based on the terminal equipment 1 of point-to-point transmission agreement the device block diagram of generator of the data fragmentation of data file is provided.
At first, receiving system 100 receptions are from data fragmentation (target data burst) request message of reciprocity terminal equipment 2.This data fragmentation request message comprises the indication information of the data fragmentation of being asked necessarily, as identification information (ID) of this data fragmentation etc., in addition, the destination address (address of terminal equipment 1) and the source address (address of reciprocity terminal equipment 2) that also should comprise this data fragmentation request message in this data fragmentation request message are so that terminal equipment 1 sends in the reciprocity terminal equipment 2 according to the source address of this data fragmentation request message data fragmentation with request.
Receiving system 100 offers first judgment means 101 with this data fragmentation that receives after receiving from reciprocity terminal equipment 2 data fragmentation request messages.First judgment means 101 is judged the data fragmentation that whether comprises in second memory device that this data fragmentation request message is asked according to this data fragmentation request message.Further, second memory device comprises access speed very fast but the limited memory of memory capacity, for example buffer memory.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as second memory device with buffer memory below.
Particularly, first judgment means 101 also further comprises extraction element 1010 (not shown)s, is used for extracting the data fragmentation indication information from described data fragmentation request message.We understand, in the data fragmentation request message except the burst ID of designation data burst, also comprise the destination address (terminal equipment 1) and the source address (reciprocity terminal equipment 2) that also should comprise this request message, so need from the data fragmentation request message, extract data fragmentation indication information (as burst ID).Then, second judgment means 1011 can get access to the page number (representing with PageID) at this data fragmentation place of request by mapping table etc., and judge that according to this PageID this page is whether in buffer memory, further, each page (promptly, the burst set) a unique page number is all arranged, each burst in each page all has a unique burst numbering, also be, in same multi-medium data, the numbering of the page and the numbering of burst all are unique, and still, a plurality of bursts can belong to a page.Preferably, stored the corresponding relation of the burst and the page in the terminal equipment 1 in the mapping table of storage.In the present embodiment, according to the number order of burst, adjacent per 12 continuous bursts are divided into a page.
If second judgment means 1011 is judged the data fragmentation that comprises described data fragmentation request message in the described buffer memory and asked (also i.e. the page under this data fragmentation), then the data fragmentation that will ask of dispensing device 102 sends to the reciprocity terminal equipment 2 of described request, and the page at this data fragmentation place of asking is requested the number of times increase once.
If the judged result of second judgment means 1011 is not comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, then this second judgment means 1011 will send a triggering signal to reading device 103, promptly inform reading device 103, the information that does not have the data fragmentation of this request in the buffer memory, trigger reading device 103 this data fragmentation of asking and the one or more data fragmentations relevant with the data fragmentation of being asked are read in the described buffer memory from first memory device, and the data fragmentation of being asked is sent to reciprocity terminal equipment 2.Further, first memory device comprises hard disk (being disk) or the slower high-capacity storage of access speed.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as first memory device with disk below.
Particularly, with reference to figure 9, reading device 103 can also be divided into following sub-device, be respectively the 3rd judgment means 1030, the second apparatus for initializing 1031, the four judgment means 1032, second circulating device 1033, the 5th judgment means 1034, page writing station 1035, data fragmentation dispensing device 1036 and the 6th judgment means 1037.
At first the 3rd judgment means 1030 judges whether the data fragmentation of this request is stored in the hard disk.Usually, the resource of in LIST SERVER (tracker), having stored all the reciprocity terminal equipment IP address on this LIST SERVER, logined and port numbers and having had, therefore, by inquiring about to LIST SERVER, which reciprocity terminal equipment the reciprocity terminal equipment of request msg burst knows has the data fragmentation that it is asked.Equity terminal equipment 2 learns that by the query directory server terminal equipment 1 has the data fragmentation that it will be asked.But, do not get rid of such situation yet, be that terminal equipment 1 does not in time upgrade the situation that it has change in resources to LIST SERVER, be that terminal equipment 1 is not reported without delay the message that requested target burst has been wiped to LIST SERVER, and this burst request message this moment incoming terminal equipment 1, therefore, the 3rd judgment means 1030 does not search this target burst in the hard disk of terminal equipment 1, therefore abandon this secondary response, by the 6th judgment means (not shown), judge whether to log off again.
If when judging in the 3rd judgment means 1030 that this target burst is in hard disk, then terminal equipment 1 is read into the page (hereinafter to be referred as this page) at the data fragmentation place of being asked in the buffer memory, in addition, terminal equipment 1 also reads in continuous several pages (hereinafter to be referred as the follow-up page) after this page in the buffer memory together in advance.The page number of reading in advance is based on such hypothesis: if the requested number of times of the page (hereinafter to be referred as the previous page) before this page is a lot, then according to the continuity of user to the multimedia file broadcast, request also should have continuity to the data burst for it, then the requested probability of its follow-up page is also bigger, therefore how follow-up page is read in buffer memory as reading the page in advance.
Particularly, 1031 initialization of second apparatus for initializing look ahead the page number and will investigate which previous page.The initial number of reading the page in advance is 0 in the present embodiment, and the previous page that will investigate is the 1st page before this page, and its page number is PageID-i, i=1.For example, the page counter of looking ahead (representing with Sum) of number that sign can be read in advance the page be initialized as 0, will be used to identify the cycle counter (representing with i) that the page that will investigate belongs to which page of target pages front and be initialized as 1.
The 4th judgment means 1032 judges whether the number of the previous page of having investigated surpasses the algorithm threshold value n of examination page number then, and judge the 1st page before this page be requested whether number of times surpassed this previous page be requested frequency threshold value a 1Also promptly, judge whether to satisfy condition simultaneously i<n and condition C ounter PageID-iAi, wherein Counter PageID-iThe requested number of times (also promptly visiting the number of times of this page) of i the page that the expression target pages is previous.If two conditions satisfy simultaneously, then trigger second circulating device 1033.If two conditions do not satisfy simultaneously, then trigger the 5th judgment means 1034.
Wherein, the number of the page that will read in advance of second circulating device 1033 increases b 1, promptly the number of pages of the follow-up page of this page of looking ahead together with this page will increase b 1Page or leaf, wherein b 1Number of pages for the 1st page of pairing continued page that should look ahead before this page more.Also promptly, the page counter Sum=Sum+b that looks ahead 1Then, the previous page that setting will be investigated be numbered PageID-i, i=2 promptly investigates the 2nd page before this page, second apparatus for initializing 1031 restarts circulation, particularly:
If the result that the 4th judgment means 1032 is judged is: the number of the previous page of having investigated is no more than the algorithm threshold value n of examination page number, simultaneously the 2nd page before this page be requested that number of times surpasses this previous page be requested frequency threshold value a 2Then will the prestore number of pages of the page of second circulating device 1033 increases the number of pages b that looks ahead of the corresponding increase of the 2nd page institute before this page again 2, also the page number of promptly looking ahead this moment is b 1+ b 2, and the PageID-i that is numbered of the previous page that will investigate being set, i=3 promptly investigates the 3rd page before this page, gets back to step S132 and restarts circulation.The rest may be inferred, and the 4th judgment means 1032 and second circulating device 1033 repeat aforesaid operations, do not satisfy until the condition of the judgement of the 4th judgment means 1032, also promptly:
Judge when following two kinds of situations have a speciogenesis at least, just do not need second circulating device, 1033 executable operations, and trigger the 5th judgment means 1034.
A) number of pages of the previous page of Kao Chaing has surpassed the number of the page in the piece that algorithm will investigate, and also is i〉n;
B) number of times that is requested of the previous page that will investigate is requested the threshold value of number of times less than it, also is Counter PageID-i<a i
The number of pages of the 5th judgment means 1034 definite subsequent page that will read in advance, the scope of the subsequent page of wherein reading in advance is no more than the scope of the piece that has comprised target pages.Be divided into 2 kinds of situations:
I) if the number of pages of the page that prestores that goes out of aforementioned calculation less than the number of all pages in this piece behind this page, then the page number of reading in advance in page writing station 1035 is that the number of pages of the page that prestores that goes out of aforementioned calculation is b 1+ b 2+ ...+b kWherein k the page is the page of the access thresholds of this page setting for last the satisfied number of times that reads to this page before target pages has surpassed, for example, target pages is that PageID is 6, be the 6th page, then the 4th page before the target pages is the 2nd page, also be, the 3rd (the 3rd page before the target pages), the number of times that the 4th (the 2nd page before the target pages) and the 5th (the 1st page before the target pages) all satisfy its visit surpasses preset threshold, and the number of times of the visit of the 1st page (also being target pages the 5th page before) surpasses this threshold value.
Ii) if the number of pages of the page that prestores that goes out of aforementioned calculation greater than the number of all pages in this piece behind this page, the page of reading in advance in the page writing station 1035 for all pages behind this page in this piece, also be
Figure A200810034137D00221
Wherein
Figure A200810034137D00222
The integer part (also promptly rounding downwards) that this numerical value is got in expression can obtain the block identification at this target pages place.And
Figure A200810034137D00223
Obtain the numbering of last page in this page place piece, subtract each other with the numbering of described target pages, obtained the number of the page that can read in advance at most, for example, so that a data file is divided into a piece according to the size of 3Mb, and the size of the page is for comprising 12 bursts, and the size of a burst is 16k, then comprising 16 of the pages in each piece, also is n 2=16.The sequence number of supposing the page is that the order according to file begins number consecutively from top of file, for example, for a target pages be numbered 37, also be PageID=37, the numbering of this target pages place piece then
Figure A200810034137D00231
Be the piece under the target pages number,
Figure A200810034137D00232
The numbering of last page in the piece under obtaining in the target pages, then
Figure A200810034137D00233
Number for the page that can read in advance at most.
Page writing station 1035 is with the page under the requested date and at situation i) or ii) in the subsequent page of reading in advance that determines write in the buffer memory, and the number of times that is requested that will write each subsequent page of buffer memory increases progressively 1, represent that it has been requested once, then trigger data burst dispensing device 1036;
Data fragmentation dispensing device 1036 is sent to the reciprocity terminal equipment 2 of asking this data fragmentation according to the source address of data fragmentation request message with the data fragmentation of being asked, and triggers the 6th judgment means (not shown) then;
The 6th judgment means judges whether to log off, if finish the data fragmentation request message that receiving system 100 receives from reciprocity terminal equipment 2.
Preferably, the number of times that is requested of each page regularly resets to zero, is requested situation about downloading to show it in real time in a period of time.
In the embodiment of a variation, the step that the step of the transmission data fragmentation of data fragmentation dispensing device 1036 and being used to is looked ahead between the device of a plurality of data fragmentations also can walk abreast.When also soon the page at target burst place and relative one or more page will read in buffer memory from disk, requested target data burst is sent to reciprocity terminal equipment 2.Order herein only is an example.
The 4th embodiment
Below, with reference to Fig. 8 the second embodiment of the present invention is described, wherein, identical with similar Reference numeral is represented identical with similar device.
At first, the 3rd apparatus for initializing (not shown) will be carried out initialization to system.Wherein, the 3rd apparatus for initializing can be identical device with first apparatus for initializing, also can be different devices.The 3rd apparatus for initializing initialization n, n is the threshold value that algorithm is used, the page number that the expression algorithm can be investigated, the page that algorithm can be investigated is the continuous page before the page under the data fragmentation of request.
The 3rd apparatus for initializing is also wanted initialization n 1And n 2, n 1Be the burst number that a page comprises, n 2It is a number of pages that piece comprises;
After having finished above-mentioned initialized step, the 3rd apparatus for initializing begins the request of deal with data burst, as shown in Figure 8.Fig. 8 has described the device block diagram that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the terminal equipment based on the point-to-point transmission agreement.
The data fragmentation request message that receiving system 100 ' receives from reciprocity terminal equipment 2.This data fragmentation request message comprises the indication information of the data fragmentation of being asked necessarily, as identification information (ID) of this data fragmentation etc., in addition, the destination address (address of terminal equipment 1) and the source address (address of reciprocity terminal equipment 2) that also should comprise this data fragmentation request message in this data fragmentation request message are so that terminal equipment 1 sends to the data fragmentation of being asked in the reciprocity terminal equipment 2 according to the source address that comprises in this data fragmentation request message.
Receiving system 100 ' is behind the data fragmentation request message that receives from reciprocity terminal equipment 2, first judgment means 101 ' is judged the data fragmentation that whether comprises in second memory device that this data fragmentation request message is asked according to this data fragmentation request message.Further, second memory device comprises access speed very fast but the limited memory of memory capacity, for example buffer memory.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as second memory device with buffer memory below.
Particularly, first judgment means 101 ' can be obtained page number (representing with PageID) under the data fragmentation that reciprocity terminal equipment 2 asked by mapping table etc., and judges that according to this PageID this page is whether in buffer memory.Further, each page (promptly, the burst set) a unique page number is all arranged, each burst in each page all has a unique burst numbering, also promptly, in same multi-medium data, the numbering of the page and the numbering of burst all are unique, but a plurality of bursts can belong to a page.Preferably, store a mapping table in first judgment means 101 ', stored the corresponding relation of the burst and the page in this mapping table.In the present embodiment, according to the number order of burst, adjacent per 12 continuous bursts are divided into a page.
If first judgment means, 101 ' judged result is to comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, then the data fragmentation that will ask of dispensing device 102 ' sends to the reciprocity terminal equipment 2 of described request.
If first judgment means, 101 ' judged result is not comprise the data fragmentation that described data fragmentation request message asked (also i.e. the page under this data fragmentation) in the buffer memory, then reading device 103 ' reads in all data fragmentations in the page at the data fragmentation place of being asked the described buffer memory from first memory device, and the data fragmentation of being asked is sent to reciprocity terminal equipment 2.Further, first memory device comprises hard disk (being disk) or the slower high-capacity storage (Storage) of access speed.This is that those skilled in the art will be understood that, does not give unnecessary details at this.To be described technical scheme of the present invention as first memory device with disk below.
In the embodiment of a variation, do not need in the system data burst paging, then the performed step of the 3rd apparatus for initializing all can be omitted.
First judgment means 101 ' directly judges that according to the identification information (ID) of the data fragmentation in this data fragmentation request message the ID of this data fragmentation is whether in buffer memory.
If first judgment means, 101 ' judged result is not comprise the data fragmentation that described data fragmentation request message is asked in the buffer memory, then reading device 103 ' is with continuous n before the target data burst of being asked and the target burst 3Continuous n after individual data burst and the target burst 4Individual data burst.N wherein 3And n 4Be that system is pre-configured, also can adjust according to the actual operation situation of system.
Those of ordinary skill in the art will be understood that the invention is not restricted to the first, second, third and the 4th embodiment based on cellular logic topological structure and data fragmentation quantity based on point-to-point transmission shown in Figure 1, based on the cellular logic topological structure of point-to-point transmission and the situation of data fragmentation, method of the present invention is suitable equally for other.More than embodiments of the invention are described, but the present invention is not limited to specific system, method and apparatus, those skilled in that art can make various distortion or modification within the scope of the appended claims.

Claims (13)

1. method that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the terminal equipment based on the point-to-point transmission agreement wherein, may further comprise the steps:
A. receive data fragmentation request message from described other reciprocity terminal equipments;
B. according to described data fragmentation request message, judge the data fragmentation that whether comprises in second memory device that described data fragmentation request message is asked;
C. if comprise the data fragmentation of being asked in described second memory device, then this data fragmentation is sent to described other reciprocity terminal equipments;
D. if do not comprise the data fragmentation of being asked in described second memory device, then this data fragmentation of asking and the one or more data fragmentations relevant with the data fragmentation of being asked are read in described second memory device from first memory device, and the data fragmentation of being asked is sent to described other reciprocity terminal equipments.
2. method according to claim 1 is characterized in that, described data fragmentation request message comprises the indication information that is used to indicate the data fragmentation that described other reciprocity terminal equipments ask, and described step b is further comprising the steps of:
B1. from described data fragmentation request message, extract the data fragmentation indication information;
B2. according to described data fragmentation indication information, judge whether comprise the data fragmentation that described data fragmentation request message is asked in described second memory device.
3. method according to claim 2, it is characterized in that, described data file comprises the burst set of several pre-sizings, described steps d also comprises: if do not comprise the data fragmentation of being asked in described second memory device, then all data fragmentations in the set of the target burst under this data fragmentation of asking are read in described second memory device from described first memory device, and the data fragmentation of being asked sent to described other reciprocity terminal equipments
Wherein, the content of the data fragmentation in any two continuous burst set is mutually continuous in the set of the burst of described several pre-sizings.
4. method according to claim 3, it is characterized in that, described steps d also comprises: if do not comprise the data fragmentation of being asked in described second memory device, the historical visit information of continuous one or more bursts set before then gathering according to the described target burst in described second memory device, all data fragmentations in one or more burst set continuous after this target burst set and the set of this target burst are read in described second memory device from described first memory device, and the data fragmentation of being asked is sent to described other reciprocity terminal equipments.
5. method according to claim 4, it is characterized in that the historical visit information of the continuous one or more bursts set before gathering of the described target burst in described second memory device comprises that each interior data fragmentation of each burst set in these continuous one or more bursts set is for information about requested.
6. according to each described method in the claim 1 to 5, it is characterized in that described first memory device comprises hard disk, described second memory device comprises buffer memory.
7. generator that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the terminal equipment based on the point-to-point transmission agreement wherein, comprising:
Receiving system is used to receive the data fragmentation request message from described other reciprocity terminal equipments;
First judgment means is used for judging the data fragmentation that whether comprises in second memory device that described data fragmentation request message is asked according to described data fragmentation request message;
Dispensing device is used for then this data fragmentation being sent to described other reciprocity terminal equipments if described second memory device comprises the data fragmentation of being asked;
Reading device, be used for if described second memory device does not comprise the data fragmentation of being asked, then this data fragmentation of asking and the one or more data fragmentations relevant with the data fragmentation of being asked are read in described second memory device from first memory device, and the data fragmentation of being asked is sent to described other reciprocity terminal equipments.
8. generator according to claim 7 is characterized in that, described data fragmentation request message comprises the indication information that is used to indicate the data fragmentation that described other reciprocity terminal equipments ask, and described first judgment means also comprises:
Extraction element is used for extracting the data fragmentation indication information from described data fragmentation request message;
Second judgment means is used for according to described data fragmentation indication information, judges whether comprise the data fragmentation that described data fragmentation request message is asked in described second memory device.
9. generator according to claim 8, it is characterized in that, described data file comprises the burst set of several pre-sizings, described reading device also is used for: if described second memory device does not comprise the data fragmentation of being asked, then all data fragmentations in the set of the target burst under this data fragmentation of asking are read in described second memory device from described first memory device, and the data fragmentation of being asked sent to described other reciprocity terminal equipments
Wherein, the content of the data fragmentation in any two continuous burst set is mutually continuous in the set of the burst of described several pre-sizings.
10. generator according to claim 9, it is characterized in that, described reading device also is used for: if described second memory device does not comprise the data fragmentation of being asked, the historical visit information of continuous one or more bursts set before then gathering according to the described target burst in described second memory device, all data fragmentations in one or more burst set continuous after this target burst set and the set of this target burst are read in described second memory device from described first memory device, and the data fragmentation of being asked is sent to described other reciprocity terminal equipments.
11. generator according to claim 10, it is characterized in that the historical visit information of the continuous one or more bursts set before gathering of the described target burst in described second memory device comprises that each interior data fragmentation of each burst set in these continuous one or more bursts set is for information about requested.
12., it is characterized in that described first memory device comprises hard disk according to each described generator in the claim 7 to 11, described second memory device comprises buffer memory.
13. terminal equipment that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided based on the point-to-point transmission agreement, it is characterized in that, comprise each described generator that is used to other reciprocity terminal equipments that the data fragmentation of data file is provided in the claim 7 to 12.
CN2008100341373A 2008-02-29 2008-02-29 Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof Expired - Fee Related CN101521553B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2008100341373A CN101521553B (en) 2008-02-29 2008-02-29 Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2008100341373A CN101521553B (en) 2008-02-29 2008-02-29 Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof

Publications (2)

Publication Number Publication Date
CN101521553A true CN101521553A (en) 2009-09-02
CN101521553B CN101521553B (en) 2011-08-03

Family

ID=41081949

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2008100341373A Expired - Fee Related CN101521553B (en) 2008-02-29 2008-02-29 Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof

Country Status (1)

Country Link
CN (1) CN101521553B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075338A (en) * 2009-11-25 2011-05-25 突触计算机系统(上海)有限公司 Distributed network-based live broadcasting method and device
CN102111448A (en) * 2011-01-13 2011-06-29 华为技术有限公司 Data prefetching method of DHT memory system and node and system
CN102255866A (en) * 2010-05-17 2011-11-23 腾讯科技(深圳)有限公司 Method and device for downloading data
CN103077225A (en) * 2012-12-31 2013-05-01 华为技术有限公司 Data reading method, device and system
CN103188279A (en) * 2011-12-27 2013-07-03 中国电信股份有限公司 Method and device for downloading file from neighbor nodes through peer-to-peer network
CN104021034A (en) * 2014-06-24 2014-09-03 北京奇艺世纪科技有限公司 Task processing method and system
CN106802952A (en) * 2017-01-18 2017-06-06 广东睿江云计算股份有限公司 The processing method of mass data, extracting method and processing unit
CN109558386A (en) * 2018-11-26 2019-04-02 北京微播视界科技有限公司 A kind of caching method of client data, device, equipment and medium
CN110764708A (en) * 2019-10-25 2020-02-07 北京浪潮数据技术有限公司 Data reading method, device, equipment and storage medium
CN112261118A (en) * 2020-10-19 2021-01-22 腾讯科技(深圳)有限公司 Multimedia data anomaly detection method, terminal and server

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100450205C (en) * 2005-08-04 2009-01-07 华为技术有限公司 Method for realizing sectionalization domain service of called user terminal in idle state
CN100372283C (en) * 2005-10-28 2008-02-27 华为技术有限公司 Method and device for securing data block uniformly distributing in entire system in multiple point down loading
CN101094248A (en) * 2006-06-20 2007-12-26 腾讯科技(深圳)有限公司 Client end of playing back stream media
CN101094107A (en) * 2006-06-21 2007-12-26 北京网视天元信息技术有限公司 System and method for accurate measuring transmission effect of P2P stream media netwrok for video / audio programs

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102075338A (en) * 2009-11-25 2011-05-25 突触计算机系统(上海)有限公司 Distributed network-based live broadcasting method and device
CN102075338B (en) * 2009-11-25 2015-05-13 突触计算机系统(上海)有限公司 Distributed network-based live broadcasting method and device
CN102255866A (en) * 2010-05-17 2011-11-23 腾讯科技(深圳)有限公司 Method and device for downloading data
US8738861B2 (en) 2011-01-13 2014-05-27 Huawei Technologies Co., Ltd. Data prefetching method for distributed hash table DHT storage system, node, and system
CN102111448B (en) * 2011-01-13 2013-04-24 华为技术有限公司 Data prefetching method of DHT memory system and node and system
CN102111448A (en) * 2011-01-13 2011-06-29 华为技术有限公司 Data prefetching method of DHT memory system and node and system
CN103188279A (en) * 2011-12-27 2013-07-03 中国电信股份有限公司 Method and device for downloading file from neighbor nodes through peer-to-peer network
CN103188279B (en) * 2011-12-27 2016-06-01 中国电信股份有限公司 By the method and apparatus that peer-to-peer network downloads file from multiple neighbor nodes
CN103077225A (en) * 2012-12-31 2013-05-01 华为技术有限公司 Data reading method, device and system
CN104021034A (en) * 2014-06-24 2014-09-03 北京奇艺世纪科技有限公司 Task processing method and system
CN104021034B (en) * 2014-06-24 2017-12-08 上海众源网络有限公司 Task processing method and system
CN106802952A (en) * 2017-01-18 2017-06-06 广东睿江云计算股份有限公司 The processing method of mass data, extracting method and processing unit
CN109558386A (en) * 2018-11-26 2019-04-02 北京微播视界科技有限公司 A kind of caching method of client data, device, equipment and medium
CN110764708A (en) * 2019-10-25 2020-02-07 北京浪潮数据技术有限公司 Data reading method, device, equipment and storage medium
CN112261118A (en) * 2020-10-19 2021-01-22 腾讯科技(深圳)有限公司 Multimedia data anomaly detection method, terminal and server

Also Published As

Publication number Publication date
CN101521553B (en) 2011-08-03

Similar Documents

Publication Publication Date Title
CN101521553B (en) Method which is based on terminal equipment of point-to-point transmission protocol and used for providing data fragment of data file for other peer terminal equipment and device thereof
US11870871B2 (en) Methods and apparatus for serving content to customer devices based on dynamic content popularity
US11481657B2 (en) Content recommendation method, apparatus and system
CN106911780B (en) Service ID generation method, device and system
CN106888381B (en) A kind of data resource storage method and device
US20180026938A1 (en) Detection and scheduling method, device, and node of content delivery network
KR100791628B1 (en) Method for active controlling cache in mobile network system, Recording medium and System thereof
CN102523314B (en) Identify the method and apparatus of efficient destination server
EP2290912A1 (en) Content distributing method, service redirecting method and system, node device
US20190306234A1 (en) Network Node, Endpoint Node and Method of Receiving an Interest Message
CN105379295A (en) Streaming of segmented content
CN101800731B (en) Network transmission management server, network transmission management method and network transmission system
CN113452808B (en) Domain name resolution method, device, equipment and storage medium
US20200106852A1 (en) Cache data control method and device
CN114760482B (en) Live broadcast source returning method and device
CN103096126A (en) Method and system of collaborative type cache for video-on-demand service in collaborative type cache cluster
CN101110844B (en) Program fragment prefetching method and peer-to-peer network node
CN104822084A (en) Concurrent-stream-based rapid channel switching method of P2P real-time playing system
Wu et al. Reuse time based caching policy for video streaming
CN108521611B (en) Anti-jitter video data access method and computer equipment
CN105847867A (en) Multimedia live content piloting method and device
CN106470348B (en) Rating number statistical method and device
WO2018090315A1 (en) Data request processing method and cache system
CN110139125B (en) Video sharing method based on demand perception and resource caching in wireless mobile network
US10812837B2 (en) System and method for live service content handling with content storing servers caching popular content therein

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20110803