WO2011110042A1 - Web request scheduling method and system - Google Patents

Web request scheduling method and system Download PDF

Info

Publication number
WO2011110042A1
WO2011110042A1 PCT/CN2010/079740 CN2010079740W WO2011110042A1 WO 2011110042 A1 WO2011110042 A1 WO 2011110042A1 CN 2010079740 W CN2010079740 W CN 2010079740W WO 2011110042 A1 WO2011110042 A1 WO 2011110042A1
Authority
WO
WIPO (PCT)
Prior art keywords
file
cache
data
identification code
corresponding
Prior art date
Application number
PCT/CN2010/079740
Other languages
French (fr)
Chinese (zh)
Inventor
陈普
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to PCT/CN2010/079740 priority Critical patent/WO2011110042A1/en
Publication of WO2011110042A1 publication Critical patent/WO2011110042A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/957Browsing optimisation, e.g. caching or content distillation
    • G06F16/9574Browsing optimisation, e.g. caching or content distillation of access to content, e.g. by caching

Abstract

The present invention provides a Web request scheduling method and system. The method includes the following steps: analyzing the received Web request to obtain file path information, and transmitting the cache request carrying the file path information; obtaining the file identifier code corresponding to the file path information, obtaining and returning the cache data corresponding to the file identifier code, wherein, the correspondence between the file identifier code and the cache data is one to one. The embodiments of the present invention can improve cache utilization rate and reduce costs.

Description

Method and system for Web request scheduling

FIELD

The present invention relates to network communication technology, particularly to a method and system for scheduling a Web request. Background technique

In a complex network systems, multiple servers can be provided by the World Wide Web (Web) services, each server may have different functional orientation, such as cache server load balancing servers, Web servers, database servers, and so on. By abstraction, the Web request is forwarded by means of a plurality of forwarding, by the final treatment unit is processed on the server side. There may cache data forwarding unit and / or processing unit to increase access speed.

Based on existing programs in the cache is based on the Uniform Resource Locator (Uniform Resource Locator, URL) corresponding to the cache data, when the same two site system deployment in a distributed Web environment, and different access URL, this will cause the same system in the same two forwarding units or processing units actually caches the same data in duplicate. Observed from the system-wide perspective, for the same URL request, since selection on a processing algorithm forwarding unit may also cause the same URL (or a different URL, but consistent with the actual contents of the requested file) the request is forwarded to a different forwarding unit or processing unit,

The same cache data. SUMMARY

Embodiments of the present invention to provide a scheduling method and system for Web request to solve the prior art on the substance present in the same Web request for a corresponding resource wastage caused by multiple copies of the same data, improved cache utilization, reduced Web service cost environment.

Embodiment of the present invention provides a Web request scheduling method, comprising:

Parsing the received Web request to obtain the file path information, and the transmission buffer request carrying the information of the file path;

Acquiring the file path information corresponding to the file identification code, and returns the acquired file to the cache data corresponding to the identification code, wherein the code cache file data - corresponding relationship.

Embodiment of the present invention provides a Web request scheduling system, comprising:

Request processing module for parsing a received Web request to obtain the file path information, and the transmission buffer request carrying the information of the file path;

Local cache means for acquiring the file path information corresponding to the file identification code, and returns the acquired file to the cache data corresponding to the identification code, wherein the code cache file data - corresponding relationship.

Seen from the foregoing technical solutions, embodiments of the present invention is Web request scheduling method and system, the cache data corresponding to the unique identification code through each file can be made the same request to the substance with a Web cache data corresponding to the request, the cache can improve utilization rate, reduce the cost of Web services environment. BRIEF DESCRIPTION

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings will be described below as required in the embodiment, a brief introduction Apparently, the drawings in the following description are some embodiments of the present invention, for ordinary skill in the art, without any creative effort, and you can obtain other drawings based on these drawings.

The method of FIG. 1 a schematic flow of the first embodiment of the present invention;

Figure 2 corresponds to an embodiment of the system architecture of the present invention, FIG;

Figure 3 a schematic view of an embodiment of a shared cache configuration unit embodiment of the present invention;

FIG 4 embodiment corresponds to a system architecture of the present invention, Figure II;

FIG 5 is a schematic in two cases shared cache configuration unit embodiment of the present invention;

6 a second embodiment of a schematic flowchart of a method embodiment of the present invention;

7 a third embodiment of a schematic flowchart of a method embodiment of the present invention;

8 a fourth embodiment of a schematic flowchart of a method embodiment of the present invention; FIG. 9 is a schematic diagram of the present invention, internal processes embodiments shared cache unit in the embodiment; FIG. 10 is a schematic view of two embodiments of the present invention, internal processes shared cache unit in the embodiment;

FIG 11 is a schematic view of three embodiments of the present invention, internal processes shared cache unit in the embodiment;

FIG 12 a schematic view of fourth embodiment of the present invention, internal processes shared cache unit in the embodiment;

FIG 13 is a schematic view of the present invention, five embodiments of internal processes shared cache unit in the embodiment;

FIG 14 is a schematic view of six internal processes of the present invention in embodiments the shared cache unit in the embodiment;

Example 15 of the present embodiment of the invention the data cache, a schematic diagram of the correspondence relationship information file path, the file identification code. detailed description

Order that the invention object, technical solutions, and advantages of the embodiments more clearly below in conjunction with the present invention in the accompanying drawings, technical solutions in the embodiments will be apparent to the present invention, completely described, obviously, the described embodiments some embodiments of the present invention rather than all embodiments. Based on the embodiments of the present invention, all other embodiments of ordinary skill in the art without any creative effort shall fall within the scope of the present invention.

The method of the first embodiment of the process of FIG. 1 is a schematic view of the present invention, comprising:

Step 11: Web request for a Web scheduling system parses the received file path information acquisition request, and transmits the cache request carries information of the file path;

Step 12: Web request scheduling system acquires file identification code corresponding to the file path information, and returns the acquired file to the cache data corresponding to the identification code, wherein the code cache file data - corresponding relationship.

This embodiment corresponds to a unique identification code for each file cached data can be made on the substance of the same with a Web cache data corresponding to the request, can improve cache utilization, cost reduction Lambda good Web service environment.

Figure 2 corresponds to an embodiment of the system architecture of the present invention, FIG, comprising forwarding unit / processing unit 21, file metadata storage unit 22, buffer unit 23, and shared file system 24, the forwarding unit / processing unit 21 includes a request processing module 211, and local cache module 212. The interface between the local cache module 211 and the request processing module 212 is H2 interface, the interface 22 between the module 212 and the local cache file metadata storage unit F1 is an interface, the interface 23 between the buffer module 212 and the local shared cache unit T1 interface, an interface 24 between the unit 23 and the shared cache F2 file system interface, the interface between the file metadata storage unit 23 and the shared cache unit 22 is an interface F1.

Among them, the request processing module 211 is responsible for parsing Web requests, for example, parse URL, the request class. After parsing the query request via interface H2 Web request corresponds to the cache data, the cache memory data corresponding to the data file may be, byte code script file or a script file parsing. Which means that the script uses scripting language programs, such as PHP, Ruby and other program languages.

Local cache data cache module 212 is a lookup engine, the prior art local cache module 212 is stored in the correspondence relation file cache data path information, e.g., URL correspondence relation with cache data, and by the correspondence URL query to get the corresponding cache data. Embodiments of the present invention, the local cache module 212 also needs to be saved corresponding relationship between the file identification code with cache data, file identifiers uniquely representative of the contents of files, e.g. md5 value document. Further, the embodiment of the present invention, only one copy of each file identification code corresponding to the cached data.

Request processing module 211 and a local cache module 212 may be an internal interface between H2 communication, e.g., a request processing module 211 receives the Web request, send a request to the local cache buffer module 212, and carries the file path information cache type, buffer type refers to a cache data request is the file cache or script cache, if the cache data corresponding local cache module 212, can be returned to the requesting processing module 211 by H2 the interface; if the local cache module 212 not corresponding to the cached data, from the shared memory unit 23 acquires the data cache and returned to the requesting processing module 211, T1 remote interface communication interface through the T1 interface.

File metadata storage unit 22 stores all the Web application refers file metadata storage unit, metadata in the metadata storage unit needs to contain the file information, file information including but not limited to file identifiers, file path information. File identification code uniquely identifies a document, such as file md5 value. File metadata storage unit 22 via the interface opening F1 metadata query interface. F1 can use the interface 22 by the file path information stored in the metadata storage unit and the file path information file corresponding relationship between the file metadata query to the file identification code.

Shared cache unit 23 independently of the forwarding unit / processing unit 21 to provide a shared cache memory, and cache query opening through the T1 interface. Upon receiving the query request buffer, the shared cache if the cache data unit 23 does not exist on the shared buffer unit 23 can read data from the file system via interfaces F2; ​​buffer for script, script files can be acquired in the file system after compiled get the script cache. Shared cache unit 23 queries supplied by the file path information or the file identification code way cache data, the cache file may be provided, the structure of the cache memory cache or the bytecode script compiler.

Figure 3 a schematic view of an embodiment of a shared cache configuration unit embodiment of the present invention, including file cache module 31, a script buffer module 32 and the script engine module 33. In the shared buffer unit may be an interface shown in FIG. 2 T1 T1.1 and T1.2 decomposed into two interfaces, T1.1 corresponds to the interface file cache read request, T 1.2 Script cache read request corresponding to the interface. Of course, T 1.1 interfaces may be combined with T 1.2 interfaces, increasing the types of input parameters acquired by the cache, and then respectively processed by the internal scheduling module.

Among them, the file cache module 31 is responsible for the file type cache operation, upon receipt of the file cache when a file by file path information or carry identification code parameters, file caching module will check whether it has cached the corresponding data, if there is a return data, judging method is: through cache request by the file path if the file path information can not be queried, through F1 Interface query file identification code, then the query code through the file if the file identification code corresponding to the data cache, while the file path information and / or document identifiers corresponding relationship to cached data will be cached, if cached data can not be acquired by the file path information, and file identification code, the file F2 caching module 31 via the interface 24 to obtain data to the file system, a file from system 24 can obtain data from the file cache 31 caching module to cache query for next time.

Script cache buffer read request by the script and script engine module 32 together to complete the processing module 33, a script buffer module 32 receives the read request cache script, the script queries to whether there is a cache. Wherein, similar to a file cache, the cache read request script in the script file may carry path information or the file identification code. When the query cache, the cache can be similar to a file, you can code the query cache data or file by file path information, and the establishment of the file path information, correspondence between the code and the file cache data. If there is cached data will be returned, if not, the script buffer module 32 through N1 script engine module 33 reads the request and compile the script file. When the script engine module 33 receives N1 interface calls the script file read by the interface F2, compiler will read the script files, and script data compiled cache module 32 returns to the script, the script data can be compiled by a script cache module 32 is cached for the next cache query.

FIG 4 is a schematic diagram of a system architecture embodiment corresponding to FIG. 5 is a schematic of two embodiments two shared cache configuration unit embodiment of the present invention invention. FIG 2-3 except that the file identification code calculation module 41, a file 51 instead of the metadata storage unit, a file identification code calculation module for calculating the code cache data file, for example file cache data code MD5 value. Using the file identification code calculation module calculates a file in the file cache after the contents of an example, the local cache module can not find the cache data corresponding to the file based on the file path information is acquired to the file system file data, file data acquired code. Establishing a data cache file identifiers and the correspondence between file path information of the file cache data caching module. If a subsequent request file identifiers found in the calculated cache module already exists, the file path and the direct relationship existing cache data, the cache without the need to copy the same data. The remaining modules function as defined above, is omitted.

Will be shown below in FIG. 2 or FIG. 3 an example of a configuration diagram of an embodiment of the present invention, the structure shown in FIGS. 4-5 may refer to the implementation. Specific embodiments of the process of the present invention may refer to various specific embodiments The following embodiments.

Method 6 is a schematic flowchart of a second embodiment of the invention, the present embodiment the data to the local cache file of file information corresponding to the path as an example. Referring to Figure 6, the present embodiment includes:

Step 601: a request processing module receives a Web request.

Step 602: a request processing module for parsing Web request, acquires a corresponding file path information, and send the local cache module cache request carrying the file path information. Step 603: a local file path information caching module to query whether there is local cache data file.

Step 604: If the corresponding data exists in the file cache, the local cache module to the requesting data processing module returns the file cache.

Wherein the corresponding relationship between the local cache file path information stored in the module file cache data, by the correspondence relation, the query to the file cache can be carried in the request data cache file path information corresponding to whether or not there. Further, if there is a corresponding cache data file, the query may be returned to the file cache data.

The method of flow diagram illustrating a third embodiment of the present invention. FIG. 7, the present embodiment of the local cache file path information corresponding to the data file does not exist, but of file identification code corresponding to file cache data as an example. Referring to Figure 7, the present embodiment includes:

Step 701: a request processing module receives a Web request.

Step 702: a request processing module for parsing Web request, acquires a corresponding file path information, and send the local cache module cache request carrying the file path information.

Step 703: the local cache module file path information to query the local cache for file data.

Step 704: If the data corresponding to the file cache, the local cache file query module does not exist transmission code request carrying the file path information to the file metadata storage unit.

Step 705: the file metadata storage unit returns the file to the local cache module identification code.

Wherein the correspondence relation file metadata storage unit stored with the file path information of the file identification code, by the correspondence, the identification code can query the file to file path information file query request carries a code corresponding to.

Step 706: a local file cache module identification code query whether the local file cache data exists. Step 707: If the corresponding data exists in the file cache, the local cache module establishes a corresponding relationship between file path information file cache data.

Step 708: the local cache module to the requesting data processing module returns the file cache. Correspondence between the local cache module identification code and files saved in the file cache data, through the correspondence, you can query the data corresponding cache file if the file identification code exists. Further, if the cache data corresponding to the file exists, the file can be returned to the cache data. And, in order to obtain faster next time the file cache data, you can also establish correspondence between the file path information and data through the file cache file code.

The method of flow diagram of a fourth embodiment of the present invention 8, the present embodiment is not present in local cache data file information corresponding to the file path, the file does not exist corresponding to the code file cache data as an example. Referring to Figure 8, the present embodiment includes:

Step 801: a request processing module receives a Web request.

Step 802: a request processing module for parsing Web request, acquires a corresponding file path information, and send the local cache module cache request carrying the file path information.

Step 803: a local file path information caching module to query whether there is local cache data file.

Step 804: If the data corresponding to the file cache, the local cache file query module does not exist transmission code request carrying the file path information to the file metadata storage unit.

Step 805: the file metadata storage unit tank local cache module returns the file identification code.

Wherein the correspondence relation file metadata storage unit stored with the file path information of the file identification code, by the correspondence, the identification code can query the file to file path information file query request carries a code corresponding to.

Step 806: a local file cache module identification code query whether the local file cache data exists. Step 807: If the cache data corresponding to the file does not exist, the local caching query request to the transmission buffer module shared cache unit, the file path information or the file carrying an identification code.

Step 808: the shared cache unit to perform internal processes, obtain the file cache data.

Specifically see Example 9-15 shown in FIG.

Step 809: the shared buffer unit acquires the file cache data back to the local cache module. Step 810: establishing a corresponding relationship local cache module and the correspondence between the file identification code with a data file cache file cache file path information and data.

Step 811: the local cache module to the requesting data processing module returns the file cache.

FIG 9 is a schematic diagram of the present invention, internal processes shared cache unit embodiment embodiment, the present embodiment to obtain the file cache and the data cache of file information corresponding to the file path Example. Referring to Figure 9, the present embodiment includes:

Step 901: Send a local cache module to the module file cache file cache read request, carries the file path information.

Step 902: the file cache file cache module queries the data file path information corresponding to whether or not exist locally.

Step 903: If there is, the file cache module returns the file to the local cache data corresponding to the cache module.

Wherein the corresponding relationship between the file cache file path information stored in the module file cache data, by the correspondence relation, the query to the file cache can be carried in the request read file path information corresponding to whether the file cache data exists. Further, if there is a corresponding cache file data, file cache can return the data.

FIG 10 is a schematic view of two embodiments of the present invention, internal processes shared cache unit embodiment, the present embodiment to obtain the file path information corresponding to the data cache and there is no file cache Example. Referring to FIG. 10, the present embodiment includes:

Step 1001: the local cache file cache module sends the module file cache read request, carries the file path information.

Step 1002: File Cache File Cache module queries the data file path information corresponding to whether or not exist locally.

Step 1003: If the cache data corresponding to the file does not exist, the file cache file identification code module sends a query request carrying the information of the file path to the file metadata storage unit.

Step 1004: File metadata storage unit returns the file identification code to the file caching module.

Wherein the correspondence relation file metadata storage unit stored with the file path information of the file identification code, by the correspondence, the identification code can query the file to file path information file query request carries a code corresponding to.

Step 1005: File Cache module queries whether there is local cache data file corresponding to the file identification code.

Step 1006: If the cache data corresponding to the file exists, the file cache module establishes a corresponding relationship between file path information file cache data.

Step 1007: File Cache File Cache module returns data to a local cache block.

Correspondence between the file cache module identification code and save the file cache file data through the correspondence, you can query the data file to the file cache whether there is a corresponding code. Further, if the cache data corresponding to the file exists, the file can be returned to the cache data. And, in order to obtain faster next time the file cache data, you can also establish correspondence between the file path information and data through the file cache file code.

FIG 11 is a schematic view of three embodiments of the present invention, internal processes shared cache unit embodiment, the present embodiment to obtain the file path information corresponding to the document file does not exist and the cache data corresponding to the code data buffer and there is no file cache Example. Referring to Figure 11, the present embodiment includes:

Step 1101: the local cache file cache module sends the module file cache read request, carries the file path information.

Step 1102: File Cache File Cache module queries the data file path information corresponding to whether or not exist locally.

Step 1103: If the cache data corresponding to the file does not exist, the file cache file identification code module sends a query request carrying the information of the file path to the file metadata storage unit.

Step 1104: File metadata storage unit returns the file identification code to the file caching module.

Wherein the correspondence relation file metadata storage unit stored with the file path information of the file identification code, by the correspondence, the identification code can query the file to file path information file query request carries a code corresponding to.

Step 1105: The file identification code file caching module to query whether the local file cache data exists. Step 1106: If the cache data corresponding to the file does not exist, the file caching module sends a read request to the file system file data, file identification code carried.

Step 1107: the file system returns the file data corresponding to the file identification code to the file caching module.

Read file data or file cache module sends requests to the file system carries the file path information, the file system obtains the corresponding data file according to the file path information.

Step 1108: File data caching module file system returns the file cache, file path information to establish the correspondence between the file cache data file and the correspondence between the file identification code with cache data.

Step 1109: File Cache File Cache module returns data to a local cache block.

Illustrative embodiments of the internal processes of the shared cache embodiment shown in Fig. 9-11, is not limited to the above embodiments, but may be, transmitted to the document file cache module in the local cache read request buffer module carries both the file path information, the file identification code also carries this case, the corresponding step 1003-1004 no longer performed, whether there is a direct data file cache file based on the identification code carried in the query. Further, the above-mentioned documents may be carried in a file cache read request code, without carrying the file path information, then in step 902, 903, steps 1002-1004 and steps 1102-1104 need not be performed, directly in accordance with the query carried file data is cached files identification code exists.

Above is an example file cache, the cache data corresponding cache data file, the script will cache the following example, cache data corresponding cache data for the script.

FIG 12 a schematic view of fourth embodiment of the present invention, internal processes shared cache unit embodiment, the present embodiment and the cache for the presence of the script file path information corresponding to the script data cache Example. Referring to Figure 12, the present embodiment includes:

Step 1201: the local cache module transmits the script to the script buffer module cache read requests, carries the file path information.

Step 1202: Script cache module queries whether the existence of the local file path information corresponding script cache data. Step 1203: If there is, the script buffer cache module returns the script data corresponding to the local cache module.

Wherein a script corresponding relationship stored in the cache module script file path information cache data, by the correspondence relation, the query to the file cache can be carried in the request read file path information corresponding to whether there is a cache data script. Further, if the corresponding cache data exists script, the script may return the cached data.

FIG 13 is a schematic view of the present invention, five embodiments of internal processes shared cache unit embodiment, the present embodiment to obtain the script file path information corresponding to the cache the cache data and there is no script Example. Referring to Figure 13, the present embodiment includes:

Step 1301: the local cache module transmits the script to the script buffer module cache read requests, carries the file path information.

Step 1302: Script cache module queries whether the existence of the local file path information corresponding script cache data.

Step 1303: If the cache data corresponding to the script, the script is not present caching module sends a query request to the file identification code file metadata storage unit, carries the file path information.

Step 1304: File metadata storage unit returns the identification code to the script file cache module.

Wherein the correspondence relation file metadata storage unit stored with the file path information of the file identification code, by the correspondence, the identification code can query the file to file path information file query request carries a code corresponding to.

Step 1305: The script file cache module to query script code if the local cache data exists. Step 1306: If the script corresponding cache data exists, the script cache module establishes a correspondence between the file path information to the script cache data.

Step 1307: The script script cache module returns cached data to the local cache module.

Script cache module, save the file and script code corresponding relationship cache data, through the correspondence, you can check whether the corresponding cache data file script code exists. Further, if the corresponding cache data exists script, the script can be returned to the cache data. And, in order to obtain faster next time the script cache data, you can also establish a corresponding relationship with the script file path information cache data by file identification code.

FIG 14 is a schematic view of the present invention, six internal processes shared cache unit embodiment embodiment, the present embodiment to obtain the path information corresponding to the script file cache script file does not exist and the cache data corresponding to the script code and there is no cache data as an example. Referring to Figure 14, the present embodiment includes:

Step 1401: the local cache module transmits the script to the script buffer module cache read requests, carries the file path information.

Step 1402: Script cache module queries whether the existence of the local file path information corresponding script cache data.

Step 1403: If the cache data corresponding to the script, the script is not present caching module sends a query request to the file identification code file metadata storage unit, carries the file path information.

Step 1404: File metadata storage unit returns the identification code to the script file cache module.

Wherein the correspondence relation file metadata storage unit stored with the file path information of the file identification code, by the correspondence, the identification code can query the file to file path information file query request carries a code corresponding to.

Step 1405: The script file cache module to query script code if the local cache data exists. Step 1406: If the cache data corresponding to the script does not exist, cache module transmits the script to the script engine module compilation request, carrying the file path information.

Step 1407: The script engine module sends a read data request to the script file system, the file path carries information corresponding to the file identification code.

Step 1408: The file system data is returned to the script script engine module.

Step 1409: The script engine module compiles the script data.

It refers to compile the script into the data byte or script code data file parsed data may be representative of the memory structure of the script execution.

Step 1410: The script engine module returns data compiled script to script cache module.

Step 1411: The script script caching module caches compiled data, establish a corresponding relationship and the correspondence between the file and script code cache data file path information to the script cache data.

Step 1412: The script script cache module returns cached data to the local cache module.

Illustrative embodiments of the internal processes of the shared cache embodiment shown in FIG. 12-14, is not limited to the above embodiments, but may be, carries both the script file path information caching module sending the local cache file cache module to the read request, also bring it to the code, this time, corresponding steps 1303-1304 no longer need to perform, whether there is a script data directly from the cache file identification code carried by the query. Another Bu Xi, the above-mentioned documents may be carried in a file cache read request code, without carrying the file path information, then step 1202, 1203, steps 1302-1304 and steps 1402-1404 need to perform the query directly from script cache data files whether they carry the identification code exists.

In the above process, the data cache, the file path, the file identification code corresponding relationship may be found in FIG. 15, FIG. 15 embodiment of the present invention, the data cache, file path information, the file identification code corresponding relationship schematic, 15, assume cached data is datal, data2 ... dataN, file path information urll, url2 ... urlN, file identification code for the keyl, key2 ... keyN. Wherein the corresponding relationship can be obtained by lookup hash algorithm or other algorithms. Wherein the cached data is file identification code - the corresponding relationship, for example, keyl corresponding to data3, key3 correspond DATA3; cache data file path information or may be a many-to-many, or - a correspondence relationship, e.g., urll and are url2 correspondence data3.

It will be appreciated that the above-described methods and apparatus related features can refer to each other. Further, the above-described embodiments of the "first," "second," etc. are used to distinguish one embodiment, each do not represent embodiments ύ inferior.

Those of ordinary skill in the art will be understood: the hardware implementing the above method to complete all or part of the steps associated with embodiments may be implemented by program instructions, the program may be stored in a computer readable storage medium, the program, when executed, perform operations comprising the procedure of Example above method embodiments; the storage medium includes: any medium may store program code ROM, RAM, magnetic disk, or optical disk.

Finally, it should be noted that: the above embodiments are intended to illustrate the present invention, rather than limiting;. Although the embodiments of the present invention has been described in detail, those of ordinary skill in the art should be understood: that they may still to the technical solutions described in each embodiment to modify, or to some technical features equivalents; as such modifications or replacements do not cause the essence of corresponding technical solutions to depart from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

Rights request
A Web request scheduling method, comprising:
Parsing the received Web request to obtain the file path information, and the transmission buffer request carrying the information of the file path;
Acquiring the file path information corresponding to the file identification code, and returns the acquired file to the cache data corresponding to the identification code, wherein the code cache file data - corresponding relationship.
2. The method of claim 1, wherein said acquiring the file path information corresponding to the file identification code, comprising:
Local cache module sends file metadata storage unit query request code file, the information file query request carries the code file path; receiving the file metadata storage unit to return information corresponding to the file path and file identification code, the file metadata storage unit stored with the file path information corresponding relationship between the file identification code;
or,
Local cache module calculates a file identification code of the module from the acquired file identification code.
3. The method of claim 1 or claim 2, wherein the acquiring and returning the cache data corresponding to the file identification code, comprising:
If the local cache block is stored in the cache data corresponding to the file identification code, stored in the local cache data is returned.
4. The method of claim 1 or claim 2, wherein the acquiring and returning the cache data corresponding to the file identification code, comprising:
If the module is not stored in the local cache file has a code corresponding to the cached data, the transmission buffer to the shared buffer unit query request, the query request carries the cache file path information and / or document identifiers;
Receiving said shared cache unit returns information of the file path and / or file cache data corresponding to the identification code;
Returning the cached data, and establishing corresponding relationship between file path information and the correspondence between the data cache and the cache data code files.
5. The method as claimed in claim 4, characterized in that, further comprising:
Shared cache buffer unit receives the query request;
If the unit is not stored in the shared cache file path information corresponding to the cache data, obtaining the file identification code corresponding to the file path information;
If the shared cache unit is stored in the cache data corresponding to the file identification code is returned to the local cache block corresponding to the cache data, and the correspondence relation file path information and cache data.
6. The method as claimed in claim 4, characterized in that, further comprising:
Shared cache buffer unit receives the query request;
If the unit is not stored in the shared cache file path information corresponding to the cache data, obtaining the file identification code corresponding to the file path information;
If the unit is not stored in the shared cache and the cache data corresponding to the file identification code, and acquires from the file system cache data;
Shared cache unit returns the cache data corresponding to the local cache module, and establishing a correspondence relationship with the identification code and the correspondence between the file cache data file path information and cache data.
7. The method of claim 5 or claim 6, wherein the obtaining the file identification code corresponding to the file path information, comprising:
If the cache file query request carries an identification code from the cache query request to obtain the file identification code;
or,
If the cache file query request does not carry the identification code, the received document metadata storage unit based on the correspondence information and the file path and the file path information of the file identification code, the identification code acquired file;
or,
If the query request does not carry the cache file identifiers, file identification code calculation module from the acquired file identification code.
8. The method of claim 6, wherein the obtaining and caching data from the file system comprising:
If you want to get the file cache data, the shared cache block read request file data to the file system, the read file data request carries a file identification code; and receiving a data file according to the file system of the file identification code is returned ;
or,
If you want to get the script cache data, the cache module shared script data read request to the file system, the read script file data request carries identification code; and receiving the script data file according to the file system returns the identification code ; the data compiled script, script data compiled cache.
9. A Web request scheduling system, characterized by comprising:
Request processing module for parsing a received Web request to obtain the file path information, and the transmission buffer request carrying the information of the file path;
Local cache means for acquiring the file path information corresponding to the file identification code, and returns the acquired file to the cache data corresponding to the identification code, wherein the code cache file data - corresponding relationship.
10. The system of claim 9, characterized in that, further comprising:
File metadata storage unit, a file path information stored corresponding relationship between the file identification code; said module is configured to obtain a local cache file corresponding to the file identification code from the metadata storage unit according to the file path information.
11. The system according to claim 9, characterized in that, further comprising:
The file identification code calculation module calculates a file identification code is used;
The module is used to calculate the local cache file identification code of the module from the acquired file identification code.
12. The system of claim any one of claims 9-11, characterized in that said local cache module is configured to: if stored with the file identification code corresponding to the local cache data in the cache module, a local return data stored in the cache.
13. A system according to any one of claims 9-11, characterized in that, further comprising: a shared buffer unit, the identification code for the module returns the cached data to the local cache according to the file path information and / or file ;
The local cache module is configured to: if the local cache is not stored in the module has a cache data corresponding to the file identification code, sending a query request to the cache shared cache unit, said cache query request carries the file path information and / or document identifiers; the unit receiving the shared cache file path information and / or document identifiers corresponding to the return of cached data; returning the cached data, and the correspondence relation file cache data and code correspondence between file path information cache data.
14. The system according to claim 13, wherein,
The shared cache unit comprises: a file cache module for, if there is not stored with the file path information corresponding to the file cache data, the data file read request to the file system, the file read request carries data file identification code;
Said system further comprising: a file system for acquiring an identification code to the file cache module returns the corresponding cache data file according to the file.
15. The system of claim 13, wherein, said shared buffer unit comprises: a script cache module for, if cache data stored script file path corresponding to the information, to the local cache module the script returns the corresponding cache data.
16. The system according to claim 13, wherein,
The shared cache unit comprises: a script, and the script engine module cache module, said buffer module if no script stored with the file path of the script data corresponding to the cache, a request is sent to the script engine module compiled; the script script engine module sends a read request to the file system reads the script file request carries identification code;
Said system further comprising: a file system for acquiring an identification code to the script engine module returns the corresponding data according to the script file;
The script engine module is further configured to compile said script data; the script buffer module is further configured to receive and buffer data compiled script.
PCT/CN2010/079740 2010-12-14 2010-12-14 Web request scheduling method and system WO2011110042A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2010/079740 WO2011110042A1 (en) 2010-12-14 2010-12-14 Web request scheduling method and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2010800046912A CN102216930A (en) 2010-12-14 2010-12-14 Web request scheduling method and system
PCT/CN2010/079740 WO2011110042A1 (en) 2010-12-14 2010-12-14 Web request scheduling method and system

Publications (1)

Publication Number Publication Date
WO2011110042A1 true WO2011110042A1 (en) 2011-09-15

Family

ID=44562864

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2010/079740 WO2011110042A1 (en) 2010-12-14 2010-12-14 Web request scheduling method and system

Country Status (2)

Country Link
CN (1) CN102216930A (en)
WO (1) WO2011110042A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102929958A (en) * 2012-10-10 2013-02-13 无锡江南计算技术研究所 Metadata processing method, agenting and forwarding equipment, server and computing system
CN102970358B (en) * 2012-11-08 2016-06-15 百度在线网络技术(北京)有限公司 Local cache of the mobile client network disk control method and apparatus
CN105812839B (en) * 2014-12-31 2018-12-14 华为技术有限公司 Video stream data acquisition, the page data transmission method, system and network server

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1601526A (en) * 2003-09-23 2005-03-30 国际商业机器公司 Method and appts for searching within a computer network
CN1852170A (en) * 2006-03-21 2006-10-25 华为技术有限公司 Method and system for realizing apparatus management based on standard platform
CN101408899A (en) * 2008-11-21 2009-04-15 北京中企开源信息技术有限公司 Method and apparatus for switching website multiple data sources
US20090313241A1 (en) * 2008-06-16 2009-12-17 Cisco Technology, Inc. Seeding search engine crawlers using intercepted network traffic

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100591078C (en) * 2007-09-28 2010-02-17 北京金山软件有限公司;北京金山数字娱乐科技有限公司 A website buffering method and device
CN101719936A (en) * 2009-12-09 2010-06-02 成都市华为赛门铁克科技有限公司 Method, device and cache system for providing file downloading service

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1601526A (en) * 2003-09-23 2005-03-30 国际商业机器公司 Method and appts for searching within a computer network
CN1852170A (en) * 2006-03-21 2006-10-25 华为技术有限公司 Method and system for realizing apparatus management based on standard platform
US20090313241A1 (en) * 2008-06-16 2009-12-17 Cisco Technology, Inc. Seeding search engine crawlers using intercepted network traffic
CN101408899A (en) * 2008-11-21 2009-04-15 北京中企开源信息技术有限公司 Method and apparatus for switching website multiple data sources

Also Published As

Publication number Publication date
CN102216930A (en) 2011-10-12

Similar Documents

Publication Publication Date Title
US8166079B2 (en) Dynamic content assembly on edge-of-network servers in a content delivery network
US8312172B2 (en) Method and system for delta compression
US7024452B1 (en) Method and system for file-system based caching
US7899991B2 (en) Method and system for an extensible caching framework
US6748386B1 (en) System and method for automated construction of URL, cookie, and database query mapping
US6976090B2 (en) Differentiated content and application delivery via internet
US7827169B2 (en) Methods and systems for data processing
EP1277118B1 (en) A system and method to accelerate client/server interactions using predictive requests
EP2791819B1 (en) Content delivery network
US20080243992A1 (en) System and method for bandwidth optimization in a network storage environment
US20170337224A1 (en) Targeted Processing of Executable Requests Within A Hierarchically Indexed Distributed Database
US20130138763A1 (en) Systems and methods for caching and serving dynamic content
US20100125584A1 (en) Intelligent event query publish and subscribe system
US8352613B2 (en) Content management
US20100050072A1 (en) System and method for processing extensible markup language (xml) documents
CN101090401B (en) Data buffer store method and system at duster environment
US9210235B2 (en) Client side cache management
US20090204682A1 (en) Caching http request and response streams
US20040073549A1 (en) Query resolution system
US20020178259A1 (en) Load balancing content requests using dynamic document generation cost information
US20040068579A1 (en) System and method to refresh proxy cache server objects
US9456050B1 (en) Browser optimization through user history analysis
US7657595B2 (en) Method and system for generating auxiliary-server cache identifiers
US20140089460A1 (en) Unobtrusive methods and systems for collecting information transmitted over a network
US20030236857A1 (en) Network service system and program using data processing

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 201080004691.2

Country of ref document: CN

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 10847300

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 10847300

Country of ref document: EP

Kind code of ref document: A1