CN101662483A - Cache system for cloud computing system and method thereof - Google Patents
Cache system for cloud computing system and method thereof Download PDFInfo
- Publication number
- CN101662483A CN101662483A CN200810043744A CN200810043744A CN101662483A CN 101662483 A CN101662483 A CN 101662483A CN 200810043744 A CN200810043744 A CN 200810043744A CN 200810043744 A CN200810043744 A CN 200810043744A CN 101662483 A CN101662483 A CN 101662483A
- Authority
- CN
- China
- Prior art keywords
- task
- local node
- node
- buffer memory
- cloud computing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Computer And Data Communications (AREA)
Abstract
The invention discloses a cache system for a cloud computing network, which is arranged on each node of the cloud computing network and comprises a service module for receiving tasks transmitted fromother nodes and recording the types of the tasks which can be executed by a local node; a distributing module for distributing the tasks received by the local node to the local node to execute the tasks or forwarding the tasks to other nodes; a caching strategy module for recording the caching policies of various tasks, wherein the caching policies comprise a caching decision and a caching time; and a caching management module for managing the cache size of the local node, searching the task in a cache of the local node, and storing the task to the cache of the local node. The invention also discloses a caching method for the cloud computing system. The cache system for the cloud computing network and the method thereof establish a local cache system of each node in the cloud computing network, also utilize the cache system of a CDN network, so that the cloud computing can be performed faster and more efficient world wide, avoid the probability of each node to execute the same task repeatedly and also reduce the utilization of a network bandwidth greatly.
Description
Technical field
The present invention relates to a kind of caching system and method thereof of computer network.
Background technology
Cloud computing (Cloud Computing) is the development of Distributed Calculation (Distributed Computing), parallel computation (Parallel Computing) and grid computing (Grid Computing), its basic principle is to carry out for many computers by network allocation calculation task, and every computer is called a node of system for cloud computing.
In the existing system for cloud computing, each node does not have caching system, this means that node may carry out same task repeatedly.For example, the A node is received the calculation task of " 1+1 ", and the A node is finished this calculation task, and the A node returns result of calculation.The A node is received the calculation task of " 1+1 " again after a period of time, and the A node is finished this calculation task again, and the A node returns result of calculation again.This obviously is the wasting of resources to system for cloud computing.
Using the browser access world wide web (www) is one of the most basic application in the Internet.Nowadays, the World Wide Web (WWW) has become a ultra-large distributed system.In order to improve the access speed of this system, many network-cachings (Web Cache) technology is arisen at the historic moment, and what wherein have superiority most is exactly CDN (ContentDelivery Network, content distributing network) technology.
The principle of CDN network is that many CDN servers are set in the Internet, and when the user capture World Wide Web (WWW), ICP issues user's access request the fastest CDN server of response speed automatically, and whether the CDN server is checked in the buffer memory has the user to wish the page of visiting.If have, the CDN server is directly issued the user with this page.If no, the CDN server obtains this page and issues user and buffer memory.The CDN technology can allow the user and the fast access network nearby.Nowadays the ICP of countries in the world has disposed a large amount of CDN networks, but cloud computing does not but utilize the buffer memory characteristic of CDN network.
Summary of the invention
Technical problem to be solved by this invention provides a kind of caching system of cloud computing, and this system utilizes the buffer memory characteristic of CDN network, can reduce network usage, reduces each node load.For this reason, the present invention also will provide a kind of caching method of cloud computing.
For solving the problems of the technologies described above, the caching system of system for cloud computing of the present invention is deployed in each node of system for cloud computing, and described system comprises:
Service module receives the task that other nodes send, the task kind that the minute book ground node can be carried out;
Dispatch module is carried out the task assignment that local node receives to local node, perhaps be transmitted to other nodes;
The cache policy module writes down the cache policy of various tasks, and whether described cache policy comprises buffer memory, cache-time;
Caching management module, the cache size of management local node is searched task in the buffer memory of local node, task is saved in the buffer memory of local node.
The caching method of system for cloud computing of the present invention comprises the steps:
In the 1st step, the service module of local node receives the task that other nodes send with the http agreement;
In the 2nd step, can the dispatch module judgement local node of local node carry out this task;
If can, continued for the 3rd step;
If not, the dispatch module of local node is transmitted to other nodes with this task with the http agreement;
The 3rd step, the cache policy of this task of cache policy module searches of local node;
If this mission requirements buffer memory continued for the 4th step;
If this task is forbidden buffer memory, local node is carried out this task, and task result is returned the sending node of this task with the http agreement, the additional instruction of forbidding CDN buffer memory during return;
In the 4th step, the caching management module of local node is searched the buffer memory whether same task is arranged in the buffer memory of local node;
If have, the caching management module of local node is returned the sending node of this task with the buffered results of same task with the http agreement, the instruction of additional requirement CDN buffer memory during return;
If do not have, local node is carried out this task, and task is cached in the buffer memory of local node, also task result is returned the sending node of this task, the instruction of additional requirement CDN buffer memory during return.
The present invention has not only set up the local cache system of each node of system for cloud computing, but also utilized the caching system of CDN network, this can carry out cloud computing more efficiently worldwide sooner, has avoided each node may carry out same task repeatedly, can also significantly reduce network bandwidth utilization.
Description of drawings
The present invention is further detailed explanation below in conjunction with drawings and Examples:
Fig. 1 is the schematic diagram of the caching system of system for cloud computing of the present invention;
Fig. 2 is the schematic diagram of the caching method of system for cloud computing of the present invention.
Embodiment
See also Fig. 1, the caching system of system for cloud computing of the present invention is deployed in each node of system for cloud computing, and described system comprises:
Service module receives the task (comprising task kind and task parameters) that other nodes send, the task kind that the minute book ground node can be carried out;
Dispatch module is carried out the task assignment that local node receives to local node, perhaps be transmitted to other nodes;
The cache policy module writes down the cache policy of various tasks (especially local node can carry out various tasks), and whether described cache policy comprises buffer memory, cache-time;
Caching management module, the cache size of management local node is searched task in the buffer memory of local node, task is saved in the buffer memory of local node.
See also Fig. 2, the caching method of system for cloud computing of the present invention comprises the steps:
In the 1st step, the service module of local node receives the task (comprising task kind and task parameters) that other nodes send with the http agreement.
In the 2nd step, can the dispatch module judgement local node of local node carry out this task.Basis for estimation is the task kind that the local node that service module write down of local node can be carried out.
If can, continued for the 3rd step.
If not, the dispatch module of local node is transmitted to other nodes with this task (comprising task kind and task parameters) with the http agreement.
The 3rd step, the cache policy of this task of cache policy module searches of local node.Search according to the cache policy that is the various tasks that write down of the cache policy module of local node (especially local node can carry out various tasks).
If this mission requirements buffer memory continued for the 4th step.
If this task is forbidden buffer memory, local node is carried out this task, and task result is returned the sending node of this task with the http agreement, the additional instruction of forbidding CDN buffer memory during return.
In the 4th step, the caching management module of local node is searched the buffer memory whether same task (task of identical type and parameter) is arranged in the buffer memory of local node;
If have, the caching management module of local node is returned the sending node of this task with the task result buffer memory of same task with the http agreement, the instruction of additional requirement CDN buffer memory during return;
If do not have, local node is carried out this task, obtains task result, and task (comprising task kind, task parameters and task result) is cached in the buffer memory of local node, also task result is returned the sending node of this task, the instruction of additional requirement CDN buffer memory during return.
Task of the present invention includes task kind, parameter and result.For example in the task of " 1+1 ", the task kind is an addition, and parameter is two 1, and the result is 2.
In the method for the invention, task kind, parameter and result all transmit between each node of system for cloud computing in the http mode.Because the CDN network carries out buffer memory to the http data, so each task (comprising task kind, parameter and result) also can be by the CDN network-caching.When by the CDN network certain node being sent same task (task that the task kind is identical with parameter) in the short time, this task can not be sent to destination node, but just obtains task result at the CDN server.Like this, the present invention can significantly reduce the bandwidth usage of system for cloud computing, and can save the load that each node repeats work.
Additional requirement in the http data/forbid that the instruction of CDN buffer memory is a prior art, and unified technical specification is arranged, do not repeat them here.
Claims (7)
1. the caching system of a system for cloud computing, it is characterized in that: described system deployment is in each node of system for cloud computing, and described system comprises:
Service module receives the task that other nodes send, the task kind that the minute book ground node can be carried out;
Dispatch module is carried out the task assignment that local node receives to local node, perhaps be transmitted to other nodes;
The cache policy module writes down the cache policy of various tasks, and whether described cache policy comprises buffer memory, cache-time;
Caching management module, the cache size of management local node is searched task in the buffer memory of local node, task is saved in the buffer memory of local node.
2. the caching method of a system for cloud computing, it is characterized in that: described method comprises the steps:
In the 1st step, the service module of local node receives the task that other nodes send with the http agreement;
In the 2nd step, can the dispatch module judgement local node of local node carry out this task;
If can, continued for the 3rd step;
If not, the dispatch module of local node is transmitted to other nodes with this task with the http agreement;
The 3rd step, the cache policy of this task of cache policy module searches of local node;
If this mission requirements buffer memory continued for the 4th step;
If this task is forbidden buffer memory, local node is carried out this task, and task result is returned the sending node of this task with the http agreement, the additional instruction of forbidding CDN buffer memory during return;
In the 4th step, the caching management module of local node is searched the buffer memory whether same task is arranged in the buffer memory of local node;
If have, the caching management module of local node is returned the sending node of this task with the buffered results of same task with the http agreement, the instruction of additional requirement CDN buffer memory during return;
If do not have, local node is carried out this task, and task is cached in the buffer memory of local node, also task result is returned the sending node of this task, the instruction of additional requirement CDN buffer memory during return.
3. the caching method of system for cloud computing according to claim 2, it is characterized in that: described task includes task kind, parameter and result.
4. the caching method of system for cloud computing according to claim 3 is characterized in that: in the 1st step of described method, the service module of local node receives task kind and the parameter that other nodes send with the http agreement.
5. the caching method of system for cloud computing according to claim 3 is characterized in that: in the 2nd step of described method, if local network can not be carried out this task, the dispatch module of local node is transmitted to other nodes with this task kind and parameter with the http agreement.
6. the caching method of system for cloud computing according to claim 3, it is characterized in that: in the 4th step of described method, if the caching management module of local node can not find out the buffer memory of same task in the buffer memory of local node, local node is carried out this task, and with this task kind, parameter and result cache in the buffer memory of local node.
7. the caching method of system for cloud computing according to claim 3, it is characterized in that: described same task is meant the task with identical type and parameter.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810043744A CN101662483A (en) | 2008-08-28 | 2008-08-28 | Cache system for cloud computing system and method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200810043744A CN101662483A (en) | 2008-08-28 | 2008-08-28 | Cache system for cloud computing system and method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101662483A true CN101662483A (en) | 2010-03-03 |
Family
ID=41790269
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200810043744A Pending CN101662483A (en) | 2008-08-28 | 2008-08-28 | Cache system for cloud computing system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101662483A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101778005A (en) * | 2010-03-05 | 2010-07-14 | 中兴通讯股份有限公司 | Method and system for configuring complex network |
| CN101808012A (en) * | 2010-03-31 | 2010-08-18 | 重庆索伦互联网信息服务有限公司 | Data backup method in the cloud atmosphere |
| CN102065122A (en) * | 2010-11-11 | 2011-05-18 | 上海海事大学 | Ship network construction method based on radio frequency identification and cloud computing |
| CN102170476A (en) * | 2011-05-09 | 2011-08-31 | 中兴通讯股份有限公司 | Cloud computing method and device based on cloud node autonomic learning |
| CN102307206A (en) * | 2010-09-25 | 2012-01-04 | 广东电子工业研究院有限公司 | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage |
| CN102377809A (en) * | 2010-08-24 | 2012-03-14 | 鸿富锦精密工业（深圳）有限公司 | Method for reading data from cloud storage space by client |
| WO2012034273A1 (en) * | 2010-09-15 | 2012-03-22 | Empire Technology Development Llc | Task assignment in cloud computing environment |
| CN102413166A (en) * | 2011-09-22 | 2012-04-11 | 上海西本网络科技有限公司 | Distributed transaction method and system thereof |
| CN103226896A (en) * | 2013-03-22 | 2013-07-31 | 浙江工业大学 | Parking guidance system based on cloud platform and AGPS (Assisted Global Positioning System) |
| CN103516777A (en) * | 2012-06-18 | 2014-01-15 | 国际商业机器公司 | A method of provisioning in a cloud compute environment |
| CN103609060A (en) * | 2011-06-10 | 2014-02-26 | 华为技术有限公司 | Method for flexible data protection with dynamically authorized data receivers in a content network or in cloud storage and content delivery services |
| CN103886019A (en) * | 2014-02-21 | 2014-06-25 | 汉柏科技有限公司 | Method and system for improving multi-service query performance of cloud computing platform |
| WO2017185633A1 (en) * | 2016-04-25 | 2017-11-02 | 乐视控股（北京）有限公司 | Cdn server and data caching method thereof |
| CN108804214A (en) * | 2018-05-24 | 2018-11-13 | 阿里巴巴集团控股有限公司 | A kind of dispatching method of asynchronous task, device and electronic equipment |
| CN108875367A (en) * | 2018-06-13 | 2018-11-23 | 苏州若依玫信息技术有限公司 | A kind of cloud computing intelligent security system based on timing |
| CN109074282A (en) * | 2016-07-15 | 2018-12-21 | 惠普发展公司，有限责任合伙企业 | content management |
| CN110493315A (en) * | 2019-07-19 | 2019-11-22 | 视联动力信息技术股份有限公司 | A kind of call method and device of video communication link |
| CN111611077A (en) * | 2020-05-20 | 2020-09-01 | 北京字节跳动网络技术有限公司 | Task parameter processing method, terminal and storage medium |
| CN113244606A (en) * | 2021-05-13 | 2021-08-13 | 北京达佳互联信息技术有限公司 | Task processing method and device and related equipment |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030120867A1 (en) * | 2001-12-21 | 2003-06-26 | International Business Machines Corporation | Context-sensitive caching |
| US20030217113A1 (en) * | 2002-04-08 | 2003-11-20 | Microsoft Corporation | Caching techniques for streaming media |
| CN1783081A (en) * | 2004-11-30 | 2006-06-07 | 微软公司 | Method and system for caching remote files locally |
| CN101193294A (en) * | 2006-11-29 | 2008-06-04 | 中兴通讯股份有限公司 | A video content service system and service method |
| CN101222424A (en) * | 2007-12-24 | 2008-07-16 | 中国电信股份有限公司 | Content distribution network and scheduling method based on content in the network |
| CN101226542A (en) * | 2008-02-01 | 2008-07-23 | 中国建设银行股份有限公司 | Method for caching report |
-
2008
- 2008-08-28 CN CN200810043744A patent/CN101662483A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20030120867A1 (en) * | 2001-12-21 | 2003-06-26 | International Business Machines Corporation | Context-sensitive caching |
| US20030217113A1 (en) * | 2002-04-08 | 2003-11-20 | Microsoft Corporation | Caching techniques for streaming media |
| CN1783081A (en) * | 2004-11-30 | 2006-06-07 | 微软公司 | Method and system for caching remote files locally |
| CN101193294A (en) * | 2006-11-29 | 2008-06-04 | 中兴通讯股份有限公司 | A video content service system and service method |
| CN101222424A (en) * | 2007-12-24 | 2008-07-16 | 中国电信股份有限公司 | Content distribution network and scheduling method based on content in the network |
| CN101226542A (en) * | 2008-02-01 | 2008-07-23 | 中国建设银行股份有限公司 | Method for caching report |
Cited By (29)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101778005A (en) * | 2010-03-05 | 2010-07-14 | 中兴通讯股份有限公司 | Method and system for configuring complex network |
| CN101808012A (en) * | 2010-03-31 | 2010-08-18 | 重庆索伦互联网信息服务有限公司 | Data backup method in the cloud atmosphere |
| CN101808012B (en) * | 2010-03-31 | 2012-07-18 | 重庆索伦互联网信息服务有限公司 | Data backup method in the cloud atmosphere |
| CN102377809A (en) * | 2010-08-24 | 2012-03-14 | 鸿富锦精密工业（深圳）有限公司 | Method for reading data from cloud storage space by client |
| US8887169B2 (en) | 2010-09-15 | 2014-11-11 | Empire Technology Development Llc | Task assignment in cloud computing environment |
| WO2012034273A1 (en) * | 2010-09-15 | 2012-03-22 | Empire Technology Development Llc | Task assignment in cloud computing environment |
| CN102307206B (en) * | 2010-09-25 | 2014-10-01 | 广东电子工业研究院有限公司 | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage |
| CN102307206A (en) * | 2010-09-25 | 2012-01-04 | 广东电子工业研究院有限公司 | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage |
| CN102065122A (en) * | 2010-11-11 | 2011-05-18 | 上海海事大学 | Ship network construction method based on radio frequency identification and cloud computing |
| CN102170476A (en) * | 2011-05-09 | 2011-08-31 | 中兴通讯股份有限公司 | Cloud computing method and device based on cloud node autonomic learning |
| CN102170476B (en) * | 2011-05-09 | 2015-07-22 | 中兴通讯股份有限公司 | Cloud computing method and device based on cloud node autonomic learning |
| WO2012151802A1 (en) * | 2011-05-09 | 2012-11-15 | 中兴通讯股份有限公司 | Cloud computing method and device based on automatic learning of cloud node |
| CN103609060B (en) * | 2011-06-10 | 2017-06-13 | 华为技术有限公司 | Method for carrying out flexible data protection using the data sink of dynamic authorization in content network or in cloud storage service and content delivery services |
| CN103609060A (en) * | 2011-06-10 | 2014-02-26 | 华为技术有限公司 | Method for flexible data protection with dynamically authorized data receivers in a content network or in cloud storage and content delivery services |
| CN102413166A (en) * | 2011-09-22 | 2012-04-11 | 上海西本网络科技有限公司 | Distributed transaction method and system thereof |
| CN103516777A (en) * | 2012-06-18 | 2014-01-15 | 国际商业机器公司 | A method of provisioning in a cloud compute environment |
| CN103226896B (en) * | 2013-03-22 | 2015-10-07 | 浙江工业大学 | Based on the stopping guide system of cloud platform and AGPS |
| CN103226896A (en) * | 2013-03-22 | 2013-07-31 | 浙江工业大学 | Parking guidance system based on cloud platform and AGPS (Assisted Global Positioning System) |
| CN103886019A (en) * | 2014-02-21 | 2014-06-25 | 汉柏科技有限公司 | Method and system for improving multi-service query performance of cloud computing platform |
| WO2017185633A1 (en) * | 2016-04-25 | 2017-11-02 | 乐视控股（北京）有限公司 | Cdn server and data caching method thereof |
| CN109074282A (en) * | 2016-07-15 | 2018-12-21 | 惠普发展公司，有限责任合伙企业 | content management |
| CN108804214B (en) * | 2018-05-24 | 2022-04-12 | 创新先进技术有限公司 | Asynchronous task scheduling method and device and electronic equipment |
| CN108804214A (en) * | 2018-05-24 | 2018-11-13 | 阿里巴巴集团控股有限公司 | A kind of dispatching method of asynchronous task, device and electronic equipment |
| CN108875367A (en) * | 2018-06-13 | 2018-11-23 | 苏州若依玫信息技术有限公司 | A kind of cloud computing intelligent security system based on timing |
| CN110493315A (en) * | 2019-07-19 | 2019-11-22 | 视联动力信息技术股份有限公司 | A kind of call method and device of video communication link |
| CN110493315B (en) * | 2019-07-19 | 2022-06-14 | 视联动力信息技术股份有限公司 | Method and device for calling video communication link |
| CN111611077A (en) * | 2020-05-20 | 2020-09-01 | 北京字节跳动网络技术有限公司 | Task parameter processing method, terminal and storage medium |
| CN113244606A (en) * | 2021-05-13 | 2021-08-13 | 北京达佳互联信息技术有限公司 | Task processing method and device and related equipment |
| CN113244606B (en) * | 2021-05-13 | 2023-09-26 | 北京达佳互联信息技术有限公司 | Task processing method and device and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101662483A (en) | Cache system for cloud computing system and method thereof | |
| CN108027805B (en) | Load distribution in a data network | |
| Taneja et al. | Resource aware placement of data analytics platform in fog computing | |
| CN103338252B (en) | Realizing method of distributed database concurrence storage virtual request mechanism | |
| CN105450780A (en) | CDN system and source tracing method thereof | |
| CN102843426B (en) | Based on Web cache resources shared system and the method for intelligent father node | |
| CN107135268B (en) | Distributed task computing method based on information center network | |
| CN102394929A (en) | Conversation-oriented cloud computing load balancing system and method therefor | |
| CN102821113A (en) | Cache method and system | |
| CN102307206A (en) | Caching system and caching method for rapidly accessing virtual machine images based on cloud storage | |
| CN104935636A (en) | Network channel acceleration method and system | |
| CN107491320A (en) | Loading method and device based on mixed mode Mobile solution | |
| CN106230997A (en) | A kind of resource regulating method and device | |
| CN104836747A (en) | Network outbound load balancing method and system | |
| CN106331160A (en) | Data migration method and system | |
| CN102420863A (en) | Rapid file distribution system, method thereof and apparatus thereof | |
| CN106164888A (en) | The sequencing schemes of network and storage I/O request for minimizing interference between live load free time and live load | |
| Dimitrios et al. | Simulation and performance evaluation of a fog system | |
| CN104753922A (en) | Method for pre-loading, server side, client and system | |
| CN109327506A (en) | A kind of resource allocation methods, device and readable storage medium storing program for executing | |
| CN106330994A (en) | User message publishing method and system | |
| CN107633102A (en) | A kind of method, apparatus, system and equipment for reading metadata | |
| CN103731484B (en) | A kind of power save transmission method towards mobile cloud computing and middleware system | |
| CN103685576A (en) | Interaction method for CDN (Content Delivery Network) nodes and CDN management system | |
| CN101325499A (en) | Method, system and equipment for distributing static data |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20100303 |