CN102629946A - Method for decreasing energy consumption of cloud computing network transmission by using zero memory copy - Google Patents
Method for decreasing energy consumption of cloud computing network transmission by using zero memory copy Download PDFInfo
- Publication number
- CN102629946A CN102629946A CN2012101179541A CN201210117954A CN102629946A CN 102629946 A CN102629946 A CN 102629946A CN 2012101179541 A CN2012101179541 A CN 2012101179541A CN 201210117954 A CN201210117954 A CN 201210117954A CN 102629946 A CN102629946 A CN 102629946A
- Authority
- CN
- China
- Prior art keywords
- memory
- data
- zero
- region
- transmission
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention provides a method for decreasing energy consumption of cloud computing network transmission by using zero memory copy, belonging to the technical field of cloud computing platforms .The method comprises the steps : that users apply and assign memory area of transmission data as to network transmission of an application program in a clouding platform; that the memory areas are distributed dynamically through zero copy memory distribution functions; that data is directly transmitted from users ' memory areas to a network device through a zero copy module of an operating system to avoid superfluous copy of transmission data between a kernel and a user mode, to further decrease total time for network transmission; and that through a memory protection module in the operating system, copy-on-write is carried out while writing operation is carried out in the memory areas during the data transmission process, thereby protecting data integrity. The method can effectively improve network transmission efficiency of application programs in cloud computing platform and reduce unnecessary copy operations of transmission data, thereby decreasing total energy consumption of server system operation.
Description
Technical field
The invention belongs to the cloud computing platform technical field, be specifically related to a kind of method that reduces system for cloud computing transmission energy resource consumption.
Background technology
In recent years, along with the fast development of cloud computing, each major company has all released the server scale and has reached millions of large-scale data centers.These data centers are very high to the consumption of the energy, and the theme of this and the world today " low-carbon energy-saving environmental protection " has produced contradiction.Therefore, how when guaranteeing computer center's service ability, reduce its consumption as far as possible, become an important problem the energy.Therefore, the described power-economizing method of this patent can be accomplished the energy that server consumed under the prerequisite of identical calculations task through reduction, thereby contribute for energy-conservation cause.
Network data transmission is one of important operation of cloud computing platform.No matter be the user's service that moves in the cloud platform, or the operation of the maintenance and management of platform self, all can produce a large amount of Network Transmission.Therefore, network data transmission becomes the important component part of cloud platform energy consumption.In traditional network transmission process, the data of required transmission can repeatedly be duplicated in internal memory: at first be copied to the kernel process space from the user memory space, be copied to Device memory from the kernel process space again.Wherein, to duplicate be in order to guarantee that when the kernel transmission data, application program can not made amendment to data to previous internal memory; But it not is necessary that current internal memory duplicates.The present invention is through introducing " zero duplicates " technology of Network Transmission; Removed current extra internal memory copy operation; Thereby the redundancy that greatly reduces network data transmission is duplicated, and when improving performance, has also well reduced and has accomplished the spent energy of identical work.
Summary of the invention
The objective of the invention is to propose a kind of method that can make things convenient for, effectively reduce system for cloud computing transmission energy resource consumption.
The method of the reduction system for cloud computing transmission energy resource consumption that the present invention proposes is the redundancy memory copy operation when reducing network data transmission, improves the efficient of network data transmission, reduces the energy consumption of accomplishing transmission, thereby reduces server energy consumption.
Cardinal principle of the present invention is: the user specifies the datarams position that needs transmission, is labeled as " zero duplicates " zone, directly sends to the network equipment by operating system, thereby avoids duplicating from the data that are applied to kernel, avoids unnecessary energy consumption.Specifically: the first, by the zone of data in internal memory of user's appointment " zero duplicates " Network Transmission.The second, duplicate the region of memory that the distribution of memory management built-in function needs Network Transmission through zero.The 3rd, through the zero replication agent module in the operating system, directly data are transferred to the network equipment from user's internal memory.The 4th, through the zero copy data protection module in the operating system, thereby the user memory write operation in the data transmission procedure carried out the integrality of copy-on-write protected data.The 5th, through reducing unnecessary internal memory copy operation, effectively improve the efficient of network data transmission, the time of compression network transfer of data, thus reduce the server energy consumption of accomplishing equivalent workload.
The method of the reduction cloud computing platform energy resource consumption that the present invention proposes, concrete steps are:
The first, for the Network Transmission of cloud platform application program, use the region of memory of given transmission data by the user;
The second, duplicate memory management built-in function dynamic assigning memory zone through zero; This function is labeled as zero replication region with the region of memory that distributes;
The 3rd, through the zero replication agent module in the operating system, directly data are transferred to the network equipment from user's region of memory, avoid unnecessary duplicate of these transmission data between kernel and user's attitude, thus the overall time of minimizing Network Transmission;
The 4th, through the zero copy data protection module in the operating system, user's in the data transmission procedure internal memory write operation is carried out copy-on-write (Copy-on-write), thus the integrality of protected data.
The inventive method can effectively improve the efficient of network data transmission when guaranteeing data integrity, the time of compression network transfer of data, reduce the operand that invalid internal memory duplicates, thereby reduce the server energy consumption of accomplishing equivalent workload.
Of the present inventionly specifically be embodied as application programs, Memory Allocation storehouse and operating system and make amendment, the following steps of Network Transmission are optimized.The first, for application program, at first confirm to carry out the Data Position of Network Transmission, duplicate distribution and the reclaimer operation that the memory management built-in function carries out internal memory through calling zero, other internal memories that need not carry out Network Transmission then can be revised.The second, the zero memory management function that duplicates can be through specific parameter, this section of mark region of memory in operating system nucleus.The 3rd; When Network Transmission is carried out in user's application; Operating system at first changes memory-mapped into read-only, and directly data is sent to the network equipment from internal memory through DMA (Direct Memory Access), thereby has reduced from being applied to the copy operation of operating system.The 4th, when application program to just when the region of memory of DMA carries out write operation because that internal memory has been changed to is read-only, it is unusual therefore can to trigger hardware protection.Operating system is handled through copy-on-write (Copy-on-write) technology in abnormality processing function, thereby guarantees the correctness of internal memory write operation.
The people that this written explanation can make this technical field have common skill can use the embodiment that contains the alternative key element that is similar to the listed key element of claim.Therefore, this scope of invention comprises the identical method of the literal meaning with claim, and the literal meaning that also comprises other and claim does not have the method for essential distinction.Though only describe and explained Partial Feature and embodiment here, the basic skills of correlation technique can be carried out many modifications and variation.Accompanying claims will contain all such modifications and variation.
Description of drawings
Fig. 1 is the general frame and the data flow diagram of zero copy operation.
Fig. 2 is for concerning sketch map between contrast of network packet structure and data.
Fig. 3 is the overall flow sketch map of zero copy operation.
Embodiment
Below in conjunction with instance the present invention is further specified.
Current, many companies and mechanism all have large-scale data center, have disposed a large amount of webservers, and network data transmission is the operation of a key, and the frequency of generation is quite high.Therefore existing Network Transmission can not only reduce performance, and waste energy consumption with data from the application copy to the operating system nucleus.Especially when the service such as move of data center inside need be carried out a large amount of Network Transmission, this waste was more obvious.Therefore, through the present invention the energy consumption of network data transmission is optimized, from data center on the whole, the energy total amount that can practice thrift is considerable.
Application program is carried out the zero region of memory that duplicates for needs, uses zero to duplicate memory management built-in function storage allocation, and is as shown in Figure 1.This function is responsible for the region of memory that distributes is labeled as zero replication region.Operating system is not distributed concrete region of memory, and is only distributed corresponding network packet header when being the application assigned network packet, points to zero and duplicates the region of memory that internal memory distributes.Concrete structure is as shown in Figure 2.
The network protocol stack of operating system is when duplicating region of memory, and flow process is as shown in Figure 3: judge at first whether replication region is zero replication region, if not then according to normal flow, internal memory is sent to the network equipment after application copies to kernel; If then region of memory is set to read-onlyly, and sends the data to the network equipment, sends the write permission that will recover page after finishing, till constantly iteration to all data transmissions finish.If the write operation of user to region of memory taken place, then can trigger the unusual of hardware around here, operating system guarantees the correctness of write operation through the method for copy-on-write in abnormality processing function.
Claims (3)
1. one kind is utilized internal memory zero to duplicate the method that reduces system for cloud computing transmission energy resource consumption, it is characterized in that concrete steps are:
The first, for the Network Transmission of cloud platform application program, use the region of memory of given transmission data by the user;
The second, duplicate memory management built-in function dynamic assigning memory zone through zero; This function is labeled as zero replication region with the region of memory that distributes;
The 3rd, through the zero replication agent module in the operating system, directly data are transferred to the network equipment from user's region of memory, avoid unnecessary duplicate of these transmission data between kernel and user's attitude, thus the overall time of minimizing Network Transmission;
The 4th, through the memory protect module in the operating system, user's in the data transmission procedure internal memory write operation is carried out copy-on-write, thus the integrality of protected data.
2. the internal memory zero that utilizes according to claim 1 duplicates the method that reduces system for cloud computing transmission energy resource consumption; It is characterized in that operating system is for the application assigned network packet time; Do not distribute concrete region of memory; Only distribute corresponding network packet header, point to zero and duplicate the region of memory that internal memory distributes.
3. the internal memory zero that utilizes according to claim 1 duplicates the method that reduces system for cloud computing transmission energy resource consumption; The network protocol stack that it is characterized in that operating system is when duplicating region of memory; Judge at first whether replication region is zero replication region; If not, internal memory is sent to the network equipment after application copies to kernel then according to normal flow; If then region of memory is set to read-onlyly, and sends the data to the network equipment, sends the write permission that page is recovered in the back that finishes, till constantly iteration to all data are sent and finished; If the write operation of user to region of memory taken place, then trigger the unusual of hardware around here, operating system guarantees the correctness of write operation through the method for copy-on-write in abnormality processing function.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101179541A CN102629946A (en) | 2012-04-22 | 2012-04-22 | Method for decreasing energy consumption of cloud computing network transmission by using zero memory copy |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2012101179541A CN102629946A (en) | 2012-04-22 | 2012-04-22 | Method for decreasing energy consumption of cloud computing network transmission by using zero memory copy |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102629946A true CN102629946A (en) | 2012-08-08 |
Family
ID=46588105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2012101179541A Pending CN102629946A (en) | 2012-04-22 | 2012-04-22 | Method for decreasing energy consumption of cloud computing network transmission by using zero memory copy |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102629946A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103905553A (en) * | 2014-04-04 | 2014-07-02 | 江苏林洋电子股份有限公司 | Cloud architecture of energy efficiency management system and operation method thereof |
| CN108566444A (en) * | 2018-08-01 | 2018-09-21 | 长沙拓扑陆川新材料科技有限公司 | A kind of network transfer method and system of cloud service |
| WO2020119000A1 (en) * | 2018-12-10 | 2020-06-18 | Huawei Technologies Co., Ltd. | On-demand network-based replication agent |
| CN113157395A (en) * | 2021-04-20 | 2021-07-23 | 上海泓戟信息科技有限公司 | Method for optimizing computer memory data synchronization |
-
2012
- 2012-04-22 CN CN2012101179541A patent/CN102629946A/en active Pending
Non-Patent Citations (3)
| Title |
|---|
| 任睿智: "SAN存储资源管理系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
| 余胜生等: ""基于RDMA协议的零拷贝技术研究"", 《计算机工程与应用》 * |
| 孙春玲: "基于局域网的共享存储研究", 《中国优秀硕士学位论文全文数据库 信息科技辑》 * |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103905553A (en) * | 2014-04-04 | 2014-07-02 | 江苏林洋电子股份有限公司 | Cloud architecture of energy efficiency management system and operation method thereof |
| CN108566444A (en) * | 2018-08-01 | 2018-09-21 | 长沙拓扑陆川新材料科技有限公司 | A kind of network transfer method and system of cloud service |
| WO2020119000A1 (en) * | 2018-12-10 | 2020-06-18 | Huawei Technologies Co., Ltd. | On-demand network-based replication agent |
| US11451626B2 (en) | 2018-12-10 | 2022-09-20 | Huawei Technologies Co., Ltd. | On demand network-based replication agent |
| CN113157395A (en) * | 2021-04-20 | 2021-07-23 | 上海泓戟信息科技有限公司 | Method for optimizing computer memory data synchronization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101086714B (en) | System and method for remote mirroring operation | |
| Zhu et al. | Real-time tasks oriented energy-aware scheduling in virtualized clouds | |
| CN102142006B (en) | File processing method and device of distributed file system | |
| CN102917064B (en) | Based on the double hot standby method of privately owned cloud computing platform | |
| CN103970585A (en) | Method and device for creating virtual machine | |
| CN102136993B (en) | A kind of methods, devices and systems of Data Migration | |
| CN101091147A (en) | Methods and apparatus for power management in a computing system | |
| CN101369241A (en) | Cluster fault-tolerance system, apparatus and method | |
| CN102308274B (en) | Method, network card and hard disk card of accessing power-off hard disk | |
| CN102629946A (en) | Method for decreasing energy consumption of cloud computing network transmission by using zero memory copy | |
| CN104123171A (en) | Virtual machine migrating method and system based on NUMA architecture | |
| CN105103136A (en) | Shared and managed memory unified access | |
| CN102810184A (en) | Method and device for dynamically executing workflow and enterprise system | |
| CN101403966B (en) | Method for implementing portable software | |
| CN104937576A (en) | Coordinating replication of data stored in a non-volatile memory-based system | |
| CN104598293A (en) | Online snapshot method and equipment | |
| CN102467394A (en) | Method and system for realizing multi-core hot patching | |
| CN104572483A (en) | Device and method for management of dynamic memory | |
| Guo et al. | Efficient power management schemes for dual-processor fault-tolerant systems | |
| CN104850628A (en) | Data synchronization method and apparatus in database | |
| Egger et al. | Scratchpad memory management in a multitasking environment | |
| CN102750371B (en) | Parallel real-time database system and data management method thereof for power system | |
| CN104182280B (en) | Low-energy RM real-time task scheduling method for hybrid main memory embedded system | |
| CN102541654A (en) | Efficient memory management method and device | |
| CN102207907A (en) | Method and device for data operation and computer |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120808 |