CN114679456A - High-performance computing and HPC cloud computing system and resource management technical method thereof - Google Patents

High-performance computing and HPC cloud computing system and resource management technical method thereof Download PDF

Info

Publication number
CN114679456A
CN114679456A CN202210310114.0A CN202210310114A CN114679456A CN 114679456 A CN114679456 A CN 114679456A CN 202210310114 A CN202210310114 A CN 202210310114A CN 114679456 A CN114679456 A CN 114679456A
Authority
CN
China
Prior art keywords
computing
cloud computing
virtual
physical
hpc
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210310114.0A
Other languages
Chinese (zh)
Inventor
李健
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Blue Yun Polytron Technologies Inc
Original Assignee
Beijing Blue Yun Polytron Technologies Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Blue Yun Polytron Technologies Inc filed Critical Beijing Blue Yun Polytron Technologies Inc
Priority to CN202210310114.0A priority Critical patent/CN114679456A/en
Publication of CN114679456A publication Critical patent/CN114679456A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Mobile Radio Communication Systems (AREA)

Abstract

The invention discloses a high-performance computing and HPC (high-performance computing) cloud computing system and a resource management technical method thereof. The high-performance computing and HPC cloud computing system and the resource management technical method thereof have the advantages that the internal computing structure of the cloud computing center is simple, the computing node matching is simple, the resource management computing efficiency is high, the stability is high, and the large time delay is effectively avoided when the mobile client terminal receives the returned execution result from the cloud computing system.

Description

High-performance computing and HPC cloud computing system and resource management technical method thereof
Technical Field
The invention relates to the technical field of HPC cloud computing systems, in particular to a high-performance computing and HPC cloud computing system and a resource management technical method thereof.
Background
Cloud Computing (Cloud Computing) is a product of the convergence of traditional computer and network technology development, such as grid Computing, distributed Computing, parallel Computing, utility Computing, network storage, virtualization, load balancing, and the like. Many cloud computing deployments rely on computer clusters (but are quite different from the composition, architecture, purpose and working mode of grids), and also absorb the characteristics of autonomous computing and utility computing.
However, when the mobile client terminal executes the resource management operation through the cloud computing center, because the internal operation structure of the traditional cloud computing center is complex and the matching of the operation nodes is complex, the delay of the resource management operation is large, the stability is not high, and the mobile client terminal has a large time delay when receiving the returned execution result from the cloud computing system. Therefore, we improve this and propose a high performance computing and HPC cloud computing system and a resource management technique thereof.
Disclosure of Invention
In order to solve the technical problems, the invention provides the following technical scheme:
the invention discloses a high-performance computing and HPC (high-performance computing) cloud computing system which comprises a cloud computing center, wherein a data encryption module, a data storage module, a data transmission module and a data receiving module are arranged in the cloud computing center, the data encryption module, the data storage module, the data transmission module and the data receiving module can independently operate on data, a transmission end of the cloud computing center is provided with a service base station, a sharing end of the service base station is provided with a mobile client, and cloud computing data in the cloud computing center is subjected to data sharing with the mobile client through the service base station.
As a preferred technical solution of the present invention, the cloud computing center includes an HPC cloud computing system, a compute node processing unit, and a virtual server resource allocation unit, and the HPC cloud computing system, the compute node processing unit, and the virtual server resource allocation unit operate sequentially.
As a preferred technical solution of the present invention, a physical server node list is provided inside the HPC cloud computing system, and the physical server node list includes a plurality of physical server computing nodes for data analysis and computation.
As a preferred technical solution of the present invention, two parts of selecting a physical node calculation point and selecting a plurality of virtual calculation nodes are provided in the calculation node processing unit, and the two parts of selecting the physical node calculation point and selecting the plurality of virtual calculation nodes sequentially run.
As a preferred technical solution of the present invention, a plurality of virtual servers for processing data are arranged in the virtual server resource allocation unit, and the plurality of virtual servers are respectively matched with the selection of the plurality of virtual computing nodes.
A resource management technical method of a high-performance computing and HPC cloud computing system comprises the following steps:
s1, acquiring physical computing node parameters, namely acquiring the physical computing node parameters of the physical computing nodes from a node list of the HPC cloud computing system;
s2, selecting parameters of the physical computing nodes, and selecting the physical computing nodes meeting the resource demand parameters according to the parameters of the physical computing nodes;
s3, acquiring virtual computing node parameters, and acquiring virtual computing node parameters of virtual computing nodes in the selected physical computing nodes from the computing node list;
s4, selecting virtual computing node parameters, and selecting virtual computing nodes meeting the resource demand parameters according to the virtual computing node parameters;
and S5, matching the corresponding virtual server, and managing the resources by matching the corresponding virtual server with the virtual computing node parameters.
The invention has the beneficial effects that:
1. according to the high-performance computing and HPC cloud computing system and the resource management technical method thereof, the internal computing structure of the cloud computing center is simple, the matching of computing nodes is simple, the efficiency is high during resource management computing, the stability is high, and the large time delay is effectively avoided when the mobile client terminal receives the returned execution result from the cloud computing system;
2. according to the high-performance computing and HPC cloud computing system and the resource management technical method thereof, the physical computing node parameters of the physical computing nodes are obtained from the node list of the HPC cloud computing system, the physical computing nodes meeting the resource demand parameters are selected according to the physical computing node parameters, the parameter obtaining way is simple, and the efficiency is higher;
3. according to the high-performance computing and HPC cloud computing system and the resource management technical method thereof, resources are managed by matching the corresponding virtual servers through the virtual computing node parameters, and the management efficiency is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic diagram of a high performance computing and HPC cloud computing system according to the present invention;
FIG. 2 is a schematic diagram of an internal cloud computing center of a high performance computing and HPC cloud computing system according to the present invention;
FIG. 3 is a schematic diagram of a resource management technique for a high performance computing and HPC cloud computing system according to the present invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Example (b): as shown in fig. 1 to 3, the high performance computing and HPC cloud computing system includes a cloud computing center, a data encryption module, a data storage module, a data transmission module, and a data reception module are disposed inside the cloud computing center, the data encryption module, the data storage module, the data transmission module, and the data reception module can independently operate on data, a transmission end of the cloud computing center is provided with a service base station, a sharing end of the service base station is provided with a mobile client, and cloud computing data inside the cloud computing center is shared with the mobile client through the service base station.
The cloud computing center comprises an HPC cloud computing system, a computing node processing unit and a virtual server resource allocation unit, wherein the HPC cloud computing system, the computing node processing unit and the virtual server resource allocation unit run sequentially, the set HPC cloud computing system can preliminarily confirm the operated logic to ensure that the operated program can be confirmed, the set computing node processing unit can confirm the computing nodes of data, and the set virtual server resource allocation unit can match the confirmed computing nodes with the virtual nodes to ensure that the data operation efficiency is higher.
The HPC cloud computing system is internally provided with a physical server node list, the physical server node list comprises a plurality of physical server computing nodes used for data analysis and computation, and the source management data can be subjected to node acquisition through the plurality of physical server computing nodes, so that subsequent computation is facilitated.
The computing node processing unit is internally provided with two parts, namely a physical node computing point selection part and a plurality of virtual computing node selection parts, wherein the two parts, namely the physical node computing point selection part and the virtual computing node selection parts, operate sequentially, the physical computing node which meets the resource demand parameter can be selected according to the physical computing node parameter through the set physical node computing point selection, and the virtual computing node parameter of the virtual computing node in the selected physical computing node can be obtained from the computing node list through the plurality of virtual computing nodes.
The virtual server resource allocation unit is internally provided with a plurality of virtual servers for processing data, the plurality of virtual servers are respectively matched with the selection of the plurality of virtual computing nodes, and the plurality of virtual servers are respectively matched with the selection of the plurality of virtual computing nodes, so that the virtual servers corresponding to the virtual computing node parameters can be matched to manage resources.
A resource management technical method of a high performance computing and HPC cloud computing system comprises the following steps:
s1, acquiring physical computing node parameters, namely acquiring the physical computing node parameters of the physical computing nodes from a node list of the HPC cloud computing system;
s2, selecting parameters of the physical computing nodes, and selecting the physical computing nodes meeting the resource demand parameters according to the parameters of the physical computing nodes;
s3, acquiring virtual computing node parameters, and acquiring virtual computing node parameters of virtual computing nodes in the selected physical computing nodes from the computing node list;
s4, selecting virtual computing node parameters, and selecting virtual computing nodes meeting the resource demand parameters according to the virtual computing node parameters;
and S5, matching the corresponding virtual server, and managing the resources by matching the corresponding virtual server with the virtual computing node parameters.
The working principle is as follows: firstly, acquiring physical computing node parameters of physical computing nodes from a node list of an HPC (high-performance computing) cloud computing system, selecting the physical computing nodes meeting resource demand parameters according to the physical computing node parameters, then acquiring virtual computing node parameters of virtual computing nodes in the selected physical computing nodes from the computing node list, selecting the virtual computing nodes meeting the resource demand parameters according to the virtual computing node parameters, and managing resources by matching corresponding virtual servers according to the virtual computing node parameters; the internal operation structure of the cloud computing center is simple, operation node matching is simple, efficiency is high in resource management operation, stability is high, large time delay is effectively avoided when a mobile client terminal receives a returned execution result from a cloud computing system, physical computing node parameters of physical computing nodes are obtained from a node list of an HPC cloud computing system, the physical computing nodes meeting resource demand parameters are selected according to the physical computing node parameters, the parameter obtaining way is simple, and efficiency is high.
Finally, it should be noted that: in the description of the present invention, it should be noted that the terms "vertical", "upper", "lower", "horizontal", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the present invention and simplifying the description, but do not indicate or imply that the referred device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.
In the description of the present invention, it should also be noted that, unless otherwise explicitly specified or limited, the terms "disposed," "mounted," "connected," and "connected" are to be construed broadly and may, for example, be fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Although the present invention has been described in detail with reference to the foregoing embodiments, it will be apparent to those skilled in the art that modifications may be made to the embodiments described above, or equivalents may be substituted for elements thereof. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (6)

1. The utility model provides a high performance calculates and HPC cloud computing system, includes cloud computing center, its characterized in that, inside data encryption module, data storage module, data transmission module and the data receiving module of being provided with of cloud computing center, data encryption module data storage module data transmission module and data receiving module can carry out independent operation to data, cloud computing center's transmission end is provided with the service base station, the sharing end of service base station is provided with mobile client, the inside cloud computing data of cloud computing center passes through the service base station with mobile client carries out the data sharing.
2. The high performance computing and HPC cloud computing system of claim 1, wherein the cloud computing center comprises an HPC cloud computing system, compute node processing units, and virtual server resource allocation units, the HPC cloud computing system, the compute node processing units, and the virtual server resource allocation units running in sequence.
3. The high-performance computing and HPC cloud computing system of claim 2, wherein said HPC cloud computing system has a physical server node list disposed therein, said physical server node list comprising a plurality of physical server computing nodes for data analysis and computation.
4. The high-performance computing and HPC cloud computing system of claim 2, wherein said compute node processing units have two parts, a physical compute point selection and a plurality of virtual compute nodes selection, running sequentially.
5. The high-performance computing and HPC cloud computing system of claim 4, wherein said virtual server resource allocation unit has a plurality of virtual servers for processing data, and said plurality of virtual servers are respectively matched with a selection of said plurality of virtual computing nodes.
6. A resource management technical method for a high performance computing and HPC cloud computing system is characterized by comprising the following steps:
s1, acquiring physical computing node parameters, namely acquiring the physical computing node parameters of the physical computing nodes from a node list of the HPC cloud computing system;
s2, selecting parameters of the physical computing nodes, and selecting the physical computing nodes meeting the resource demand parameters according to the parameters of the physical computing nodes;
s3, acquiring virtual computing node parameters, and acquiring virtual computing node parameters of virtual computing nodes in the selected physical computing nodes from the computing node list;
s4, selecting virtual computing node parameters, and selecting virtual computing nodes meeting the resource demand parameters according to the virtual computing node parameters;
and S5, matching the corresponding virtual server, and managing the resources by matching the corresponding virtual server with the virtual computing node parameters.
CN202210310114.0A 2022-03-28 2022-03-28 High-performance computing and HPC cloud computing system and resource management technical method thereof Pending CN114679456A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210310114.0A CN114679456A (en) 2022-03-28 2022-03-28 High-performance computing and HPC cloud computing system and resource management technical method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210310114.0A CN114679456A (en) 2022-03-28 2022-03-28 High-performance computing and HPC cloud computing system and resource management technical method thereof

Publications (1)

Publication Number Publication Date
CN114679456A true CN114679456A (en) 2022-06-28

Family

ID=82077038

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210310114.0A Pending CN114679456A (en) 2022-03-28 2022-03-28 High-performance computing and HPC cloud computing system and resource management technical method thereof

Country Status (1)

Country Link
CN (1) CN114679456A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546741A (en) * 2011-08-31 2012-07-04 苏州华谷电子科技有限公司 Cloud computing system
CN102938790A (en) * 2012-11-20 2013-02-20 无锡城市云计算中心有限公司 Resource allocation method of cloud computing system
CN105812394A (en) * 2016-05-24 2016-07-27 王四春 Novel application of cloud computing to cross-border electronic commerce
CN105872013A (en) * 2016-03-08 2016-08-17 周口师范学院 Cloud computing system
CN108712499A (en) * 2018-05-25 2018-10-26 南京森林警察学院 Based on the system being managed to cloud computing service
CN110417868A (en) * 2019-07-02 2019-11-05 启东威艾信息技术有限公司 A kind of cloud computing system
US20210342193A1 (en) * 2020-04-29 2021-11-04 International Business Machines Corporation Multi-cluster container orchestration
US20220060431A1 (en) * 2020-08-21 2022-02-24 Kyndryl, Inc. Microservice placement in hybrid multi-cloud using graph matching

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102546741A (en) * 2011-08-31 2012-07-04 苏州华谷电子科技有限公司 Cloud computing system
CN102938790A (en) * 2012-11-20 2013-02-20 无锡城市云计算中心有限公司 Resource allocation method of cloud computing system
CN105872013A (en) * 2016-03-08 2016-08-17 周口师范学院 Cloud computing system
CN105812394A (en) * 2016-05-24 2016-07-27 王四春 Novel application of cloud computing to cross-border electronic commerce
CN108712499A (en) * 2018-05-25 2018-10-26 南京森林警察学院 Based on the system being managed to cloud computing service
CN110417868A (en) * 2019-07-02 2019-11-05 启东威艾信息技术有限公司 A kind of cloud computing system
US20210342193A1 (en) * 2020-04-29 2021-11-04 International Business Machines Corporation Multi-cluster container orchestration
US20220060431A1 (en) * 2020-08-21 2022-02-24 Kyndryl, Inc. Microservice placement in hybrid multi-cloud using graph matching

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
赵敏;邱秀荣;尹雪婷;: "云计算中的数据安全存储和加密模型的设计", 吉林工程技术师范学院学报, no. 02, pages 96 - 98 *

Similar Documents

Publication Publication Date Title
CN104598425B (en) A kind of general multiprocessing parallel calculation method and system
CN103560967B (en) The virtual data center mapping method of a kind of business demand perception
CN109189751A (en) Method of data synchronization and terminal device based on block chain
CN104468688A (en) Method and apparatus for network virtualization
CN104156216A (en) Heterogeneous storage management system and method oriented to cloud computing
CN103955509A (en) Quick search method for massive electric power metering data
CN112148484A (en) Micro-service online distribution method and system based on coupling degree
CN105162623B (en) A kind of cloud processing method and Cloud Server
CN102510403B (en) Receive and the cluster distributed system and method for real-time analysis for vehicle data
CN102427420B (en) Virtual network mapping method and device based on graph pattern matching
CN105282045B (en) A kind of distributed computing and storage method based on consistency hash algorithm
CN108259605B (en) Data calling system and method based on multiple data centers
Chen Design of computer big data processing system based on genetic algorithm
CN115802398A (en) Interference optimization method and device, storage medium and electronic equipment
CN108334410A (en) A kind of distributed application program client light weight method and computer equipment
CN114679456A (en) High-performance computing and HPC cloud computing system and resource management technical method thereof
CN114422455B (en) Multidimensional resource management architecture and method based on space-air-ground integrated network
CN111245878A (en) Method for computing and offloading communication network based on hybrid cloud computing and fog computing
CN104092731A (en) Cloud computing system
CN114936071A (en) Civil aircraft airborne distributed simulation system based on edge calculation
CN107341057A (en) A kind of data processing method and device
CN113872673A (en) Satellite constellation simulation container cloud resource scheduling system and scheduling method thereof
Lu et al. High-elasticity virtual cluster placement in multi-tenant cloud data centers
Niranjan et al. Energy optimization of an elastic computer cluster with a SDN controller
CN108632357A (en) A kind of data center network region partitioning method, device and equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination