CN111221623B - Mirror image library management system - Google Patents
Mirror image library management system Download PDFInfo
- Publication number
- CN111221623B CN111221623B CN201911364512.5A CN201911364512A CN111221623B CN 111221623 B CN111221623 B CN 111221623B CN 201911364512 A CN201911364512 A CN 201911364512A CN 111221623 B CN111221623 B CN 111221623B
- Authority
- CN
- China
- Prior art keywords
- mirror image
- image
- node
- library
- shared
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims description 5
- 238000012217 deletion Methods 0.000 claims description 3
- 230000037430 deletion Effects 0.000 claims description 3
- 230000001960 triggered effect Effects 0.000 claims description 3
- 238000000034 method Methods 0.000 claims description 2
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000007726 management method Methods 0.000 description 22
- 238000010586 diagram Methods 0.000 description 5
- 238000011161 development Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000011084 recovery Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000007711 solidification Methods 0.000 description 2
- 230000008023 solidification Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/4557—Distribution of virtual machine instances; Migration and load balancing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
- G06F9/45533—Hypervisors; Virtual machine monitors
- G06F9/45558—Hypervisor-specific management and integration aspects
- G06F2009/45595—Network integration; Enabling network access in virtual machine instances
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a mirror image library management system, which comprises: the shared storage node is used for storing all the images and comprises a first shared storage node and a second shared storage node; the plurality of computing nodes are connected to the first shared storage node, and local mirror image libraries of the plurality of computing nodes are all mounted in the first shared storage node; the load balancing nodes are connected with each computing node; the mirror image server is connected with the load balancing node and the second shared storage node; any one of the plurality of computing nodes obtains the mirror image on the mirror image server through the load balancing node, and the mirror image is stored in a local mirror image library of any one of the computing nodes. Through the technical scheme, the mirror image storage technology can be optimized, so that the storage space utilization rate of the cluster is improved.
Description
Technical Field
The invention relates to the technical field of computer clusters, in particular to a mirror image library management system.
Background
Some services or software are required to run on the server based on the operating system, and different operating system deployment modes and commands are different, so that the technology of comparison and modeling is that the deployment and release of the software is simplified through a Docker Container (Container) technology. The container technology not only eliminates the environmental difference of online and offline, but also facilitates the development, testing and release of application software. Development and testing personnel can directly deploy application software through mirroring, mirror image centers such as an Ari mirror image, a network mirror image, a speed cloud and the like are derived in the market at present besides Dockerhub, and most of the development and testing personnel have an acceleration effect on the downloading of the mirror image, but most of management modes in a mirror image warehouse are ignored, and the method of distributing rights of the mirror image warehouse according to different user levels and reasonably distributing and managing mirror image storage in the mirror image warehouse is a blank in the market at present.
The following problems exist in the conventional mirror image management method:
the prior art is mainly similar to a github management mode, only official images and user-defined images are distinguished, but no specific difference description exists for distinguishing the official images from the user-defined images, when a certain user selects a certain image in the images of the same type, various images exist in an image library, and the user cannot select which image is suitable for own scenes;
the user management of the existing mirror image library does not support the management of NIS users and system users, but manages the users only through a database mode, if an administrator adds the users in the background of the server, the newly added users cannot be automatically identified, and the users cannot obtain rights and use mirror images.
Disclosure of Invention
In view of the above problems in the related art, the present invention provides a mirror library management system, which can solve the above problems in the prior art.
The technical scheme of the invention is realized as follows:
according to one aspect of the present invention, there is provided a mirror library management system comprising:
the shared storage node is used for storing all the images and comprises a first shared storage node and a second shared storage node;
the plurality of computing nodes are connected to the first shared storage node, and local mirror image libraries of the plurality of computing nodes are all mounted in the first shared storage node;
the load balancing nodes are connected with each computing node;
the mirror image server is connected with the load balancing node and the second shared storage node;
any one of the plurality of computing nodes obtains the mirror image on the mirror image server through the load balancing node, and the mirror image is stored in a local mirror image library of any one of the computing nodes.
According to an embodiment of the invention, the administrator node has the authority to view and delete the images; the common user node has the authority of subscribing the mirror image to the mirror image in the shared library, and has the authority of sharing, subscribing, modifying and deleting the private mirror image of the common user node.
According to the embodiment of the invention, the user node selects the mirror image of the application scene by carrying out mirror image comparison through the Dockerfile file.
According to an embodiment of the invention, the user node performs the cure creation operation when running the mirror, and directly from the cure when the mirror is needed again.
According to the embodiment of the invention, the creator of the image performs the operation of deleting the image thoroughly.
According to the embodiment of the invention, when the user nodes want to share the mirror image, the sharing operation is performed so that all the user nodes view and subscribe to the shared mirror image.
According to the embodiment of the invention, when the administrator node performs the adding or deleting operation, the automatic synchronization operation and the mirror image garbage collection operation are triggered to perform corresponding synchronization processing and collection processing on the newly added mirror images or useless mirror images in the mirror image library.
According to the technical scheme, authority management is carried out on the mirror image library according to the License level and the user role of the user; the management mode of the mirror image library is designed, and users and roles with different authorities are explicitly allocated. The mirror image library supports operations such as query, addition, deletion, subscription mirror image and the like of the mirror images, when a user wants to store the mirror image content after modification, the mirror image library can be used for solidifying the mirror image operation, and when the user wants to share the mirror images, the mirror image library can also be shared among the users; the invention optimizes the mirror image storage technology, thereby improving the storage space utilization rate of the cluster. Therefore, on the premise of not affecting the mirror image content, the disaster recovery and load balancing are carried out on the mirror image library by mounting the mirror image library and the nodes in the shared storage, and the downloading speed and the hard disk utilization rate of the mirror image are improved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a mirrored library management system according to an embodiment of the invention;
FIG. 2 is a schematic diagram of different user rights query schemes of a mirrored library management system according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a registry operation of a mirrored library management system according to an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which are derived by a person skilled in the art based on the embodiments of the invention, fall within the scope of protection of the invention.
The system for managing the Docker mirror image library is provided, and can be designed based on the mirror image management technology of the version 2.0 of Registry2. The following takes deep learning application scenarios as examples to make specific architecture design and specific description. Dock is an open-source application container engine that allows developers to package their applications and rely on packages into a portable container and then release them onto any popular Linux machine, providing an additional layer of software abstraction, and an automatic management mechanism for operating system layer virtualization.
As shown in fig. 1, the overall architecture design of the mirror library management system of the present invention mainly includes: firstly, storing all images by a mirror image server through shared storage, and carrying out disaster recovery processing on the mirror image server by the mirror image server through a master-slave strategy; when the computing nodes need to download the images, any node in all the computing nodes acquires the images on a certain image server through load balancing, and the load balancing can enable the image server cluster to reach an balanced state, so that IO and network influence of the image server cluster are reduced; the mirror image is stored in the local mirror image library of the computing node by carrying out mirror image pulling operation in the intranet, so that the local mirror image libraries of all the computing nodes can be hung in the same shared storage in order to prevent the computing node from carrying out repeated mirror image pulling operation.
FIG. 2 is a schematic diagram of different user rights query schemes for a mirrored library management system according to an embodiment of the invention. As shown in fig. 2, an administrator can query all users in a cluster through nis (network supplies for controlling several system management databases) and the databases, and has unified viewing and deleting rights for all images of the users; the common user existing in nis or a database (mysql) can check the mirror image shared by other people into the cluster shared library and a plurality of private mirror images customized by the common user, the mirror image in the cluster shared library has the authority of subscribing the mirror image, and the private mirror image of the common user can have any operation authority of sharing, subscribing, modifying, deleting and the like; all users can inquire a certain type of mirror image, and when the users want to know specific differences, mirror images can be compared through the DockerFile file, and the mirror image suitable for the application scene of the users is selected, so that the cost of the hard disk is facilitated, and the running performance of the container is greatly improved.
FIG. 3 is a schematic diagram of a registry operation of a mirrored library management system according to an embodiment of the invention. region is a stateless, highly extensible server-side application that can store and allow you to distribute Docker Images (Images). As shown in fig. 3, for example, through a container virtual drive (Docker device) of a container HOST (Docker HOST), a user (Client) may perform a subscription (subscribe) operation through a mirror image in a cluster shared library, and after the subscription, the user may perform deep knowledge of the content in the mirror image through a Docker file, so as to select a mirror image suitable for his own scenario; the operation of solidification creation can be carried out when the mirror image is operated, which is equivalent to the operation of backing up the operation of the mirror image, and the operation is carried out from the last solidification when the mirror image is needed again; when the user wants to share the own mirror image, sharing (share) operation can be performed, namely all users can see and subscribe the mirror image to perform operation; when the creator of the image does not want to use the image any more, a delete operation can be performed, that is, the image in the cluster is completely deleted; when an administrator automatically adds or deletes the images in the background, the automatic synchronization operation and the image garbage collection operation are triggered, and the newly added images or useless images in the image library are processed.
In summary, the technical scheme of the invention carries out authority management on the mirror image library according to the License level and the user role of the user; the management mode of the mirror image library is designed, and users and roles with different authorities are explicitly allocated. The mirror image library supports operations such as query, addition, deletion, subscription mirror image and the like of the mirror images, when a user wants to store the mirror image content after modification, the mirror image library can be used for solidifying the mirror image operation, and when the user wants to share the mirror images, the mirror image library can also be shared among the users; the invention optimizes the mirror image storage technology, thereby improving the storage space utilization rate of the cluster. Therefore, on the premise of not affecting the mirror image content, the disaster recovery and load balancing are carried out on the mirror image library by mounting the mirror image library and the nodes in the shared storage, and the downloading speed and the hard disk utilization rate of the mirror image are improved.
The foregoing description of the preferred embodiments of the invention is not intended to be limiting, but rather is intended to cover all modifications, equivalents, alternatives, and improvements that fall within the spirit and scope of the invention.
Claims (6)
1. A mirrored library management system, comprising:
the shared storage node is used for storing all the images and comprises a first shared storage node and a second shared storage node;
the method comprises the steps that a plurality of computing nodes of a cluster are connected to a first shared storage node, and local mirror image libraries of the computing nodes are all mounted in the first shared storage node;
the load balancing nodes are connected with each computing node;
the mirror image server is connected with the load balancing node and the second shared storage node;
a cluster shared library, wherein the users of the clusters share the mirror images into the cluster shared library;
any one of the plurality of computing nodes obtains the mirror image on the mirror image server through the load balancing node, and the mirror image is stored in the local mirror image library of the any one computing node;
the user node of the cluster has the authority of subscribing the mirror image to the mirror image in the cluster shared library, wherein the user node obtains the difference by carrying out mirror image comparison on the mirror image in the cluster shared library through a Dockerfile file so as to select the mirror image applicable to the application scene of the user node;
and the common user node has the authority to view the mirror image shared by other user nodes into the cluster shared library and the customized private mirror image, the common user node has the authority to subscribe the mirror image in the cluster shared library, and the common user node has the authority to share, subscribe, modify and delete the private mirror image of the common user node.
2. The image library management system of claim 1, wherein an administrator node has authority to view and delete the image.
3. The image library management system of claim 1, wherein a user node performs a cure creation operation when running an image, and directly from the cure when the image is again needed to be used.
4. The image library management system of claim 1, wherein the creator of the image performs a complete delete operation on the image.
5. The image library management system of claim 1, wherein when user nodes are to share images, a sharing operation is performed to cause all user nodes to view and subscribe to the shared images.
6. The image library management system according to claim 1, wherein when the administrator node performs the addition or deletion operation, an automatic synchronization operation and an image garbage collection operation are triggered to perform corresponding synchronization processing and collection processing on the newly added image or useless image in the image library.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911364512.5A CN111221623B (en) | 2019-12-26 | 2019-12-26 | Mirror image library management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911364512.5A CN111221623B (en) | 2019-12-26 | 2019-12-26 | Mirror image library management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111221623A CN111221623A (en) | 2020-06-02 |
| CN111221623B true CN111221623B (en) | 2024-01-19 |
Family
ID=70829214
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911364512.5A Active CN111221623B (en) | 2019-12-26 | 2019-12-26 | Mirror image library management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111221623B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112306629B (en) * | 2020-10-13 | 2022-09-20 | 苏州浪潮智能科技有限公司 | Mirror image recovery method and system based on deep learning platform |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017129106A1 (en) * | 2016-01-29 | 2017-08-03 | 腾讯科技（深圳）有限公司 | Data request processing method, server and system |
| CN108241797A (en) * | 2018-01-10 | 2018-07-03 | 郑州云海信息技术有限公司 | Mirror image warehouse user right management method, device, system and readable storage medium storing program for executing |
| CN109814879A (en) * | 2019-01-16 | 2019-05-28 | 福建省天奕网络科技有限公司 | Automate CI/CD project dispositions method, storage medium |
| CN109976667A (en) * | 2016-01-26 | 2019-07-05 | 华为技术有限公司 | A kind of mirror image management method, apparatus and system |
| CN110099076A (en) * | 2018-01-29 | 2019-08-06 | 中兴通讯股份有限公司 | A kind of method and its system that mirror image pulls |
-
2019
- 2019-12-26 CN CN201911364512.5A patent/CN111221623B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109976667A (en) * | 2016-01-26 | 2019-07-05 | 华为技术有限公司 | A kind of mirror image management method, apparatus and system |
| WO2017129106A1 (en) * | 2016-01-29 | 2017-08-03 | 腾讯科技（深圳）有限公司 | Data request processing method, server and system |
| CN108241797A (en) * | 2018-01-10 | 2018-07-03 | 郑州云海信息技术有限公司 | Mirror image warehouse user right management method, device, system and readable storage medium storing program for executing |
| CN110099076A (en) * | 2018-01-29 | 2019-08-06 | 中兴通讯股份有限公司 | A kind of method and its system that mirror image pulls |
| CN109814879A (en) * | 2019-01-16 | 2019-05-28 | 福建省天奕网络科技有限公司 | Automate CI/CD project dispositions method, storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111221623A (en) | 2020-06-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11836516B2 (en) | Reducing execution times in an on-demand network code execution system using saved machine states | |
| US11709799B2 (en) | Content or file based application virtualization using a cache | |
| US9135342B2 (en) | Comprehensive, relevant, and dynamic data searching in a virtualization environment | |
| US8555018B1 (en) | Techniques for storing data | |
| JP6284617B2 (en) | System and method for calculating resource allocation | |
| US9052962B2 (en) | Distributed storage of data in a cloud storage system | |
| CN109922106B (en) | Cloud mobile phone system realized based on Docker container | |
| CN113296792B (en) | Storage method, device, equipment, storage medium and system | |
| US11409707B2 (en) | Sharing resources among remote repositories utilizing a lock file in a shared file system or a node graph in a peer-to-peer system | |
| US20140280796A1 (en) | Systems and methods for providing a distributed service configuration framework | |
| CN111930473B (en) | Method and apparatus for deploying image recognition service on container cloud | |
| CN109391664A (en) | System and method for the deployment of more cluster containers | |
| CN104050216A (en) | File system manager for customized resource allocation | |
| US11675927B2 (en) | System and method for external users in groups of a multitenant system | |
| US11442927B1 (en) | Storage performance-based distribution of deduplicated data to nodes within a clustered storage environment | |
| CN108073423A (en) | A kind of accelerator loading method, system and accelerator loading device | |
| US20190266175A1 (en) | Decentralized image management | |
| JP2002182970A5 (en) | ||
| CN111221623B (en) | Mirror image library management system | |
| CN110134489A (en) | Using moving method and device, system, storage medium, using upper cloud tool | |
| CN113296891B (en) | Platform-based multi-scene knowledge graph processing method and device | |
| CN111651418A (en) | Document content downloading method and device, computer equipment and storage medium | |
| US8949432B2 (en) | Identity management | |
| CN112988062B (en) | Metadata reading limiting method and device, electronic equipment and medium | |
| US20210067599A1 (en) | Cloud resource marketplace |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |