WO2021139264A1 - 对象存储控制方法、装置、计算机设备及存储介质 - Google Patents
对象存储控制方法、装置、计算机设备及存储介质 Download PDFInfo
- Publication number
- WO2021139264A1 WO2021139264A1 PCT/CN2020/118724 CN2020118724W WO2021139264A1 WO 2021139264 A1 WO2021139264 A1 WO 2021139264A1 CN 2020118724 W CN2020118724 W CN 2020118724W WO 2021139264 A1 WO2021139264 A1 WO 2021139264A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- ecs
- host
- preset
- object storage
- access
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/188—Virtual file systems
Definitions
- This application relates to the field of big data processing technology, and in particular to an ECS-based object storage control method, device, computer equipment, and computer-readable storage medium.
- Object storage also called object-based storage, is used to describe methods for solving and processing discrete units, which are called objects.
- This application provides an ECS-based object storage control method, device, computer equipment, and computer-readable storage medium, which can solve the problem of waste of object storage resources in traditional technologies.
- this application provides an ECS service-based object storage control method.
- the method includes: receiving a client-side object storage creation request; according to the creation request, sending preset ECS host resource requirements to the ECS service Terminal, so that the ECS server creates an ECS host according to the resource requirements of the ECS host, and after the ECS host is successfully created, returns the creation information corresponding to the ECS host; receives the creation information; Create information, mount the ECS host as a preset virtual file system; based on the virtual file system, build a preset object storage system on the ECS host, the preset object storage system including the preset object
- the present application also provides an ECS-based object storage control device, including: a first receiving unit, configured to receive a creation request for creating an object storage from a client; and a first sending unit, configured to create an object storage based on the creation request , Sending the preset ECS host resource requirements to the ECS server, so that the ECS server creates an ECS host according to the ECS host resource requirements, and after the ECS host is successfully created, returns the creation corresponding to the ECS host Information; a second receiving unit, configured to receive the creation information; a mounting unit, configured to mount the ECS host as a preset virtual file system according to the creation information; a construction unit, configured based on the virtual File system, constructing a preset object storage system on the ECS host, the preset object storage system including the access IP corresponding to the preset object storage system; a return unit, used to return the access IP to the The client terminal, so that the client terminal receives access from other client terminals through the access IP.
- a first receiving unit configured to receive
- the present application also provides a computer device, which includes a memory and a processor, and a computer program is stored on the memory.
- the processor runs the computer program, the following steps are executed: The creation request; according to the creation request, send the preset ECS host resource requirements to the ECS server, so that the ECS server creates the ECS host according to the ECS host resource requirements, and after the ECS host is successfully created, Return the creation information corresponding to the ECS host; receive the creation information; according to the creation information, mount the ECS host as a preset virtual file system; based on the virtual file system, on the ECS host Construct a preset object storage system, the preset object storage system includes the access IP corresponding to the preset object storage system; return the access IP to the user end, so that the user end can pass the access The IP receives access from other clients.
- the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the following steps: Create a creation request for object storage; according to the creation request, send preset ECS host resource requirements to the ECS server, so that the ECS server creates an ECS host according to the ECS host resource requirements, and creates it on the ECS host After success, return the creation information corresponding to the ECS host; receive the creation information; according to the creation information, mount the ECS host as a preset virtual file system; based on the virtual file system, in the A preset object storage system is constructed on the ECS host, and the preset object storage system contains the access IP corresponding to the preset object storage system; the access IP is returned to the client so that the client can pass The access IP receives access from other clients.
- this application mounts the ECS host memory as a preset virtual file system, thereby constructing a preset object storage system on the ECS host, thereby realizing the expansion of memory-based object storage resources, and is able to
- the object storage resources can be released in time when needed, so as to realize the dynamic scaling of memory-based object storage resources, which can save the cost of users and the resource cost of service providers, improve the use efficiency of object storage resources, and avoid The waste of object storage resources.
- FIG. 1 is a diagram of an application environment of an ECS-based object storage control method provided by an embodiment of the application
- FIG. 2 is a schematic flowchart of an embodiment in an ECS-based object storage control method provided by an embodiment of the application;
- FIG. 3 is another schematic flowchart of an ECS-based object storage control method provided by an embodiment of the application.
- FIG. 4 is a schematic block diagram of an ECS-based object storage control device provided by an embodiment of the application.
- Fig. 5 is a schematic block diagram of a computer device provided by an embodiment of the application.
- FIG. 1 is a diagram of an application environment of the ECS-based object storage control method provided by an embodiment of the application.
- the application environment includes the following subjects: (1) Client. It is used to make a creation request for creating object storage based on business requirements. (2) Object storage system management terminal. It is the server side, used to create an object storage system according to the request of the user side. (3) ECS server side. It is the cloud server side and is used to provide cloud server resources.
- the above interaction process of each subject includes: 1) The user terminal proposes a creation request to create an object storage according to business requirements, and sends the creation request to the management terminal of the object storage system. Receive the creation request of the client to create the object store. 2) The object storage system management terminal sends the preset ECS host resource requirements to the ECS server according to the creation request. 3) The ECS server creates an ECS host according to the resource requirements of the ECS host, and after the ECS host is successfully created, returns the creation information corresponding to the ECS host to the object storage system management terminal.
- the object storage system management terminal receives the creation information, mounts the ECS host as a preset virtual file system based on the creation information, and builds a preset object on the ECS host based on the virtual file system
- the storage system simultaneously generates the access IP corresponding to the preset object storage system, and the preset object storage system includes the access IP corresponding to the preset object storage system.
- the management terminal of the object storage system returns the access IP to the user terminal. 6)
- the client terminal receives access from other client terminals through the access IP.
- FIG. 2 is a schematic flowchart of an ECS-based object storage control method provided by an embodiment of the application. As shown in Figure 2, the method includes the following steps S201-S206:
- S201 Receive a creation request for creating an object store on the user side.
- the system management terminal receives an application form for creating an object storage system, and thereby receives a creation request for creating an object storage on the user side.
- ECS means Elastic Compute Service in English, or ECS for short, which refers to cloud servers, ECS hosts, and cloud hosts.
- the object storage system management terminal submits the ECS host request to the ECS server according to the creation request, and then waits for the ECS server to successfully create the ECS host.
- the ECS server creates an ECS host according to the resource requirements of the ECS host, and returns creation information corresponding to the ECS host after the ECS host is successfully created.
- ECS hosts cloud hosts between different users are isolated, that is, this batch of cloud hosts is only available to the user, but what the user sees is only an access domain name. How many cloud hosts actually affect the user? Is invisible.
- object storage there is no elastic service like ECS host in the traditional technology. The object storage is controlled through the embodiments of this application.
- the elastic application can be made based on the demand.
- the object storage performance of the memory can be easily expanded, and the object storage resources can be released in time when the increased object storage performance is not needed. This can save the cost of the user and the resource cost of the service provider, which can improve the object storage resources. Use efficiency to avoid the waste of object storage resources.
- FIG. 3 is another flowchart of an ECS-based object storage control method provided by an embodiment of the application.
- the method before the step of sending the preset ECS host resource requirements to the ECS server, the method further includes:
- the object storage system management terminal after receiving the creation request, calculates the preset ECS host resource requirements required by the creation request according to the creation request For example, count the required ECS host specifications and the number of hosts included in the creation request, and then submit an ECS host resource requirement application to the ECS end according to the creation request.
- the step of counting the resource requirements of the preset ECS host required by the creation request includes: obtaining the estimated storage capacity required by the user included in the creation request; obtaining the number of copies corresponding to the preset copy, The copy is a backup; the storage capacity of the host corresponding to the specifications of each ECS host is obtained; the ECS host required for the creation request is determined according to the estimated storage capacity, the number of copies, and the storage capacity of the host The number of hosts in order to obtain the ECS host specifications and the number of hosts required for the creation request.
- the process for the object storage system management terminal to count the preset ECS host resource requirements required for the creation request according to the creation request includes the following steps: the object storage system calculates the required ECS according to the creation request form submitted by the user Host resources, including the required memory size and the number of ECS hosts required.
- the calculation method is as follows: If the standard ECS host adopts a 4-core 32GB configuration, of which 24GB is used as available memory, a cloud host with this configuration can be used. Provides 24GB storage capacity.
- the embodiments of the present application can thereby enable the object storage system management terminal to accurately create the object storage system according to requirements, and realize the elastic and dynamic scaling of the object storage system.
- mounting English as Mounting, refers to a process by which the operating system makes computer files and directories on a storage device (such as a hard disk, CD-ROM or shared resource) accessible to users through the computer's file system.
- the standard form of the mount command is as follows: mount-t type device dir.
- Virtual memory referred to as virtual memory in English, VM for short, makes the application think that it has continuous available memory (a continuous and complete address space), but in fact it is usually divided into multiple physical memory fragments, and some Temporarily store on external disk storage, and exchange data when needed.
- Virtual memory file system also known as virtual kernel file system, in English is VirtualKernel File Systems, refers to those file systems that are generated by the kernel but do not exist on the hard disk (exist in memory). Virtual memory file systems include tmpfs file systems .
- the object storage system management terminal receives the creation information, and after learning that the ECS host is successfully created, mounts the ECS host as a preset virtual file system, so that each ECS host mounts a memory as a local file system.
- the object storage system English as Object-Based Storage System, combines the advantages of NAS and SAN, and at the same time has the advantages of high-speed direct access to SAN and data sharing of NAS, providing high reliability, cross-platform and secure Data sharing storage architecture, object storage systems include MINIO and Swift, etc.
- the ECS host after applying for the ECS host resource for creating object storage, mount the ECS host as a preset virtual file system. Since the ECS host is a memory storage, the preset virtual file system is also a virtual memory file system. , Building an object storage system based on a mounted virtual file system is the same as building an object storage system based on a physical machine by adding a physical machine. By implementing memory-based object storage, the performance of object storage is expanded.
- the preset object storage system is constructed based on the MinIO object storage service.
- MinIO object storage system on a cloud host with a memory virtual file system mounted, it can be constructed as follows: ./minio server host1:/mnt/tmpfs hist2:/mnt/tmpfs, thus forming a memory-based
- the MINIO cluster is used for object storage and realizes the expansion of object storage. Because Minio is best for storing unstructured data such as photos, videos, log files, backups and container/VM images. The size of the object can range from a few KB to a maximum of 5TB.
- the Minio server is light enough to be bundled with the application stack, similar to NodeJS, Redis and MySQL, so that it can easily implement a variety of object storage.
- the object storage method provided by the embodiments of the present application is constructed based on ECS services, and is implemented by an object storage system, such as Minio, to implement a memory-based object storage system that can be dynamically applied for, which improves the use efficiency of object storage resources and avoids objects. Waste of storage resources.
- the memory-based object storage system is successfully created and returned to the user. Since the created preset object storage system contains the access IP corresponding to the preset object storage system, the access IP is returned to the client, for example , Return to the user's constructed Minio object storage system access IP, and when the user corresponding to the user terminal needs a large number of external client access for activities held by the user, the other external client terminal accesses through the access IP.
- a preset ECS host resource requirement is sent to the ECS server, so that the ECS server creates an ECS host according to the ECS host resource requirement .
- the creation information corresponding to the ECS host is returned, the creation information is received, and the ECS host is mounted as a preset virtual file system based on the creation information.
- a preset object storage system is constructed on the ECS host, the preset object storage system includes the access IP corresponding to the preset object storage system, and the access IP is returned to the client , So that the client terminal receives access from other client terminals through the access IP, so that the ECS host can be mounted as a preset virtual file system by applying for ECS host resources, thereby building a preset object storage on the ECS host.
- the system realizes the expansion of object storage resources, and can release the object storage resources in time when they are not needed, so as to realize the dynamic scaling of the object storage resources, which can save the cost of the user and the resource cost of the service provider.
- the use efficiency of object storage resources is improved, and the waste of object storage resources is avoided.
- the step of sending the ECS host resource requirements to the ECS server further includes: sending a preset cloud disk requirement consistent with the size of the ECS host included in the ECS host resource requirements to the ECS server, This allows the ECS server to create a preset cloud disk according to the requirements of the preset cloud disk, and synchronize the files in the memory file system to the preset cloud disk when the preset object storage system is running.
- the bottom layer of the object storage system is constructed based on the memory virtual file system, when the ECS host is restarted, the contents of the memory will be lost. Therefore, it can be stored on each ECS host.
- the preset cloud disk requirements with the same size as the ECS host included in the ECS host resource requirements are sent to the ECS server, so that the ECS The server creates a preset cloud disk according to the requirements of the preset cloud disk, and causes the preset object storage system to synchronously copy the files in the memory file system to the preset cloud disk when the preset object storage system is running.
- the object storage system is running, the files in the memory file system are synchronously copied to the preset cloud disk, which can ensure the data security of the object storage system.
- the method further includes:
- the object storage system management end will also synchronously submit the ECS host and cloud disk offline application to the ECS end to synchronize the ECS end.
- Release the resource ECS host and cloud disk that is, the object storage system management terminal receives the offline request of the preset object storage system sent by the user terminal, and sends an ECS resource release request to the ECS service according to the offline request So that the ECS server releases the ECS resource corresponding to the preset object storage system, and the ECS resource includes an ECS host.
- the traditional object storage system cannot be expanded in time. If the physical machine is used to expand the object storage system, there will be a waste of resources of the expanded physical machine after the activity is completed.
- the memory-based elastic object storage system provided by the embodiments of this application, it can not only solve the waste of physical machines caused by the short-term use of storage object resources in the traditional technology, but also provide good object storage performance, because the ECS host (I.e., cloud host) memory is a hardware device with a higher speed than an SSD (i.e. solid state drive), so the memory-based elastic object storage system corresponding to the object storage control method provided in the embodiments of the present application achieves object storage performance and cost It is beneficial to both users and storage providers. It can not only improve the use efficiency of object storage resources, but also avoid the waste of object storage resources.
- FIG. 4 is a schematic block diagram of an ECS-based object storage control apparatus provided by an embodiment of the application.
- an embodiment of the present application also provides an ECS-based object storage control device.
- the ECS-based object storage control device includes a unit for executing the above-mentioned ECS-based object storage control method, and the ECS-based object storage control device may be configured in a computer device.
- the ECS-based object storage control device 400 includes a first receiving unit 401, a first sending unit 402, a second receiving unit 403, a mounting unit 404, a construction unit 405, and a returning unit 406.
- the first receiving unit 401 is configured to receive a creation request for creating object storage on the client side;
- the first sending unit 402 is configured to send preset ECS host resource requirements to the ECS server according to the creation request, so that the The ECS server creates an ECS host according to the resource requirements of the ECS host, and after the ECS host is successfully created, returns the creation information corresponding to the ECS host;
- the second receiving unit 403 is configured to receive the creation information;
- the loading unit 404 is configured to mount the ECS host as a preset virtual file system according to the creation information;
- the construction unit 405 is configured to build a preset object storage on the ECS host based on the virtual file system System, the preset object storage system includes the access IP corresponding to the preset object storage system;
- the returning unit 406 is configured to return the access IP to the client, so that the client can pass the Visit IP to receive visits from other clients.
- the first sending unit 402 is further configured to send a preset cloud disk demand consistent with the size of the ECS host included in the ECS host resource requirement to the ECS server, so that the ECS The server creates a preset cloud disk according to the requirements of the preset cloud disk, and causes the preset object storage system to synchronously copy files in the memory file system to the preset cloud disk when the preset object storage system is running.
- the ECS-based object storage control device 400 further includes: a third receiving unit, configured to receive the offline request of the preset object storage system sent by the user terminal; and a second sending unit, It is used to send an ECS resource release request to the ECS server according to the offline request, so that the ECS server releases the ECS resource corresponding to the preset object storage system, and the ECS resource includes an ECS host.
- a third receiving unit configured to receive the offline request of the preset object storage system sent by the user terminal
- a second sending unit It is used to send an ECS resource release request to the ECS server according to the offline request, so that the ECS server releases the ECS resource corresponding to the preset object storage system, and the ECS resource includes an ECS host.
- the ECS-based object storage control device 400 further includes: a statistics unit, configured to count the preset ECS host resource requirements required by the creation request according to the creation request, and the preset ECS The host resource requirements include the required ECS host specifications and the number of hosts.
- the preset object storage system is constructed based on the MinIO object storage service.
- the division and connection of the various units in the ECS-based object storage control device are only for illustration.
- the ECS-based object storage control device can be divided into different units as needed, or the Each unit in the ECS-based object storage control device adopts different connection sequences and methods to complete all or part of the functions of the above-mentioned ECS-based object storage control device.
- the above-mentioned ECS-based object storage control device may be implemented in the form of a computer program, and the computer program may run on the computer device as shown in FIG. 5.
- FIG. 5 is a schematic block diagram of a computer device according to an embodiment of the present application.
- the computer device 500 may be a computer device such as a desktop computer or a server, or may be a component or component in other devices.
- the computer device 500 includes a processor 502, a memory, and a network interface 505 connected through a system bus 501, where the memory may include a non-volatile storage medium 503 and an internal memory 504.
- the non-volatile storage medium 503 can store an operating system 5031 and a computer program 5032.
- the processor 502 can execute the above-mentioned ECS-based object storage control method.
- the processor 502 is used to provide calculation and control capabilities to support the operation of the entire computer device 500.
- the internal memory 504 provides an environment for the operation of the computer program 5032 in the non-volatile storage medium 503.
- the processor 502 can execute the above-mentioned ECS-based object storage control method.
- the network interface 505 is used for network communication with other devices.
- the specific computer device 500 may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.
- the computer device may only include a memory and a processor.
- the structures and functions of the memory and the processor are the same as those of the embodiment shown in FIG. 5, which will not be repeated here.
- the processor 502 is configured to run a computer program 5032 stored in a memory to implement the object storage control method described in the embodiment of the present application.
- the processor 502 may be a central processing unit (Central Processing Unit, CPU), and the processor 502 may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc.
- the general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.
- the computer-readable storage medium may be a non-volatile computer-readable storage medium, or may be a volatile computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program is executed by the processor When the processor executes the steps of the ECS-based object storage control method described in the above embodiments.
- the storage medium is a physical, non-transitory storage medium, such as a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a magnetic disk, or an optical disk, etc., which can store computer programs. medium.
- a physical, non-transitory storage medium such as a U disk, a mobile hard disk, a read-only memory (Read-Only Memory, ROM), a magnetic disk, or an optical disk, etc., which can store computer programs. medium.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Bioethics (AREA)
- Software Systems (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Data Mining & Analysis (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
一种基于ECS的对象存储控制方法、装置、计算机设备及计算机可读存储介质,属于大数据处理技术领域,通过接收用户端创建对象存储的创建请求(S201),根据创建请求,发送预设ECS主机资源需求至ECS服务端,以使ECS服务端根据ECS主机资源需求创建ECS主机,并在ECS主机创建成功后,返回ECS主机所对应的创建信息(S202),接收所述创建信息(S203),根据创建信息,将ECS主机挂载成预设虚拟文件系统(S204),基于虚拟文件系统,在ECS主机上构建预设对象存储系统,预设对象存储系统包含预设对象存储系统所对应的访问IP(S205),将访问IP返回至用户端,以使用户端通过访问IP接收其它用户端的访问(S206)。
Description
本申请要求于2020年07月28日提交中国专利局、申请号为202010738663.9、申请名称为“对象存储控制方法、装置、计算机设备及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及大数据处理技术领域,尤其涉及一种基于ECS的对象存储控制方法、装置、计算机设备及计算机可读存储介质。
对象存储,也叫做基于对象的存储,是用来描述解决和处理离散单元的方法,这些离散单元被称作为对象。
现在的对象存储系统一般是基于固定配置的物理机搭建的,若干个物理机搭建完成后组成物理机集群。如果物理机集群需要性能扩容,涉及到物理机采购、物理机上架、网络等硬件配置,动辄都是以周来计算时间,扩容周期比较长。同时,对一些突发要求的流量访问,比如举办的各业务活动,活动期间,这些业务数据存量可能不会太多,只是访问可能会非常的频繁,动辄都是QPS万级以上,短期内可能存在大量的访问性能要求,需要提升对象存储系统的性能,但是活动过了以后,就不需要这么大的性能了,若通过增加物理机以提升对象存储系统性能,活动过后,就会造成大量的性能浪费。因此,发明人意识到,传统技术中存在对对象存储资源浪费的问题。
发明内容
本申请提供了一种基于ECS的对象存储控制方法、装置、计算机设备及计算机可读存储介质,能够解决传统技术中对对象存储资源浪费的问题。
第一方面,本申请提供了一种基于ECS服务的对象存储控制方法,所述方法包括:接收用户端创建对象存储的创建请求;根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;接收所述创建信息;根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
第二方面,本申请还提供了一种基于ECS的对象存储控制装置,包括:第一接收单元,用于接收用户端创建对象存储的创建请求;第一发送单元,用于根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;第二接收单元,用于接收所述创建信息;挂载单元,用于根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;构建单元,用于基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;返回单元,用于将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
第三方面,本申请还提供了一种计算机设备,其包括存储器及处理器,所述存储器上存储有计算机程序,所述处理器运行所述计算机程序时执行如下步骤:接收用户端创建对象存储的创建请求;根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;接收所述创建信息;根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;将所述访问IP 返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
第四方面,本申请还提供了一种计算机可读存储介质,所述计算机可读存储介质存储有计算机程序,所述计算机程序被处理器执行时使所述处理器实现如下步骤:接收用户端创建对象存储的创建请求;根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;接收所述创建信息;根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
本申请通过申请ECS主机资源,将所述ECS主机内存挂载成预设虚拟文件系统,从而在ECS主机上构建预设对象存储系统,进而实现基于内存的对象存储资源的扩展,并且能够在不需要时可以及时释放对象存储资源,从而能够实现基于内存的对象存储资源的动态伸缩,这样既可以节省用户的成本,又可以节省服务提供方的资源成本,提高了对象存储资源的使用效率,避免了对象存储资源的浪费。
为了更清楚地说明本申请实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本申请实施例提供的基于ECS的对象存储控制方法的一个应用环境图;
图2为本申请实施例提供的基于ECS的对象存储控制方法中一个实施例的流程示意图;
图3为本申请实施例提供的基于ECS的对象存储控制方法的另一个流程示意图;
图4为本申请实施例提供的基于ECS的对象存储控制装置的一个示意性框图;以及
图5为本申请实施例提供的计算机设备的示意性框图。
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
图1为本申请实施例提供的基于ECS的对象存储控制方法的一个应用环境图。如图1所示,在该应用环境中,包括以下主体:(1)用户端。用于根据业务需求提出创建对象存储的创建请求。(2)对象存储系统管理端。为服务器端,用于根据用户端的请求创建对象存储系统。(3)ECS服务器端。为云服务器端,用于提供云服务器资源。
以上各个主体交互的过程包括:1)用户端根据业务需求提出创建对象存储的创建请求,将所述创建请求发送至对象存储系统管理端。接收用户端创建对象存储的创建请求。2)对象存储系统管理端根据所述创建请求,发送预设ECS主机资源需求至ECS服务端。3)所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,向对象存储系统管理端返回所述ECS主机所对应的创建信息。4)对象存储系统管理端接收所述创建信息,根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统,基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,同时生成所述预设对象存储系统所对应的访问IP,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP。5)对象存储系统管理端将所述访问IP返回至所述用户端。6)所述用户端通过所述访问IP接收其它用户端的访问。
请参阅图2,图2为本申请实施例提供的基于ECS的对象存储控制方法的一个流程示意图。如图2所示,该方法包括以下步骤S201-S206:
S201、接收用户端创建对象存储的创建请求。
具体地,用户需要增加对象存储时,比如用户要举办活动以应对暂时的大访问流量导致 需要增加对象存储时,用户根据对举办活动的预期,预估活动的访问量,再根据访问量,用户预估自己的对象存储容量需求及性能需求等创建对象存储的需求的参数,然后填写对象存储申请表单,并提交创建对象存储系统申请表单提交至对象存储系统管理端(即服务器端),对象存储系统管理端接收创建对象存储系统申请表单,从而接收用户端创建对象存储的创建请求。
S202、根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息。
其中,ECS,英文为Elastic Compute Service,简称ECS,指云服务器,ECS主机,指云主机。
具体地,对象存储系统管理端根据所述创建请求,提交ECS主机需求至ECS服务端,然后等待ECS服务端将ECS主机创建成功。所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息。对于ECS主机而言,不同的用户之间云主机都是隔离的,即这批云主机仅提供给该用户使用,但是用户看到的只是一个访问域名,后面具体有多少台云主机实际对用户是不可见的。对于对象存储而言,传统技术中还未有像ECS主机那样的弹性服务,通过本申请实施例对对象存储进行控制,可以在需要使用增加的对象存储性能时根据需求进行弹性申请,能够实现基于内存的对象存储性能的扩容方便,不需要使用增加的对象存储性能时可以及时释放对象存储资源,这样既可以节省用户的成本,又可以节省服务提供端方的资源成本,可以提高对象存储资源的使用效率,避免了对象存储资源的浪费。
进一步地,请参阅图3,图3为本申请实施例提供的基于ECS的对象存储控制方法的另一个流程示意图。在该实施例中,所述发送预设ECS主机资源需求至ECS服务端的步骤之前,还包括:
S2020、根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求,所述预设ECS主机资源需求包括所需的ECS主机规格及主机数量。
具体地,对象存储系统管理端接收到所述创建请求后,在发送预设ECS主机资源需求至ECS服务端之前,根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求,例如统计创建请求中所包括的所需的ECS主机规格及主机数量,然后再根据所述创建请求提交ECS主机资源需求申请给ECS端。
进一步地,所述统计所述创建请求所需的预设ECS主机资源需求的步骤包括:获取所述创建请求中所包含的用户需要的预估存储容量;获取预设副本所对应的副本数,其中,所述副本为备份;获取每台ECS主机规格所对应的主机存储容量;根据所述预估存储容量、所述副本数及所述主机存储容量,确定所述创建请求所需的ECS主机的主机数量,以得到所述创建请求所需的ECS主机规格及主机数量。
具体地,对象存储系统管理端根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求的过程包括以下步骤:对象存储系统根据用户提交的创建请求表单,计算所需的ECS主机资源,包括所需内存大小及所需ECS主机的数量,在一个具体示例中,计算方法如下:若标准ECS主机采用4核32GB配置,其中24GB作为可用内存使用,一台该配置云主机可提供24GB存储容量,对象存储系统采用3副本机制来保证数据可靠性,假设用户需要的容量为X GB,则需要申请的标准云主机数量=X*3/24GB,例如,假设用户需要200GB的容量,则需要200*3/24=25台云主机。
可见,本申请实施例从而能使对象存储系统管理端根据需求准确的创建对象存储系统,实现对象存储系统的弹性动态伸缩。
S203、接收所述创建信息。
S204、根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统。
其中,挂载,英文为Mounting,是指由操作系统使一个存储设备(诸如硬盘、CD-ROM 或共享资源)上的计算机文件和目录可供用户通过计算机的文件系统访问的一个过程。mount命令的标准形式如下:mount-t type device dir。
虚拟内存,英文为virtual memory,简称VM,它使得应用程序认为它拥有连续的可用的内存(一个连续完整的地址空间),而实际上它通常是被分隔成多个物理内存碎片,还有部分暂时存储在外部磁盘存储器上,在需要时进行数据交换。虚拟内存文件系统,又称为虚拟内核文件系统,英文为VirtualKernel File Systems,是指那些是由内核产生但不存在于硬盘上(存在于内存中)的文件系统,虚拟内存文件系统包括tmpfs文件系统。
具体地,对象存储系统管理端接收所述创建信息,获知ECS主机创建成功后,将所述ECS主机挂载成预设虚拟文件系统,从而使各ECS主机挂载内存为本地文件系统。其中,ECS主机创建成功后,将内存挂载成虚拟文件系统的过程,例如,采取如下语句会将一块10G的内存挂载成一个本地的目录:mount tmpfs/mnt/tmpfs-t tmpfs-o size=10g。
S205、基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP。
其中,对象存储系统,英文为Object-Based Storage System,是综合了NAS和SAN的优点,同时具有SAN的高速直接访问和NAS的数据共享等优势,提供了高可靠性、跨平台性以及安全的数据共享的存储体系结构,对象存储系统包括MINIO及Swift等。
具体地,在申请到创建对象存储的ECS主机资源后,将所述ECS主机挂载成预设虚拟文件系统,由于所述ECS主机为内存存储,预设虚拟文件系统也即为虚拟内存文件系统,基于挂载好的虚拟文件系统构建对象存储系统,与通过增加物理机从而搭建基于物理机的对象存储系统一样,通过实现基于内存的对象存储,实现了对象存储性能的扩展。
进一步地,在一实施例中,所述预设对象存储系统基于MinIO对象存储服务而构建。
具体地,在挂载好了内存虚拟文件系统的云主机构建MinIO对象存储系统,可以通过如下方式实现构建:./minio server host1:/mnt/tmpfs hist2:/mnt/tmpfs,从而形成基于内存的MINIO集群用以进行对象存储,实现对象存储的扩容。由于Minio最适合存储非结构化数据,如照片,视频,日志文件,备份和容器/VM映像。对象的大小可以从几KB到最大5TB,Minio服务器足够轻,可以与应用程序堆栈捆绑在一起,类似于NodeJS,Redis和MySQL,从而能够方便的实现多种对象存储。本申请实施例提供的对象存储方法依托ECS服务而构建,并通过对象存储系统,例如Minio实现,实现了基于内存的可动态申请的对象存储系统,提高了对象存储资源的使用效率,避免了对象存储资源的浪费。
S206、将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
具体地,将基于内存的对象存储系统创建成功返回用户,由于创建的预设对象存储系统包含所述预设对象存储系统所对应的访问IP,将所述访问IP返回至所述用户端,例如,返回用户构建好了的Minio对象存储系统访问IP,用户端所对应的用户举办活动需要大量外部其它用户端的访问时,外部其它用户端通过所述访问IP进行访问。
本申请实施例通过接收用户端创建对象存储的创建请求,根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息,接收所述创建信息,根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统,基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP,将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问,从而实现通过申请ECS主机资源,将所述ECS主机挂载成预设虚拟文件系统,从而在ECS主机上构建预设对象存储系统,实现对象存储资源的扩展,并且能够在不需要时可以及时释放对象存储资源,从而能够实现对象存储资源的动态伸缩,这样既可以节省用户的成本,又可以节省服务提供方的资源成本,提高了对象存储资源的使用效率,避免了对象存储资源的浪费。
在一实施例中,所述发送ECS主机资源需求至ECS服务端的步骤,还包括:发送与所述ECS主机资源需求中包含的ECS主机大小一致的预设云磁盘需求至所述ECS服务端,以使所述ECS服务端根据所述预设云磁盘需求创建预设云磁盘,并使所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘。
具体地,为了提高基于内存的对象存储的性能,由于对象存储系统底层是基于内存虚拟文件系统构建的,当ECS主机重启后,内存里面的东西是会丢失的,因此,可以在每个ECS主机上挂载一块和内存虚拟文件系统同等大小的云磁盘,弹性对象存储系统会实时的将内存文件系统中的文件复制到云磁盘中,保证即使ECS主机损坏或者是宕机了,对象存储数据依然不会丢失,因此,发送ECS主机资源需求至ECS服务端时,发送与所述ECS主机资源需求中包含的ECS主机大小一致的预设云磁盘需求至所述ECS服务端,以使所述ECS服务端根据所述预设云磁盘需求创建预设云磁盘,并使所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘,通过创建的所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘,能够保证对象存储系统的数据安全性。
请继续参阅图3,如图3所示,所述将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问的步骤之后,还包括:
S207、接收所述用户端发送的所述预设对象存储系统的下线请求;
S208、根据所述下线请求,发送ECS资源释放请求至所述ECS服务端,以使所述ECS服务端释放所述预设对象存储系统所对应的ECS资源,所述ECS资源包括ECS主机。
具体地,用户使用完对象存储后,需要提交对象存储系统下线申请,不然会持续计费。在用户提交完对象存储系统下线申请后,若初始同时申请了ECS主机和云磁盘,对象存储系统管理端也会同步提交ECS主机和云磁盘的下线申请至ECS端,以使ECS端同步释放资源ECS主机和云磁盘,即对象存储系统管理端接收所述用户端发送的所述预设对象存储系统的下线请求,根据所述下线请求,发送ECS资源释放请求至所述ECS服务端,以使所述ECS服务端释放所述预设对象存储系统所对应的ECS资源,所述ECS资源包括ECS主机。由于针对临时的业务活动,传统对象存储系统无法及时扩容,若采用物理机搭建的方式进行对象存储系统的扩容,会有活动完成后扩容的物理机资源浪费的问题。在使用了本申请实施例提供的基于内存的弹性对象存储系统后,既可以解决传统技术中存储对象资源短期使用造成对物理机的浪费问题,又可以提供很好的对象存储性能,因为ECS主机(即云主机)内存是比的SSD(即固态硬盘)还要高速的硬件设备,从而本申请实施例提供的对象存储控制方法所对应的基于内存的弹性对象存储系统达到了对象存储性能和成本的一致,无论是对用户还是存储提供方都是有益的,既能提高对象存储资源的使用效率,又能避免对象存储资源的浪费。
需要说明的是,上述各个实施例所述的基于ECS的对象存储控制方法,可以根据需要将不同实施例中包含的技术特征重新进行组合,以获取组合后的实施方案,但都在本申请要求的保护范围之内。
请参阅图4,图4为本申请实施例提供的基于ECS的对象存储控制装置的一个示意性框图。对应于上述所述基于ECS的对象存储控制方法,本申请实施例还提供一种基于ECS的对象存储控制装置。如图4所示,该基于ECS的对象存储控制装置包括用于执行上述所述基于ECS的对象存储控制方法的单元,该基于ECS的对象存储控制装置可以被配置于计算机设备中。具体地,请参阅图4,该基于ECS的对象存储控制装置400包括第一接收单元401、第一发送单元402、第二接收单元403、挂载单元404、构建单元405及返回单元406。
其中,第一接收单元401,用于接收用户端创建对象存储的创建请求;第一发送单元402,用于根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;第二接收单元403,用于接收所述创建信息;挂载单元404,用于根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;构建单元405,用于基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述 预设对象存储系统所对应的访问IP;返回单元406,用于将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
在一实施例中,所述第一发送单元402,还用于发送与所述ECS主机资源需求中包含的ECS主机大小一致的预设云磁盘需求至所述ECS服务端,以使所述ECS服务端根据所述预设云磁盘需求创建预设云磁盘,并使所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘。
在一实施例中,所述基于ECS的对象存储控制装置400还包括:第三接收单元,用于接收所述用户端发送的所述预设对象存储系统的下线请求;第二发送单元,用于根据所述下线请求,发送ECS资源释放请求至所述ECS服务端,以使所述ECS服务端释放所述预设对象存储系统所对应的ECS资源,所述ECS资源包括ECS主机。
在一实施例中,所述基于ECS的对象存储控制装置400还包括:统计单元,用于根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求,所述预设ECS主机资源需求包括所需的ECS主机规格及主机数量。
在一实施例中,所述预设对象存储系统基于MinIO对象存储服务而构建。
需要说明的是,所属领域的技术人员可以清楚地了解到,上述基于ECS的对象存储控制装置和各单元的具体实现过程,可以参考前述方法实施例中的相应描述,为了描述的方便和简洁,在此不再赘述。
同时,上述基于ECS的对象存储控制装置中各个单元的划分和连接方式仅用于举例说明,在其他实施例中,可将基于ECS的对象存储控制装置按照需要划分为不同的单元,也可将基于ECS的对象存储控制装置中各单元采取不同的连接顺序和方式,以完成上述基于ECS的对象存储控制装置的全部或部分功能。
上述基于ECS的对象存储控制装置可以实现为一种计算机程序的形式,该计算机程序可以在如图5所示的计算机设备上运行。
请参阅图5,图5是本申请实施例提供的一种计算机设备的示意性框图。该计算机设备500可以是台式机电脑或者服务器等计算机设备,也可以是其他设备中的组件或者部件。
参阅图5,该计算机设备500包括通过系统总线501连接的处理器502、存储器和网络接口505,其中,存储器可以包括非易失性存储介质503和内存储器504。
该非易失性存储介质503可存储操作系统5031和计算机程序5032。该计算机程序5032被执行时,可使得处理器502执行一种上述基于ECS的对象存储控制方法。
该处理器502用于提供计算和控制能力,以支撑整个计算机设备500的运行。
该内存储器504为非易失性存储介质503中的计算机程序5032的运行提供环境,该计算机程序5032被处理器502执行时,可使得处理器502执行一种上述基于ECS的对象存储控制方法。
该网络接口505用于与其它设备进行网络通信。本领域技术人员可以理解,图5中示出的结构,仅仅是与本申请方案相关的部分结构的框图,并不构成对本申请方案所应用于其上的计算机设备500的限定,具体的计算机设备500可以包括比图中所示更多或更少的部件,或者组合某些部件,或者具有不同的部件布置。例如,在一些实施例中,计算机设备可以仅包括存储器及处理器,在这样的实施例中,存储器及处理器的结构及功能与图5所示实施例一致,在此不再赘述。
其中,所述处理器502用于运行存储在存储器中的计算机程序5032,以实现本申请实施例所描述的对象存储控制方法。
应当理解,在本申请实施例中,处理器502可以是中央处理单元(Central Processing Unit,CPU),该处理器502还可以是其他通用处理器、数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现成可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。其中,通用处理器可以是微处理器或者该处理器也可以是任何常规 的处理器等。
本领域普通技术人员可以理解的是实现上述实施例的方法中的全部或部分流程,是可以通过计算机程序来完成,该计算机程序可存储于一计算机可读存储介质。该计算机程序被该计算机系统中的至少一个处理器执行,以实现上述方法的实施例的流程步骤。
因此,本申请还提供一种计算机可读存储介质。该计算机可读存储介质可以为非易失性的计算机可读存储介质,也可以为易失性的计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序被处理器执行时使处理器执行以上各实施例中所描述的所述基于ECS的对象存储控制方法的步骤。
所述存储介质为实体的、非瞬时性的存储介质,例如可以是U盘、移动硬盘、只读存储器(Read-Only Memory,ROM)、磁碟或者光盘等各种可以存储计算机程序的实体存储介质。
本领域普通技术人员可以意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,能够以电子硬件、计算机软件或者二者的结合来实现,为了清楚地说明硬件和软件的可互换性,在上述说明中已经按照功能一般性地描述了各示例的组成及步骤。这些功能究竟以硬件还是软件方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请的范围。
以上所述,仅为本申请的具体实施方式,但本申请明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。
Claims (20)
- 一种基于ECS的对象存储控制方法,包括:接收用户端创建对象存储的创建请求;根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;接收所述创建信息;根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
- 根据权利要求1所述基于ECS的对象存储控制方法,其中,所述发送ECS主机资源需求至ECS服务端的步骤,还包括:发送与所述ECS主机资源需求中包含的ECS主机大小一致的预设云磁盘需求至所述ECS服务端,以使所述ECS服务端根据所述预设云磁盘需求创建预设云磁盘,并使所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘。
- 根据权利要求1或者2所述基于ECS的对象存储控制方法,其中,所述将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问的步骤之后,还包括:接收所述用户端发送的所述预设对象存储系统的下线请求;根据所述下线请求,发送ECS资源释放请求至所述ECS服务端,以使所述ECS服务端释放所述预设对象存储系统所对应的ECS资源,所述ECS资源包括ECS主机。
- 根据权利要求1所述基于ECS的对象存储控制方法,其中,所述发送预设ECS主机资源需求至ECS服务端的步骤之前,还包括:根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求,所述预设ECS主机资源需求包括所需的ECS主机规格及主机数量。
- 根据权利要求4所述基于ECS的对象存储控制方法,其中,所述统计所述创建请求所需的预设ECS主机资源需求的步骤包括:获取所述创建请求中所包含的用户需要的预估存储容量;获取预设副本所对应的副本数,其中,所述副本为备份;获取每台ECS主机规格所对应的主机存储容量;根据所述预估存储容量、所述副本数及所述主机存储容量,确定所述创建请求所需的ECS主机的主机数量,以得到所述创建请求所需的ECS主机规格及主机数量。
- 根据权利要求1所述基于ECS的对象存储控制方法,其中,所述预设对象存储系统基于MinIO对象存储服务而构建。
- 根据权利要求1所述基于ECS的对象存储控制方法,其中,所述虚拟内存文件系统为Tmpfs文件系统。
- 一种基于ECS的对象存储控制装置,包括:第一接收单元,用于接收用户端创建对象存储的创建请求;第一发送单元,用于根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;第二接收单元,用于接收所述创建信息;挂载单元,用于根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;构建单元,用于基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所 述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;返回单元,用于将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
- 一种计算机设备,所述计算机设备包括存储器以及与所述存储器相连的处理器;所述存储器用于存储计算机程序;所述处理器用于运行所述计算机程序,以执行如下步骤:接收用户端创建对象存储的创建请求;根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;接收所述创建信息;根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
- 根据权利要求9所述计算机设备,其中,所述发送ECS主机资源需求至ECS服务端的步骤,还包括:发送与所述ECS主机资源需求中包含的ECS主机大小一致的预设云磁盘需求至所述ECS服务端,以使所述ECS服务端根据所述预设云磁盘需求创建预设云磁盘,并使所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘。
- 根据权利要求9或者10所述计算机设备,其中,所述将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问的步骤之后,还包括:接收所述用户端发送的所述预设对象存储系统的下线请求;根据所述下线请求,发送ECS资源释放请求至所述ECS服务端,以使所述ECS服务端释放所述预设对象存储系统所对应的ECS资源,所述ECS资源包括ECS主机。
- 根据权利要求9所述计算机设备,其中,所述发送预设ECS主机资源需求至ECS服务端的步骤之前,还包括:根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求,所述预设ECS主机资源需求包括所需的ECS主机规格及主机数量。
- 根据权利要求12所述计算机设备,其中,所述统计所述创建请求所需的预设ECS主机资源需求的步骤包括:获取所述创建请求中所包含的用户需要的预估存储容量;获取预设副本所对应的副本数,其中,所述副本为备份;获取每台ECS主机规格所对应的主机存储容量;根据所述预估存储容量、所述副本数及所述主机存储容量,以得到所述创建请求所需的ECS主机的主机数量,从而得到所述创建请求所需的ECS主机规格及主机数量。
- 根据权利要求9所述计算机设备,其中,所述预设对象存储系统基于MinIO对象存储服务而构建。
- 根据权利要求9所述计算机设备,其中,所述虚拟内存文件系统为Tmpfs文件系统。
- 一种计算机可读存储介质,所述存储介质存储有计算机程序,所述计算机程序被处理器执行时可实现如下步骤:接收用户端创建对象存储的创建请求;根据所述创建请求,发送预设ECS主机资源需求至ECS服务端,以使所述ECS服务端根据所述ECS主机资源需求创建ECS主机,并在所述ECS主机创建成功后,返回所述ECS主机所对应的创建信息;接收所述创建信息;根据所述创建信息,将所述ECS主机挂载成预设虚拟文件系统;基于所述虚拟文件系统,在所述ECS主机上构建预设对象存储系统,所述预设对象存储系统包含所述预设对象存储系统所对应的访问IP;将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问。
- 根据权利要求16所述计算机可读存储介质,其中,所述发送ECS主机资源需求至ECS服务端的步骤,还包括:发送与所述ECS主机资源需求中包含的ECS主机大小一致的预设云磁盘需求至所述ECS服务端,以使所述ECS服务端根据所述预设云磁盘需求创建预设云磁盘,并使所述预设对象存储系统运行时将内存文件系统中的文件同步复制至所述预设云磁盘。
- 根据权利要求16或者17所述计算机可读存储介质,其中,所述将所述访问IP返回至所述用户端,以使所述用户端通过所述访问IP接收其它用户端的访问的步骤之后,还包括:接收所述用户端发送的所述预设对象存储系统的下线请求;根据所述下线请求,发送ECS资源释放请求至所述ECS服务端,以使所述ECS服务端释放所述预设对象存储系统所对应的ECS资源,所述ECS资源包括ECS主机。
- 根据权利要求16所述计算机可读存储介质,其中,所述发送预设ECS主机资源需求至ECS服务端的步骤之前,还包括:根据所述创建请求,统计所述创建请求所需的预设ECS主机资源需求,所述预设ECS主机资源需求包括所需的ECS主机规格及主机数量。
- 根据权利要求19所述计算机可读存储介质,其中,所述统计所述创建请求所需的预设ECS主机资源需求的步骤包括:获取所述创建请求中所包含的用户需要的预估存储容量;获取预设副本所对应的副本数,其中,所述副本为备份;获取每台ECS主机规格所对应的主机存储容量;根据所述预估存储容量、所述副本数及所述主机存储容量,以得到所述创建请求所需的ECS主机的主机数量,从而得到所述创建请求所需的ECS主机规格及主机数量。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010738663.9A CN111881476B (zh) | 2020-07-28 | 2020-07-28 | 对象存储控制方法、装置、计算机设备及存储介质 |
CN202010738663.9 | 2020-07-28 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021139264A1 true WO2021139264A1 (zh) | 2021-07-15 |
Family
ID=73200329
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/118724 WO2021139264A1 (zh) | 2020-07-28 | 2020-09-29 | 对象存储控制方法、装置、计算机设备及存储介质 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111881476B (zh) |
WO (1) | WO2021139264A1 (zh) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114302085A (zh) * | 2021-12-23 | 2022-04-08 | 云从科技集团股份有限公司 | 数据存储方法、装置、电子设备及存储介质 |
CN115208907A (zh) * | 2022-07-15 | 2022-10-18 | 上海七牛信息技术有限公司 | 一种基于对象存储的存储方法及系统 |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN115277827A (zh) * | 2022-07-26 | 2022-11-01 | 中国电信股份有限公司 | 云资源配置方法、系统、装置、设备及存储介质 |
CN115496749B (zh) * | 2022-11-14 | 2023-01-31 | 江苏智云天工科技有限公司 | 基于目标检测训练预处理的产品缺陷检测方法及系统 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108737494A (zh) * | 2018-04-08 | 2018-11-02 | 广西大学 | 基于云计算的教学平台 |
CN109144658A (zh) * | 2017-06-27 | 2019-01-04 | 阿里巴巴集团控股有限公司 | 有限资源的负载均衡方法、装置及电子设备 |
US20190028538A1 (en) * | 2016-03-25 | 2019-01-24 | Alibaba Group Holding Limited | Method, apparatus, and system for controlling service traffic between data centers |
CN109766174A (zh) * | 2018-12-24 | 2019-05-17 | 杭州数梦工场科技有限公司 | 资源调度方法、资源调度装置和计算机可读存储介质 |
CN111124595A (zh) * | 2018-11-01 | 2020-05-08 | 阿里巴巴集团控股有限公司 | 一种提供云计算服务的方法及系统 |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103729229A (zh) * | 2011-12-31 | 2014-04-16 | 华茂云天科技(北京)有限公司 | 弹性计算服务系统 |
US9373001B2 (en) * | 2012-12-26 | 2016-06-21 | Barracuda Networks, Inc. | Distributed encryption and access control scheme in a cloud environment |
CN105227686B (zh) * | 2014-06-20 | 2019-04-09 | 中国电信股份有限公司 | 云主机域名的动态配置方法和系统 |
CN108399106A (zh) * | 2018-02-28 | 2018-08-14 | 华为技术有限公司 | 管理物理主机的方法和装置 |
-
2020
- 2020-07-28 CN CN202010738663.9A patent/CN111881476B/zh active Active
- 2020-09-29 WO PCT/CN2020/118724 patent/WO2021139264A1/zh active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20190028538A1 (en) * | 2016-03-25 | 2019-01-24 | Alibaba Group Holding Limited | Method, apparatus, and system for controlling service traffic between data centers |
CN109144658A (zh) * | 2017-06-27 | 2019-01-04 | 阿里巴巴集团控股有限公司 | 有限资源的负载均衡方法、装置及电子设备 |
CN108737494A (zh) * | 2018-04-08 | 2018-11-02 | 广西大学 | 基于云计算的教学平台 |
CN111124595A (zh) * | 2018-11-01 | 2020-05-08 | 阿里巴巴集团控股有限公司 | 一种提供云计算服务的方法及系统 |
CN109766174A (zh) * | 2018-12-24 | 2019-05-17 | 杭州数梦工场科技有限公司 | 资源调度方法、资源调度装置和计算机可读存储介质 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114302085A (zh) * | 2021-12-23 | 2022-04-08 | 云从科技集团股份有限公司 | 数据存储方法、装置、电子设备及存储介质 |
CN114302085B (zh) * | 2021-12-23 | 2024-02-20 | 云从科技集团股份有限公司 | 数据存储方法、装置、电子设备及存储介质 |
CN115208907A (zh) * | 2022-07-15 | 2022-10-18 | 上海七牛信息技术有限公司 | 一种基于对象存储的存储方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
CN111881476B (zh) | 2023-07-28 |
CN111881476A (zh) | 2020-11-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021139264A1 (zh) | 对象存储控制方法、装置、计算机设备及存储介质 | |
US11314458B2 (en) | Global de-duplication of virtual disks in a storage platform | |
US20190384678A1 (en) | System and method for managing backup and restore of objects over cloud platforms | |
US20200356277A1 (en) | De-duplication of client-side data cache for virtual disks | |
US11157457B2 (en) | File management in thin provisioning storage environments | |
US11392497B1 (en) | Low latency access to data sets using shared data set portions | |
US10715622B2 (en) | Systems and methods for accelerating object stores with distributed caching | |
WO2018059222A1 (zh) | 一种文件切片上传方法、装置及云存储系统 | |
US20200310859A1 (en) | System and method for an object layer | |
CN104020961B (zh) | 分布式数据存储方法、装置及系统 | |
US11550713B1 (en) | Garbage collection in distributed systems using life cycled storage roots | |
US11593270B1 (en) | Fast distributed caching using erasure coded object parts | |
US8495178B1 (en) | Dynamic bandwidth discovery and allocation to improve performance for backing up data | |
US11079968B1 (en) | Queue management in multi-site storage systems | |
US20170214578A1 (en) | Method for managing a software-defined data center | |
US11994944B2 (en) | Efficient networking for a distributed storage system | |
US11341104B1 (en) | In place resize of a distributed database | |
US10440145B1 (en) | SDK for reducing unnecessary polling of a network service | |
US20240103771A1 (en) | Sharing ephemeral storage of a virtual machine for use as victim caches for use by virtual storage appliances in a cloud environment | |
US10244085B2 (en) | Transmission control protocol (TPC) data handling | |
US11354204B2 (en) | Host multipath layer notification and path switchover following node failure | |
US11782882B2 (en) | Methods for automated artifact storage management and devices thereof | |
US11095745B1 (en) | Cloud-based scheduling of data operations to an object storage using an operation pool | |
US11632432B2 (en) | Dynamic overflow processing in a multi-user computing environment | |
US20240012923A1 (en) | Providing service tier information when validating api requests |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20911404 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205N DATED 22/03/2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20911404 Country of ref document: EP Kind code of ref document: A1 |