CN115134377A

CN115134377A - OOS storage method based on cloud computing technology

Info

Publication number: CN115134377A
Application number: CN202210509166.0A
Authority: CN
Inventors: 张刚峰; 张红岩; 张玉峰
Original assignee: Nanjing Kunjue Information Technology Co ltd
Current assignee: Nanjing Kunjue Information Technology Co ltd
Priority date: 2022-05-11
Filing date: 2022-05-11
Publication date: 2022-09-30

Abstract

The invention relates to the technical field of cloud computing storage, and discloses an OOS storage method based on a cloud computing technology, which comprises an ECS cloud server, wherein the ECS cloud server is respectively connected with various equipment access modules and clients in a bidirectional signal manner, the various equipment access modules are also connected with an OOS storage system, the OOS storage system is connected with the ECS cloud server in a bidirectional signal manner, and the ECS cloud server is also connected with an STS authentication unit in a bidirectional signal manner. OOS storage based on cloud computing can expand the capacity of dozens to hundreds of EBs and can fully utilize high-density storage; the flat structure is stored, the influence of a complex directory system on the performance is avoided, and the efficiency is extremely high; according to the horizontal expansion system, with the increase of capacity, data are automatically distributed to all storage nodes according to an algorithm, data access is provided by calling an authentication key provided by storage by HTTP (hyper text transport protocol), the HTTP (S) protocol is supported, the data are called and retrieved by adopting an REST API (application program interface) mode, and NFS (network file system) and SMB (system management server) support is also increased.

Description

OOS storage method based on cloud computing technology

Technical Field

The invention relates to the technical field of cloud computing storage, in particular to an OOS storage method based on a cloud computing technology.

Background

The traditional storage method is limited by the reliability of hardware, is easy to cause problems, and can cause irreversible data loss once a bad track of a disk occurs. And the capacity of a storage hard disk is limited, manual capacity expansion is needed, the single-wire or double-wire access speed is low, the bandwidth limitation is caused, and the maintenance cost of a specially-assigned person is high. And as businesses evolve, there is a need to manage a dramatically increasing and isolated volume of data from many sources used by any number of applications and business processes. Many companies are now faced with challenges associated with fragmenting storage products. How to expand storage at a lower cost and on a large scale becomes an urgent problem to be solved by many enterprises.

In an OOS storage system, an object is a basic entity for storing data, and includes a data portion and a metadata portion of the object, the data portion of the object refers to data or content information included in the object itself, the metadata of the object refers to information describing object information, and generally includes information such as creation time of the object, size of the object, modification time of the object, last access time of the object, read-write rights of the object, and the like; objects are usually placed in a container, which can be regarded as a collection of objects, but of course, a container can also contain sub-containers, and a container can contain multiple objects and multiple sub-containers. Examples and relationships of objects and containers are shown in figure one; the entire OOS storage system is composed of objects, containers, and associated management and security modules.

For a multi-virtual machine cloud computing system or a distributed computing system, the virtual machines use the block devices provided by the distributed OOS storage system as virtual disks. A plurality of virtualization hosts are provided on the virtualization management platform. The virtualization host manages tens or even hundreds of virtual machines, each of which is a client of the distributed OOS storage system D0SS, and each virtual machine shares network access D0 SS. Assuming that N virtual machines simultaneously access the distributed OOS storage system D0SS with a total bandwidth of W bps, only W/N bps is allocated to one virtual machine. Therefore, the bandwidth of a certain virtual machine under the management of the virtualization host for accessing the distributed storage system at a certain time is limited, and quick response and access bandwidth cannot be provided for a user.

Disclosure of Invention

The technical problem to be solved by the invention is to provide an OOS storage method based on cloud computing instead of a file storage mode, which can simply and efficiently manage massive objects and containers, and simultaneously ensure the simplicity, flexibility, low-cost expandability, safety and backward compatibility of a system.

In order to achieve the purpose, the invention provides the following technical scheme: an OOS storage method based on a cloud computing technology comprises the following steps:

s1, OOS storage based on cloud computing can expand the capacity of tens to hundreds of EB, and can fully utilize high-density storage;

s2: the flat structure is stored, the influence of a complex directory system on the performance is avoided, and the efficiency is extremely high;

s3, a transverse expansion system, wherein with the increase of the capacity, the data are automatically distributed in all the storage nodes according to the algorithm;

s4: data access is usually provided by means of an HTTP call OOS to store an authentication key provided by the OOS, so that not only is an HTTP (S) protocol supported, but also data is called and retrieved by adopting an API (application program interface) mode of REST, and NFS and SMB support is also increased.

Preferably, the ECS cloud server is respectively connected to multiple device access modules and clients through bidirectional signals, the multiple device access modules are further connected to an OOS storage system, the OOS storage system is connected to the ECS cloud server through bidirectional signals, and the ECS cloud server is further connected to an STS authentication unit through bidirectional signals.

Preferably, the client is connected with a CDN content delivery network in a bidirectional signal manner, and the CDN content delivery network is connected with a video transcoding module and a picture processing module in a bidirectional manner.

Preferably, the OOS storage system is in bidirectional signal connection with the video transcoding module, the OOS storage system and the video transcoding module are in signal connection with the image processing module together, and the OOS storage system is in unidirectional signal connection with the client.

Preferably, the multiple equipment access modules comprise a mobile phone, a computer, a television and a camera.

Preferably, the OOS storage system is mainly multimedia data, and the ECS cloud server relates to application management and data processing.

Preferably, the client and OOS storage relate to video playback.

Preferably, the video transcoding module and the CDN content delivery network relate to bidirectional video sharing.

Preferably, the STS authentication unit relates to a provisional authentication service, and the CDN content delivery network relates to content delivery.

Preferably, the service interface provided by the OOS storage service system to the outside mainly includes two types of interfaces: REST interfaces and API interfaces.

The invention provides an OOS storage method based on a cloud computing technology. The OOS storage method based on the cloud computing technology has the following beneficial effects:

OOS storage based on cloud computing can expand the capacity of tens to hundreds of EB, and high-density storage can be fully utilized; the flat structure is stored, the influence of a complex directory system on the performance is avoided, and the efficiency is extremely high; according to the horizontal expansion system, with the increase of capacity, data are automatically distributed to all storage nodes according to an algorithm, data access is provided by calling an authentication key provided by OOS storage by HTTP, the HTTP (S) protocol is supported, data are called and retrieved by adopting an REST API (application program interface) mode, and NFS and SMB support is also increased.

Drawings

FIG. 1 is a block diagram of an embodiment of a storage system for cloud computing based OOS objects in accordance with the present invention;

fig. 2 is a schematic diagram of a service interface externally provided by the OSS storage service system according to the present invention.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments.

Examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the drawings are illustrative and intended to be illustrative of the invention and are not to be construed as limiting the invention.

As shown in fig. 1-2, the present invention provides a technical solution: an OOS storage method based on a cloud computing technology comprises the following steps:

An OOS storage method based on a cloud computing technology comprises an ECS cloud server, wherein the ECS cloud server is respectively connected with a plurality of equipment access modules and a client in a bidirectional signal mode, the plurality of equipment access modules are further connected with an OOS storage system, and the OOS storage service system provides service interfaces for the outside and mainly comprises two types of interfaces: REST interface and API interface, OOS storage system and ECS cloud server are connected with each other by bidirectional signal, ECS cloud server is also connected with STS authentication unit by bidirectional signal, client side is connected with CDN content distribution network by bidirectional signal, CDN content distribution network is connected with video transcoding module and picture processing module by bidirectional signal, OOS storage system and video transcoding module are connected with picture processing module by bidirectional signal, OOS storage system and client side are connected with client side by unidirectional signal, multiple equipment access module includes mobile phone, computer, television, camera, OOS storage system is mainly video multimedia data, ECS cloud server relates to application management and data processing, client side and OOS storage relate to playback, video transcoding module and CDN content distribution network relate to bidirectional video, STS authentication unit relates to temporary authentication service, CDN content delivery networks involve content delivery.

The OOS storage method based on cloud computing according to the embodiment of the present invention is further described below

The service interface provided by the OOS storage service system to the outside mainly comprises two types of interfaces: REST interfaces and API interfaces. The REST interface is a software architecture interface based on the HTTP protocol, and is called representational state Transfer interface. In particular implementation, the REST interface is utilized to construct request messages via the HTTP protocol. If all data in the WEB server side is regarded as resources (Resource), then presented to the user (i.e. the client side) is the Representation (replication) of the resources. Each resource has its own unique Identifier, namely a Uniform Resource Identifier (URI); the expression State transition refers to the State of the client, not the State of the server, and in REST, the server should be stateless. Representational State (State) is each Resource (Resource), and the Representation (Representation) at the client is a State (State) of the client. The transition (Transfer) is to mean that when a user accesses different resources through different URIs, the Representation (replication) of the client changes, which means that the state of the client is transferred (Transfer). The API interface is a function interface provided by the storage system for the programming language level, and the client directly calls the interface function in the program to access the service provided by the OOS storage system, that is, the API interface is used to construct the request information by calling the interface function.

The client constructs corresponding service request information by using the provided interface type, analyzes the request information and then forwards the request information to the corresponding service layer unit for processing, thereby completing the access of the related functions of the OOS storage system.

The service layer element describes the functionality provided by the OOS storage system. The object service module performs management operation and control operation on the object according to the request information, and the management operation of the object comprises the following steps: creation, deletion, reading, writing, appending, recovery, copying, moving operations, etc. of objects; the control operation of the object includes: set attributes of objects, read attributes of objects, and the like.

The storage layer unit is a type of storage resource to which data in the OOS storage system is serialized, and the storage resource includes: file system resources, Key-Value storage system resources, database system resources, and the like. Because the storage interface of the service layer unit can abstract different types of storage resources, the access to the bottom storage resources is realized by using a uniform interface.

It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising a reference structure" does not exclude the presence of other identical elements in a process, method, article, or apparatus that comprises the element.

Claims

1. An OOS storage method based on a cloud computing technology comprises the following steps:

s1, the OOS storage based on cloud computing can expand the capacity of dozens to hundreds of EB and can fully utilize high-density storage;

s2: the flat structure is stored, the performance is not influenced by a complex directory system, and the efficiency is extremely high;

s3, a transverse expansion system, wherein with the increase of the capacity, the data are automatically distributed to all storage nodes according to an algorithm;

2. An OOS storage method based on cloud computing technology comprises an ECS cloud server, and is characterized in that: the system comprises an ECS cloud server, a plurality of equipment access modules and a client, wherein the ECS cloud server is respectively connected with the various equipment access modules in a bidirectional signal mode and the client, the various equipment access modules are further connected with an OOS storage system, the OOS storage system is connected with the ECS cloud server in a bidirectional signal mode, and the ECS cloud server is further connected with an STS authentication unit in a bidirectional signal mode.

3. The OOS storage method based on the cloud computing technology according to claim 1, wherein: the client-side bidirectional signal connection is connected with a CDN content distribution network, and the CDN content distribution network is bidirectionally connected with a video transcoding module and an image processing module.

4. The OOS storage method based on the cloud computing technology according to claim 2, wherein: the OOS storage system is in bidirectional signal connection with the video transcoding module, the OOS storage system and the video transcoding module are in signal connection with the picture processing module together, and the OOS storage system is in unidirectional signal connection with the client.

5. The OOS storage method based on the cloud computing technology according to claim 3, wherein: the multiple equipment access modules comprise a mobile phone, a computer, a television and a camera.

6. The OOS storage method based on the cloud computing technology according to claim 4, wherein: the OOS storage system mainly comprises multimedia data, and the ECS cloud server relates to application management and data processing.

7. The OOS storage method based on the cloud computing technology according to claim 5, wherein: the client and OOS storage relate to video playback.

8. The OOS storage method based on the cloud computing technology according to claim 6, wherein: the video screen transcoding module and the CDN content distribution network relate to bidirectional video screen sharing.

9. The OOS storage method based on the cloud computing technology according to claim 7, wherein: the STS authentication unit relates to a provisional authentication service, and the CDN content delivery network relates to content delivery.

10. The OOS storage method based on the cloud computing technology according to claim 8, wherein: the service interface provided by the OOS storage service system to the outside mainly comprises two types of interfaces: REST interfaces and API interfaces.