WO2019219059A1

WO2019219059A1 - Method, apparatus and system for storing data, and method for reading data, apparatus, and system

Info

Publication number: WO2019219059A1
Application number: PCT/CN2019/087232
Authority: WO
Inventors: 林鹏; 林起芊; 汪渭春
Original assignee: 杭州海康威视系统技术有限公司
Priority date: 2018-05-17
Filing date: 2019-05-16
Publication date: 2019-11-21
Also published as: CN110502184B; CN110502184A

Abstract

The present application belongs to the field of communications and relates to a method, apparatus and system for storing data, and a method, apparatus and system for reading the data. The method comprises: a first storage device determines a target virtual storage volume for storing data to be stored, and determines a target storage block from the target virtual storage volume; apply for at least one data object comprised in the target storage block in an object storage platform; store the data to be stored into the at least one data object; correspondingly save a correspondence relationship between a device identifier of a management device and first index information in the management device; and store second index information in an index block object corresponding to the target storage block in the object storage platform. The present application can improve the reliability of data storage.

Description

Method for storing data, method, device and system for reading data

The application claims the priority of the Chinese patent application filed on May 17, 2018, the application number of which is the number of the above-mentioned patent application No. 201101474,324.31, the title of the invention is "a method of storing data, a method, a device and a system for reading data", the entire contents of which are The citations are incorporated herein by reference.

Technical field

The present application relates to the field of communications, and in particular, to a method for storing data, a method, device, and system for reading data.

Background technique

In the field of monitoring, the camera device is used to capture video data, and the video data captured by the camera device needs to be saved, so that the video data captured by the camera device can be queried in a later period. At present, the camera device transmits the captured video data to the network side after capturing the video data.

On the network side, a management server and multiple storage servers can be deployed in advance, and a large-capacity disk is deployed in each storage server. When receiving the video data sent by the camera device, the management server selects a storage server from the plurality of storage servers, and stores the video data in the selected disk of the storage server.

In the process of implementing the present application, the inventors found that the above method has at least the following defects:

Since the reliability of the storage server is not high, the video data is stored on the storage server, resulting in low reliability of data storage.

Summary of the invention

In order to improve the reliability of the data storage, the embodiment of the present application provides a method for storing data, a method, device, and system for reading data. The technical solution is as follows:

In a first aspect, an embodiment of the present application provides a method for storing data, where the method includes:

The first storage device determines a target virtual storage volume for storing data to be stored, and determines a target storage block from the target virtual storage volume;

The first storage device applies at least one data object included in the target storage block in an object storage platform;

The first storage device correspondingly saves a correspondence between the device identifier and the first index information in the management device, where the first index information includes at least a volume identifier of the target virtual storage volume, and the target storage block. a block identifier, a data identifier of the data to be stored, a first data start location of the data to be stored, and a first data length of the data to be stored;

The first storage device stores second index information in an index block object corresponding to the target storage block in the object storage platform, where the second index information includes at least the first data start position.

Optionally, the determining a target virtual storage volume for storing data to be stored, and determining a target storage block from the target virtual storage volume, includes:

Selecting one virtual storage volume from the at least one virtual storage volume corresponding to the first storage device as the target virtual storage volume;

Obtaining, from the object storage platform, a block bitmap object of the target virtual storage volume, where the block bitmap object is used to store an identifier bit of each storage block in the target virtual storage volume, and an identifier bit of the storage block is used for Recording whether the storage block is idle;

A free memory block is selected from the target virtual storage volume as a target storage block according to the block bitmap object.

Optionally, after the selecting, according to the block bitmap object, the free storage block from the target virtual storage volume as the target storage block, the method further includes:

In a block bitmap object of the target virtual storage volume, an identification bit of the target storage block is set to identify that the target storage block has been used.

Optionally, the method further includes:

Creating a first virtual storage volume for the first storage device in the object storage platform.

Optionally, the creating, by the object storage platform, the first virtual storage volume for the first storage device includes:

Generating a volume identifier of the first virtual storage volume;

Adding a volume identifier of the first virtual storage volume to a storage volume list object corresponding to the first storage device in the object storage platform;

Applying, in the object storage platform, a boot block object of the first virtual storage volume, a block bitmap object, and an index object of each of the first virtual storage volumes;

The boot block object is configured to store volume basic information, where the volume basic information includes at least a capacity of the first virtual storage volume, a number of storage blocks, and a device identifier of the first storage device; An object is configured to store an identifier bit of each of the first virtual storage volumes, where an identifier of the storage block is used to identify whether the storage block is idle; an index object of the storage block is used to store third index information. The third index information includes at least the number of data objects in the storage block.

Optionally, the method further includes:

Loading at least one virtual storage volume corresponding to the first storage device to the first storage device according to the storage volume list object corresponding to the first storage device in the object storage platform when the first storage device is started In a storage device, the storage volume list object is used to store a volume identifier of at least one virtual storage volume corresponding to the first storage device.

Optionally, the at least one virtual storage volume corresponding to the first storage device is loaded into the first storage device according to the storage volume list object corresponding to the first storage device in the object storage platform. ,include:

Downloading, from the object storage platform, a storage volume list object corresponding to the first storage device;

Downloading, according to a volume identifier of the second virtual storage volume, a boot block object of the second virtual storage volume from the object storage platform, where a volume identifier of the second virtual storage volume is any one of the storage volume list objects The volume ID of a virtual storage volume;

And adding, when the boot block object stores the device identifier of the first storage device, the volume identifier of the second virtual storage volume to the first storage device.

Optionally, the method further includes:

The first storage device takes over the third virtual storage volume according to the volume identifier of the third virtual storage volume, where the third virtual storage volume is a virtual storage volume corresponding to the second storage device, and the second storage device is Other storage devices than the first storage device.

Optionally, the taking over the third virtual storage volume according to the volume identifier of the third virtual storage volume includes:

Receiving a takeover request message, where the takeover request message carries a volume identifier of the third virtual storage volume;

Updating, according to the volume identifier of the third virtual storage volume, the device identifier of the second storage device saved in the startup block object of the third virtual storage volume to the device identifier of the first storage device;

And adding a volume identifier of the third virtual storage volume to the first virtual storage device and the storage volume list object corresponding to the first storage device.

In a second aspect, the present application provides a method of reading data, the method comprising:

Receiving a read request message including location information, where the location information includes a second data start location of the data to be read, a second data length, a volume identifier of the target storage volume where the data to be read is located, and a target The block identifier of the storage block;

Reading the data to be read from the target storage block in the object storage platform according to the location information.

Optionally, the reading the data to be read from the target storage block in the object storage platform according to the location information, including:

Obtaining an index object of the target storage block from an object storage platform according to a volume identifier of the target storage volume and a block identifier of the target storage block, where the index object includes a data stored in the target storage block a data starting position;

Determining, according to the first data start position and the second data start position, a target data object for storing the data to be read and an offset of the data to be read in the target data object ;

Reading the data to be read from the target data object according to the offset and the second data length.

In a third aspect, the present application provides an apparatus for storing data, the apparatus comprising:

a determining module, configured to determine a target virtual storage volume for storing data to be stored, and determining a target storage block from the target virtual storage volume;

An application module, configured to apply, in an object storage platform, at least one data object included in the target storage block;

a storage module, configured to store the to-be-stored data in the at least one data object, and correspondingly store a correspondence between the device identifier of the device and the first index information, where the first index information is And including at least a volume identifier of the target virtual storage volume, a block identifier of the target storage block, a data identifier of the data to be stored, a first data start location of the data to be stored, and a first to be stored data a data length; storing, in the index block object corresponding to the target storage block in the object storage platform, second index information, where the second index information includes at least the first data start position.

Optionally, the determining module includes:

a first selection unit, configured to select one virtual storage volume from the at least one virtual storage volume corresponding to the device as the target virtual storage volume;

An obtaining unit, configured to acquire, from the object storage platform, a block bitmap object of the target virtual storage volume, where the block bitmap object is used to store an identifier bit of each storage block in the target virtual storage volume, and a storage block The flag bit is used to record whether the memory block is idle;

And a second selecting unit, configured to select, from the target virtual storage volume, a free storage block as the target storage block according to the block bitmap object.

Optionally, the device further includes:

a setting unit, configured to set, in a block bitmap object of the target virtual storage volume, an identification bit of the target storage block to identify that the target storage block has been used.

Optionally, the device further includes:

A module is created for creating a first virtual storage volume for the device in the object storage platform.

Optionally, the creating module includes:

a generating unit, configured to generate a volume identifier of the first virtual storage volume;

a first adding unit, configured to add a volume identifier of the first virtual storage volume to a storage volume list object corresponding to the device located in the object storage platform;

An application unit, configured to apply, in the object storage platform, a boot block object of the first virtual storage volume, a block bitmap object, and an index object of each of the first virtual storage volumes;

The boot block object is configured to store volume basic information, where the volume basic information includes at least a capacity of the first virtual storage volume, a number of storage blocks, and a device identifier of the device; the block bitmap object is used for And storing an identifier bit of each of the first virtual storage volumes, where an identifier of the storage block is used to identify whether the storage block is idle; an index object of the storage block is configured to store third index information, The third index information includes at least the number of data objects in the storage block.

Optionally, the device further includes:

a loading module, configured to load at least one virtual storage volume corresponding to the device into the device according to a storage volume list object corresponding to the device in the object storage platform when the device is started, The storage volume list object is used to store a volume identifier of at least one virtual storage volume corresponding to the device.

Optionally, the loading module includes:

a downloading unit, configured to download, from the object storage platform, a storage volume list object corresponding to the device, and downloading, according to a volume identifier of the second virtual storage volume, the startup of the second virtual storage volume from the object storage platform a volume identifier, where a volume identifier of the second virtual storage volume is a volume identifier of any one of the storage volume list objects;

a second adding unit, configured to add a volume identifier of the second virtual storage volume to the device when the boot block object stores the device identifier of the device.

Optionally, the device further includes:

a takeover module, configured to take over the third virtual storage volume according to the volume identifier of the third virtual storage volume, where the third virtual storage volume is a virtual storage volume corresponding to the second storage device, and the second storage device is Other storage devices than the device.

Optionally, the takeover module includes:

a receiving unit, configured to receive a takeover request message, where the takeover request message carries a volume identifier of the third virtual storage volume;

An update unit, configured to update, according to the volume identifier of the third virtual storage volume, a device identifier of the second storage device saved in the startup block object of the third virtual storage volume to a device identifier of the device;

And a third adding unit, configured to separately add volume identifiers of the third virtual storage volume to the storage volume list object corresponding to the device and the device.

In a fourth aspect, the present application provides an apparatus for reading data, the apparatus comprising:

a receiving module, configured to receive a read request message including location information, where the location information includes a second data start location of the data to be read, a second data length, and a volume of the target storage volume where the data to be read is located The identifier of the block and the block of the target storage block;

And a reading module, configured to read the data to be read from the target storage block in the object storage platform according to the location information.

Optionally, the reading module includes:

An obtaining unit, configured to acquire an index object of the target storage block from an object storage platform according to a volume identifier of the target storage volume and a block identifier of the target storage block, where the index object includes the target storage block The first data start position of the stored data;

a determining unit, configured to determine, according to the first data start location and the second data start location, a target data object for storing the data to be read and the data to be read in the target data The offset in the object;

And a reading unit, configured to read the data to be read from the target data object according to the offset and the second data length.

In a fifth aspect, the embodiment of the present application provides a system for storing data, where the system includes: a storage device, an object storage platform, and a management device;

The storage device is configured to determine a target virtual storage volume for storing data to be stored, and determine a target storage block from the target virtual storage volume; and apply at least the target storage block included in the object storage platform a data object; storing the data to be stored in the at least one data object; correspondingly storing a correspondence between the device identifier of the storage device and the first index information in the management device, the first The index information includes at least a volume identifier of the target virtual storage volume, a block identifier of the target storage block, a data identifier of the data to be stored, a first data start location of the data to be stored, and the to-be-stored data The first data length is stored in the index block object corresponding to the target storage block in the object storage platform, and the second index information includes at least the first data start position.

In a sixth aspect, the embodiment of the present application provides a system for reading data, where the system includes: a storage device, a management device, and an object storage platform;

The storage device is configured to receive a read request message that includes the location information that is sent by the management device, where the location information includes a second data start location of the data to be read, a second data length, and the to-be-read The volume identifier of the target storage volume where the data is located and the block identifier of the target storage block in which the data is stored; the data to be read is read from the target storage block in the object storage platform according to the location information.

The technical solutions provided by the embodiments of the present application may include the following beneficial effects:

The first storage device determines a target virtual storage volume for storing data to be stored, and determines a target storage block from the target virtual storage volume; applies at least one data object included in the target storage block in the object storage platform; and the data to be stored Stored in at least one data object. Moreover, since the reliability of the storage data of the object storage platform is high, the reliability of the data storage is improved.

The above general description and the following detailed description are intended to be illustrative and not restrictive.

DRAWINGS

The drawings herein are incorporated in and constitute a part of the specification,

1-1 is a schematic diagram of a network architecture provided by an embodiment of the present application;

1-2 is a schematic diagram of a storage structure provided by an embodiment of the present application;

2 is a flowchart of a method for creating a virtual storage volume according to an embodiment of the present application;

3 is a flowchart of a method for loading a virtual storage volume according to an embodiment of the present application;

4 is a flowchart of a method for taking over a virtual storage volume according to an embodiment of the present application;

FIG. 5 is a flowchart of a method for storing data according to an embodiment of the present application;

FIG. 6 is a flowchart of a method for reading data according to an embodiment of the present application;

FIG. 7 is a schematic structural diagram of an apparatus for storing data according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of an apparatus for reading data according to an embodiment of the present disclosure;

9 is a schematic structural diagram of a system for storing data according to an embodiment of the present application;

FIG. 10 is a schematic structural diagram of a system for reading data according to an embodiment of the present disclosure;

FIG. 11 is a schematic structural diagram of a device according to an embodiment of the present application.

The embodiments of the present application have been illustrated by the above-described figures, which will be described in more detail hereinafter. The drawings and the written description are not intended to limit the scope of the present invention in any way, and the concept of the present application will be described by those skilled in the art by referring to the specific embodiments.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. The following description refers to the same or similar elements in the different figures unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are merely examples of devices and methods consistent with aspects of the present application as detailed in the appended claims.

Referring to FIG. 1-1, referring to FIG. 1-1, an embodiment of the present application provides a network architecture, including:

Management device 1, at least one storage device 2 and object storage platform 3;

A network connection is established between the management device 1 and each of the at least one storage device 2, and a network connection is established between each storage device 2 and the object storage platform 3. The network connection can be a wired connection or a wireless connection.

The object storage platform 3 stores data in a file storage manner. The storage unit in the object storage platform 3 is a data object, and one data object can be a file.

The storage device 2 can call an object storage interface of the object storage platform 3, by which data can be read from the object storage platform 3, stored in or deleted from the object storage platform 3, and the like.

In a possible implementation manner, the management device 1 may be a management server or a management terminal, and the storage device 2 may be a storage server or a storage terminal or the like.

Referring to FIG. 1-2, the storage device 2 corresponds to one storage volume list object and at least one virtual storage volume, and each virtual storage volume includes at least one storage block. The storage volume list object is a data object in the object storage platform 3 for storing the volume identifier of each virtual storage volume corresponding to the storage device 2.

For each virtual storage volume, the virtual storage volume corresponds to a boot block object and a block bitmap object; the boot block object is a data object in the object storage platform 3, and is used to store volume basic information of the virtual storage volume. The volume basic information includes at least the capacity of the virtual storage volume, the number of storage blocks, and the device identification of the storage device 2. The block bitmap object is also a data object in the object storage platform 3, and is used for storing an identifier bit of each storage block included in the virtual storage volume, and the identifier bit of the storage block is used to identify whether the storage block is free.

For each memory block in the virtual storage volume, the storage block corresponds to an index object, and the storage block includes at least one data object. The index object corresponding to the storage block is a data object in the object storage platform 3, and is used for storing index information of the storage block; when the storage block does not store data, that is, when the storage block is idle, the index information is The third index information includes at least the number of data objects in the storage block. When the storage block stores data, the index information includes second index information, and may further include third index information, where the second index information is at least Includes the starting position of the data.

Referring to FIG. 2, the embodiment of the present application provides a method for creating a virtual storage volume, which may be applied to the network architecture shown in FIG. 1-1, and the execution entity may be a storage device in the network architecture.

For any storage device of the network architecture, for convenience of description, the storage device is referred to as a first storage device, and the first storage device creates a first virtual storage volume for the storage device in the object storage platform. Referring to Figure 2, the creation process can be:

Step 201: The first storage device generates a volume identifier of the first virtual storage volume.

In a possible implementation manner, the first storage device may allocate a character string, and the device identifier of the first storage device and the string form a volume identifier of the first virtual storage volume.

The first storage device may randomly assign a character string or sequentially assign a character string based on the last last allocated string. For the manner of sequential allocation, assuming that the last last allocated character string is OS 251, the character string sequentially allocated on the basis of the character string OS 251 is OS 252.

In a possible implementation, the string may be suffixed and the device identifier of the first storage device is formed into a volume identifier of the first virtual storage volume; for example, if the device identifier of the first storage device is fall 613158, The assigned character string OS252 is suffixed, and the volume identifier of the first virtual storage volume constituting the device identifier of the first storage device is fall613158/OS252. or,

In a possible implementation, the string may be prefixed with the device identifier of the first storage device to form a volume identifier of the first virtual storage volume; for example, the assigned string OS252 is prefixed, and The device identifier of a storage device constitutes the volume identifier of the first virtual storage volume as OS252/fall613158.

When the first storage device generates the volume identifier of the first virtual storage volume, it may ensure that the volume identifier of the first virtual storage volume is not the same as the volume identifier of the generated virtual storage volume. Therefore, in general, the first storage device may generate a volume identifier of the first virtual storage volume in a sequential allocation manner.

In a possible implementation, after the step is performed, the volume identifier of the first virtual storage volume may be added to the storage volume list object corresponding to the first storage device in the object storage platform, and the implementation process may be as follows. The operations of steps 202 to 204.

Step 202: The first storage device determines whether there is a storage volume list object corresponding to the first storage device in the object storage platform. If not, step 203 is performed, and if yes, step 204 is performed.

The storage volume list object corresponding to the first storage device is a data object in the object storage platform, and is used to store a volume identifier of at least one virtual storage volume belonging to the first storage device.

In a possible implementation manner, the storage volume list object may include a storage volume list, and the volume identifier of the at least one virtual storage volume belonging to the first storage device may be stored in the storage volume list.

In this step, the first storage device may acquire the object identifier of the storage volume list object according to the device identifier of the first storage device and the preset and the first preset character string, invoke the object storage interface, and invoke the object storage interface from the object. The storage platform queries the storage volume list object corresponding to the object identifier.

Before the step of executing, if the first storage device has applied for the storage volume list object in the object storage platform, the object storage platform has an object identifier that is the same as the acquired object identifier, and the data object is the first storage. The storage volume list object that the device has applied for in the object storage platform. Correspondingly, the first storage device may query, from the object storage platform, the obtained storage volume list object corresponding to the acquired object identifier.

If the first storage device does not apply for the storage volume list object in the object storage platform before performing this step, the object storage platform does not have the same data object as the obtained object identifier. Correspondingly, the first storage device may not query the obtained storage volume list object corresponding to the object identifier from the object storage platform.

In a possible implementation manner, the first storage device acquires an object identifier of the storage volume list object, and may be:

The first storage device may form the first preset character string and the device identifier of the first storage device to form an object identifier of the storage volume list object.

For example, the above two examples of constituent object identifiers are listed, and examples of other constituent object identifiers are not listed one by one. In the first example, the first storage device may use the first preset character string as the prefix of the device identifier of the first storage device, and the device identifier of the first storage device to form the object identifier of the storage volume list object. For example, the first preset character string is LIST, the first preset character string LIST is used as a prefix, and the object identifier of the storage volume list object is formed by the device identifier fall 613158 of the first storage device as LIST_fall 613158. or,

In the second example, the first storage device may use the first preset character string as the suffix of the device identifier of the first storage device and the device identifier of the first storage device to form the object identifier of the storage volume list object. For example, suppose the first preset character string is LIST, the first preset character string LIST is used as a suffix, and the object identifier of the storage volume list object is formed with the device identifier fall 613158 of the first storage device as fall613158/LIST.

Step 203: The first storage device applies, in the object storage platform, a storage volume list object, where the storage volume list object is used to store the volume identifier of the first virtual storage volume, and step 205 is performed.

The first storage device may invoke an object storage interface of the object storage platform, apply for a data object in the object storage platform, and set the object identifier of the data object to obtain the object identifier, and obtain the corresponding storage device. A volume list object is stored, and the volume identifier of the first virtual storage volume is stored in the storage volume list object.

Step 204: The first storage device adds the volume identifier of the first virtual virtual volume to the storage volume list object in the object storage platform.

After the first storage device queries the corresponding storage volume list object from the object storage platform, the volume identifier of the first virtual storage volume may be added to the storage volume list object.

In a possible implementation manner, the storage volume list object may include a storage volume list, and the volume identifier of the first virtual storage volume may be added to the storage volume list. For example, the volume ID of the first virtual storage volume can be appended to the end of the list of storage volumes.

The storage volume list object corresponding to the first storage device is substantially a file stored in the object storage platform. In this step, after the first storage device queries the corresponding storage volume list object from the object storage platform, the storage volume list object is read from the object storage platform, and the volume identifier of the first virtual storage volume is added to the In the storage volume list object, the added storage volume list object is uploaded to the object storage platform, so that the object storage platform updates the storage volume list object corresponding to the first storage device saved by the object storage platform to the added storage volume list object.

Step 205: The first storage device applies, in the object storage platform, a boot block object and a block bitmap object of the first virtual storage volume, and an index object of each storage block in the first virtual storage volume.

The boot block object is configured to store volume basic information, where the volume basic information includes at least a capacity of the first virtual storage volume, a number of storage blocks, and a device identifier of the first storage device. The block bitmap object is used to store an identification bit of each storage block in the first virtual storage volume, and the identification bit of the storage block is used to identify whether the storage block is free. The index object of the storage block is used to store third index information, and the third index information includes at least the number of data objects in the storage block.

In this step, the first storage device may set the capacity of the first virtual storage volume, the number of storage blocks M, and set the number N of data objects included in each storage block, and generate an object of the startup block object of the first virtual storage volume. The object identifier of the identifier and the block bitmap object, and the object identifier of the index object of each storage block; applying the data object in the object storage platform, setting the object identifier of the data object to the object identifier of the startup block object, and obtaining the a boot block object of a virtual storage volume, storing basic information of the volume in the boot block object; applying a data object in the object storage platform, setting an object identifier of the data object to an object identifier of the block bitmap object, obtaining the first a block bitmap object of a virtual storage volume, where the M bitmap bits are stored in the block bitmap object, each identifier bit corresponding to a storage block in the first virtual storage volume, used to identify whether the storage block is idle; For each storage block, apply for a data object in the object storage platform, and set the object identifier of the data object to an index object of the storage block. Object identifier, to obtain the index object corresponding to the storage block, the storage block includes a number of data objects stored in the index object.

Since the first virtual storage volume is a newly created storage volume, each storage block in the first virtual storage volume is idle, and the identification bits of the M storage blocks included in the block bitmap object of the first virtual storage volume, The identification bit of the memory block is used to identify that the memory block is free.

In a possible implementation, the operation of generating the object identifier of the boot block object of the first virtual storage volume and the object identifier of the block bitmap object, and the object identifier of the index object of each storage block may be:

The volume identifier of the first virtual storage volume and the second preset string are grouped into an object identifier of a boot block object of the first virtual storage volume. For example, assuming that the second string boot is preset, the object identifier of the startup block object of the first virtual storage volume composed may be fall613158/OS252/boot.

The volume identifier of the first virtual storage volume and the third preset string are grouped into object identifiers of the block bitmap object of the first virtual storage volume. For example, assuming that the third preset character string is map, the object identifier of the block bitmap object of the first virtual storage volume composed may be fall613158/OS252/map.

For each memory block, the volume identifier of the first virtual storage volume, the fourth preset character string, and the block number of the storage block in the first virtual storage volume constitute an object identifier of the index object of the storage block. For example, if the fourth preset character string is info and the block number of the storage block in the first virtual storage volume is 1, the object identifier of the index object of the storage block that is formed is fall613158/OS252/info/1.

In a possible implementation manner, the volume identifier of the first virtual storage volume may also be added to the memory of the first storage device.

In a possible implementation, the memory of the first storage device may include a storage volume linked list, where the storage volume linked list is used to store a volume identifier of each virtual storage volume corresponding to the first storage device.

In a possible implementation, each node in the storage volume linked list is used to store a volume identifier of a virtual storage volume. Therefore, adding a node that stores the volume identifier of the first virtual storage volume to the storage volume linked list is implemented to add the volume identifier of the first virtual storage volume to the memory of the first storage device.

Referring to FIG. 3, the embodiment of the present application provides a method for loading a virtual storage volume. The method may be applied to a network architecture as shown in FIG. 1-1, and the execution entity may be a storage device in the network architecture.

For any storage device of the network architecture, the storage device is referred to as a first storage device for convenience of description. When the first storage device is started, the volume identifier of the virtual storage volume corresponding to the first storage device is loaded into the first storage device according to the storage volume list object of the first storage device in the object storage platform.

The data saved in the memory of the first storage device may be lost when the first storage device is turned off, that is, the volume identifier of the virtual storage volume corresponding to the first storage device included in the memory of the first storage device may be lost. When the first storage device is started, the volume identifier of the virtual storage volume corresponding to the first storage device needs to be saved to the memory of the first storage device. Loading the volume identifier of the virtual storage volume corresponding to the first storage device into the first storage device is: saving the volume identifier of the virtual storage volume corresponding to the first storage device to the memory of the first storage device. Referring to Figure 3, the loading process can be:

Step 301: The first storage device downloads its corresponding storage volume list object from the object storage platform.

The first storage device may obtain the object identifier of the storage volume list object, invoke the object storage interface, and download the storage volume list object corresponding to the object identifier from the object storage platform by using the invoked object storage interface.

In a possible implementation manner, the first storage device may form the first preset character string and the device identifier of the first storage device to form an object identifier of the storage volume list object.

In a possible implementation manner, the first storage device may use the first preset character string as a prefix of the device identifier of the first storage device and the device identifier of the first storage device to form an object identifier of the storage volume list object. For example, suppose the first preset character string is LIST, the device identifier of the first storage device is fall 613158; the first preset character string LIST is used as a prefix, and the device identifier fall 613158 of the first storage device constitutes an object identifier of the storage volume list object. For LIST_fall613158. or,

The first storage device may use the first preset character string as a suffix of the device identifier of the first storage device and the device identifier of the first storage device to form an object identifier of the storage volume list object. For example, suppose the first preset character string is LIST, the first preset character string LIST is used as a suffix, and the object identifier of the storage volume list object is formed with the device identifier fall 613158 of the first storage device as fall613158/LIST.

Step 302: Download a boot block object of the second virtual storage volume from the object storage platform according to the volume identifier of the second virtual storage volume, where the volume identifier of the second virtual storage volume is any virtual storage volume in the storage volume list object. Volume identification.

In a possible implementation, the object identifier of the startup block object of the second virtual storage volume is generated, and the object storage interface is invoked, and the startup block object corresponding to the object identifier is downloaded from the object storage platform through the object storage interface.

In a possible implementation manner, the volume identifier of the second virtual storage volume and the second preset string may be formed into an object identifier of the startup block object of the second virtual storage volume. For example, suppose the second string boot is preset, the volume identifier of the second virtual storage volume is fall613158/OS252, and the object identifier of the startup block object of the composed second virtual storage volume may be fall613158/OS252/boot.

Step 303: Add a volume identifier of the second virtual storage volume to the first storage device when the boot block object of the second virtual storage volume stores the device identifier of the first storage device.

The volume basic information of the second virtual storage volume is stored in the startup block object of the second virtual storage volume, and the volume basic information includes at least the capacity of the second virtual storage volume, the number of storage blocks, and the device identifier of the storage device to which the storage device belongs.

In this step, when the boot block object of the second virtual storage volume stores the device identifier of the first storage device, a node storing the volume identifier of the second virtual storage volume is added to the storage volume linked list to implement the first The volume identifier of the second virtual storage volume is added to the memory of the first storage device.

The operations of

steps

302 and 303 above are performed on the volume identifier of each virtual storage volume in the storage volume list object, thereby loading the virtual storage volume of the first storage device into the first storage device.

Referring to FIG. 4, the embodiment of the present application provides a method for taking over a virtual storage volume. The method can be applied to the network architecture shown in FIG. 1-1, and the execution entity can be a storage device in the network architecture.

For any storage device of the network architecture, for convenience of description, the storage device is referred to as a first storage device, and the first storage device takes over the third virtual storage volume according to the volume identifier of the third virtual storage volume, and the third virtual storage volume is The virtual storage volume corresponding to the second storage device, and the second storage device is a storage device other than the first storage device. Referring to Figure 4, the takeover process can be:

Step 401: The first storage device receives a takeover request message, where the takeover request message carries a volume identifier of the third virtual storage volume.

The management device can send a takeover request message to the first storage device.

In a possible implementation manner, when the second storage device fails or exits, the management device may schedule a storage device other than the second storage device to take over the virtual storage volume of the second storage device. The implementation process can be:

The management device downloads the storage volume list object corresponding to the second storage device from the object storage platform, and determines the storage device to be taken over, which is referred to as the first storage device for convenience of description. Selecting, from the storage volume list object, a volume identifier of the virtual storage volume for the first storage device. To facilitate description of the volume identifier of the third virtual storage volume, a takeover request message is sent to the first storage device, where the takeover request message carries the Volume ID of the three virtual storage volumes.

In a possible implementation, the management device further stores a correspondence between the device identifier and the first index information of the storage block, where the first index information of each storage block in the correspondence relationship is An index information includes at least a volume identifier of a storage volume in which the storage block is located, a block number of the storage block, a data identifier of data stored in the storage block, a start position and a data length of the data, and the like.

In a possible implementation, after the management device sends the takeover request message to the first storage device, each first index information including the volume identifier of the third virtual storage volume may also be obtained from the corresponding relationship, where the corresponding information is obtained. In the relationship, the device identifier of the storage device corresponding to each first index information is updated to the device identifier of the first storage device.

In a possible implementation, the operation of the management device to download the storage volume list object corresponding to the second storage device may be: acquiring the device identifier of the second storage device, and setting the device identifier of the second storage device and the first preset character The string constitutes an object identifier of the storage volume list object of the second storage device; and the storage volume list object corresponding to the second storage device is downloaded from the object storage platform according to the object identifier.

Step 402: The first storage device updates the device identifier of the second storage device saved in the startup block object of the third virtual storage volume to the device identifier of the first storage device according to the volume identifier of the third virtual storage volume.

The first storage device may form a volume identifier of the third virtual storage volume and a second preset character string to form an object identifier of the startup block object, and download a startup block object of the third virtual storage volume from the object storage platform according to the object identifier; Modifying the device identifier of the second storage device saved in the boot block object to the device identifier of the first storage device; uploading the modified boot block object to the object storage platform, so that the third virtual storage volume to be saved by the object storage platform The startup block object is updated to the modified startup block object.

Step 403: The first storage device adds the volume identifier of the third virtual storage volume to the storage volume list object corresponding to the first storage device in the memory of the first storage device.

In a possible implementation manner, the first storage device may compose the device identifier and the first preset character string into an object identifier of the storage volume list object, and download the corresponding corresponding storage device from the object storage platform according to the object identifier. Storing a volume list object, adding a volume identifier of the third virtual storage volume to the storage volume list object; uploading the added storage volume list object to the object storage platform, so that the object storage platform stores the storage volume corresponding to the first storage device The list object is updated to the added storage volume list object.

In a possible implementation manner, the first storage device may add a node that stores the volume identifier of the third virtual storage volume in the storage storage volume linked list thereof, and add the volume identifier of the third virtual storage volume to the first A memory device in memory.

In the embodiment of the present application, when the second storage device is faulty or exits, the first storage device may be used to take over the third virtual storage volume corresponding to the second storage device, so that when the second storage device is faulty, A storage device reads the data in the third virtual storage volume, and the data cannot be read when the second storage device fails or exits, thereby improving the reliability of the data storage.

Referring to FIG. 5, an embodiment of the present application provides a method for storing data, where the method includes:

Step 501: The first storage device determines a target virtual storage volume for storing data to be stored, and determines a target storage block from the target virtual storage volume.

The data to be stored may be data buffered by the first storage device, and the cached data may be sent by the management device.

The management device can receive data sent by the terminal device, and the terminal device can be an imaging device or the like, and the data can be image data captured by the imaging device. The management device determines a storage device for storing the data. For convenience of explanation, the storage device is referred to as a first storage device, and the data is sent to the first storage device.

The first storage device receives the data and caches the data in its buffer. In a possible implementation manner, the first storage device may reach a preset data volume threshold in the amount of data in the buffer, or the buffer occupancy rate reaches a preset occupancy threshold, or in its buffer cache. In the case of full, etc., the method of the embodiment is started to store the data to be stored in the buffer into the object storage platform.

In a possible implementation manner, when the buffering time of the data in the buffer reaches a preset time threshold, the method in this embodiment is also started to store the data to be stored in the buffer into the object storage platform. That is, even if the amount of data in the buffer does not reach the preset data amount threshold, or if the buffer occupancy rate does not reach the preset occupancy threshold, or if its buffer is not buffered, etc., when in the buffer When the buffering time of the data reaches the preset time threshold, the method of the embodiment is started to store the data to be stored in the buffer into the object storage platform.

Because the reliability of the object storage platform is high, the first storage device stores the data to be stored in the cache cache of the cache to the object storage platform, which can improve the reliability of the data storage.

In a possible implementation manner, in this step, the target virtual storage volume may be determined through the following processes of 5011 to 5013, and the target storage block is determined, respectively:

5011: Select one virtual storage volume from the at least one virtual storage volume corresponding to the first storage device as the target virtual storage volume.

The volume identifier of the corresponding at least one virtual storage volume is stored in the memory of the first storage device. In this step, the first storage device determines each virtual storage volume corresponding to each virtual storage volume that is stored according to the volume identifier of each virtual storage volume that it stores, and selects one virtual storage volume from each corresponding virtual storage volume as the target virtual storage. volume.

5012: Download a block bitmap object of the target virtual storage volume from the object storage platform, where the block bitmap object is used to store an identifier bit of each storage block in the target virtual storage volume, and the storage block identifier bit is used for record storage. Whether the block is free.

In this step, the volume identifier of the target virtual storage volume and the third preset string may be formed into an object identifier of the block bitmap object of the target virtual storage volume, and the object storage interface is invoked, and the object storage identifier is downloaded according to the object identifier. A block bitmap object for the target virtual storage volume.

For example, suppose the volume identifier of the target virtual storage volume is fall613158/OS252, and the third preset string is map, so the volume identifier fall613158/OS252 of the target virtual storage volume and the third preset string map are composed of the target virtual storage volume. The object identifier of the block bitmap object is fall613158/OS252/map. The object storage interface is called, and the block bitmap object of the target virtual storage volume is downloaded through the object storage interface according to the object identifier fall613158/OS252/map.

The block bitmap object is used to store the identification bits corresponding to each of the storage blocks in the target virtual storage volume. The storage bits of each storage block in the block bitmap object are stored in the same order as each storage block in the target virtual storage volume.

The identification bit of the storage block is used to identify whether the storage block is free. In a possible implementation manner, when the identifier bit is a value of 1, it may indicate that the storage block is idle; when the identifier bit is a value of 0, it may indicate that the storage block has been used.

For example, if the block bitmap object stores 0001111, it means that the first storage block, the second storage block, and the third storage block in the target virtual storage volume are used, and the fourth storage block and the fifth storage block are used. The memory block, the sixth memory block, and the seventh memory block are all free.

5013: Select a free storage block from the target virtual storage volume as the target storage block according to the block bitmap object.

According to the identification bit of each storage block in the target virtual storage volume stored in the block bitmap object, the free storage block in the target virtual storage volume can be determined, and the storage block is selected from the free storage block as the target storage block.

For example, determining, according to the identifier bit 0001111 of each storage block stored by the block bitmap object, that the free storage block in the target virtual storage volume is the fourth storage block, the fifth storage block, and the sixth in the target virtual storage volume. The storage block and the seventh storage block can select the fourth storage block as the target storage block.

In a possible implementation, in the block bitmap object of the target virtual storage volume, the identification bit of the target storage block is set to be used to identify that the target storage block has been used.

Step 502: The first storage device applies at least one data object included in the target storage block in the object storage platform.

Specifically, the first storage device acquires an index object of the target storage block from the object storage platform, and applies N data objects from the object storage platform according to the number N of data objects included in the target storage block stored by the index object, and sets the N The object ID of each data object in the data object.

For each data object, the setting process of the object identifier of the data object can be:

Obtaining a block number of the target storage block in the target virtual storage volume, and obtaining a sequence number of the data object in the target storage block, and generating an object identifier of the data object according to the volume identifier of the target virtual storage volume, the block number, and the sequence number, Set the object ID of the data object to the generated object ID.

In a possible implementation manner, the volume identifier of the target virtual storage volume, the block number, and the sequence number may be formed into an object identifier of the data object. For example, suppose the volume identifier of the target virtual storage volume is fall613158/OS252, the block number is 1, and the sequence number is 1, the object identifier of the data object composed is fall613158/OS252/1/1. or,

In a possible implementation, the volume identifier of the target virtual storage volume, the block number, the sequence number, and the fifth preset string may be formed into an object identifier of the data object. For example, suppose the volume identifier of the target virtual storage volume is fall613158/OS252, the block number is 1, the sequence number is 1, and the fifth preset string is DATA/BLOCK, and the object identifier of the data object composed is fall613158/OS252. /DATA/BLOCK/1/1.

Step 503: The first storage device stores the to-be-stored data in the at least one data object.

In a possible implementation, the first storage device selects one or more data objects from the data objects included in the target storage block according to the data amount of the data to be stored, and sends a storage request to the object storage platform through the object storage interface. The storage request carries the object identifier of the data to be stored and the selected data object. The object storage platform stores the data to be stored in the data object corresponding to the object identifier.

The capacity of each data object in the object storage platform may be equal, and the capacity of the data object is included in the first storage device, so the first storage device determines the data object according to the data amount of the data to be stored and the capacity of the data object. The number, according to the number, selects a data object from the data objects included in the target storage block.

Step 504: The first storage device saves the correspondence between the device identifier and the first index information in the management device, and stores the second index information in the index block object corresponding to the target storage block in the object storage platform.

In a possible implementation manner, the first index information includes at least a volume identifier of the target virtual storage volume, a block number of the target storage block, and a data identifier of the data to be stored, a first data start location, and a first data length.

The second index information includes at least a first data start position. The first data starting position is a starting storage location of the data to be stored in the target storage block, and the first data length is the length of the data to be stored.

The first storage device may update the third index information saved by the index object of the target storage block to the second index information, or add the second index information to the index object of the target storage block; and then upload the update to the object storage platform. Or the added index object, so that the object storage platform replaces the index object of its saved target storage block with the updated or added index object.

The first storage device may send the first index information to the management device, so that the management device saves the device identifier of the first storage device and the first index information in a corresponding relationship between the device identifier and the first index information.

In a possible implementation manner, the data identifier of the data to be stored may be a device identifier of a device that collects data to be stored. For example, if the data to be stored is a piece of video data captured by the camera device, the data identifier of the data to be stored may be the device identifier of the camera device, and the first data start position of the data to be stored may be the start of the segment of video data. time.

In the embodiment of the present application, the first storage device determines a target virtual storage volume for storing data to be stored, and determines a target storage block from the target virtual storage volume; and at least one of the target storage blocks is requested in the object storage platform. a data object; storing the data to be stored in at least one data object. Moreover, since the reliability of the storage data of the object storage platform is high, the data to be stored is stored in the data object of the object storage platform, which can improve the reliability of the data storage.

Referring to FIG. 6, an embodiment of the present application provides a method for reading data, where the method includes:

Step 601: Receive a read request message including location information, where the location information includes a second data start location of the data to be read, a second data length, a volume identifier of the target storage volume where the data to be read is located, and a target The block number of the storage block.

The read request message may be sent by the management device. The corresponding relationship between the device identifier and the first index information is stored in the management device. The first index information of the storage block is stored in the correspondence, and the first index information of the storage block includes at least a volume identifier of the virtual storage volume where the storage block is located, a block number of the storage block, and is stored in the storage block. The data identification of the data, the first data start location of the data, and the first data length of the data.

The management device may receive the query data request from the terminal device, where the query data request may carry the data identifier of the data to be read, the second data start location, and the second data length; and the slave device identifier according to the data identifier of the data to be read. Obtaining, by the correspondence relationship with the first index information, first index information of the at least one storage block, where the first index information of each of the at least one storage block includes a data identifier of the data to be read, according to each storage block Determining a first data start position and a first data length included in the first index information, determining a location range of data stored in each of the storage blocks, determining a location range including the second data start position, and determining the determined location range Corresponding storage block is used as the target storage block; the device identifier of the storage device corresponding to the first index information of the target storage block is obtained from the correspondence, and the target virtual storage of the target storage block is obtained from the first index information of the target storage block. The volume ID of the volume and the block number of the target storage block; the storage device is identified according to the device identifier of the storage device Transmitting a read request message including location information, where the second data start position of the data to be read, the second data length, the volume identifier of the target storage volume where the data to be read is located, and the target storage block where the target is located Block number.

Next, the data to be read can be read from the target storage block in the object storage platform according to the location information. The detailed reading process can be implemented by the following steps 602 to 604.

Step 602: Acquire an index object of the target storage block from the object storage platform according to the volume identifier of the target storage volume and the block number of the target storage block, where the index object includes a first data start position of the data stored in the target storage block.

Specifically, the object identifier of the index object of the target storage block is obtained according to the volume identifier of the target storage volume and the block number of the target storage block, and the index object of the target storage block is downloaded from the object storage platform according to the object identifier.

For the object identifier of the index object, the volume identifier of the target virtual storage volume, the fourth preset character string, and the block number of the target storage block may be the object identifier of the index object of the target storage block.

Step 603: Determine, according to the first data start position and the second data start position, an offset of the target data object for storing the data to be read and the data to be read in the target data object.

Each data object in the object storage platform has the same capacity. Therefore, in this step, a difference between the first data start position and the second data start position may be calculated, and according to the difference and the data object capacity, the target data object for storing the data to be read may be calculated. The sequence number and the offset of the data to be read in the target data object.

Step 604: Read data to be read from the target data object according to the offset and the second data length.

An object identifier of the target data object may be obtained, and according to the offset, the data to be read of the second data length is read in the data object corresponding to the object identifier in the object storage platform. The read data is sent to the management device, and the data to be read is sent by the management device to the terminal device.

For the object identifier of the target data object, the object identifier of the target data object may be generated according to the volume identifier of the target virtual storage volume, the block number of the target storage block, and the sequence number of the target data object.

For example, the volume identifier of the target virtual storage volume, the block number of the target storage block, and the sequence number of the target data object may be composed of the object identifier of the data object. Alternatively, the volume identifier of the target virtual storage volume, the block number of the target storage block, the sequence number of the target data object, and the fifth preset string may be composed of the object identifier of the data object.

In the embodiment of the present application, a read request message including location information is included, where the location information includes a second data start location of the data to be read, a second data length, and a volume identifier of the target storage volume where the data to be read is located And a block identifier of the target storage block; and reading the data to be read from the target storage block in the object storage platform according to the location information. Therefore, the data is stored in the object storage platform. Since the object storage platform stores data with high reliability, the data is stored in the object storage platform, thereby improving the reliability of the data storage. Using data objects in the object storage platform to simulate blocks, it is easy to manage unstructured data such as video data. In addition, one of the multiple storage devices fails, and other normal devices can quickly take over the storage volumes in the failed device. , which further improves reliability.

Referring to FIG. 7, an embodiment of the present application provides an apparatus 700 for storing data, where the apparatus 700 includes:

a determining module 701, configured to determine a target virtual storage volume for storing data to be stored, and determine a target storage block from the target virtual storage volume;

The application module 702 is configured to apply, in the object storage platform, at least one data object included in the target storage block;

a storage module 703, configured to store the to-be-stored data in the at least one data object, and correspondingly save a correspondence between the device identifier of the device 700 and the first index information, where the first The index information includes at least a volume identifier of the target virtual storage volume, a block identifier of the target storage block, a data identifier of the data to be stored, a first data start location of the data to be stored, and the to-be-stored data The first data length is stored in the index block object corresponding to the target storage block in the object storage platform, and the second index information includes at least the first data start position.

In a possible implementation manner, the determining module 701 includes:

a first selection unit, configured to select one virtual storage volume from the at least one virtual storage volume corresponding to the device 700 as the target virtual storage volume;

In a possible implementation, the apparatus 700 further includes:

A module is created for creating a first virtual storage volume for the apparatus 700 in the object storage platform.

In a possible implementation manner, the creating module includes:

a first adding unit, configured to add a volume identifier of the first virtual storage volume to a storage volume list object corresponding to the device 700 located in the object storage platform;

The boot block object is configured to store volume basic information, where the volume basic information includes at least a capacity of the first virtual storage volume, a number of storage blocks, and a device identifier of the device 700; And storing an identifier bit of each storage block in the first virtual storage volume, where an identifier bit of the storage block is used to identify whether the storage block is idle; an index object of the storage block is used to store third index information, where The third index information includes at least the number of data objects in the storage block.

In a possible implementation, the apparatus 700 further includes:

a loading module, configured to load at least one virtual storage volume corresponding to the device 700 to the device 700 according to a storage volume list object corresponding to the device 700 in the object storage platform when the device 700 is started. The storage volume list object is configured to store a volume identifier of the at least one virtual storage volume corresponding to the device 700.

In a possible implementation manner, the loading module includes:

a downloading unit, configured to download a storage volume list object corresponding to the device 700 from the object storage platform, and download the second virtual storage volume from the object storage platform according to a volume identifier of the second virtual storage volume Activating a block object, the volume identifier of the second virtual storage volume being a volume identifier of any one of the storage volume list objects;

And a second adding unit, configured to add a volume identifier of the second virtual storage volume to the device 700 when the boot block object stores the device identifier of the device 700.

In a possible implementation, the apparatus 700 further includes:

a takeover module, configured to take over the third virtual storage volume according to the volume identifier of the third virtual storage volume, where the third virtual storage volume is a virtual storage volume corresponding to the second storage device, and the second storage device is Other storage devices than the device 700.

In a possible implementation manner, the takeover module includes:

An update unit, configured to update, according to the volume identifier of the third virtual storage volume, a device identifier of the second storage device saved in the startup block object of the third virtual storage volume to a device identifier of the device 700;

And a third adding unit, configured to add a volume identifier of the third virtual storage volume to the storage volume list object corresponding to the device 700 in the device 700.

Referring to FIG. 8, an embodiment of the present application provides an apparatus 800 for reading data, where the apparatus 800 includes:

The receiving module 801 is configured to receive a read request message including location information, where the location information includes a second data start location of the data to be read, a second data length, and a target storage volume where the data to be read is located The volume identifier and the block identifier of the target storage block in which it resides;

The reading module 802 is configured to read the data to be read from the target storage block in the object storage platform according to the location information.

In a possible implementation, the reading module 802 includes:

Referring to FIG. 9, the embodiment of the present application provides a system 900 for storing data, where the system 900 includes: a storage device 901, an object storage platform 902, and a management device 903;

The first storage device 901 is configured to determine a target virtual storage volume for storing data to be stored, and determine a target storage block from the target virtual storage volume; apply the target storage in the object storage platform 902 At least one data object included in the block; storing the data to be stored in the at least one data object; correspondingly storing a correspondence between the device identifier of the storage device 901 and the first index information in the management device 903 The first index information includes at least a volume identifier of the target virtual storage volume, a block identifier of the target storage block, a data identifier of the data to be stored, and a first data start location of the data to be stored. a first data length of the data to be stored; storing, in the index block object corresponding to the target storage block in the object storage platform, second index information, where the second index information includes at least the first data starting point.

Referring to FIG. 10, an embodiment of the present application provides a system 1000 for reading data, where the system 1000 includes: a storage device 1001, a management device 1002, and an object storage platform 1003;

The storage device 1001 is configured to receive a read request message that includes the location information that is sent by the management device 1002, where the location information includes a second data start location, a second data length, and the to-be-read data. And reading a volume identifier of the target storage volume where the data is located and a block identifier of the target storage block where the data is stored; and reading the data to be read from the target storage block in the object storage platform 1003 according to the location information.

FIG. 11 is a block diagram showing the structure of a device 1100 according to an exemplary embodiment of the present invention. Generally, the device 1100 includes a processor 1101 and a memory 1102.

The processor 1101 can include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 1101 may be configured by at least one of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). achieve. The processor 1101 may also include a main processor and a coprocessor. The main processor is a processor for processing data in an awake state, which is also called a CPU (Central Processing Unit); the coprocessor is A low-power processor for processing data in standby. In some embodiments, the processor 1101 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and rendering of content that needs to be displayed on the display screen. In some embodiments, the processor 1101 may further include an AI (Artificial Intelligence) processor for processing computational operations related to machine learning.

Memory 1102 can include one or more computer readable storage media, which can be non-transitory. Memory 1102 can also include high speed random access memory, as well as non-volatile memory, such as one or more disk storage devices, flash storage devices. In some embodiments, the non-transitory computer readable storage medium in memory 1102 is for storing at least one instruction for execution by processor 1101 to implement the present application as shown in FIGS. 2-6. The method provided by any of the method embodiments.

In some embodiments, the device 1100 can also optionally include: a peripheral device interface 1103 and at least one peripheral device. The processor 1101, the memory 1102, and the peripheral device interface 1103 may be connected by a bus or a signal line. Each peripheral device can be connected to the peripheral device interface 1103 via a bus, signal line or circuit board. Specifically, the peripheral device includes at least one of a radio frequency circuit 1104, an audio circuit 1107, and a power source 1109.

The peripheral device interface 1103 can be used to connect at least one peripheral device associated with an I/O (Input/Output) to the processor 1101 and the memory 1102. In some embodiments, processor 1101, memory 1102, and peripheral interface 1103 are integrated on the same chip or circuit board; in some other embodiments, any of processor 1101, memory 1102, and peripheral interface 1103 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The RF circuit 1104 is configured to receive and transmit an RF (Radio Frequency) signal, also called an electromagnetic signal. The RF circuit 1104 communicates with the communication network and other communication devices via electromagnetic signals. The radio frequency circuit 1104 converts the electrical signal into an electromagnetic signal for transmission, or converts the received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 1104 includes an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 1104 can communicate with other devices via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to, the World Wide Web, a metropolitan area network, an intranet, generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and/or WiFi (Wireless Fidelity) networks.

The display 1105 is used to display a UI (User Interface). The UI can include graphics, text, icons, video, and any combination thereof. When the display 1105 is a touch display, the display 1105 also has the ability to capture touch signals over the surface or surface of the display 1105. The touch signal can be input to the processor 1101 as a control signal for processing. At this time, the display 1105 can also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. The display 1105 can be made of a material such as an LCD (Liquid Crystal Display) or an OLED (Organic Light-Emitting Diode).

The audio circuit 1107 can include a microphone and a speaker. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals for input to the processor 1101 for processing, or to the RF circuit 1104 for voice communication. For the purpose of stereo acquisition or noise reduction, the microphones may be multiple, and are respectively disposed at different parts of the device 1100. The microphone can also be an array microphone or an omnidirectional acquisition microphone. The speaker is then used to convert electrical signals from the processor 1101 or the RF circuit 1104 into sound waves. The speaker can be a conventional film speaker or a piezoelectric ceramic speaker. When the speaker is a piezoelectric ceramic speaker, not only can the electrical signal be converted into human audible sound waves, but also the electrical signal can be converted into sound waves that are inaudible to humans for ranging and the like. In some embodiments, the audio circuit 1107 can also include a headphone jack.

Power source 1109 is used to power various components in device 1100. The power source 1109 can be an alternating current, a direct current, a disposable battery, or a rechargeable battery. When the power source 1109 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. A wired rechargeable battery is a battery that is charged by a wired line, and a wireless rechargeable battery is a battery that is charged by a wireless coil. The rechargeable battery can also be used to support fast charging technology.

Those skilled in the art will appreciate that the structure illustrated in FIG. 11 does not constitute a limitation to device 1100, may include more or fewer components than illustrated, or may combine certain components, or employ different component arrangements.

Other embodiments of the present application will be readily apparent to those skilled in the <RTIgt; The application is intended to cover any variations, uses, or adaptations of the application, which are in accordance with the general principles of the application and include common general knowledge or common technical means in the art that are not disclosed herein. . The specification and examples are to be regarded as illustrative only,

It is to be understood that the invention is not limited to the details of the details and The scope of the present application is limited only by the accompanying claims.

Claims

A method of storing data, the method comprising:

The first storage device determines a target virtual storage volume for storing data to be stored, and determines a target storage block from the target virtual storage volume;

The first storage device applies at least one data object included in the target storage block in an object storage platform;

The first storage device stores the to-be-stored data in the at least one data object;

The first storage device correspondingly saves a correspondence between the device identifier and the first index information in the management device, where the first index information includes at least a volume identifier of the target virtual storage volume, and the target storage block. a block identifier, a data identifier of the data to be stored, a first data start location of the data to be stored, and a first data length of the data to be stored;

The first storage device stores second index information in an index block object corresponding to the target storage block in the object storage platform, where the second index information includes at least the first data start position.
The method of claim 1, wherein the determining a target virtual storage volume for storing data to be stored, and determining a target storage block from the target virtual storage volume comprises:

Selecting one virtual storage volume from the at least one virtual storage volume corresponding to the first storage device as the target virtual storage volume;

Obtaining, from the object storage platform, a block bitmap object of the target virtual storage volume, where the block bitmap object is used to store an identifier bit of each storage block in the target virtual storage volume, and an identifier bit of the storage block is used for Recording whether the storage block is idle;

A free memory block is selected from the target virtual storage volume as a target storage block according to the block bitmap object.
The method of claim 1, wherein after the selecting, according to the block bitmap object, the free storage block from the target virtual storage volume as the target storage block, the method further comprises:

In a block bitmap object of the target virtual storage volume, an identification bit of the target storage block is set to identify that the target storage block has been used.
The method of claim 1 wherein the method further comprises:

Creating a first virtual storage volume for the first storage device in the object storage platform.
The method of claim 4, wherein the creating a first virtual storage volume for the first storage device in the object storage platform comprises:

Generating a volume identifier of the first virtual storage volume;

Adding a volume identifier of the first virtual storage volume to a storage volume list object corresponding to the first storage device in the object storage platform;

Applying, in the object storage platform, a boot block object of the first virtual storage volume, a block bitmap object, and an index object of each of the first virtual storage volumes;

The boot block object is configured to store volume basic information, where the volume basic information includes at least a capacity of the first virtual storage volume, a number of storage blocks, and a device identifier of the first storage device; An object is configured to store an identifier bit of each of the first virtual storage volumes, where an identifier of the storage block is used to identify whether the storage block is idle; an index object of the storage block is used to store third index information. The third index information includes at least the number of data objects in the storage block.
The method of claim 1 wherein the method further comprises:

Loading at least one virtual storage volume corresponding to the first storage device to the first storage device according to the storage volume list object corresponding to the first storage device in the object storage platform when the first storage device is started In a storage device, the storage volume list object is used to store a volume identifier of at least one virtual storage volume corresponding to the first storage device.
The method according to claim 6, wherein the at least one virtual storage volume corresponding to the first storage device is according to a storage volume list object corresponding to the first storage device in the object storage platform Loading into the first storage device, including:

Downloading, from the object storage platform, a storage volume list object corresponding to the first storage device;

Downloading, according to a volume identifier of the second virtual storage volume, a boot block object of the second virtual storage volume from the object storage platform, where a volume identifier of the second virtual storage volume is any one of the storage volume list objects The volume ID of a virtual storage volume;

And adding, when the boot block object stores the device identifier of the first storage device, a volume identifier of the second virtual storage volume to the first storage device.
The method of claim 1 wherein the method further comprises:

The first storage device takes over the third virtual storage volume according to the volume identifier of the third virtual storage volume, where the third virtual storage volume is a virtual storage volume corresponding to the second storage device, and the second storage device is Other storage devices than the first storage device.
The method of claim 8, wherein the taking over the third virtual storage volume according to the volume identifier of the third virtual storage volume comprises:

Receiving a takeover request message, where the takeover request message carries a volume identifier of the third virtual storage volume;

Updating, according to the volume identifier of the third virtual storage volume, the device identifier of the second storage device saved in the startup block object of the third virtual storage volume to the device identifier of the first storage device;

And adding a volume identifier of the third virtual storage volume to the storage volume list object corresponding to the first storage device and the first storage device.
A method of reading data, the method comprising:

Receiving a read request message including location information, where the location information includes a second data start location of the data to be read, a second data length, a volume identifier of the target storage volume where the data to be read is located, and a target The block identifier of the storage block;

Reading the data to be read from the target storage block in the object storage platform according to the location information.
The method of claim 10, wherein the reading the data to be read from the target storage block in the object storage platform according to the location information comprises:

Obtaining an index object of the target storage block from an object storage platform according to a volume identifier of the target storage volume and a block identifier of the target storage block, where the index object includes a data stored in the target storage block a data starting position;

Determining, according to the first data start position and the second data start position, a target data object for storing the data to be read and an offset of the data to be read in the target data object ;

The to-be-read data is read from the target data object based on the offset and the second data length.
An apparatus for storing data, the apparatus comprising:

a determining module, configured to determine a target virtual storage volume for storing data to be stored, and determining a target storage block from the target virtual storage volume;

An application module, configured to apply, in an object storage platform, at least one data object included in the target storage block;

a storage module, configured to store the to-be-stored data in the at least one data object, and correspondingly store a correspondence between the device identifier of the device and the first index information, where the first index information is And including at least a volume identifier of the target virtual storage volume, a block identifier of the target storage block, a data identifier of the data to be stored, a first data start location of the data to be stored, and a first to be stored data a data length; storing, in the index block object corresponding to the target storage block in the object storage platform, second index information, where the second index information includes at least the first data start position.
The device of claim 12, wherein the determining module comprises:

a first selection unit, configured to select one virtual storage volume from the at least one virtual storage volume corresponding to the device as the target virtual storage volume;

An obtaining unit, configured to acquire, from the object storage platform, a block bitmap object of the target virtual storage volume, where the block bitmap object is used to store an identifier bit of each storage block in the target virtual storage volume, and a storage block The flag bit is used to record whether the memory block is idle;

And a second selecting unit, configured to select, from the target virtual storage volume, a free storage block as the target storage block according to the block bitmap object.
The device of claim 12, wherein the device further comprises:

a setting unit, configured to set, in a block bitmap object of the target virtual storage volume, an identification bit of the target storage block to identify that the target storage block has been used.
The device of claim 12, wherein the device further comprises:

A module is created for creating a first virtual storage volume for the device in the object storage platform.
The device of claim 15, wherein the creating module comprises:

a generating unit, configured to generate a volume identifier of the first virtual storage volume;

a first adding unit, configured to add a volume identifier of the first virtual storage volume to a storage volume list object corresponding to the device located in the object storage platform;

An application unit, configured to apply, in the object storage platform, a boot block object of the first virtual storage volume, a block bitmap object, and an index object of each of the first virtual storage volumes;

The boot block object is configured to store volume basic information, where the volume basic information includes at least a capacity of the first virtual storage volume, a number of storage blocks, and a device identifier of the device; the block bitmap object is used for And storing an identifier bit of each of the first virtual storage volumes, where an identifier of the storage block is used to identify whether the storage block is idle; an index object of the storage block is configured to store third index information, The third index information includes at least the number of data objects in the storage block.
The device of claim 12, wherein the device further comprises:

a loading module, configured to load at least one virtual storage volume corresponding to the device into the device according to a storage volume list object corresponding to the device in the object storage platform when the device is started, The storage volume list object is used to store a volume identifier of at least one virtual storage volume corresponding to the device.
The device of claim 17, wherein the loading module comprises:

a downloading unit, configured to download, from the object storage platform, a storage volume list object corresponding to the device, and downloading, according to a volume identifier of the second virtual storage volume, the startup of the second virtual storage volume from the object storage platform a volume identifier, where a volume identifier of the second virtual storage volume is a volume identifier of any one of the storage volume list objects;

a second adding unit, configured to add a volume identifier of the second virtual storage volume to the device when the boot block object stores the device identifier of the device.
The device of claim 12, wherein the device further comprises:

a takeover module, configured to take over the third virtual storage volume according to the volume identifier of the third virtual storage volume, where the third virtual storage volume is a virtual storage volume corresponding to the second storage device, and the second storage device is Other storage devices than the device.
The device of claim 19, wherein the takeover module comprises:

a receiving unit, configured to receive a takeover request message, where the takeover request message carries a volume identifier of the third virtual storage volume;

An update unit, configured to update, according to the volume identifier of the third virtual storage volume, a device identifier of the second storage device saved in the startup block object of the third virtual storage volume to a device identifier of the device;

And a third adding unit, configured to separately add volume identifiers of the third virtual storage volume to the storage volume list object corresponding to the device and the device.
A device for reading data, characterized in that the device comprises:

a receiving module, configured to receive a read request message including location information, where the location information includes a second data start location of the data to be read, a second data length, and a volume of the target storage volume where the data to be read is located The identifier of the block and the block of the target storage block;

And a reading module, configured to read the data to be read from the target storage block in the object storage platform according to the location information.
The device of claim 21, wherein the reading module comprises:

An obtaining unit, configured to acquire an index object of the target storage block from an object storage platform according to a volume identifier of the target storage volume and a block identifier of the target storage block, where the index object includes the target storage block The first data start position of the stored data;

a determining unit, configured to determine, according to the first data start location and the second data start location, a target data object for storing the data to be read and the data to be read in the target data The offset in the object;

And a reading unit, configured to read the data to be read from the target data object according to the offset and the second data length.
A system for storing data, the system comprising: a storage device, an object storage platform, and a management device;

The storage device is configured to determine a target virtual storage volume for storing data to be stored, and determine a target storage block from the target virtual storage volume; and apply at least the target storage block included in the object storage platform a data object; storing the data to be stored in the at least one data object; correspondingly storing a correspondence between the device identifier of the storage device and the first index information in the management device, the first The index information includes at least a volume identifier of the target virtual storage volume, a block identifier of the target storage block, a data identifier of the data to be stored, a first data start location of the data to be stored, and the to-be-stored data The first data length is stored in the index block object corresponding to the target storage block in the object storage platform, and the second index information includes at least the first data start position.
A system for reading data, characterized in that the system comprises: a storage device, a management device and an object storage platform;

The storage device is configured to receive a read request message that includes the location information that is sent by the management device, where the location information includes a second data start location of the data to be read, a second data length, and the to-be-read The volume identifier of the target storage volume where the data is located and the block identifier of the target storage block in which the data is stored; the data to be read is read from the target storage block in the object storage platform according to the location information.