WO2023143061A1

WO2023143061A1 - Data access method and data access system thereof

Info

Publication number: WO2023143061A1
Application number: PCT/CN2023/071628
Authority: WO
Inventors: 潘浩
Original assignee: 华为技术有限公司
Priority date: 2022-01-27
Filing date: 2023-01-10
Publication date: 2023-08-03
Also published as: CN116561203A

Abstract

The present application discloses a data access method and a data access system thereof, which are applied to an application scene for providing key value storage by using a cloud service. The method comprises: acquiring a first object on the basis of a key value, wherein the first object is used for supporting an operation corresponding to the key value; then, obtaining a target object on the basis of the key value and the first object; after the target object is obtained, sending the target object to a first cloud service provider and a second cloud service provider, so that the first cloud service provider and the second cloud service provider execute, on the basis of the target object, operations corresponding to the key value, wherein the first cloud service provider and the second cloud service provider are cloud service providers having first objects. By means of to the invention, different cloud service providers are ensured to have the same object, so that different cloud service providers can provide services for the same key value, the reliability problem of key value storage provided by the cloud service is solved, and the operation and maintenance costs for providing reliability for key value storage across cloud service providers are reduced.

Description

A data access method and its data access system

technical field

The embodiment of the present application relates to the communication field, and in particular to a data access method and a data access system thereof.

Background technique

Key-value storage is widely used in the Internet industry. For example, most cloud services use key-value storage to support operations such as query, insertion, deletion, and modification of data. They are used to support network services, such as saving pictures, videos, and applications, and many other items have formed de facto standards.

The key-value storage services provided by current cloud services are mostly supported by a supplier or an open-source key-value storage project. For example, various non-relational (not only structured query language, NoSQL) databases can store key-value data, and these key-value storage services are provided by corresponding cloud service providers. However, in the current way that cloud services provide key-value storage, reliability problems are prone to occur when cloud services fail or access is abnormal.

Contents of the invention

This application provides a data access method and its data access system, which are applied to the application scenarios using cloud services, can support the reliability of key-value storage across cloud service providers, and can reduce the need for cross-cloud service providers to provide key-value storage The cost of reliability.

The first aspect of the present application provides a data access method, including:

The first object is obtained based on the key value, and the first object is used to support the operation corresponding to the key value. Wherein, the key value includes a key value and a target value corresponding to the key value;

Then, the target object is obtained based on the key value and the first object, and the number of the target object is at least one;

After obtaining the target object, send the target object to the first cloud service provider and the second cloud service provider, so that the first cloud service provider and the second cloud service provider complete the execution of the key-value corresponding operation based on the target object, and the first cloud service provider The provider and the second cloud service provider are cloud service providers with the first object.

In the implementation of this application, the first object is obtained based on the key value, and the first object is used to support the operation corresponding to the key value, and then the target object is obtained based on the key value and the first object, and then the target object is sent to the first cloud service provider and the second cloud service provider, so that the first cloud service provider and the second cloud service provider perform key-value corresponding operations based on the target object. The first cloud service provider and the second cloud service provider are cloud services with the first object provider. Among them, the first cloud service provider and the second cloud service provider have the first object and the target object, ensuring that different cloud service providers have the same object, that is, ensuring that different cloud service providers can provide the same key value Service, solves the reliability problem of key-value storage provided by cloud service, and reduces the operation and maintenance cost of providing key-value storage reliability across cloud service providers.

In a possible implementation manner of the first aspect, in the case of an abnormal access to the first cloud service provider, the key-value corresponding operation is executed through the first object and/or the target object on the second cloud service provider.

In the embodiment of this application, in the case of an abnormal access to the first cloud service provider, the execution of the key-value corresponding operation is completed through the first object and/or the target object on the second cloud service provider, ensuring that When the service provider's access is abnormal, another cloud service provider can continue to complete the operation, which reflects the reliability support of the key-value storage of this solution and ensures the real-time access and operation of the key-value storage.

In a possible implementation manner of the first aspect, the second object is obtained based on the key value and the first object, and the number of the second object is at least one, and then the target object is obtained by updating the second object based on the key value.

In the implementation of this application, the second object is obtained based on the key value and the first object, and the second object is updated according to the key value, which can ensure the accuracy of the key value storage and update the key value storage more accurately and flexibly. Objects to ensure the provision of guaranteed services.

In a possible implementation manner of the first aspect, the first target value corresponding to at least one first key value and the first target value corresponding to at least one second key value are respectively obtained from the first cloud service provider and the second cloud service provider. Two target values, the first key value and the second key value are key values of the target value to be queried.

In the embodiment of the present application, the target value of the key value can be obtained from the first cloud service provider and the second cloud service provider respectively, and the query operation of multiple key values can be completed, which can reduce the workload of the cloud service provider, and can Provides productivity.

In a possible implementation of the first aspect, after the target object is sent to the first cloud service provider and the second cloud service provider, response information is obtained, and the response information is used to indicate that the cloud service provider that sent the response information has The target object is saved, or, in the case of an abnormality in obtaining the response information, the target object is resent to the cloud service provider whose response information is abnormal.

In the embodiment of this application, the response information is obtained and the target object is sent again when the response information is abnormal, so as to ensure that both the first cloud service provider and the second cloud service provider save the target object, and ensure that different cloud service providers have real-time The same object can provide services for the same key value.

In a possible implementation manner of the first aspect, the key value includes at least any one of the following:

The key-value to be modified, the key-value to be inserted, or the key-value to be deleted.

In the embodiment of the present application, the specific form of the key value is described, reflecting the selectivity, reliability and flexibility of the scheme.

In the second aspect of the present application, a data access system is provided, and the data access system has the function of implementing the method of the above-mentioned first aspect or any possible implementation manner of the first aspect. This function may be implemented by hardware, or may be implemented by executing corresponding software on the hardware. The hardware or software includes one or more modules corresponding to the above functions.

The data access system in the second aspect of the present application executes the method described in the first aspect of the present application or any possible implementation manner of the first aspect.

In a possible implementation of the second aspect, the data access system further includes a second computer device, and the first cloud service provider or the second cloud service provider is further configured to determine the third key by using at least one third key value value corresponding to the third target value, and send the third target value to the first computer device and/or the second computer device, and the third key value is sent to the first cloud service provider by the first computer device and/or the second computer device Or sent by the second cloud service provider.

In the embodiment of the present application, the data access system supports multiple computer devices to query the key value from the first cloud service provider or the second cloud service provider, and obtain the target value corresponding to the key value, which is applicable to a wide range of network environments and improves work efficiency. efficiency.

The third aspect of the present application provides an information processing device, which may include a processor, the processor is coupled with a memory, wherein the memory is used to store instructions, and the processor is used to execute the instructions in the memory so that the information processing device executes the first aspect of the present application The method in the first aspect or any one of the possible implementations of the first aspect, or execute the first computer device, the second computer device, the first cloud service provider or the second cloud in the data access system in the second aspect of the application Functions implemented by the service provider.

The fourth aspect of the embodiment of the present application provides another information processing device, including a processor, configured to execute the computer program (or computer-executable instruction) stored in the memory, when the computer program (or computer-executable instruction) is executed, Make the information processing apparatus execute the method in the first aspect or any one of the possible implementations of the first aspect, or execute the first computer device, the second computer device, and the first cloud in the data access system in the second aspect of the present application Functions implemented by the service provider or the second cloud service provider.

In one possible implementation, the processor and memory are integrated;

In another possible implementation, the above-mentioned memory is located outside the information processing device.

The information processing device also includes a communication interface, which is used for the information processing device to communicate with other devices, such as sending or receiving data and/or signals. Exemplarily, the communication interface may be a transceiver, a circuit, a bus, a module or other types of communication interfaces.

The fifth aspect of the present application provides a computer-readable storage medium, including computer-readable instructions. When the computer-readable instructions are run on a computer, the method is executed.

The sixth aspect of the present application provides a computer program product, including computer-readable instructions. When the computer-readable instructions are run on a computer, the method described in the first aspect of the present application or any possible implementation manner of the first aspect is executed. implement.

The seventh aspect of the present application provides a chip, the chip includes at least one processor and at least one interface circuit, the interface circuit is coupled to the processor, the at least one interface circuit is used to perform the function of sending and receiving, and send instructions to at least one Processor, at least one processor is used to run computer programs or instructions, which has the function of implementing the method in the above first aspect or any possible implementation manner of the first aspect, and this function can be realized by hardware or by software , can also be implemented by a combination of hardware and software, where the hardware or software includes one or more modules corresponding to the above functions.

Description of drawings

Figure 1a is a schematic diagram of the architecture of the data access system provided by the embodiment of the present application;

Figure 1b is a schematic diagram of an application scenario of the data access system provided by the embodiment of the present application;

FIG. 2 is a schematic diagram of a data access method provided by an embodiment of the present application;

FIG. 3 is a schematic diagram of an application scenario provided by an embodiment of the present application;

Fig. 4 is a schematic diagram of the key-value storage structure provided by the embodiment of the present application;

FIG. 5 is a schematic diagram of an updated first object provided by the embodiment of the present application;

FIG. 6 is another schematic diagram of an updated first object provided by the embodiment of the present application;

Fig. 7 is a schematic diagram of the first object or the intermediate object provided by the embodiment of the present application;

FIG. 8 is another schematic diagram of an application scenario provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of the query key value provided by the embodiment of the present application;

Fig. 10a is another schematic diagram of the application scenario provided by the embodiment of the present application;

Fig. 10b is another schematic diagram of the application scenario provided by the embodiment of the present application;

FIG. 11 is a schematic diagram of the architecture of the data access system provided by the embodiment of the present application;

FIG. 12 is a schematic structural diagram of an information processing device provided by an embodiment of the present application.

Detailed ways

The terms "first", "second" and the like in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific sequence or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances, and this is merely a description of the manner in which objects with the same attribute are described in the embodiments of the present application. Furthermore, the terms "comprising" and "having", as well as any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, product, or apparatus comprising a series of elements is not necessarily limited to those elements, but may include elements not expressly included. Other elements listed explicitly or inherent to the process, method, product, or apparatus.

Before introducing the embodiment of the present application, a brief introduction is made to the key-value store and the key-value store provided by the common cloud services at present, so as to facilitate the subsequent understanding of the embodiment of the present application.

Key-value storage mainly stores the mapping relationship between the key value (key) and the target value (value), which acts like a dictionary and provides operations such as key->value query, insertion, deletion, and modification. In the storage system, database system or file system, key-value storage is used to save and maintain a large number of key-value mapping relationships. The specific content of these mapping relationships and value saves the internal state of the above-mentioned system. During the operation of the system The subsequent operation of the program is determined by querying, modifying, inserting or deleting these mapping relationships. For example, in the storage system, key-value storage can be used to store the mapping relationship between the user's logical address and the physical address of the disk where the data is actually stored. When the user reads the data at the logical address, it needs to query and read the actual Save the physical address of the disk, and after querying the physical address, read the data from the physical address and return it to the user; if the logical address does not store data, return no corresponding mapping relationship, and inform the user that there is no data.

Key-value storage on cloud services can usually be provided by cloud service providers. For example, some NoSQL databases use fully managed NoSQL database services (DynamoDB) to store key-value data, or use distributed data storage systems (Bigtable) to store Key-value data, these key-value storage services are provided by corresponding cloud service providers (such as Amazon or Google, etc.).

Alternatively, build and run open source key-value storage projects on cloud services, such as key-value storage projects such as LeveIDB, RocksDB, or HBase. Through these key-value storage projects, they can be provided to users in the form of accessed services to run other projects on cloud services. application.

However, in the above-mentioned form of cloud service providing key-value storage, in the case of cloud service failure or abnormal access, the reliability problem of key-value storage is prone to occur, and the reliability problem is solved in the current way of providing key-value storage The cost is relatively large, and it is difficult to realize.

In order to solve the above-mentioned problems, the embodiment of the present application provides a data access method and a data access system thereof, and the embodiment of the present application is applied to an application scenario using cloud services, and is used to enable multiple cloud service providers to use the same key value The storage method provides key-value corresponding operations, solves the reliability problem of key-value storage provided by cloud services, and can reduce the cost of providing key-value storage reliability across cloud service providers.

In order to facilitate the understanding of the data access method of the present application, the following briefly describes the data access system applied in the embodiment of the present application with reference to the accompanying drawings. Those of ordinary skill in the art know that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems. Please refer to Fig. 1a for details. Fig. 1a is a schematic diagram of the architecture of the data access system provided by the embodiment of the present application, which specifically includes:

A first computer device 101 , a first cloud service provider 102 and a second cloud service provider 103 .

In order to facilitate the understanding of the data access system shown in Figure 1a, the following is a specific description through the application scenario shown in Figure 1b. And the second cloud service provider 103 is a cloud service provider with the first object, and the first object is used to support operations corresponding to key values, such as querying, deleting, inserting or modifying operations of key values.

Wherein, the first computer device 101 is configured to obtain the first object from the first cloud service provider 102 or the second cloud service provider 103 based on the key value.

Then, the first computer device 101 is further configured to obtain a target object based on the above-mentioned key value and the first object, and the number of the target object is at least one.

After obtaining the target object, the first computer device 101 is further configured to send the target object to the first cloud service provider 102 and the second cloud service provider 103 .

Wherein, after receiving the target object, the first cloud service provider 102 and the second cloud service provider 103 are used to complete the execution of the key-value corresponding operation based on the target object.

In the data access system described in the embodiment of the present application, the first computer device obtains the first object based on the key value, and determines the target object based on the key value and the first object, and then sends the data to the first cloud service provider and the second cloud service provider Send target object. Among them, the first cloud service provider and the second cloud service provider are cloud service providers with the first object, so the first computer device sends the target object to different cloud service providers, ensuring that different cloud service providers have the same Objects can provide corresponding operations for the same key value at the same time, solve the reliability problem of key-value storage provided by cloud services, and reduce the operation and maintenance cost of providing key-value storage reliability across cloud service providers.

Optionally, the first computer device 101 may be a terminal device with a communication function. For example, Internet of Things (IoT) devices (such as sensors, electricity meters, water meters, etc.), Vehicle to Everything (V2X) devices, and stations (stations, STs) in wireless local area networks (WLAN) ), personal digital assistant (PDA) devices, handheld devices with wireless communication capabilities (such as mobile phones), computing devices or other processing devices connected to wireless modems, vehicle-mounted devices, wearable devices (also known as wearable smart devices), tablets or computers with wireless transceiver functions, or cloud-side devices, such as cloud servers or controllers.

Optionally, the first cloud service provider 102 and the second cloud service provider 103 may be providers of various cloud services currently on the market, or may be providers of cloud services that are also applicable to this solution in the future.

It should be noted that the data access system described in the embodiment of the present application is to illustrate the technical solutions of the embodiments of the present application more clearly, and does not constitute a limitation to the technical solutions provided in the embodiments of the present application. Those of ordinary skill in the art know that, With the evolution of the network architecture and the emergence of new business scenarios, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

The data access method of the embodiment of the present application will be described more intuitively below in conjunction with the accompanying drawings. Those of ordinary skill in the art know that, with the development of technology and the emergence of new scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems. Please refer to Figure 2 for details. Figure 2 is a schematic diagram of the data access method provided by the embodiment of this application, which specifically includes:

201. Acquire a first object based on a key value.

The first object is acquired based on the key value, wherein the first object is used to support the operation corresponding to the key value, and the key value includes a key value and a target value corresponding to the key value.

For example, please refer to the example in FIG. 3 for illustration. FIG. 3 is a schematic diagram of an application scenario provided by the embodiment of the present application, wherein the first cloud service provider and the second cloud service provider provide cloud services with the first object Provider, in the case that the first computer device has at least one key value to be processed, the first computer device will obtain the second cloud service provider from any one of the first cloud service provider or the second cloud service provider shown in Figure 3 according to the key value An object, the first object is used to support key-value corresponding operations, for example, the data interface or data structure preset in the first cloud service provider and the second cloud service provider to support key-value storage related operations, specifically support It can be understood that the root object of the storage tree of key-value storage can also be an object that supports key-value corresponding operations in other specific forms in actual situations.

For ease of understanding, the following uses the first object as the root object for illustration. Since object storage is a storage service widely available on the Internet, for example, each cloud service provider organizes key-value data in a tree structure, and each node in the tree structure is an object of object storage, where the first The object is the root object of the tree structure, specifically a data interface for supporting operations corresponding to key values. The tree structure includes at least one first object, namely the root object, and the first object has a corresponding identity document (identity document, ID), and the first computer device can obtain the first object through the ID of the first object. For the specific form of the tree structure, please refer to the example in FIG. 4 , which is a schematic diagram of the key-value storage structure provided by the embodiment of the present application. It can be understood that the ID of the first object can be represented by numerical values, characters, Chinese characters and various combinations thereof, which are determined according to specific requirements in actual situations, and are not specifically limited here.

Optionally, since the cost of updating an object is relatively high, when the number of key values reaches a threshold, the first object may be acquired for subsequent updating, thereby reducing the cost of modifying the object.

In addition, optionally, after the first computer device in FIG. 3 fails to obtain the first object from the first cloud service provider, it switches to obtain the first object from the second cloud service provider, or the first computer device obtains the first object from the second cloud service provider. After the service provider fails to obtain the first object, it switches to obtain the first object from the first cloud service provider.

It can be understood that the above-mentioned Fig. 3 and Fig. 4 are only examples for understanding the embodiment of the present application, and do not substantially limit the embodiment of the present application. In actual situations, except from the first cloud service provider or the second cloud service Providers can obtain the first object, and can also obtain the first object from other cloud service providers with the first object, which is not limited here, and the number of cloud service providers with the first object is at least two, specifically here There is no limit.

202. Obtain a target object based on the key value and the first object.

The target object is obtained based on the key value and the first object, and the number of the target object is at least one.

Wherein, the key value at least includes any one of the key value to be modified, the key value to be inserted, or the key value to be deleted.

Exemplarily, continuing the description with the above-mentioned FIG. 3, after the first computer device obtains the first object, it will update the first object according to the key value. Specifically, for example, if the key value is the key value to be inserted, then the first The computer device will first increase the key value to be inserted in the first object, and if the key value cache space of the first object does not exceed the threshold, the key value (key/value) cache in the current first object will be compared with the new The key value to be inserted is added to the record and merged and updated to obtain the target object, and the ID of the target object is consistent with the ID of the first object. Please refer to Figure 5 for details. Figure 5 is a schematic diagram of updating the first object provided by the embodiment of the present application, wherein the key value key4/value is the key value to be inserted, and the inserted first object is stored in the key/value cache, namely key /value Buffer, and finally get the target object.

For example, the key value to be processed is the key value to be modified, and when the key contained in the key value to be modified is stored in the first object, the first computer device stores the value 1 corresponding to the key contained in the key value to be modified in the first object. Replace it with the value 2 contained in the key value to be modified to get the updated target object. Please refer to Figure 6 for details. Figure 6 is another schematic diagram of updating the first object provided by the embodiment of the present application. The key value to be modified is key3/value 2, and the target value value 1 corresponding to key3 in the first object is modified. Get the target object for value 2.

For example, the key value to be processed is the key value to be deleted. When the key value to be deleted is stored in the first object, the first computer device marks the key value to be deleted as deleted in the first object. Specifically, inserting a tombstone can be used. Mark the key value in a way to complete the deletion operation of the key value. It can be understood that, in actual situations, the key-value deletion operation can also be completed in other forms, which are not specifically limited here.

In a possible implementation manner, the second object is acquired based on the key value and the first object, and then the second object is updated based on the key value to obtain a target object. Exemplarily, more and more key values are stored, which will exceed the threshold of the first object to store key values, so the first object stores key values in multiple leaf objects, but as the number of leaf objects increases, it will pass a Layer or multiple layers of intermediate objects to keep the key value stored in a single object does not exceed the threshold, as shown in the example shown in Figure 4, the tree structure also includes intermediate objects and leaf objects. The first object and/or the intermediate object at least include a lookup table pointing to the lower object, a key/value cache, and a version number of summary information.

Among them, the version number of the summary information is used to check whether the object has changed when the object is modified. It can be represented by the time when the operation occurs or by an incremental and unique integer. It is understandable that it can also be represented by characters, character combinations, Chinese characters, Chinese character combinations, numerical values, and character combinations or other forms of representation are determined according to specific needs in actual situations, and are not limited here.

The key/value cache is used to save newly inserted key values and modified key values. Optionally, the key/value cache has a threshold, which can be the number of cached key values, or the size of the memory space occupied by the cached key values. It is understandable that it can be determined according to specific needs in actual situations, specifically here No limit. In addition, since a leaf object has no underlying objects to which it points, the threshold of the leaf object may be greater than the first object and/or the intermediate object. And the specific format of the key/value cache can adopt sorted array, hash table or tree structure, which is convenient for users to quickly find out whether the key belongs to the cache and find the corresponding value. It is understandable that in actual situations, the key/value cache can also be implemented in other formats, which are not limited here.

The object lookup table is used to record the information of the lower-level objects associated with the upper-level objects, such as the key range stored in the lower-level objects and the ID of the lower-level objects. For example, please refer to FIG. 7, which is the first object or A schematic diagram of the intermediate object, where rangekey represents the key range, and the lower object represents the lower object, which can be the ID of the lower object, which is not limited here. The object lookup table in the first object includes the ID of the intermediate object, and the object lookup table of each intermediate object includes the ID of the corresponding leaf object. In addition, the ID of the intermediate object and the leaf object is similar to the ID of the aforementioned first object, specifically here No longer. Optionally, when the key value stored in the first object or the intermediate object exceeds the threshold value of the key value inserted earlier, the key value stored in the first object and the newly inserted key value are passed through the starting key in the key range Divide into multiple groups, and then send different groups to the corresponding lower-level object storage according to the corresponding start key. In the case of exceeding the threshold of the lower-level object, it is still sent to the lower-level object storage of the lower-level object accordingly. Dividing the key-value group by the starting key can avoid data holes and ensure the accuracy of the data.

The following describes in detail by taking FIG. 3 and FIG. 4 as examples. After the first computer device obtains the first object, it determines the second object according to the key value. Specifically, for example, the key value is the key value to be inserted, in the case of exceeding the threshold of the first object cache, or the key value is the key value to be modified or the key value to be deleted, and the key in the key value does not belong to the first In the case of the key/value cache of the object, the key of the key value is found in the object lookup table to belong to the key range contained in an intermediate object, and the intermediate object is determined to be the second object. Then the first computer device obtains the second object from the first cloud service provider or the second cloud service provider, and then updates the second object according to the key value to obtain the target object, wherein the update of the second object to obtain the target object is the same as the aforementioned update of the first object Obtaining the target object is similar, and details will not be repeated here.

In a possible implementation, when the key value exceeds the threshold of the intermediate object and/or does not belong to the key/value cache of the intermediate object, the second object can be the leaf object in the above-mentioned figure 4, and the specific determination method is the same as The foregoing determination of the intermediate object as the second object is similar, and details are not repeated here.

And because the second objects corresponding to different key values may be different, the number of second objects may be multiple.

In the implementation manner of the present application, the second object is acquired based on the key value and the first object, and then the second object is updated based on the key value to obtain the target object. It can ensure the accuracy of key-value storage, update the objects of key-value storage more accurately and flexibly, and ensure the provision of guaranteed services.

203. Send the target object to the first cloud service provider and the second cloud service provider.

Send the target object to the first cloud service provider and the second cloud service provider, so that the first cloud service provider and the second cloud service provider complete the execution of the key-value corresponding operation based on the target object, and the first cloud service provider and the second cloud service provider The service provider is a cloud service provider with the first object.

Exemplarily, continue to illustrate with the example of FIG. 3 , after the first computer device obtains the target object, it sends the target object to the first cloud service provider and the second cloud service provider, and then the first cloud service provider and the second cloud service provider Operations corresponding to key values can be completed according to the target object, such as insert, modify, query, or delete.

It can be understood that the above-mentioned FIG. 3 is only used as an example to understand the embodiment of the present application, and does not substantially limit the embodiment of the present application. In actual situations, there may be three cloud service providers or four cloud service providers. Or more cloud service providers, which are not limited here.

In the embodiment of this application, the first object is obtained based on the key value, and then the target object is obtained based on the key value and the first object, and then the target object is sent to the first cloud service provider and the second cloud service provider, which can ensure that at least two Different cloud service providers have the same object, can provide services for the same key value, solve the reliability problem of key-value storage provided by cloud service, and reduce the operation and maintenance of key-value storage reliability provided by cross-cloud service providers cost.

In a possible implementation, after the target object is sent to the first cloud service provider and the second cloud service provider, response information is also obtained, and the response information is used to indicate that the cloud service provider that sent the response information has completed the update target object, or, in the case of abnormality in obtaining the response information, resend the target object to the cloud service provider whose acquisition of the response information is abnormal.

Optionally, the abnormality of obtaining the response information includes at least one of the situations of timeout of obtaining the response information or failure of obtaining the response information. It is understandable that there are other ways to determine the abnormality of obtaining the response information in actual situations, which will not be done here. limited.

For example, please refer to FIG. 8 , which is another schematic diagram of an application scenario provided by an embodiment of the present application. Wherein, after the first computer device sends the target object to the first cloud service provider and the second cloud service provider, it obtains response information from the first cloud service provider and/or the second cloud service provider, and then the first computer device determines that the other party Update the first object or the second object as the target object. Or, as shown in Figure 8, the first computer device obtains the response information from the first cloud service provider abnormally, that is, the response information is timed out or fails to obtain the response information, and then sends the target object to the first cloud service provider again to ensure that the first cloud The facilitator replaces the first object or the second object with the target object.

In the embodiment of the present application, the target object is sent to the cloud service provider whose response information is abnormal when the response information is acquired or when the response information is abnormal, so as to ensure that different cloud service providers save the target object and ensure that different cloud services provide Providers always have the same objects and can serve the same key values.

In a possible implementation manner, the first target value corresponding to at least one key value and the second target value corresponding to at least one second key value are respectively obtained from the first cloud service provider and the second cloud service provider. Wherein, the first key value and the second key value belong to the key value of the target value to be queried.

For example, please refer to FIG. 9. FIG. 9 is a schematic diagram of the query key value provided by the embodiment of the present application, wherein the key values that need to query the target value on the first computer device are key1, key2, key3, key4 and key5, Divide it into two groups, one group includes key1 and key2, the other group includes key3, key4 and key5, and then obtain the target values corresponding to key1 and key2 from the first cloud service provider, and obtain key3 and key4 from the second cloud service provider And the target value corresponding to key5. It can be understood that, as an example, Fig. 9 is only used to understand the embodiment of the present application, and does not substantially limit the embodiment of the present application. In actual situations, it can be divided into three or more groups, and then the Multiple cloud service providers obtain corresponding target values, which are not limited here.

In the embodiment of the present application, the key value of the target value to be queried can be divided into multiple groups, and then the target value corresponding to the key value can be obtained from different cloud service providers, which can reduce the workload of the cloud service provider, And efficiently complete the query task, improve work efficiency.

In a possible implementation manner, in the case of an abnormal access to the first cloud service provider, the operation corresponding to the key value is performed through the first object and/or the target object on the second cloud service provider.

For example, please refer to FIG. 10a, which is another schematic diagram of an application scenario provided by the embodiment of the present application. Wherein, the first computer equipment visits the first cloud service provider abnormally, at this time the first computer equipment can visit the second cloud service provider to obtain the first object to obtain the target object and send it to the first cloud service provider and the second cloud service provider to complete Operations such as inserting, modifying, or deleting key values, or completing key-value query through the first object and/or the target object, ensure that key-value operations can be completed smoothly in real time.

In the embodiment of the present application, in the case of an abnormal access to the first cloud service provider, the first object and/or the target object on the second cloud service provider executes the operation corresponding to the key value, ensuring that in a certain cloud service When the provider's access is abnormal, another cloud service provider can continue to complete the operation, which reflects the reliability support of key-value storage and ensures the real-time access and operation of key-value storage.

In a possible implementation manner, only one computer device can send the target object to the first cloud service provider and the second cloud service provider in the same time period. Exemplarily, the target object may only be updated by a fixed computer device, or the target object may be updated by a preset computer device within a defined period of time, and then sent to the first cloud service provider and the second cloud service provider It can be understood that the target object can be determined according to specific needs in actual situations, and is not specifically limited here. It can ensure the real-time and accuracy of the objects provided by the cloud service provider.

In a possible implementation manner, the first cloud service provider or the second cloud service provider determines the third target value corresponding to the third key value through at least one third key value, and sends the corresponding first computer device and/or the second The second computer device sends the third target value, wherein the third key value is sent by the first computer device and/or the second computer device to the first cloud service provider or the second cloud service provider. For example, please refer to FIG. 10b. FIG. 10b is another schematic diagram of the application scenario provided by the embodiment of the present application, in which the first computer device and the second computer device receive from the first cloud service provider and/or the second cloud service provider Query key value. It can be understood that, in actual situations, three or more computer devices may query the key value from the first cloud service provider or the second cloud service provider, and the number of computer devices querying the key value is not specifically limited here. Multiple computer devices querying key values from cloud service providers can adapt to a wide range of networks and improve work efficiency.

In the embodiment of this application, the first object is obtained through the key value, and the target object is obtained, and the target object is sent to different cloud service providers with the first object, so as to ensure that different cloud service providers have the same object and can be the same The key-value provides corresponding operations, which solves the reliability problem of key-value storage provided by cloud services. And it reduces the operation and maintenance cost of providing key-value storage reliability across cloud service providers. In the case of an abnormal access to a certain cloud service provider, switch to another cloud service provider to complete the operation corresponding to the key value, and provide real-time key-value storage services to ensure the normal operation of the business and improve work efficiency.

In order to realize the various functions in the method provided by the above embodiments of the present application, the data processing system may include a hardware structure and/or a software module, and realize the above-mentioned functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. Whether one of the above-mentioned functions is executed in the form of a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraints of the technical solution.

As shown in FIG. 11 , the embodiment of the present application also provides a data access system. Please refer to FIG. 11 for details. FIG. 11 is a schematic diagram of the architecture of the data access system provided by the embodiment of the present application. In a possible implementation, the data access system may include one-to-one modules or units that execute the methods/operations/steps/actions in the above method embodiments, and the units may be hardware circuits, software, or It is realized by combining hardware circuit and software. In a possible implementation, the data access system may include: a first computer device 1101 , a first cloud service provider 1102 and a second cloud service provider 1103 . The first computer device 1101 can be used to perform the steps of obtaining the first object based on the key value and obtaining the target object as in the above method embodiment, and the step of sending the target object to the first cloud service provider and the second cloud service provider, the first The cloud service provider 1102 and the second cloud service provider 1103 may be used to perform the step of performing key-value correspondence based on the target object in the above method embodiment.

In another possible design, the data access system further includes a second computer device 1104, wherein the first cloud service provider 1102 and/or the second cloud service provider 1103 are further configured to use the third key value to determine the corresponding and send the third target value to the corresponding first computer device 1101 and/or the second computer device 1104, and the third key value is sent to the first computer device 1104 by the first computer device and/or the second computer device 1104 Cloud service provider or second cloud service provider.

In the embodiment of this application, the first computer device 1101 obtains the first object based on the key value, obtains the target object according to the key value and the first object, and sends the target object to the first cloud service provider 1102 and the second cloud service provider 1103 , and the first cloud service provider and the second cloud service provider are cloud service providers with the first object, then the first cloud service provider 1102 and the second cloud service provider 1103 perform key-value corresponding operations based on the target object. Among them, different cloud service providers have the same object, and can complete the execution of corresponding operations for the same key value, which solves the reliability problem of cloud service providing key value storage. And it reduces the operation and maintenance cost of providing key-value storage reliability across cloud service providers.

In other possible designs, the first computer device 1101, the first cloud service provider 1102, the second cloud service provider 1103, or the second computer device 1104 can execute various possible corresponding methods in the above method embodiments one by one. A method/operation/step/action in an implementation.

In a possible design, the above-mentioned first computer device 1101 is also used to execute the key-value corresponding operation.

In a possible design, the above-mentioned first computer device 1101 is specifically configured to obtain the second object based on the key value and the first object;

It is also specifically used to update the second object based on the key value to obtain the target object.

In a possible design, the above-mentioned first computer device 1101 is further configured to respectively obtain at least one first target value corresponding to the first key value and at least one second key value from the first cloud service provider and the second cloud service provider. The second target value corresponding to the key value, the first key value and the second key value are key values of the target value to be queried.

In a possible design, the key value includes at least any of the following:

For the beneficial effects of the above-mentioned various designs in the present application, please refer to the beneficial effects of the one-to-one corresponding various implementation modes in the above-mentioned method embodiment in FIG.

It should be noted that Figure 11 corresponds to the information interaction and execution process between modules/units in the data access system described in the embodiment, and the method embodiment corresponding to Figure 2 in this application is based on the same idea, and the specific content can be Refer to the descriptions in the foregoing method embodiments of the present application, and details are not repeated here.

Next, an information processing device provided by the embodiment of the present application is introduced. Please refer to FIG. 12. FIG. 12 is a schematic structural diagram of the information processing device provided by the embodiment of the present application. The information processing device 1200 may be the corresponding embodiment in FIG. 11 Corresponding to the first computer equipment, the second computer equipment, the first cloud service provider or the second cloud service provider, for realizing the first computer equipment, the second computer equipment, the first cloud service provider or the second cloud service in Fig. 11 Specifically, the information processing device 1200 is implemented by one or more servers, and the information processing device 1200 may have relatively large differences due to different configurations or performances, and may include one or more central processing units (central processing units, CPU) 1222 (eg, one or more central processing units) and memory 1232, and one or more storage media 1230 (eg, one or more storage devices). Wherein, the memory 1232 and the storage medium 1230 may be temporary storage or persistent storage. The program stored in the storage medium 1230 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations for the information processing device 1200 . Furthermore, the central processing unit 1222 may be configured to communicate with the storage medium 1230 , and execute a series of instruction operations in the storage medium 1230 on the information processing device 1200 .

The information processing device 1200 may also include one or more power sources 1226 , one or more wired or wireless network interfaces 1250 , and/or, one or more input/output interfaces 1258 .

In the embodiment of the present application, the central processing unit 1222 is configured to execute the method in the embodiment corresponding to FIG. 2 . For example, the central processing unit 1222 can be configured to: obtain the first object based on the key value, then obtain the target object based on the key value and the first object, and then send the target object to the first cloud service provider and the second cloud service provider, so that the second cloud service provider A cloud service provider and a second cloud service provider perform key-value corresponding operations based on the target object, and the first cloud service provider and the second cloud service provider are cloud service providers with the first object.

Or the central processing unit 1222 may be configured to: acquire a target object and execute key-value corresponding operations based on the first object and/or the target object.

Or the central processing unit 1222 may be configured to: send the third key value to the first cloud service provider or the second cloud service provider to obtain a target value corresponding to the third key value.

It should be noted that the central processing unit 1222 can also be used to execute any step in the method embodiment corresponding to FIG. 2 in this application. Let me repeat.

The embodiments of the present application also provide a computer-readable storage medium, including computer-readable instructions, which, when the computer-readable instructions are run on a computer, cause the computer to execute any one of the implementation manners shown in the foregoing method embodiments.

An embodiment of the present application also provides a computer program product, the computer program product includes a computer program or an instruction, and when the computer program or instruction is run on a computer, the computer is made to execute any one of the implementation manners shown in the foregoing method embodiments.

The present application also provides a chip or a chip system, and the chip may include a processor. The chip may also include memory (or storage module) and/or transceiver (or communication module), or, the chip is coupled with memory (or storage module) and/or transceiver (or communication module), wherein the transceiver ( or communication module) can be used to support the chip for wired and/or wireless communication, the memory (or storage module) can be used to store a program or a set of instructions, and the processor calls the program or the set of instructions can be used to implement the above method embodiments, An operation performed by a terminal or a network device in any possible implementation manner of the method embodiment. The system-on-a-chip may include the above-mentioned chips, and may also include the above-mentioned chips and other discrete devices, such as memory (or storage module) and/or transceiver (or communication module).

In addition, it should be noted that the device embodiments described above are only illustrative, and the units described as separate components may or may not be physically separated, and the components shown as units may or may not be A physical unit can be located in one place, or it can be distributed to multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. In addition, in the drawings of the device embodiments provided in the present application, the connection relationship between the modules indicates that they have communication connections, which can be specifically implemented as one or more communication buses or signal lines.

Through the description of the above embodiments, those skilled in the art can clearly understand that the present application can be implemented by means of software plus necessary general-purpose hardware, and of course it can also be realized by special hardware including application-specific integrated circuits, dedicated CPUs, dedicated memories, Special components, etc. to achieve. In general, all functions completed by computer programs can be easily realized by corresponding hardware, and the specific hardware structure used to realize the same function can also be varied, such as analog circuits, digital circuits or special-purpose circuit etc. However, for this application, software program implementation is a better implementation mode in most cases. Based on this understanding, the essence of the technical solution of this application or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product is stored in a readable storage medium, such as a floppy disk of a computer , U disk, mobile hard disk, read only memory (read only memory, ROM), random access memory (random access memory, RAM), magnetic disk or optical disk, etc., including several instructions to make a computer device (which can be a personal A computer, a training device, or a network device, etc.) executes the methods described in various embodiments of the present application.

In the above embodiments, all or part of them may be implemented by software, hardware, firmware or any combination thereof. When implemented using software, it may be implemented in whole or in part in the form of a computer program product.

The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present application will be generated in whole or in part. The computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transferred from a website, computer, training device, or data The center transmits to another website site, computer, training device or data center via wired (eg coaxial cable, optical fiber, digital subscriber line) or wireless (eg infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be stored by a computer, or a data storage device such as a training device or a data center integrated with one or more available media. The available medium may be a magnetic medium, (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a high-density digital video disc (digital video disc, DVD)), or a semiconductor medium (for example, a solid state drive (solid state drive) , SSD)) etc.

Claims

A data access method, characterized in that, comprising:

Acquiring a first object based on the key value, where the first object is used to support operations corresponding to the key value;

obtaining a target object based on the key value and the first object;

sending the target object to the first cloud service provider and the second cloud service provider, so that the first cloud service provider and the second cloud service provider complete the execution of the key-value corresponding operation based on the target object, The first cloud service provider and the second cloud service provider are cloud service providers with the first object.
The method according to claim 1, wherein in the case of an abnormal access to the first cloud service provider, the method further comprises:

The execution of the key-value corresponding operation is completed through the first object and/or the target object on the second cloud service provider.
The method according to any one of claims 1 or 2, wherein said obtaining the target object based on said key value and said first object comprises:

obtaining a second object based on the key value and the first object;

updating the second object based on the key value to obtain the target object.
The method according to any one of claims 1-3, further comprising:

Obtain a first target value corresponding to at least one first key value and a second target value corresponding to at least one second key value from the first cloud service provider and the second cloud service provider respectively, and the first key value and the second key value belong to the key value of the target value to be queried.
The method according to any one of claims 1-4, wherein the key value includes at least any of the following:

The key-value to be modified, the key-value to be inserted, or the key-value to be deleted.
A data access system, characterized in that it comprises:

The first computer equipment, the first cloud service provider, and the second cloud service provider, the first cloud service provider and the second cloud service provider are cloud service providers with a first object, and the first object is used for Support key-value corresponding operations;

The first computer device is configured to obtain the first object from the first cloud service provider or the second cloud service provider based on the key value;

The first computer device is further configured to obtain a target object based on the key value and the first object;

The first computer device is further configured to send the target object to the first cloud service provider and the second cloud service provider;

The first cloud service provider and the second cloud service provider are configured to execute the key-value corresponding operation based on the target object.
The data access system according to claim 6, wherein when the access of the first cloud service provider is abnormal, the first computer device is further configured to The first object and/or the target object completes the execution of the operation corresponding to the key value.
The data access system according to claim 6 or 7, wherein the first computer device is specifically configured to acquire a second object based on the key value and the first object;

And it is specifically used to update the second object based on the key value to obtain the target object.
The data access system according to any one of claims 6-8, wherein the first computer device is further configured to obtain at least A first target value corresponding to a first key value, and a second target value corresponding to at least one second key value, the first key value and the second key value are key values of the target value to be queried.
The data access system according to any one of claims 6-9, wherein the data access system further comprises a second computer device, wherein the first cloud service provider or the second cloud service provider is further configured to use at least one third key value to determine a third target value corresponding to the third key value, and send the third target value to the first computer device and/or the second computer device, The third key value is sent by the first computer device and/or the second computer device to the first cloud service provider or the second cloud service provider.
The data access system according to any one of claims 6-10, wherein the key value includes at least any of the following:

The key-value to be modified, the key-value to be inserted, or the key-value to be deleted.
A data access system, characterized by comprising: a processor, the processor is coupled to a memory, and the memory stores instructions, and the processor is used to execute the instructions, so that the data access system performs claims 1 to The method described in any one of 5.
A computer-readable storage medium, comprising computer-readable instructions, characterized in that, when the computer-readable instructions are run on a computer, the method according to any one of claims 1-5 is executed.
A computer program product, comprising computer-readable instructions, characterized in that, when the computer-readable instructions are run on a computer, the method according to any one of claims 1-5 is executed.