WO2021203591A1 - Data processing method for heterogeneous cloud storage system, and readable medium and system therefor - Google Patents
Data processing method for heterogeneous cloud storage system, and readable medium and system therefor Download PDFInfo
- Publication number
- WO2021203591A1 WO2021203591A1 PCT/CN2020/106147 CN2020106147W WO2021203591A1 WO 2021203591 A1 WO2021203591 A1 WO 2021203591A1 CN 2020106147 W CN2020106147 W CN 2020106147W WO 2021203591 A1 WO2021203591 A1 WO 2021203591A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- cloud storage
- storage system
- data request
- link
- independent
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Definitions
- This application relates to the computer field, and in particular to a data processing method of a heterogeneous cloud storage system, and a readable medium and system thereof.
- Cloud storage systems refer to functions such as cluster applications, network technologies, or distributed file systems.
- enterprises will use multiple cloud storage systems at the same time. If a cloud storage system needs to be upgraded, the existing technology is to shut down the cloud storage system first, then back up the data, and then import the backup data into the new system, but this kind of system
- the upgrade method has a long process, complicated processing, and requires a lot of time and energy.
- the embodiment of the application provides a data processing method for a unified heterogeneous cloud storage system.
- the unified cloud storage system can include a large number of independent cloud storage systems internally, and provides a unified data interaction interface for developers externally, so that developers do not need to care
- the composition of the heterogeneous cloud storage system only needs to interact with the unified cloud storage system, reducing the development workload of developers.
- an embodiment of the present application provides a data processing method for a heterogeneous cloud storage system.
- the heterogeneous cloud storage system includes a unified cloud storage system and multiple independent cloud storage systems.
- the method includes:
- the unified cloud storage system receives the registration request of the independent cloud storage system, and configures a storage link for the registered independent cloud storage system;
- the unified cloud storage system receives the data request sent by the client, and parses the data request based on the registered storage link;
- the unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result;
- the independent cloud storage system performs data processing based on the data request and returns the processing result to the client.
- the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
- the unified cloud storage system receiving the registration request of the independent cloud storage system, and configuring a storage link for the registered independent cloud storage system includes:
- Each independent cloud storage system sends a registration request to the unified cloud storage system
- the unified cloud storage system For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
- Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
- the data request includes the data request ID, data request information, and independent cloud storage system information written by the user terminal.
- the unified cloud storage system receiving the data request sent by the user terminal, and analyzing the data request based on all registered storage links includes:
- the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
- the data request further includes time node information.
- the method further includes:
- a corresponding independent cloud storage system is selected to process the data request.
- an embodiment of the present application provides a heterogeneous cloud storage system, including a unified cloud storage system and multiple independent cloud storage systems, wherein the unified cloud storage system includes:
- the registration unit is used to receive the registration request of the independent cloud storage system and configure a storage link for the registered independent cloud storage system;
- the parsing unit is used to receive the data request sent by the client and analyze the data request based on the registered storage link;
- the forwarding unit is configured to forward the data request to the corresponding independent cloud storage system for processing based on the analysis result, and the independent cloud storage system performs data processing based on the data request and then returns the processing result to the user terminal.
- the storage link includes:
- the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
- the registration unit performs registration in the following manner:
- Each independent cloud storage system sends a registration request to the unified cloud storage system
- the unified cloud storage system For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
- Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
- the data request includes the data request ID, data request information, and independent cloud storage system information written by the user terminal.
- the parsing unit parses the data request in the following manner:
- the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
- the data request further includes time node information.
- the parsing unit parses the data request in the following manner:
- a corresponding independent cloud storage system is selected to process the data request.
- embodiments of the present application provide a machine-readable medium with instructions stored on the machine-readable medium, which when executed on a machine, cause the machine to perform any of the above-mentioned data processing of heterogeneous cloud storage systems method.
- an embodiment of the present application provides a system, and the system includes:
- Memory used to store instructions executed by one or more processors of the system
- the processor is one of the processors of the system and is used to execute the data processing method of the heterogeneous cloud storage system described in any one of the above aspects.
- Fig. 1 shows a data processing scene diagram of a heterogeneous cloud storage system according to some embodiments of the present application.
- Fig. 2 shows a structural block diagram of a unified cloud storage system according to some embodiments of the present application.
- Fig. 3 shows a flowchart of a data processing method of a heterogeneous cloud storage system according to some embodiments of the present application.
- Fig. 4 shows a block diagram of a system according to some embodiments of the present application.
- Fig. 5 shows a block diagram of a system on chip (SoC) according to some embodiments of the present application.
- SoC system on chip
- Illustrative embodiments of this application include, but are not limited to, a unified heterogeneous cloud storage system and its data processing method.
- module can refer to or include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) that executes one or more software or firmware programs, and /Or memory, combinational logic circuits, and/or other suitable hardware components that provide the described functions, or may be part of these hardware components.
- ASIC application specific integrated circuit
- processor shared, dedicated, or group
- processor shared, dedicated, or group
- combinational logic circuits and/or other suitable hardware components that provide the described functions, or may be part of these hardware components.
- the processor may be a microprocessor, a digital signal processor, a microcontroller, etc., and/or any combination thereof.
- the processor may be a single-core processor, a multi-core processor, etc., and/or any combination thereof.
- FIG. 1 shows a data processing scene diagram of a heterogeneous cloud storage system.
- the client 100 sends a data request to the unified cloud storage system 200, and the unified cloud storage system 200
- the data request is forwarded to the registered independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 respectively, and the independent cloud storage system returns the processing result to the client 100 after processing the received data request.
- the independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 are heterogeneous storage systems, and their overall architecture, storage methods, and query principles may be different. They can be registered under the unified storage system 200 and passed through the unified storage system.
- independent cloud storage systems may be cloud storage systems developed by different companies. Although only three independent cloud storage systems are shown in Figure 1, in fact, the unified cloud storage system 200 may also include any number of independent cloud storage systems. , There is no restriction here.
- FIG. 2 shows a block diagram of a unified cloud storage system 200 according to some embodiments of the present application.
- the unified cloud storage system 200 includes a registration unit 201 and an analysis unit 202. And forwarding unit 203. in,
- the registration unit 201 is used to process the registration request of each independent cloud storage system, and bind a registered storage link to each independent cloud storage system that has been registered.
- the storage link is the legal credential of the independent cloud storage system, which is stored on each independent cloud storage system. Only the independent cloud storage system with the storage link can successfully register on the unified cloud storage framework. When a new cloud storage system needs to be added for the user to choose from, it is only necessary to register the storage system to the unified cloud storage system 200 to achieve seamless expansion of the entire heterogeneous cloud storage system.
- Storage links include link IDs, publishers, and receivers.
- the link ID is an identifier that distinguishes each independent cloud storage system.
- Each storage link has a different link ID.
- the publisher and receiver respectively represent the unified cloud storage system 200. And the system information of the independent cloud storage system.
- the parsing unit 202 is configured to receive a data request sent by the user terminal 100, and analyze the data request based on all registered storage links.
- the data request includes the data request ID, processor, data request information and response information.
- the data request ID is used to distinguish different data requests.
- the processor indicates the independent cloud storage system that requires the processing of the data request.
- the value of the processor is the value of the registered link ID.
- the data request information is the specific information of the data request. For the data that the developer wants to obtain, the response information is written by the independent cloud storage system that ultimately processes the data request.
- the parsing unit parsing the data request includes: analyzing the processor in the data request based on all registered storage links. Since the developer user logs in to the unified cloud storage system 200, the unified cloud storage system 200 provides the link IDs of numerous registered independent cloud storage systems for the user to choose. Users only need to take the value of the link ID of the cloud storage system they need as The value of the processor of the data request can be written in the data request.
- the forwarding unit 203 is configured to select an independent cloud storage system with a link ID corresponding to the processor for processing when the processor is not empty and corresponds to the link ID of a certain registered storage link. It is understandable that the correspondence mentioned here can be exactly the same in value, or it can be the mapping relationship between the value of the link ID and the value of the processor stored in the unified cloud storage system, as long as the value of the processor analyzed at this time The value of the link ID only needs to belong to one element in the mapping relationship.
- the parsing unit 202 parses the data request and obtains the value of the data request ID after parsing. For example, if the data request ID value contains 0101, the forwarding unit 202 sends the data request to the independent cloud storage system 400 for processing. If the data request is If the ID value contains 0202, the forwarding unit 202 forwards the data request to the independent cloud storage system 500 for processing. If the data request ID value contains 0303, the request unit 203 forwards the data request to the independent cloud storage system 600 for processing. deal with.
- the request unit 202 may use the start-up time of the unified cloud storage system 200 as the limit, if it is less than or equal to the start-up time of the unified cloud storage , Choose an independent cloud storage system that stores old data. Conversely, if it is longer than the start-up time of the unified cloud storage system, choose an independent cloud storage system that stores new data.
- the data stored by the independent cloud storage system 400 from January to March is old data
- the data stored by the independent cloud storage system 500 from September to December is new data
- the intermediate time period (March to September ) Is the data stored in the independent cloud storage system 600.
- the parsing unit 202 parses out the time node information of the data request. For example, if the time node parsed by the time information of the data request is June, then the forwarding unit 203 sends the data request to the independent cloud storage system 600, and the independent cloud storage After receiving the instruction, the system 600 reads and writes the file according to its own read and write mode.
- the data request is forwarded to the independent cloud storage system 400, and the independent cloud storage system 400 reads and writes the file according to its own reading and writing mode after receiving the instruction.
- the time node information of the data request is October
- the data request is forwarded to the independent cloud storage system 500, and the independent cloud storage system 500 reads and writes the file according to its own reading and writing mode after receiving the instruction.
- the independent cloud storage system receives the data request forwarded by the forwarding unit 203, it performs data processing according to the data request information in the data request (for example, the data request information is to obtain detailed information of all files in the specified directory), and process The result is written in the response message, and then returned to the client 100.
- the data request information for example, the data request information is to obtain detailed information of all files in the specified directory
- FIG. 3 schematically shows a flow chart of a data processing method of a heterogeneous cloud storage system.
- the data processing method in FIG. 3 can be executed by each unit in FIG. 2.
- the Methods include:
- the unified cloud storage system processes the registration request of the independent cloud storage system, and binds a storage link (301) to the registered independent cloud storage system; the storage link includes the link ID, the publisher and the receiver, among which, the link ID It is the identifier that distinguishes each independent cloud storage system. Each storage link has a different link ID.
- the publisher and receiver respectively represent the system information of the unified cloud storage system and the independent cloud storage system.
- the unified cloud storage system receives the data request sent by the client, and analyzes the data request based on all the registered storage links (302); it is used to receive the data request sent by the client and is based on all the registered storage links Analyze the data request.
- the data request includes the data request ID, processor, data request information and response information.
- the data request ID is used to distinguish different data requests.
- the processor indicates the independent cloud storage system that requires the processing of the data request.
- the value of the processor is the value of the registered link ID; the data request information is the specific information of the data request, expressing The data that the developer wants to obtain; the response information is written by the independent cloud storage system that ultimately processes the data request.
- the unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result (303); used to select when the processor is not empty and corresponds to the link ID of a registered storage link
- the independent cloud storage system corresponding to the link ID and the processor performs processing. It should be understood that the correspondence mentioned here can be exactly the same in value, or it can be the mapping relationship between the value of the link ID stored in the unified cloud storage system and the value of the processor, as long as the processor analyzed at this time The value of and the value of the link ID only need to belong to one element in the mapping relationship.
- the request unit can be based on the starting time of the unified cloud storage as the limit. If it is less than or equal to the starting time of the unified cloud storage, choose to store the old data On the contrary, if it is longer than the start-up time of the unified cloud storage system, choose an independent cloud storage system that stores new data.
- the independent cloud storage system performs data processing based on the data request and then returns the processing result to the client (304).
- the data request information performs data processing, and the processing result is written into the response information, and then returned to the user terminal.
- the embodiments of the present application provide a data processing method for a unified heterogeneous cloud storage system.
- the unified cloud storage system can include a large number of independent cloud storage systems internally, and provide developers with a unified data interaction interface externally, so that developers can No need to care about the composition of the heterogeneous cloud storage system, only need to interact with the unified cloud storage system, reducing the developer's development workload.
- the system 400 may include one or more processors 404, a system control logic 408 connected to at least one of the processors 404, a system memory 412 connected to the system control logic 408, and a system control logic 408 connected to the system control logic 408.
- the non-volatile memory (NVM) 416 is connected to the system control logic 408, and the network interface 420 is connected to the system control logic 408.
- the processor 404 may include one or more single-core or multi-core processors. In some embodiments, the processor 404 may include any combination of a general-purpose processor and a special-purpose processor (for example, a graphics processor, an application processor, a baseband processor, etc.). In an embodiment in which the system 400 adopts an eNB (Evolved Node B, enhanced base station) 101 or a RAN (Radio Access Network, radio access network) controller 102, the processor 404 may be configured to execute various conforming embodiments, For example, one or more of the multiple embodiments shown in FIGS. 1-3.
- eNB evolved Node B, enhanced base station
- RAN Radio Access Network, radio access network
- system control logic 408 may include any suitable interface controller to provide any suitable interface to at least one of the processors 404 and/or any suitable device or component in communication with the system control logic 408.
- system control logic 408 may include one or more memory controllers to provide an interface to the system memory 412.
- the system memory 412 can be used to load and store data and/or instructions.
- the memory 412 of the system 400 may include any suitable volatile memory, such as a suitable dynamic random access memory (DRAM).
- DRAM dynamic random access memory
- the NVM/memory 416 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions.
- the NVM/memory 416 may include any suitable non-volatile memory such as flash memory and/or any suitable non-volatile storage device, such as HDD (Hard Disk Drive, hard disk drive), CD (Compact Disc) , At least one of an optical disc drive and a DVD (Digital Versatile Disc, Digital Versatile Disc) drive.
- the NVM/memory 416 may include a part of the storage resources on the device where the system 400 is installed, or it may be accessed by the device, but not necessarily a part of the device.
- the NVM/storage 416 can be accessed through the network via the network interface 420.
- system memory 412 and the NVM/memory 416 may respectively include: a temporary copy and a permanent copy of the instruction 424.
- the instructions 424 may include instructions that, when executed by at least one of the processors 404, cause the system 400 to implement the method shown in FIGS. 3-4.
- the instructions 424, hardware, firmware, and/or software components thereof may additionally/alternatively be placed in the system control logic 408, the network interface 420, and/or the processor 404.
- the network interface 420 may include a transceiver to provide a radio interface for the system 400, and then communicate with any other suitable devices (such as a front-end module, an antenna, etc.) through one or more networks.
- the network interface 420 may be integrated with other components of the system 400.
- the network interface 420 may be integrated in at least one of the processor 404, the system memory 412, the NVM/storage 416, and a firmware device (not shown) with instructions.
- the system 400 implements the data processing method of the heterogeneous cloud storage system as shown in FIG. 3.
- the network interface 420 may further include any suitable hardware and/or firmware to provide a multiple input multiple output radio interface.
- the network interface 420 may be a network adapter, a wireless network adapter, a telephone modem, and/or a wireless modem.
- At least one of the processors 404 may be packaged with the logic of one or more controllers for the system control logic 408 to form a system in package (SiP). In one embodiment, at least one of the processors 404 may be integrated on the same die with the logic of one or more controllers for the system control logic 408 to form a system on chip (SoC).
- SiP system in package
- SoC system on chip
- the system 400 may further include: an input/output (I/O) device 432.
- the I/O device 432 may include a user interface to enable a user to interact with the system 400; the design of the peripheral component interface enables the peripheral component to also interact with the system 400.
- the system 400 further includes a sensor for determining at least one of environmental conditions and location information related to the system 400.
- the user interface may include, but is not limited to, a display (e.g., liquid crystal display, touch screen display, etc.), speakers, microphones, one or more cameras (e.g., still image cameras and/or video cameras), flashlights (e.g., LED flash) and keyboard.
- a display e.g., liquid crystal display, touch screen display, etc.
- speakers e.g., speakers, microphones, one or more cameras (e.g., still image cameras and/or video cameras), flashlights (e.g., LED flash) and keyboard.
- the peripheral component interface may include, but is not limited to, a non-volatile memory port, an audio jack, and a power interface.
- the senor may include, but is not limited to, a gyroscope sensor, an accelerometer, a proximity sensor, an ambient light sensor, and a positioning unit.
- the positioning unit may also be part of or interact with the network interface 420 to communicate with components of the positioning network (eg, global positioning system (GPS) satellites).
- GPS global positioning system
- FIG. 5 shows a block diagram of a SoC (System on Chip) 500.
- the SoC 500 includes: an interconnection unit 550, which is coupled to the application processor 515; a system agent unit 570; a bus controller unit 580; an integrated memory controller unit 540; a group or one or more co-processing
- the device 520 may include an integrated graphics logic, an image processor, an audio processor, and a video processor; a static random access memory (SRAM) unit 530; and a direct memory access (DMA) unit 560.
- the coprocessor 520 includes a dedicated processor, such as, for example, a network or communication processor, a compression engine, a GPGPU, a high-throughput MIC processor, or an embedded processor, or the like.
- the various embodiments of the mechanism disclosed in this application may be implemented in hardware, software, firmware, or a combination of these implementation methods.
- the embodiments of the present application can be implemented as a computer program or program code executed on a programmable system including at least one processor and a storage system (including volatile and non-volatile memory and/or storage elements) , At least one input device and at least one output device.
- Program codes can be applied to input instructions to perform the functions described in this application and generate output information.
- the output information can be applied to one or more output devices in a known manner.
- a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.
- DSP digital signal processor
- ASIC application specific integrated circuit
- the program code can be implemented in a high-level programming language or an object-oriented programming language to communicate with the processing system.
- assembly language or machine language can also be used to implement the program code.
- the mechanism described in this application is not limited to the scope of any particular programming language. In either case, the language can be a compiled language or an interpreted language.
- the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof.
- the disclosed embodiments can also be implemented as instructions carried by or stored on one or more transient or non-transitory machine-readable (eg, computer-readable) storage media, which can be executed by one or more processors. Read and execute.
- the instructions can be distributed through a network or through other computer-readable media.
- a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (for example, a computer), including, but not limited to, floppy disks, optical disks, optical disks, read-only memories (CD-ROMs), magnetic Optical disk, read only memory (ROM), random access memory (RAM), erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), magnetic or optical card, flash memory, or A tangible machine-readable memory used to transmit information (for example, carrier waves, infrared signals, digital signals, etc.) using the Internet with electric, optical, acoustic, or other forms of propagating signals. Therefore, a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (for example, a computer).
- each unit/module mentioned in each device embodiment of this application is a logical unit/module.
- a logical unit/module can be a physical unit/module or a physical unit/ A part of the module can also be realized by a combination of multiple physical units/modules.
- the physical realization of these logical units/modules is not the most important.
- the combination of the functions implemented by these logical units/modules is the solution to this application.
- the above-mentioned device embodiments of this application do not introduce units/modules that are not closely related to solving the technical problems proposed by this application. This does not mean that the above-mentioned device embodiments do not exist. Other units/modules.
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (16)
- 一种异构云存储系统的数据处理方法,其特征在于,所述异构云存储系统包括一个统一云存储系统和多个独立云存储系统,所述方法包括:A data processing method for a heterogeneous cloud storage system, wherein the heterogeneous cloud storage system includes a unified cloud storage system and multiple independent cloud storage systems, and the method includes:统一云存储系统接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接;The unified cloud storage system receives the registration request of the independent cloud storage system, and configures a storage link for the registered independent cloud storage system;统一云存储系统接收用户端发送的数据请求,并基于已注册的存储链接对该数据请求进行解析;The unified cloud storage system receives the data request sent by the client, and parses the data request based on the registered storage link;统一云存储系统基于解析结果将数据请求转发给相应的独立云储存系统进行处理;The unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result;独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端。The independent cloud storage system performs data processing based on the data request and returns the processing result to the client.
- 根据权利要求1所述的异构云存储系统的数据处理方法,其特征在于,所述存储链接包括以下信息:链接ID、统一云存储系统信息和独立云存储系统信息。The data processing method of a heterogeneous cloud storage system according to claim 1, wherein the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
- 根据权利要求1或2所述的异构云存储的数据处理方法,其特征在于,所述统一云存储系统接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接包括:The data processing method for heterogeneous cloud storage according to claim 1 or 2, wherein the unified cloud storage system receives a registration request from an independent cloud storage system, and configures a storage link for the registered independent cloud storage system include:各个独立云存储系统分别发送注册请求给统一云存储系统;Each independent cloud storage system sends a registration request to the unified cloud storage system;针对每个注册请求,统一云存储系统将所述链接ID和统一云存储系统信息写入一个存储链接并配置给对应的独立云存储系统,其中,不同的独立云存储系统对应的链接ID不同;For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;各个独立云存储系统将各自的系统信息写入存储链接并将存储链接返回给统一云存储系统。Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
- 根据权利要求1所述的异构云存储的数据处理方法,其特征在于,所述数据请求包括用户端写入的所述数据请求ID、数据请求信息和独立云存储系统信息。The data processing method for heterogeneous cloud storage according to claim 1, wherein the data request includes the data request ID, data request information, and independent cloud storage system information written by the client.
- 根据权利要求1或4所述的方法,其特征在于,所述统一云存储系统接收用户端发送的数据请求,并基于所有已注册的存储链接对该数据请求进行解析包括:The method according to claim 1 or 4, wherein the unified cloud storage system receiving the data request sent by the user terminal, and analyzing the data request based on all registered storage links comprises:数据请求ID与已注册的存储链接的其中一个链接ID对应,则选择数据请求ID与该 链接ID对应的独立云存储系统进行处理。If the data request ID corresponds to one of the link IDs of the registered storage link, the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
- 根据权利要求4所述的异构云存储的数据处理方法,其特征在于,所述数据请求还包括时间节点信息。The data processing method for heterogeneous cloud storage according to claim 4, wherein the data request further includes time node information.
- 根据权利要求1或6所述的异构云存储的数据处理方法,其特征在于,还包括:The data processing method for heterogeneous cloud storage according to claim 1 or 6, characterized in that it further comprises:获取数据请求的时间节点信息;Obtain the time node information of the data request;基于所述时间节点信息选择相应的独立云存储系统处理所述数据请求。Based on the time node information, a corresponding independent cloud storage system is selected to process the data request.
- 一种异构云存储系统,其特征在于,包括一个统一云存储系统和多个独立云存储系统,其中,所说统一云存储系统包括:A heterogeneous cloud storage system, characterized in that it includes a unified cloud storage system and multiple independent cloud storage systems, wherein the unified cloud storage system includes:注册单元,用于接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接;The registration unit is used to receive the registration request of the independent cloud storage system and configure a storage link for the registered independent cloud storage system;解析单元,用于接收用户端发送的数据请求,并基于已注册的存储链接对该数据请求进行解析;The parsing unit is used to receive the data request sent by the client and analyze the data request based on the registered storage link;转发单元,用于基于解析结果将数据请求转发给相应的独立云储存系统进行处理,独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端。The forwarding unit is configured to forward the data request to the corresponding independent cloud storage system for processing based on the analysis result, and the independent cloud storage system performs data processing based on the data request and then returns the processing result to the user terminal.
- 根据权利要求8所述的异构云存储系统,其特征在于,所述存储链接包括:The heterogeneous cloud storage system according to claim 8, wherein the storage link comprises:所述存储链接包括以下信息:链接ID、统一云存储系统信息和独立云存储系统信息。The storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
- 根据权利要求8或9所述的异构云存储系统,其特征在于,所述注册单元通过以下方式进行注册:The heterogeneous cloud storage system according to claim 8 or 9, wherein the registration unit performs registration in the following manner:各个独立云存储系统分别发送注册请求给统一云存储系统;Each independent cloud storage system sends a registration request to the unified cloud storage system;针对每个注册请求,统一云存储系统将所述链接ID和统一云存储系统信息写入一个存储链接并配置给对应的独立云存储系统,其中,不同的独立云存储系统对应的链接ID不同;For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;各个独立云存储系统将各自的系统信息写入存储链接并将存储链接返回给统一云存储系统。Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
- 根据权利要求8所述的异构云存储系统,其特征在于,所述数据请求包括用户端 写入的所述数据请求ID、数据请求信息和独立云存储系统信息。The heterogeneous cloud storage system according to claim 8, wherein the data request includes the data request ID, data request information, and independent cloud storage system information written by the client.
- 根据权利要求8或11所述的异构云存储系统,所述解析单元通过以下方式对数据请求进行解析:According to the heterogeneous cloud storage system according to claim 8 or 11, the parsing unit analyzes the data request in the following manner:数据请求ID与已注册的存储链接的其中一个链接ID对应,则选择数据请求ID与该链接ID对应的独立云存储系统进行处理。If the data request ID corresponds to one of the link IDs of the registered storage link, the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
- 根据权利要求8所述的异构云存储系统,其特征在于,所述数据请求还包括时间节点信息。The heterogeneous cloud storage system according to claim 8, wherein the data request further includes time node information.
- 根据权利要求8或13所述的异构存储系统,其特征在于,所述解析单元通过以下方式对数据请求进行解析:The heterogeneous storage system according to claim 8 or 13, wherein the parsing unit analyzes the data request in the following manner:获取数据请求的时间节点信息;Obtain the time node information of the data request;基于所述时间节点信息选择相应的独立云存储系统处理所述数据请求。Based on the time node information, a corresponding independent cloud storage system is selected to process the data request.
- 一种机器可读介质,其特征在于,所述机器可读介质上存储有指令,该指令在机器上执行时使机器执行权力要求1至7中任一项异构云存储系统的数据处理方法。A machine-readable medium, characterized in that an instruction is stored on the machine-readable medium, and when the instruction is executed on a machine, the machine executes the data processing method of any one of right requirements 1 to 7 in a heterogeneous cloud storage system .
- 一种系统,包括:A system including:存储器,用于存储由系统的一个或多个处理器执行的指令,以及Memory, used to store instructions executed by one or more processors of the system, and处理器,是系统的处理器之一,用于执行权利要求1至7中任一项所述的异构云存储系统的数据处理方法。The processor is one of the processors of the system, and is used to execute the data processing method of the heterogeneous cloud storage system according to any one of claims 1 to 7.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010278779.9 | 2020-04-10 | ||
CN202010278779.9A CN111314493A (en) | 2020-04-10 | 2020-04-10 | Data processing method of heterogeneous cloud storage system and readable medium and system thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021203591A1 true WO2021203591A1 (en) | 2021-10-14 |
Family
ID=71161020
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/106147 WO2021203591A1 (en) | 2020-04-10 | 2020-07-31 | Data processing method for heterogeneous cloud storage system, and readable medium and system therefor |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN111314493A (en) |
WO (1) | WO2021203591A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111314493A (en) * | 2020-04-10 | 2020-06-19 | 上海依图网络科技有限公司 | Data processing method of heterogeneous cloud storage system and readable medium and system thereof |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140181301A1 (en) * | 2012-12-20 | 2014-06-26 | Software Ag Usa, Inc. | Heterogeneous cloud-store provider access systems, and/or associated methods |
CN105162845A (en) * | 2015-08-05 | 2015-12-16 | 深圳联友科技有限公司 | Heterogeneous cloud storage system and data processing method thereof |
CN106161634A (en) * | 2016-07-20 | 2016-11-23 | 蔡雄 | Use the data administrator of cloud storage |
CN109710392A (en) * | 2018-12-21 | 2019-05-03 | 万达信息股份有限公司 | A kind of heterogeneous resource dispatching method based on mixed cloud |
CN111314493A (en) * | 2020-04-10 | 2020-06-19 | 上海依图网络科技有限公司 | Data processing method of heterogeneous cloud storage system and readable medium and system thereof |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014522011A (en) * | 2011-05-17 | 2014-08-28 | データボード・インコーポレーテツド | Providing access to mainframe data objects in a heterogeneous computing environment |
CN108023746B (en) * | 2016-11-02 | 2020-01-17 | 杭州海康威视数字技术股份有限公司 | Video data processing method, device and system |
CN110389817B (en) * | 2018-04-20 | 2023-05-23 | 伊姆西Ip控股有限责任公司 | Scheduling method, device and computer readable medium of multi-cloud system |
CN110719325A (en) * | 2019-09-30 | 2020-01-21 | 恩亿科(北京)数据科技有限公司 | Method and device for responding to user request |
-
2020
- 2020-04-10 CN CN202010278779.9A patent/CN111314493A/en active Pending
- 2020-07-31 WO PCT/CN2020/106147 patent/WO2021203591A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20140181301A1 (en) * | 2012-12-20 | 2014-06-26 | Software Ag Usa, Inc. | Heterogeneous cloud-store provider access systems, and/or associated methods |
CN105162845A (en) * | 2015-08-05 | 2015-12-16 | 深圳联友科技有限公司 | Heterogeneous cloud storage system and data processing method thereof |
CN106161634A (en) * | 2016-07-20 | 2016-11-23 | 蔡雄 | Use the data administrator of cloud storage |
CN109710392A (en) * | 2018-12-21 | 2019-05-03 | 万达信息股份有限公司 | A kind of heterogeneous resource dispatching method based on mixed cloud |
CN111314493A (en) * | 2020-04-10 | 2020-06-19 | 上海依图网络科技有限公司 | Data processing method of heterogeneous cloud storage system and readable medium and system thereof |
Also Published As
Publication number | Publication date |
---|---|
CN111314493A (en) | 2020-06-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021018005A1 (en) | Inter-process communication method, apparatus and device | |
JP5518946B2 (en) | Method, system, and apparatus for activation of objects across protected area boundaries | |
WO2023098032A1 (en) | Memory space extension method and apparatus, electronic device, and storage medium | |
US20090199213A1 (en) | Automatic Connections Between Application Components | |
CN104866383A (en) | Interface calling method and device and terminal | |
JP2005050334A (en) | Synchronization of logical view independent of physical storage expression | |
CN111880866B (en) | Cross-process callback execution method, device, equipment and storage medium | |
CN106648569B (en) | Target serialization realization method and device | |
CN114385091B (en) | Method and device for realizing network disk drive character, network disk and storage medium | |
CN114925084A (en) | Distributed transaction processing method, system, device and readable storage medium | |
CN111796865A (en) | Byte code file modification method and device, terminal equipment and medium | |
US12073116B2 (en) | Systems, methods, and apparatus for computational storage functions | |
WO2021203591A1 (en) | Data processing method for heterogeneous cloud storage system, and readable medium and system therefor | |
CN113434315B (en) | Interface management method and device, storage medium and electronic equipment | |
CN111241346B (en) | Object serialization method, device, machine-readable medium and system | |
CN109614089B (en) | Automatic generation method, device, equipment and storage medium of data access code | |
US20230393980A1 (en) | Techniques for runtime protocol conformance cache for third party applications | |
CN117827221A (en) | Method, apparatus, device and storage medium for deploying program code | |
CN113220237B (en) | Distributed storage method, device, equipment and storage medium | |
CN113934691A (en) | Method for accessing file, electronic device and readable storage medium | |
CN115136120A (en) | Database synchronization test method and device, computer equipment and storage medium | |
US20240291890A1 (en) | System and method for managing end point presenting devices | |
US11954510B2 (en) | Native-image in-memory cache for containerized ahead-of-time applications | |
TWI687822B (en) | Method and device for storing and reading log files | |
CN113495869B (en) | File system space adjusting method and device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20929805 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20929805 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 27/03/2023) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 20929805 Country of ref document: EP Kind code of ref document: A1 |