WO2021203591A1 - Data processing method for heterogeneous cloud storage system, and readable medium and system therefor - Google Patents

Data processing method for heterogeneous cloud storage system, and readable medium and system therefor Download PDF

Info

Publication number
WO2021203591A1
WO2021203591A1 PCT/CN2020/106147 CN2020106147W WO2021203591A1 WO 2021203591 A1 WO2021203591 A1 WO 2021203591A1 CN 2020106147 W CN2020106147 W CN 2020106147W WO 2021203591 A1 WO2021203591 A1 WO 2021203591A1
Authority
WO
WIPO (PCT)
Prior art keywords
cloud storage
storage system
data request
link
independent
Prior art date
Application number
PCT/CN2020/106147
Other languages
French (fr)
Chinese (zh)
Inventor
苏晨光
吴永军
Original Assignee
上海依图网络科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 上海依图网络科技有限公司 filed Critical 上海依图网络科技有限公司
Publication of WO2021203591A1 publication Critical patent/WO2021203591A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Definitions

  • This application relates to the computer field, and in particular to a data processing method of a heterogeneous cloud storage system, and a readable medium and system thereof.
  • Cloud storage systems refer to functions such as cluster applications, network technologies, or distributed file systems.
  • enterprises will use multiple cloud storage systems at the same time. If a cloud storage system needs to be upgraded, the existing technology is to shut down the cloud storage system first, then back up the data, and then import the backup data into the new system, but this kind of system
  • the upgrade method has a long process, complicated processing, and requires a lot of time and energy.
  • the embodiment of the application provides a data processing method for a unified heterogeneous cloud storage system.
  • the unified cloud storage system can include a large number of independent cloud storage systems internally, and provides a unified data interaction interface for developers externally, so that developers do not need to care
  • the composition of the heterogeneous cloud storage system only needs to interact with the unified cloud storage system, reducing the development workload of developers.
  • an embodiment of the present application provides a data processing method for a heterogeneous cloud storage system.
  • the heterogeneous cloud storage system includes a unified cloud storage system and multiple independent cloud storage systems.
  • the method includes:
  • the unified cloud storage system receives the registration request of the independent cloud storage system, and configures a storage link for the registered independent cloud storage system;
  • the unified cloud storage system receives the data request sent by the client, and parses the data request based on the registered storage link;
  • the unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result;
  • the independent cloud storage system performs data processing based on the data request and returns the processing result to the client.
  • the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
  • the unified cloud storage system receiving the registration request of the independent cloud storage system, and configuring a storage link for the registered independent cloud storage system includes:
  • Each independent cloud storage system sends a registration request to the unified cloud storage system
  • the unified cloud storage system For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
  • Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
  • the data request includes the data request ID, data request information, and independent cloud storage system information written by the user terminal.
  • the unified cloud storage system receiving the data request sent by the user terminal, and analyzing the data request based on all registered storage links includes:
  • the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
  • the data request further includes time node information.
  • the method further includes:
  • a corresponding independent cloud storage system is selected to process the data request.
  • an embodiment of the present application provides a heterogeneous cloud storage system, including a unified cloud storage system and multiple independent cloud storage systems, wherein the unified cloud storage system includes:
  • the registration unit is used to receive the registration request of the independent cloud storage system and configure a storage link for the registered independent cloud storage system;
  • the parsing unit is used to receive the data request sent by the client and analyze the data request based on the registered storage link;
  • the forwarding unit is configured to forward the data request to the corresponding independent cloud storage system for processing based on the analysis result, and the independent cloud storage system performs data processing based on the data request and then returns the processing result to the user terminal.
  • the storage link includes:
  • the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
  • the registration unit performs registration in the following manner:
  • Each independent cloud storage system sends a registration request to the unified cloud storage system
  • the unified cloud storage system For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
  • Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
  • the data request includes the data request ID, data request information, and independent cloud storage system information written by the user terminal.
  • the parsing unit parses the data request in the following manner:
  • the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
  • the data request further includes time node information.
  • the parsing unit parses the data request in the following manner:
  • a corresponding independent cloud storage system is selected to process the data request.
  • embodiments of the present application provide a machine-readable medium with instructions stored on the machine-readable medium, which when executed on a machine, cause the machine to perform any of the above-mentioned data processing of heterogeneous cloud storage systems method.
  • an embodiment of the present application provides a system, and the system includes:
  • Memory used to store instructions executed by one or more processors of the system
  • the processor is one of the processors of the system and is used to execute the data processing method of the heterogeneous cloud storage system described in any one of the above aspects.
  • Fig. 1 shows a data processing scene diagram of a heterogeneous cloud storage system according to some embodiments of the present application.
  • Fig. 2 shows a structural block diagram of a unified cloud storage system according to some embodiments of the present application.
  • Fig. 3 shows a flowchart of a data processing method of a heterogeneous cloud storage system according to some embodiments of the present application.
  • Fig. 4 shows a block diagram of a system according to some embodiments of the present application.
  • Fig. 5 shows a block diagram of a system on chip (SoC) according to some embodiments of the present application.
  • SoC system on chip
  • Illustrative embodiments of this application include, but are not limited to, a unified heterogeneous cloud storage system and its data processing method.
  • module can refer to or include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) that executes one or more software or firmware programs, and /Or memory, combinational logic circuits, and/or other suitable hardware components that provide the described functions, or may be part of these hardware components.
  • ASIC application specific integrated circuit
  • processor shared, dedicated, or group
  • processor shared, dedicated, or group
  • combinational logic circuits and/or other suitable hardware components that provide the described functions, or may be part of these hardware components.
  • the processor may be a microprocessor, a digital signal processor, a microcontroller, etc., and/or any combination thereof.
  • the processor may be a single-core processor, a multi-core processor, etc., and/or any combination thereof.
  • FIG. 1 shows a data processing scene diagram of a heterogeneous cloud storage system.
  • the client 100 sends a data request to the unified cloud storage system 200, and the unified cloud storage system 200
  • the data request is forwarded to the registered independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 respectively, and the independent cloud storage system returns the processing result to the client 100 after processing the received data request.
  • the independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 are heterogeneous storage systems, and their overall architecture, storage methods, and query principles may be different. They can be registered under the unified storage system 200 and passed through the unified storage system.
  • independent cloud storage systems may be cloud storage systems developed by different companies. Although only three independent cloud storage systems are shown in Figure 1, in fact, the unified cloud storage system 200 may also include any number of independent cloud storage systems. , There is no restriction here.
  • FIG. 2 shows a block diagram of a unified cloud storage system 200 according to some embodiments of the present application.
  • the unified cloud storage system 200 includes a registration unit 201 and an analysis unit 202. And forwarding unit 203. in,
  • the registration unit 201 is used to process the registration request of each independent cloud storage system, and bind a registered storage link to each independent cloud storage system that has been registered.
  • the storage link is the legal credential of the independent cloud storage system, which is stored on each independent cloud storage system. Only the independent cloud storage system with the storage link can successfully register on the unified cloud storage framework. When a new cloud storage system needs to be added for the user to choose from, it is only necessary to register the storage system to the unified cloud storage system 200 to achieve seamless expansion of the entire heterogeneous cloud storage system.
  • Storage links include link IDs, publishers, and receivers.
  • the link ID is an identifier that distinguishes each independent cloud storage system.
  • Each storage link has a different link ID.
  • the publisher and receiver respectively represent the unified cloud storage system 200. And the system information of the independent cloud storage system.
  • the parsing unit 202 is configured to receive a data request sent by the user terminal 100, and analyze the data request based on all registered storage links.
  • the data request includes the data request ID, processor, data request information and response information.
  • the data request ID is used to distinguish different data requests.
  • the processor indicates the independent cloud storage system that requires the processing of the data request.
  • the value of the processor is the value of the registered link ID.
  • the data request information is the specific information of the data request. For the data that the developer wants to obtain, the response information is written by the independent cloud storage system that ultimately processes the data request.
  • the parsing unit parsing the data request includes: analyzing the processor in the data request based on all registered storage links. Since the developer user logs in to the unified cloud storage system 200, the unified cloud storage system 200 provides the link IDs of numerous registered independent cloud storage systems for the user to choose. Users only need to take the value of the link ID of the cloud storage system they need as The value of the processor of the data request can be written in the data request.
  • the forwarding unit 203 is configured to select an independent cloud storage system with a link ID corresponding to the processor for processing when the processor is not empty and corresponds to the link ID of a certain registered storage link. It is understandable that the correspondence mentioned here can be exactly the same in value, or it can be the mapping relationship between the value of the link ID and the value of the processor stored in the unified cloud storage system, as long as the value of the processor analyzed at this time The value of the link ID only needs to belong to one element in the mapping relationship.
  • the parsing unit 202 parses the data request and obtains the value of the data request ID after parsing. For example, if the data request ID value contains 0101, the forwarding unit 202 sends the data request to the independent cloud storage system 400 for processing. If the data request is If the ID value contains 0202, the forwarding unit 202 forwards the data request to the independent cloud storage system 500 for processing. If the data request ID value contains 0303, the request unit 203 forwards the data request to the independent cloud storage system 600 for processing. deal with.
  • the request unit 202 may use the start-up time of the unified cloud storage system 200 as the limit, if it is less than or equal to the start-up time of the unified cloud storage , Choose an independent cloud storage system that stores old data. Conversely, if it is longer than the start-up time of the unified cloud storage system, choose an independent cloud storage system that stores new data.
  • the data stored by the independent cloud storage system 400 from January to March is old data
  • the data stored by the independent cloud storage system 500 from September to December is new data
  • the intermediate time period (March to September ) Is the data stored in the independent cloud storage system 600.
  • the parsing unit 202 parses out the time node information of the data request. For example, if the time node parsed by the time information of the data request is June, then the forwarding unit 203 sends the data request to the independent cloud storage system 600, and the independent cloud storage After receiving the instruction, the system 600 reads and writes the file according to its own read and write mode.
  • the data request is forwarded to the independent cloud storage system 400, and the independent cloud storage system 400 reads and writes the file according to its own reading and writing mode after receiving the instruction.
  • the time node information of the data request is October
  • the data request is forwarded to the independent cloud storage system 500, and the independent cloud storage system 500 reads and writes the file according to its own reading and writing mode after receiving the instruction.
  • the independent cloud storage system receives the data request forwarded by the forwarding unit 203, it performs data processing according to the data request information in the data request (for example, the data request information is to obtain detailed information of all files in the specified directory), and process The result is written in the response message, and then returned to the client 100.
  • the data request information for example, the data request information is to obtain detailed information of all files in the specified directory
  • FIG. 3 schematically shows a flow chart of a data processing method of a heterogeneous cloud storage system.
  • the data processing method in FIG. 3 can be executed by each unit in FIG. 2.
  • the Methods include:
  • the unified cloud storage system processes the registration request of the independent cloud storage system, and binds a storage link (301) to the registered independent cloud storage system; the storage link includes the link ID, the publisher and the receiver, among which, the link ID It is the identifier that distinguishes each independent cloud storage system. Each storage link has a different link ID.
  • the publisher and receiver respectively represent the system information of the unified cloud storage system and the independent cloud storage system.
  • the unified cloud storage system receives the data request sent by the client, and analyzes the data request based on all the registered storage links (302); it is used to receive the data request sent by the client and is based on all the registered storage links Analyze the data request.
  • the data request includes the data request ID, processor, data request information and response information.
  • the data request ID is used to distinguish different data requests.
  • the processor indicates the independent cloud storage system that requires the processing of the data request.
  • the value of the processor is the value of the registered link ID; the data request information is the specific information of the data request, expressing The data that the developer wants to obtain; the response information is written by the independent cloud storage system that ultimately processes the data request.
  • the unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result (303); used to select when the processor is not empty and corresponds to the link ID of a registered storage link
  • the independent cloud storage system corresponding to the link ID and the processor performs processing. It should be understood that the correspondence mentioned here can be exactly the same in value, or it can be the mapping relationship between the value of the link ID stored in the unified cloud storage system and the value of the processor, as long as the processor analyzed at this time The value of and the value of the link ID only need to belong to one element in the mapping relationship.
  • the request unit can be based on the starting time of the unified cloud storage as the limit. If it is less than or equal to the starting time of the unified cloud storage, choose to store the old data On the contrary, if it is longer than the start-up time of the unified cloud storage system, choose an independent cloud storage system that stores new data.
  • the independent cloud storage system performs data processing based on the data request and then returns the processing result to the client (304).
  • the data request information performs data processing, and the processing result is written into the response information, and then returned to the user terminal.
  • the embodiments of the present application provide a data processing method for a unified heterogeneous cloud storage system.
  • the unified cloud storage system can include a large number of independent cloud storage systems internally, and provide developers with a unified data interaction interface externally, so that developers can No need to care about the composition of the heterogeneous cloud storage system, only need to interact with the unified cloud storage system, reducing the developer's development workload.
  • the system 400 may include one or more processors 404, a system control logic 408 connected to at least one of the processors 404, a system memory 412 connected to the system control logic 408, and a system control logic 408 connected to the system control logic 408.
  • the non-volatile memory (NVM) 416 is connected to the system control logic 408, and the network interface 420 is connected to the system control logic 408.
  • the processor 404 may include one or more single-core or multi-core processors. In some embodiments, the processor 404 may include any combination of a general-purpose processor and a special-purpose processor (for example, a graphics processor, an application processor, a baseband processor, etc.). In an embodiment in which the system 400 adopts an eNB (Evolved Node B, enhanced base station) 101 or a RAN (Radio Access Network, radio access network) controller 102, the processor 404 may be configured to execute various conforming embodiments, For example, one or more of the multiple embodiments shown in FIGS. 1-3.
  • eNB evolved Node B, enhanced base station
  • RAN Radio Access Network, radio access network
  • system control logic 408 may include any suitable interface controller to provide any suitable interface to at least one of the processors 404 and/or any suitable device or component in communication with the system control logic 408.
  • system control logic 408 may include one or more memory controllers to provide an interface to the system memory 412.
  • the system memory 412 can be used to load and store data and/or instructions.
  • the memory 412 of the system 400 may include any suitable volatile memory, such as a suitable dynamic random access memory (DRAM).
  • DRAM dynamic random access memory
  • the NVM/memory 416 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions.
  • the NVM/memory 416 may include any suitable non-volatile memory such as flash memory and/or any suitable non-volatile storage device, such as HDD (Hard Disk Drive, hard disk drive), CD (Compact Disc) , At least one of an optical disc drive and a DVD (Digital Versatile Disc, Digital Versatile Disc) drive.
  • the NVM/memory 416 may include a part of the storage resources on the device where the system 400 is installed, or it may be accessed by the device, but not necessarily a part of the device.
  • the NVM/storage 416 can be accessed through the network via the network interface 420.
  • system memory 412 and the NVM/memory 416 may respectively include: a temporary copy and a permanent copy of the instruction 424.
  • the instructions 424 may include instructions that, when executed by at least one of the processors 404, cause the system 400 to implement the method shown in FIGS. 3-4.
  • the instructions 424, hardware, firmware, and/or software components thereof may additionally/alternatively be placed in the system control logic 408, the network interface 420, and/or the processor 404.
  • the network interface 420 may include a transceiver to provide a radio interface for the system 400, and then communicate with any other suitable devices (such as a front-end module, an antenna, etc.) through one or more networks.
  • the network interface 420 may be integrated with other components of the system 400.
  • the network interface 420 may be integrated in at least one of the processor 404, the system memory 412, the NVM/storage 416, and a firmware device (not shown) with instructions.
  • the system 400 implements the data processing method of the heterogeneous cloud storage system as shown in FIG. 3.
  • the network interface 420 may further include any suitable hardware and/or firmware to provide a multiple input multiple output radio interface.
  • the network interface 420 may be a network adapter, a wireless network adapter, a telephone modem, and/or a wireless modem.
  • At least one of the processors 404 may be packaged with the logic of one or more controllers for the system control logic 408 to form a system in package (SiP). In one embodiment, at least one of the processors 404 may be integrated on the same die with the logic of one or more controllers for the system control logic 408 to form a system on chip (SoC).
  • SiP system in package
  • SoC system on chip
  • the system 400 may further include: an input/output (I/O) device 432.
  • the I/O device 432 may include a user interface to enable a user to interact with the system 400; the design of the peripheral component interface enables the peripheral component to also interact with the system 400.
  • the system 400 further includes a sensor for determining at least one of environmental conditions and location information related to the system 400.
  • the user interface may include, but is not limited to, a display (e.g., liquid crystal display, touch screen display, etc.), speakers, microphones, one or more cameras (e.g., still image cameras and/or video cameras), flashlights (e.g., LED flash) and keyboard.
  • a display e.g., liquid crystal display, touch screen display, etc.
  • speakers e.g., speakers, microphones, one or more cameras (e.g., still image cameras and/or video cameras), flashlights (e.g., LED flash) and keyboard.
  • the peripheral component interface may include, but is not limited to, a non-volatile memory port, an audio jack, and a power interface.
  • the senor may include, but is not limited to, a gyroscope sensor, an accelerometer, a proximity sensor, an ambient light sensor, and a positioning unit.
  • the positioning unit may also be part of or interact with the network interface 420 to communicate with components of the positioning network (eg, global positioning system (GPS) satellites).
  • GPS global positioning system
  • FIG. 5 shows a block diagram of a SoC (System on Chip) 500.
  • the SoC 500 includes: an interconnection unit 550, which is coupled to the application processor 515; a system agent unit 570; a bus controller unit 580; an integrated memory controller unit 540; a group or one or more co-processing
  • the device 520 may include an integrated graphics logic, an image processor, an audio processor, and a video processor; a static random access memory (SRAM) unit 530; and a direct memory access (DMA) unit 560.
  • the coprocessor 520 includes a dedicated processor, such as, for example, a network or communication processor, a compression engine, a GPGPU, a high-throughput MIC processor, or an embedded processor, or the like.
  • the various embodiments of the mechanism disclosed in this application may be implemented in hardware, software, firmware, or a combination of these implementation methods.
  • the embodiments of the present application can be implemented as a computer program or program code executed on a programmable system including at least one processor and a storage system (including volatile and non-volatile memory and/or storage elements) , At least one input device and at least one output device.
  • Program codes can be applied to input instructions to perform the functions described in this application and generate output information.
  • the output information can be applied to one or more output devices in a known manner.
  • a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • the program code can be implemented in a high-level programming language or an object-oriented programming language to communicate with the processing system.
  • assembly language or machine language can also be used to implement the program code.
  • the mechanism described in this application is not limited to the scope of any particular programming language. In either case, the language can be a compiled language or an interpreted language.
  • the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof.
  • the disclosed embodiments can also be implemented as instructions carried by or stored on one or more transient or non-transitory machine-readable (eg, computer-readable) storage media, which can be executed by one or more processors. Read and execute.
  • the instructions can be distributed through a network or through other computer-readable media.
  • a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (for example, a computer), including, but not limited to, floppy disks, optical disks, optical disks, read-only memories (CD-ROMs), magnetic Optical disk, read only memory (ROM), random access memory (RAM), erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), magnetic or optical card, flash memory, or A tangible machine-readable memory used to transmit information (for example, carrier waves, infrared signals, digital signals, etc.) using the Internet with electric, optical, acoustic, or other forms of propagating signals. Therefore, a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (for example, a computer).
  • each unit/module mentioned in each device embodiment of this application is a logical unit/module.
  • a logical unit/module can be a physical unit/module or a physical unit/ A part of the module can also be realized by a combination of multiple physical units/modules.
  • the physical realization of these logical units/modules is not the most important.
  • the combination of the functions implemented by these logical units/modules is the solution to this application.
  • the above-mentioned device embodiments of this application do not introduce units/modules that are not closely related to solving the technical problems proposed by this application. This does not mean that the above-mentioned device embodiments do not exist. Other units/modules.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The present application relates to the field of computers. Disclosed are a data processing method for a heterogeneous cloud storage system, and a readable medium and a system therefor. The heterogeneous cloud storage system of the present application comprises a unified cloud storage system and independent cloud storage systems. The data processing method of the present application comprises: a unified cloud storage system receiving a registration request of an independent cloud storage system, and configuring a storage link for the independent cloud storage system which is subjected to registration; the unified cloud storage system receiving a data request sent by a user end, and parsing the data request on the basis of the registered storage link; the unified cloud storage system forwarding, on the basis of a parsing result, the data request to the corresponding independent cloud storage system for processing; and the independent cloud storage system performing data processing on the basis of the data request, and then returning a processing result to the user end.

Description

异构云存储系统的数据处理方法及其可读介质和系统Data processing method of heterogeneous cloud storage system and readable medium and system thereof 技术领域Technical field
本申请涉及计算机领域,特别涉及一种异构云存储系统的数据处理方法及其可读介质和系统。This application relates to the computer field, and in particular to a data processing method of a heterogeneous cloud storage system, and a readable medium and system thereof.
背景技术Background technique
随着IT技术的发展,每天都有海量的业务数据产生,业界也因此出现了各种各样的云存储系统,云存储系统指的是通过集群应用、网络技术或分布式文件系统等功能,将网络中大量各种不同类型的存储设备通用应用软件集合起来协同工作,共同对外提供数据存储和业务访问功能的一个系统。一般来说企业会同时使用多种云存储系统,如果一个云存储系统需要升级,现有技术是先将该云存储系统停机然后备份数据,再将备份数据导入到新系统中,但是这种系统升级的方式流程长,处理复杂,需要耗费较大的时间和精力。With the development of IT technology, massive amounts of business data are generated every day, and various cloud storage systems have emerged in the industry. Cloud storage systems refer to functions such as cluster applications, network technologies, or distributed file systems. A system that brings together a large number of general application software for storage devices of various types in the network to work together to provide external data storage and business access functions. Generally speaking, enterprises will use multiple cloud storage systems at the same time. If a cloud storage system needs to be upgraded, the existing technology is to shut down the cloud storage system first, then back up the data, and then import the backup data into the new system, but this kind of system The upgrade method has a long process, complicated processing, and requires a lot of time and energy.
发明内容Summary of the invention
本申请实施例提供了一种统一异构云存储系统的数据处理方法,统一云存储系统对内可以包括众多的独立云存储系统,对外为开发人员提供统一的数据交互接口,使开发人员无须关心异构式云存储系统的构成,仅需要与统一云存储系统交互,减少开发人员的开发工作量。The embodiment of the application provides a data processing method for a unified heterogeneous cloud storage system. The unified cloud storage system can include a large number of independent cloud storage systems internally, and provides a unified data interaction interface for developers externally, so that developers do not need to care The composition of the heterogeneous cloud storage system only needs to interact with the unified cloud storage system, reducing the development workload of developers.
第一方面,本申请实施例提供了一种异构云存储系统的数据处理方法,所述异构云存储系统包括一个统一云存储系统和多个独立云存储系统,所述方法包括:In the first aspect, an embodiment of the present application provides a data processing method for a heterogeneous cloud storage system. The heterogeneous cloud storage system includes a unified cloud storage system and multiple independent cloud storage systems. The method includes:
统一云存储系统接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接;The unified cloud storage system receives the registration request of the independent cloud storage system, and configures a storage link for the registered independent cloud storage system;
统一云存储系统接收用户端发送的数据请求,并基于已注册的存储链接对该数据请求进行解析;The unified cloud storage system receives the data request sent by the client, and parses the data request based on the registered storage link;
统一云存储系统基于解析结果将数据请求转发给相应的独立云储存系统进行处理;The unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result;
独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端。The independent cloud storage system performs data processing based on the data request and returns the processing result to the client.
在上述第一方面的一种可能实现中,所述存储链接包括以下信息:链接ID、统一云存储系统信息和独立云存储系统信息。In a possible implementation of the foregoing first aspect, the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
在上述第一方面的一种可能实现中,所述统一云存储系统接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接包括:In a possible implementation of the above-mentioned first aspect, the unified cloud storage system receiving the registration request of the independent cloud storage system, and configuring a storage link for the registered independent cloud storage system includes:
各个独立云存储系统分别发送注册请求给统一云存储系统;Each independent cloud storage system sends a registration request to the unified cloud storage system;
针对每个注册请求,统一云存储系统将所述链接ID和统一云存储系统信息写入一个存储链接并配置给对应的独立云存储系统,其中,不同的独立云存储系统对应的链接ID不同;For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
各个独立云存储系统将各自的系统信息写入存储链接并将存储链接返回给统一云存储系统。Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
在上述第一方面的一种可能实现中,所述数据请求包括用户端写入的所述数据请求ID、数据请求信息和独立云存储系统信息。In a possible implementation of the foregoing first aspect, the data request includes the data request ID, data request information, and independent cloud storage system information written by the user terminal.
在上述第一方面的一种可能实现中,所述统一云存储系统接收用户端发送的数据请求,并基于所有已注册的存储链接对该数据请求进行解析包括:In a possible implementation of the above-mentioned first aspect, the unified cloud storage system receiving the data request sent by the user terminal, and analyzing the data request based on all registered storage links includes:
数据请求ID与已注册的存储链接的其中一个链接ID对应,则选择数据请求ID与该链接ID对应的独立云存储系统进行处理。If the data request ID corresponds to one of the link IDs of the registered storage link, the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
在上述第一方面的一种可能实现中,所述数据请求还包括时间节点信息。In a possible implementation of the foregoing first aspect, the data request further includes time node information.
在上述第一方面的一种可能实现中,所述方法还包括:In a possible implementation of the foregoing first aspect, the method further includes:
获取数据请求的时间节点信息;Obtain the time node information of the data request;
基于所述时间节点信息选择相应的独立云存储系统处理所述数据请求。Based on the time node information, a corresponding independent cloud storage system is selected to process the data request.
第二方面,本申请实施例提供了一种异构云存储系统,包括一个统一云存储系统和多个独立云存储系统,其中,所说统一云存储系统包括:In the second aspect, an embodiment of the present application provides a heterogeneous cloud storage system, including a unified cloud storage system and multiple independent cloud storage systems, wherein the unified cloud storage system includes:
注册单元,用于接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置 一个存储链接;The registration unit is used to receive the registration request of the independent cloud storage system and configure a storage link for the registered independent cloud storage system;
解析单元,用于接收用户端发送的数据请求,并基于已注册的存储链接对该数据请求进行解析;The parsing unit is used to receive the data request sent by the client and analyze the data request based on the registered storage link;
转发单元,用于基于解析结果将数据请求转发给相应的独立云储存系统进行处理,独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端。The forwarding unit is configured to forward the data request to the corresponding independent cloud storage system for processing based on the analysis result, and the independent cloud storage system performs data processing based on the data request and then returns the processing result to the user terminal.
在上述第二方面的一种可能实现中,所述存储链接包括:In a possible implementation of the above second aspect, the storage link includes:
所述存储链接包括以下信息:链接ID、统一云存储系统信息和独立云存储系统信息。The storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
在上述第二方面的一种可能实现中,所述注册单元通过以下方式进行注册:In a possible implementation of the above second aspect, the registration unit performs registration in the following manner:
各个独立云存储系统分别发送注册请求给统一云存储系统;Each independent cloud storage system sends a registration request to the unified cloud storage system;
针对每个注册请求,统一云存储系统将所述链接ID和统一云存储系统信息写入一个存储链接并配置给对应的独立云存储系统,其中,不同的独立云存储系统对应的链接ID不同;For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
各个独立云存储系统将各自的系统信息写入存储链接并将存储链接返回给统一云存储系统。Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
在上述第二方面的一种可能实现中,所述数据请求包括用户端写入的所述数据请求ID、数据请求信息和独立云存储系统信息。In a possible implementation of the above second aspect, the data request includes the data request ID, data request information, and independent cloud storage system information written by the user terminal.
在上述第二方面的一种可能实现中,所述解析单元通过以下方式对数据请求进行解析:In a possible implementation of the above second aspect, the parsing unit parses the data request in the following manner:
数据请求ID与已注册的存储链接的其中一个链接ID对应,则选择数据请求ID与该链接ID对应的独立云存储系统进行处理。If the data request ID corresponds to one of the link IDs of the registered storage link, the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
在上述第二方面的一种可能实现中,所述数据请求还包括时间节点信息。In a possible implementation of the above second aspect, the data request further includes time node information.
在上述第二方面的一种可能实现中,所述解析单元通过以下方式对数据请求进行解析:In a possible implementation of the above second aspect, the parsing unit parses the data request in the following manner:
获取数据请求的时间节点信息;Obtain the time node information of the data request;
基于所述时间节点信息选择相应的独立云存储系统处理所述数据请求。Based on the time node information, a corresponding independent cloud storage system is selected to process the data request.
第三方面,本申请实施例提供了一种机器可读介质,所述机器可读介质上存储有指令,该指令在机器上执行时使机器执行上述任一方面异构云存储系统的数据处理方法。In a third aspect, embodiments of the present application provide a machine-readable medium with instructions stored on the machine-readable medium, which when executed on a machine, cause the machine to perform any of the above-mentioned data processing of heterogeneous cloud storage systems method.
第四方面,本申请实施例提供了一种系统,所述系统包括:In a fourth aspect, an embodiment of the present application provides a system, and the system includes:
存储器,用于存储由系统的一个或多个处理器执行的指令,以及Memory, used to store instructions executed by one or more processors of the system, and
处理器,是系统的处理器之一,用于执行上述任一方面所述的异构云存储系统的数据处理方法。The processor is one of the processors of the system and is used to execute the data processing method of the heterogeneous cloud storage system described in any one of the above aspects.
附图说明Description of the drawings
图1根据本申请的一些实施例,示出了一种异构云存储系统的数据处理的场景图。Fig. 1 shows a data processing scene diagram of a heterogeneous cloud storage system according to some embodiments of the present application.
图2根据本申请的一些实施例,示出了一种统一云存储系统的结构框图。Fig. 2 shows a structural block diagram of a unified cloud storage system according to some embodiments of the present application.
图3根据本申请的一些实施例,示出了一种异构云存储系统的数据处理方法的流程图。Fig. 3 shows a flowchart of a data processing method of a heterogeneous cloud storage system according to some embodiments of the present application.
图4根据本申请的一些实施例,示出了一种系统的框图。Fig. 4 shows a block diagram of a system according to some embodiments of the present application.
图5根据本申请一些实施例,示出了一种片上系统(SoC)的框图。Fig. 5 shows a block diagram of a system on chip (SoC) according to some embodiments of the present application.
具体实施例Specific embodiment
本申请的说明性实施例包括但不限于统一异构云储存系统及其数据处理方法。Illustrative embodiments of this application include, but are not limited to, a unified heterogeneous cloud storage system and its data processing method.
可以理解,如本文所使用的,术语“模块”可以指代或者包括专用集成电路(ASIC)、电子电路、执行一个或多个软件或固件程序的处理器(共享、专用、或群组)和/或存储器、组合逻辑电路、和/或提供所描述的功能的其他适当硬件组件,或者可以作为这些硬件组件的一部分。It is understood that, as used herein, the term "module" can refer to or include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) that executes one or more software or firmware programs, and /Or memory, combinational logic circuits, and/or other suitable hardware components that provide the described functions, or may be part of these hardware components.
可以理解,在本申请各实施例中,处理器可以是微处理器、数字信号处理器、微控制器等,和/或其任何组合。根据另一个方面,所述处理器可以是单核处理器,多核处理器等,和/或其任何组合。It can be understood that, in the embodiments of the present application, the processor may be a microprocessor, a digital signal processor, a microcontroller, etc., and/or any combination thereof. According to another aspect, the processor may be a single-core processor, a multi-core processor, etc., and/or any combination thereof.
下面将结合附图对本申请的实施例作进一步地详细描述。The embodiments of the present application will be described in further detail below in conjunction with the accompanying drawings.
根据本申请的一些实施例,图1示出了异构云存储系统的数据处理的场景图10,如图1所示,用户端100向统一云存储系统200发送数据请求,统一云存储系统200将数据请求分别转发给已注册的独立云存储系统400、独立云存储系统500和独立云存储系统600, 独立云存储系统对接收到的数据请求处理完成后将处理结果返回给用户端100。其中,独立云存储系统400、独立云存储系统500和独立云存储系统600是异构存储系统,其整体架构、存储方式以及查询原理可能不同,通过注册在统一存储系统200下,通过统一存储系统200的统一调控,实现用户端100的海量数据请求的快速处理。可以理解,独立云存储系统可以是不同公司开发的云存储系统,虽然图1中只示出了3种独立云存储系统,但实际上统一云存储系统200还可以包括任意数量的独立云存储系统,在此不做限制。According to some embodiments of the present application, FIG. 1 shows a data processing scene diagram of a heterogeneous cloud storage system. As shown in FIG. 1, the client 100 sends a data request to the unified cloud storage system 200, and the unified cloud storage system 200 The data request is forwarded to the registered independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 respectively, and the independent cloud storage system returns the processing result to the client 100 after processing the received data request. Among them, the independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 are heterogeneous storage systems, and their overall architecture, storage methods, and query principles may be different. They can be registered under the unified storage system 200 and passed through the unified storage system. The unified regulation of 200 realizes the rapid processing of the massive data request of the client 100. It is understandable that independent cloud storage systems may be cloud storage systems developed by different companies. Although only three independent cloud storage systems are shown in Figure 1, in fact, the unified cloud storage system 200 may also include any number of independent cloud storage systems. , There is no restriction here.
下面介绍统一存储系统200的结构,图2根据本申请的一些实施例示出了一种统一云存储系统200的结构框图,如图2所示,统一云存储系统200包括注册单元201、解析单元202和转发单元203。其中,The following describes the structure of the unified storage system 200. FIG. 2 shows a block diagram of a unified cloud storage system 200 according to some embodiments of the present application. As shown in FIG. 2, the unified cloud storage system 200 includes a registration unit 201 and an analysis unit 202. And forwarding unit 203. in,
注册单元201,用于处理各个独立云存储系统的注册请求,并为注册通过的每个独立云存储系统绑定一个已注册的存储链接。其中,存储链接是独立云存储系统的合法凭据,保存于每个独立云存储系统上,拥有存储链接的独立云存储系统才能成功注册到统一云存储框架上。当需要增加新的云存储系统供用户选择时,只需要将该存储系统注册到统一云存储系统200即可,实现整个异构式云存储系统的无缝扩容。The registration unit 201 is used to process the registration request of each independent cloud storage system, and bind a registered storage link to each independent cloud storage system that has been registered. Among them, the storage link is the legal credential of the independent cloud storage system, which is stored on each independent cloud storage system. Only the independent cloud storage system with the storage link can successfully register on the unified cloud storage framework. When a new cloud storage system needs to be added for the user to choose from, it is only necessary to register the storage system to the unified cloud storage system 200 to achieve seamless expansion of the entire heterogeneous cloud storage system.
存储链接包括链接ID、发布者和接收者,其中,链接ID是区别各个独立云存储系统的标识,每个存储链接具有互不相同的链接ID,发布者和接收者分别表示统一云存储系统200和独立云存储系统的系统信息。Storage links include link IDs, publishers, and receivers. The link ID is an identifier that distinguishes each independent cloud storage system. Each storage link has a different link ID. The publisher and receiver respectively represent the unified cloud storage system 200. And the system information of the independent cloud storage system.
解析单元202,用于接收用户端100发送的数据请求,并基于所有已注册的存储链接对该数据请求进行解析。其中,数据请求包括数据请求ID、处理者、数据请求信息和响应信息。数据请求ID用于区分各个不同的数据请求,处理者表示要求处理该数据请求的独立云存储系统,处理者的数值是已注册的链接ID的数值,数据请求信息是数据请求的具体信息,表达开发人员想要获取的数据,响应信息由最终处理该数据请求的独立云存储系统写入。The parsing unit 202 is configured to receive a data request sent by the user terminal 100, and analyze the data request based on all registered storage links. Among them, the data request includes the data request ID, processor, data request information and response information. The data request ID is used to distinguish different data requests. The processor indicates the independent cloud storage system that requires the processing of the data request. The value of the processor is the value of the registered link ID. The data request information is the specific information of the data request. For the data that the developer wants to obtain, the response information is written by the independent cloud storage system that ultimately processes the data request.
在一些实施例中,解析单元对该数据请求进行解析包括:基于所有已注册的存储链接,分析数据请求中的处理者。由于开发用户在登录统一云存储系统200时,统一云存储系统200提供了已注册的众多独立云存储系统的链接ID供用户选择,用户只需要将自己需要的云存储系统的链接ID的数值作为数据请求的处理者的数值写入数据请求中即可。In some embodiments, the parsing unit parsing the data request includes: analyzing the processor in the data request based on all registered storage links. Since the developer user logs in to the unified cloud storage system 200, the unified cloud storage system 200 provides the link IDs of numerous registered independent cloud storage systems for the user to choose. Users only need to take the value of the link ID of the cloud storage system they need as The value of the processor of the data request can be written in the data request.
转发单元203,用于在处理者非空且与某个已注册的存储链接的链接ID相应时,选择链接ID与该处理者相应的独立云存储系统进行处理。可以理解,此处所说的相应可以是数 值上完全相同,也可以是在统一云存储系统中存储有链接ID的数值与处理者的数值之间的映射关系,只要此时分析的处理者的数值与链接ID的数值属于该映射关系中的一个元素即可。The forwarding unit 203 is configured to select an independent cloud storage system with a link ID corresponding to the processor for processing when the processor is not empty and corresponds to the link ID of a certain registered storage link. It is understandable that the correspondence mentioned here can be exactly the same in value, or it can be the mapping relationship between the value of the link ID and the value of the processor stored in the unified cloud storage system, as long as the value of the processor analyzed at this time The value of the link ID only needs to belong to one element in the mapping relationship.
例如,独立云存储系统分别是独立云存储系统400、独立云存储系统500和独立云存储系统600,则处理者独立云存储系统400、独立云存储系统500和独立云存储系统600的链接ID的数值不同,例如,链接ID的数值分别是0101,0202,0303。首先,解析单元202解析数据请求进行解析后获得数据请求ID的数值,例如,数据请求ID数值中包含有0101,则转发单元202将该数据请求发送给独立云存储系统400进行处理,如果数据请求ID数值中包含有0202,则转发单元202将数据请求转发给独立云存储系统500进行处理,如果数据请求ID数值中包含有0303,则请求单元203将该数据请求转发给独立云存储系统600进行处理。For example, if the independent cloud storage systems are the independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600, the processor independent cloud storage system 400, the independent cloud storage system 500, and the independent cloud storage system 600 have their link IDs The numerical values are different, for example, the numerical values of the link ID are 0101,0202,0303 respectively. First, the parsing unit 202 parses the data request and obtains the value of the data request ID after parsing. For example, if the data request ID value contains 0101, the forwarding unit 202 sends the data request to the independent cloud storage system 400 for processing. If the data request is If the ID value contains 0202, the forwarding unit 202 forwards the data request to the independent cloud storage system 500 for processing. If the data request ID value contains 0303, the request unit 203 forwards the data request to the independent cloud storage system 600 for processing. deal with.
另外,如果处理者非空但是寻找不到对应链接ID的处理者或者链接ID缺失,此时请求单元202可以以统一云存储系统200的启动时间为界限,如果小于或者等于统一云存储的启动时间,选择存储老数据的独立云存储系统,反之,如果大于统一云存储系统的启动时间,选择存储新数据的独立云存储系统。In addition, if the processor is not empty but the processor with the corresponding link ID cannot be found or the link ID is missing, the request unit 202 may use the start-up time of the unified cloud storage system 200 as the limit, if it is less than or equal to the start-up time of the unified cloud storage , Choose an independent cloud storage system that stores old data. Conversely, if it is longer than the start-up time of the unified cloud storage system, choose an independent cloud storage system that stores new data.
在一些实施例中,从1月到3月份独立云存储系统400存储的数据为老数据,9月份到12月份独立云存储系统500存储数据为新数据,而中间时间段(3月份到9月份)为独立云存储系统600存储的数据。那么,首先解析单元202解析出数据请求的时间节点信息,例如,数据请求的时间信息解析出来的时间节点是6月份,那么转发单元203将此数据请求发送给独立云存储系统600,独立云存储系统600接收指令后按照自己的读写方式进行读写文件。又例如,数据请求的时间信息是时间节点2月份,则将此数据请求转发送给独立云存储系统400,独立云存储系统400接收指令后按照自己的读写方式进行读写文件。又例如,数据请求的时间节点信息是10月份,则将此数据请求转发送给独立云存储系统500,独立云存储系统500接收指令后按照自己的读写方式进行读写文件。In some embodiments, the data stored by the independent cloud storage system 400 from January to March is old data, the data stored by the independent cloud storage system 500 from September to December is new data, and the intermediate time period (March to September ) Is the data stored in the independent cloud storage system 600. Then, first the parsing unit 202 parses out the time node information of the data request. For example, if the time node parsed by the time information of the data request is June, then the forwarding unit 203 sends the data request to the independent cloud storage system 600, and the independent cloud storage After receiving the instruction, the system 600 reads and writes the file according to its own read and write mode. For another example, if the time information of the data request is the time node in February, the data request is forwarded to the independent cloud storage system 400, and the independent cloud storage system 400 reads and writes the file according to its own reading and writing mode after receiving the instruction. For another example, if the time node information of the data request is October, the data request is forwarded to the independent cloud storage system 500, and the independent cloud storage system 500 reads and writes the file according to its own reading and writing mode after receiving the instruction.
最后,独立云存储系统在接收到转发单元203转发的数据请求时,根据数据请求中的数据请求信息进行数据处理(例如,数据请求信息为获取指定目录下的所有文件详细信息),并将处理结果写入响应信息中,然后返回给用户端100。Finally, when the independent cloud storage system receives the data request forwarded by the forwarding unit 203, it performs data processing according to the data request information in the data request (for example, the data request information is to obtain detailed information of all files in the specified directory), and process The result is written in the response message, and then returned to the client 100.
根据本申请的一些实施例,图3示意性示出了一种异构云存储系统的数据处理方法流 程图,图3中的数据处理方法可以由图2中的各个单元执行,具体的,该方法包括:According to some embodiments of the present application, FIG. 3 schematically shows a flow chart of a data processing method of a heterogeneous cloud storage system. The data processing method in FIG. 3 can be executed by each unit in FIG. 2. Specifically, the Methods include:
(1)统一云存储系统处理独立云存储系统的注册请求,并且为注册通过的独立云存储系统绑定一个存储链接(301);存储链接包括链接ID、发布者和接收者,其中,链接ID是区别各个独立云存储系统的标识,每个存储链接具有互不相同的链接ID,发布者和接收者分别表示统一云存储系统和独立云存储系统的系统信息。(1) The unified cloud storage system processes the registration request of the independent cloud storage system, and binds a storage link (301) to the registered independent cloud storage system; the storage link includes the link ID, the publisher and the receiver, among which, the link ID It is the identifier that distinguishes each independent cloud storage system. Each storage link has a different link ID. The publisher and receiver respectively represent the system information of the unified cloud storage system and the independent cloud storage system.
(2)统一云存储系统接收用户端发送的数据请求,基于所有已注册的存储链接对该数据请求进行解析(302);用于接收用户端发送的数据请求,并基于所有已注册的存储链接对该数据请求进行解析。其中,数据请求包括数据请求ID、处理者、数据请求信息和响应信息。数据请求ID用于区分各个不同的数据请求,处理者表示要求处理该数据请求的独立云存储系统,处理者的数值是已注册的链接ID的数值;数据请求信息是数据请求的具体信息,表达开发人员想要获取的数据;响应信息由最终处理该数据请求的独立云存储系统写入。(2) The unified cloud storage system receives the data request sent by the client, and analyzes the data request based on all the registered storage links (302); it is used to receive the data request sent by the client and is based on all the registered storage links Analyze the data request. Among them, the data request includes the data request ID, processor, data request information and response information. The data request ID is used to distinguish different data requests. The processor indicates the independent cloud storage system that requires the processing of the data request. The value of the processor is the value of the registered link ID; the data request information is the specific information of the data request, expressing The data that the developer wants to obtain; the response information is written by the independent cloud storage system that ultimately processes the data request.
(3)统一云存储系统基于解析结果将数据请求转发给相应的独立云储存系统进行处理(303);用于在处理者非空且与某个已注册的存储链接的链接ID相应时,选择链接ID与该处理者相应的独立云存储系统进行处理。应当理解的是,此处所说的相应可以是数值上完全相同,也可以是在统一云存储系统中存储有链接ID的数值与处理者的数值之间的映射关系,只要此时分析的处理者的数值与链接ID的数值属于该映射关系中的一个元素即可。(3) The unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result (303); used to select when the processor is not empty and corresponds to the link ID of a registered storage link The independent cloud storage system corresponding to the link ID and the processor performs processing. It should be understood that the correspondence mentioned here can be exactly the same in value, or it can be the mapping relationship between the value of the link ID stored in the unified cloud storage system and the value of the processor, as long as the processor analyzed at this time The value of and the value of the link ID only need to belong to one element in the mapping relationship.
如果处理者非空但是寻找不到对应链接ID的处理者或者链接ID缺失,此时请求单元可以根据统一云存储的启动时间为界限,如果小于或者等于统一云存储的启动时间,选择存储老数据的独立云存储系统,反之,如果大于统一云存储系统的启动时间,选择存储新数据的独立云存储系统。If the processor is not empty but the processor with the corresponding link ID cannot be found or the link ID is missing, the request unit can be based on the starting time of the unified cloud storage as the limit. If it is less than or equal to the starting time of the unified cloud storage, choose to store the old data On the contrary, if it is longer than the start-up time of the unified cloud storage system, choose an independent cloud storage system that stores new data.
(4)独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端(304),被选中的独立云存储系统在接收到转发单元转发的数据请求时,根据所述数据请求中的数据请求信息进行数据处理,并将处理结果写入响应信息中,然后返回给用户端。(4) The independent cloud storage system performs data processing based on the data request and then returns the processing result to the client (304). When the selected independent cloud storage system receives the data request forwarded by the forwarding unit, The data request information performs data processing, and the processing result is written into the response information, and then returned to the user terminal.
因此,本申请实施例提供了一种统一异构云存储系统的数据处理方法,统一云存储系统对内可以包括众多的独立云存储系统,对外为开发人员提供统一的数据交互接口,使开发人员无须关心异构式云存储系统的构成,仅需要与统一云存储系统交互,减少开发人员 的开发工作量。Therefore, the embodiments of the present application provide a data processing method for a unified heterogeneous cloud storage system. The unified cloud storage system can include a large number of independent cloud storage systems internally, and provide developers with a unified data interaction interface externally, so that developers can No need to care about the composition of the heterogeneous cloud storage system, only need to interact with the unified cloud storage system, reducing the developer's development workload.
现在参考图4,所示为根据本申请的一个实施例的系统400的框图。图4示意性地示出了根据多个实施例的示例系统400。在一个实施例中,系统400可以包括一个或多个处理器404,与处理器404中的至少一个连接的系统控制逻辑408,与系统控制逻辑408连接的系统内存412,与系统控制逻辑408连接的非易失性存储器(NVM)416,以及与系统控制逻辑408连接的网络接口420。Referring now to FIG. 4, shown is a block diagram of a system 400 according to an embodiment of the present application. Figure 4 schematically illustrates an example system 400 according to various embodiments. In one embodiment, the system 400 may include one or more processors 404, a system control logic 408 connected to at least one of the processors 404, a system memory 412 connected to the system control logic 408, and a system control logic 408 connected to the system control logic 408. The non-volatile memory (NVM) 416 is connected to the system control logic 408, and the network interface 420 is connected to the system control logic 408.
在一些实施例中,处理器404可以包括一个或多个单核或多核处理器。在一些实施例中,处理器404可以包括通用处理器和专用处理器(例如,图形处理器,应用处理器,基带处理器等)的任意组合。在系统400采用eNB(Evolved Node B,增强型基站)101或RAN(Radio Access Network,无线接入网)控制器102的实施例中,处理器404可以被配置为执行各种符合的实施例,例如,如图1-3所示的多个实施例中的一个或多个。In some embodiments, the processor 404 may include one or more single-core or multi-core processors. In some embodiments, the processor 404 may include any combination of a general-purpose processor and a special-purpose processor (for example, a graphics processor, an application processor, a baseband processor, etc.). In an embodiment in which the system 400 adopts an eNB (Evolved Node B, enhanced base station) 101 or a RAN (Radio Access Network, radio access network) controller 102, the processor 404 may be configured to execute various conforming embodiments, For example, one or more of the multiple embodiments shown in FIGS. 1-3.
在一些实施例中,系统控制逻辑408可以包括任意合适的接口控制器,以向处理器404中的至少一个和/或与系统控制逻辑408通信的任意合适的设备或组件提供任意合适的接口。In some embodiments, the system control logic 408 may include any suitable interface controller to provide any suitable interface to at least one of the processors 404 and/or any suitable device or component in communication with the system control logic 408.
在一些实施例中,系统控制逻辑408可以包括一个或多个存储器控制器,以提供连接到系统内存412的接口。系统内存412可以用于加载以及存储数据和/或指令。在一些实施例中系统400的内存412可以包括任意合适的易失性存储器,例如合适的动态随机存取存储器(DRAM)。In some embodiments, the system control logic 408 may include one or more memory controllers to provide an interface to the system memory 412. The system memory 412 can be used to load and store data and/or instructions. In some embodiments, the memory 412 of the system 400 may include any suitable volatile memory, such as a suitable dynamic random access memory (DRAM).
NVM/存储器416可以包括用于存储数据和/或指令的一个或多个有形的、非暂时性的计算机可读介质。在一些实施例中,NVM/存储器416可以包括闪存等任意合适的非易失性存储器和/或任意合适的非易失性存储设备,例如HDD(Hard Disk Drive,硬盘驱动器),CD(Compact Disc,光盘)驱动器,DVD(Digital Versatile Disc,数字通用光盘)驱动器中的至少一个。The NVM/memory 416 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions. In some embodiments, the NVM/memory 416 may include any suitable non-volatile memory such as flash memory and/or any suitable non-volatile storage device, such as HDD (Hard Disk Drive, hard disk drive), CD (Compact Disc) , At least one of an optical disc drive and a DVD (Digital Versatile Disc, Digital Versatile Disc) drive.
NVM/存储器416可以包括安装系统400的装置上的一部分存储资源,或者它可以由设备访问,但不一定是设备的一部分。例如,可以经由网络接口420通过网络访问NVM/存储416。The NVM/memory 416 may include a part of the storage resources on the device where the system 400 is installed, or it may be accessed by the device, but not necessarily a part of the device. For example, the NVM/storage 416 can be accessed through the network via the network interface 420.
特别地,系统内存412和NVM/存储器416可以分别包括:指令424的暂时副本和永久副本。指令424可以包括:由处理器404中的至少一个执行时导致系统400实施如图3-4 所示的方法的指令。在一些实施例中,指令424、硬件、固件和/或其软件组件可另外地/替代地置于系统控制逻辑408,网络接口420和/或处理器404中。In particular, the system memory 412 and the NVM/memory 416 may respectively include: a temporary copy and a permanent copy of the instruction 424. The instructions 424 may include instructions that, when executed by at least one of the processors 404, cause the system 400 to implement the method shown in FIGS. 3-4. In some embodiments, the instructions 424, hardware, firmware, and/or software components thereof may additionally/alternatively be placed in the system control logic 408, the network interface 420, and/or the processor 404.
网络接口420可以包括收发器,用于为系统400提供无线电接口,进而通过一个或多个网络与任意其他合适的设备(如前端模块,天线等)进行通信。在一些实施例中,网络接口420可以集成于系统400的其他组件。例如,网络接口420可以集成于处理器404的,系统内存412,NVM/存储器416,和具有指令的固件设备(未示出)中的至少一种,当处理器404中的至少一个执行所述指令时,系统400实现如图3所示的异构云存储系统的数据处理方法。The network interface 420 may include a transceiver to provide a radio interface for the system 400, and then communicate with any other suitable devices (such as a front-end module, an antenna, etc.) through one or more networks. In some embodiments, the network interface 420 may be integrated with other components of the system 400. For example, the network interface 420 may be integrated in at least one of the processor 404, the system memory 412, the NVM/storage 416, and a firmware device (not shown) with instructions. When at least one of the processor 404 executes the When instructed, the system 400 implements the data processing method of the heterogeneous cloud storage system as shown in FIG. 3.
网络接口420可以进一步包括任意合适的硬件和/或固件,以提供多输入多输出无线电接口。例如,网络接口420可以是网络适配器,无线网络适配器,电话调制解调器和/或无线调制解调器。The network interface 420 may further include any suitable hardware and/or firmware to provide a multiple input multiple output radio interface. For example, the network interface 420 may be a network adapter, a wireless network adapter, a telephone modem, and/or a wireless modem.
在一个实施例中,处理器404中的至少一个可以与用于系统控制逻辑408的一个或多个控制器的逻辑封装在一起,以形成系统封装(SiP)。在一个实施例中,处理器404中的至少一个可以与用于系统控制逻辑408的一个或多个控制器的逻辑集成在同一管芯上,以形成片上系统(SoC)。In one embodiment, at least one of the processors 404 may be packaged with the logic of one or more controllers for the system control logic 408 to form a system in package (SiP). In one embodiment, at least one of the processors 404 may be integrated on the same die with the logic of one or more controllers for the system control logic 408 to form a system on chip (SoC).
系统400可以进一步包括:输入/输出(I/O)设备432。I/O设备432可以包括用户界面,使得用户能够与系统400进行交互;外围组件接口的设计使得外围组件也能够与系统400交互。在一些实施例中,系统400还包括传感器,用于确定与系统400相关的环境条件和位置信息的至少一种。The system 400 may further include: an input/output (I/O) device 432. The I/O device 432 may include a user interface to enable a user to interact with the system 400; the design of the peripheral component interface enables the peripheral component to also interact with the system 400. In some embodiments, the system 400 further includes a sensor for determining at least one of environmental conditions and location information related to the system 400.
在一些实施例中,用户界面可包括但不限于显示器(例如,液晶显示器,触摸屏显示器等),扬声器,麦克风,一个或多个相机(例如,静止图像照相机和/或摄像机),手电筒(例如,发光二极管闪光灯)和键盘。In some embodiments, the user interface may include, but is not limited to, a display (e.g., liquid crystal display, touch screen display, etc.), speakers, microphones, one or more cameras (e.g., still image cameras and/or video cameras), flashlights (e.g., LED flash) and keyboard.
在一些实施例中,外围组件接口可以包括但不限于非易失性存储器端口、音频插孔和电源接口。In some embodiments, the peripheral component interface may include, but is not limited to, a non-volatile memory port, an audio jack, and a power interface.
在一些实施例中,传感器可包括但不限于陀螺仪传感器,加速度计,近程传感器,环境光线传感器和定位单元。定位单元还可以是网络接口420的一部分或与网络接口420交互,以与定位网络的组件(例如,全球定位系统(GPS)卫星)进行通信。In some embodiments, the sensor may include, but is not limited to, a gyroscope sensor, an accelerometer, a proximity sensor, an ambient light sensor, and a positioning unit. The positioning unit may also be part of or interact with the network interface 420 to communicate with components of the positioning network (eg, global positioning system (GPS) satellites).
根据本申请的实施例,图5示出了一种SoC(System on Chip,片上系统)500的框图。在图5中,相似的部件具有同样的附图标记。另外,虚线框是更先进的SoC的可选特征。在图5中,SoC 500包括:互连单元550,其被耦合至应用处理器515;系统代理单元570;总线控制器单元580;集成存储器控制器单元540;一组或一个或多个协处理器520,其可包括集成图形逻辑、图像处理器、音频处理器和视频处理器;静态随机存取存储器(SRAM)单元530;直接存储器存取(DMA)单元560。在一个实施例中,协处理器520包括专用处理器,诸如例如网络或通信处理器、压缩引擎、GPGPU、高吞吐量MIC处理器、或嵌入式处理器等等。According to an embodiment of the present application, FIG. 5 shows a block diagram of a SoC (System on Chip) 500. In Figure 5, similar parts have the same reference numerals. In addition, the dashed box is an optional feature of the more advanced SoC. In FIG. 5, the SoC 500 includes: an interconnection unit 550, which is coupled to the application processor 515; a system agent unit 570; a bus controller unit 580; an integrated memory controller unit 540; a group or one or more co-processing The device 520 may include an integrated graphics logic, an image processor, an audio processor, and a video processor; a static random access memory (SRAM) unit 530; and a direct memory access (DMA) unit 560. In one embodiment, the coprocessor 520 includes a dedicated processor, such as, for example, a network or communication processor, a compression engine, a GPGPU, a high-throughput MIC processor, or an embedded processor, or the like.
本申请公开的机制的各实施例可以被实现在硬件、软件、固件或这些实现方法的组合中。本申请的实施例可实现为在可编程系统上执行的计算机程序或程序代码,该可编程系统包括至少一个处理器、存储系统(包括易失性和非易失性存储器和/或存储元件)、至少一个输入设备以及至少一个输出设备。The various embodiments of the mechanism disclosed in this application may be implemented in hardware, software, firmware, or a combination of these implementation methods. The embodiments of the present application can be implemented as a computer program or program code executed on a programmable system including at least one processor and a storage system (including volatile and non-volatile memory and/or storage elements) , At least one input device and at least one output device.
可将程序代码应用于输入指令,以执行本申请描述的各功能并生成输出信息。可以按已知方式将输出信息应用于一个或多个输出设备。为了本申请的目的,处理系统包括具有诸如例如数字信号处理器(DSP)、微控制器、专用集成电路(ASIC)或微处理器之类的处理器的任何系统。Program codes can be applied to input instructions to perform the functions described in this application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of this application, a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.
程序代码可以用高级程序化语言或面向对象的编程语言来实现,以便与处理系统通信。在需要时,也可用汇编语言或机器语言来实现程序代码。事实上,本申请中描述的机制不限于任何特定编程语言的范围。在任一情形下,该语言可以是编译语言或解释语言。The program code can be implemented in a high-level programming language or an object-oriented programming language to communicate with the processing system. When needed, assembly language or machine language can also be used to implement the program code. In fact, the mechanism described in this application is not limited to the scope of any particular programming language. In either case, the language can be a compiled language or an interpreted language.
在一些情况下,所公开的实施例可以以硬件、固件、软件或其任何组合来实现。所公开的实施例还可以被实现为由一个或多个暂时或非暂时性机器可读(例如,计算机可读)存储介质承载或存储在其上的指令,其可以由一个或多个处理器读取和执行。例如,指令可以通过网络或通过其他计算机可读介质分发。因此,机器可读介质可以包括用于以机器(例如,计算机)可读的形式存储或传输信息的任何机制,包括但不限于,软盘、光盘、光碟、只读存储器(CD-ROMs)、磁光盘、只读存储器(ROM)、随机存取存储器(RAM)、可擦除可编程只读存储器(EPROM)、电可擦除可编程只读存储器(EEPROM)、磁卡或光卡、闪存、或用于利用因特网以电、光、声或其他形式的传播信号来传输信息(例如,载波、红外信号数字信号等)的有形的机器可读存储器。因此,机器可读介质包括适合于 以机器(例如,计算机)可读的形式存储或传输电子指令或信息的任何类型的机器可读介质。In some cases, the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried by or stored on one or more transient or non-transitory machine-readable (eg, computer-readable) storage media, which can be executed by one or more processors. Read and execute. For example, the instructions can be distributed through a network or through other computer-readable media. Therefore, a machine-readable medium may include any mechanism for storing or transmitting information in a form readable by a machine (for example, a computer), including, but not limited to, floppy disks, optical disks, optical disks, read-only memories (CD-ROMs), magnetic Optical disk, read only memory (ROM), random access memory (RAM), erasable programmable read only memory (EPROM), electrically erasable programmable read only memory (EEPROM), magnetic or optical card, flash memory, or A tangible machine-readable memory used to transmit information (for example, carrier waves, infrared signals, digital signals, etc.) using the Internet with electric, optical, acoustic, or other forms of propagating signals. Therefore, a machine-readable medium includes any type of machine-readable medium suitable for storing or transmitting electronic instructions or information in a form readable by a machine (for example, a computer).
在附图中,可以以特定布置和/或顺序示出一些结构或方法特征。然而,应该理解,可能不需要这样的特定布置和/或排序。而是,在一些实施例中,这些特征可以以不同于说明性附图中所示的方式和/或顺序来布置。另外,在特定图中包括结构或方法特征并不意味着暗示在所有实施例中都需要这样的特征,并且在一些实施例中,可以不包括这些特征或者可以与其他特征组合。In the drawings, some structural or method features may be shown in a specific arrangement and/or order. However, it should be understood that such a specific arrangement and/or ordering may not be required. Rather, in some embodiments, these features may be arranged in a different manner and/or order than shown in the illustrative drawings. In addition, the inclusion of structural or method features in a particular figure does not imply that such features are required in all embodiments, and in some embodiments, these features may not be included or may be combined with other features.
需要说明的是,本申请各设备实施例中提到的各单元/模块都是逻辑单元/模块,在物理上,一个逻辑单元/模块可以是一个物理单元/模块,也可以是一个物理单元/模块的一部分,还可以以多个物理单元/模块的组合实现,这些逻辑单元/模块本身的物理实现方式并不是最重要的,这些逻辑单元/模块所实现的功能的组合才是解决本申请所提出的技术问题的关键。此外,为了突出本申请的创新部分,本申请上述各设备实施例并没有将与解决本申请所提出的技术问题关系不太密切的单元/模块引入,这并不表明上述设备实施例并不存在其它的单元/模块。It should be noted that each unit/module mentioned in each device embodiment of this application is a logical unit/module. Physically, a logical unit/module can be a physical unit/module or a physical unit/ A part of the module can also be realized by a combination of multiple physical units/modules. The physical realization of these logical units/modules is not the most important. The combination of the functions implemented by these logical units/modules is the solution to this application. The key to the technical question raised. In addition, in order to highlight the innovative part of this application, the above-mentioned device embodiments of this application do not introduce units/modules that are not closely related to solving the technical problems proposed by this application. This does not mean that the above-mentioned device embodiments do not exist. Other units/modules.
需要说明的是,在本专利的示例和说明书中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in the examples and specification of this patent, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply There is any such actual relationship or sequence between these entities or operations. Moreover, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements not only includes those elements, but also includes those that are not explicitly listed Other elements of, or also include elements inherent to this process, method, article or equipment. If there are no more restrictions, the element defined by the phrase "including one" does not exclude the existence of other same elements in the process, method, article, or equipment that includes the element.
虽然通过参照本申请的某些优选实施例,已经对本申请进行了图示和描述,但本领域的普通技术人员应该明白,可以在形式上和细节上对其作各种改变,而不偏离本申请的精神和范围。Although the present application has been illustrated and described by referring to certain preferred embodiments of the present application, those of ordinary skill in the art should understand that various changes can be made in form and details without departing from the present application. The spirit and scope of the application.

Claims (16)

  1. 一种异构云存储系统的数据处理方法,其特征在于,所述异构云存储系统包括一个统一云存储系统和多个独立云存储系统,所述方法包括:A data processing method for a heterogeneous cloud storage system, wherein the heterogeneous cloud storage system includes a unified cloud storage system and multiple independent cloud storage systems, and the method includes:
    统一云存储系统接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接;The unified cloud storage system receives the registration request of the independent cloud storage system, and configures a storage link for the registered independent cloud storage system;
    统一云存储系统接收用户端发送的数据请求,并基于已注册的存储链接对该数据请求进行解析;The unified cloud storage system receives the data request sent by the client, and parses the data request based on the registered storage link;
    统一云存储系统基于解析结果将数据请求转发给相应的独立云储存系统进行处理;The unified cloud storage system forwards the data request to the corresponding independent cloud storage system for processing based on the analysis result;
    独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端。The independent cloud storage system performs data processing based on the data request and returns the processing result to the client.
  2. 根据权利要求1所述的异构云存储系统的数据处理方法,其特征在于,所述存储链接包括以下信息:链接ID、统一云存储系统信息和独立云存储系统信息。The data processing method of a heterogeneous cloud storage system according to claim 1, wherein the storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
  3. 根据权利要求1或2所述的异构云存储的数据处理方法,其特征在于,所述统一云存储系统接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接包括:The data processing method for heterogeneous cloud storage according to claim 1 or 2, wherein the unified cloud storage system receives a registration request from an independent cloud storage system, and configures a storage link for the registered independent cloud storage system include:
    各个独立云存储系统分别发送注册请求给统一云存储系统;Each independent cloud storage system sends a registration request to the unified cloud storage system;
    针对每个注册请求,统一云存储系统将所述链接ID和统一云存储系统信息写入一个存储链接并配置给对应的独立云存储系统,其中,不同的独立云存储系统对应的链接ID不同;For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
    各个独立云存储系统将各自的系统信息写入存储链接并将存储链接返回给统一云存储系统。Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
  4. 根据权利要求1所述的异构云存储的数据处理方法,其特征在于,所述数据请求包括用户端写入的所述数据请求ID、数据请求信息和独立云存储系统信息。The data processing method for heterogeneous cloud storage according to claim 1, wherein the data request includes the data request ID, data request information, and independent cloud storage system information written by the client.
  5. 根据权利要求1或4所述的方法,其特征在于,所述统一云存储系统接收用户端发送的数据请求,并基于所有已注册的存储链接对该数据请求进行解析包括:The method according to claim 1 or 4, wherein the unified cloud storage system receiving the data request sent by the user terminal, and analyzing the data request based on all registered storage links comprises:
    数据请求ID与已注册的存储链接的其中一个链接ID对应,则选择数据请求ID与该 链接ID对应的独立云存储系统进行处理。If the data request ID corresponds to one of the link IDs of the registered storage link, the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
  6. 根据权利要求4所述的异构云存储的数据处理方法,其特征在于,所述数据请求还包括时间节点信息。The data processing method for heterogeneous cloud storage according to claim 4, wherein the data request further includes time node information.
  7. 根据权利要求1或6所述的异构云存储的数据处理方法,其特征在于,还包括:The data processing method for heterogeneous cloud storage according to claim 1 or 6, characterized in that it further comprises:
    获取数据请求的时间节点信息;Obtain the time node information of the data request;
    基于所述时间节点信息选择相应的独立云存储系统处理所述数据请求。Based on the time node information, a corresponding independent cloud storage system is selected to process the data request.
  8. 一种异构云存储系统,其特征在于,包括一个统一云存储系统和多个独立云存储系统,其中,所说统一云存储系统包括:A heterogeneous cloud storage system, characterized in that it includes a unified cloud storage system and multiple independent cloud storage systems, wherein the unified cloud storage system includes:
    注册单元,用于接收独立云存储系统的注册请求,并对注册后的独立云存储系统配置一个存储链接;The registration unit is used to receive the registration request of the independent cloud storage system and configure a storage link for the registered independent cloud storage system;
    解析单元,用于接收用户端发送的数据请求,并基于已注册的存储链接对该数据请求进行解析;The parsing unit is used to receive the data request sent by the client and analyze the data request based on the registered storage link;
    转发单元,用于基于解析结果将数据请求转发给相应的独立云储存系统进行处理,独立云储存系统基于该数据请求进行数据处理后返回处理结果给用户端。The forwarding unit is configured to forward the data request to the corresponding independent cloud storage system for processing based on the analysis result, and the independent cloud storage system performs data processing based on the data request and then returns the processing result to the user terminal.
  9. 根据权利要求8所述的异构云存储系统,其特征在于,所述存储链接包括:The heterogeneous cloud storage system according to claim 8, wherein the storage link comprises:
    所述存储链接包括以下信息:链接ID、统一云存储系统信息和独立云存储系统信息。The storage link includes the following information: link ID, unified cloud storage system information, and independent cloud storage system information.
  10. 根据权利要求8或9所述的异构云存储系统,其特征在于,所述注册单元通过以下方式进行注册:The heterogeneous cloud storage system according to claim 8 or 9, wherein the registration unit performs registration in the following manner:
    各个独立云存储系统分别发送注册请求给统一云存储系统;Each independent cloud storage system sends a registration request to the unified cloud storage system;
    针对每个注册请求,统一云存储系统将所述链接ID和统一云存储系统信息写入一个存储链接并配置给对应的独立云存储系统,其中,不同的独立云存储系统对应的链接ID不同;For each registration request, the unified cloud storage system writes the link ID and unified cloud storage system information into a storage link and configures it to the corresponding independent cloud storage system, where different independent cloud storage systems correspond to different link IDs;
    各个独立云存储系统将各自的系统信息写入存储链接并将存储链接返回给统一云存储系统。Each independent cloud storage system writes its own system information into the storage link and returns the storage link to the unified cloud storage system.
  11. 根据权利要求8所述的异构云存储系统,其特征在于,所述数据请求包括用户端 写入的所述数据请求ID、数据请求信息和独立云存储系统信息。The heterogeneous cloud storage system according to claim 8, wherein the data request includes the data request ID, data request information, and independent cloud storage system information written by the client.
  12. 根据权利要求8或11所述的异构云存储系统,所述解析单元通过以下方式对数据请求进行解析:According to the heterogeneous cloud storage system according to claim 8 or 11, the parsing unit analyzes the data request in the following manner:
    数据请求ID与已注册的存储链接的其中一个链接ID对应,则选择数据请求ID与该链接ID对应的独立云存储系统进行处理。If the data request ID corresponds to one of the link IDs of the registered storage link, the independent cloud storage system corresponding to the data request ID and the link ID is selected for processing.
  13. 根据权利要求8所述的异构云存储系统,其特征在于,所述数据请求还包括时间节点信息。The heterogeneous cloud storage system according to claim 8, wherein the data request further includes time node information.
  14. 根据权利要求8或13所述的异构存储系统,其特征在于,所述解析单元通过以下方式对数据请求进行解析:The heterogeneous storage system according to claim 8 or 13, wherein the parsing unit analyzes the data request in the following manner:
    获取数据请求的时间节点信息;Obtain the time node information of the data request;
    基于所述时间节点信息选择相应的独立云存储系统处理所述数据请求。Based on the time node information, a corresponding independent cloud storage system is selected to process the data request.
  15. 一种机器可读介质,其特征在于,所述机器可读介质上存储有指令,该指令在机器上执行时使机器执行权力要求1至7中任一项异构云存储系统的数据处理方法。A machine-readable medium, characterized in that an instruction is stored on the machine-readable medium, and when the instruction is executed on a machine, the machine executes the data processing method of any one of right requirements 1 to 7 in a heterogeneous cloud storage system .
  16. 一种系统,包括:A system including:
    存储器,用于存储由系统的一个或多个处理器执行的指令,以及Memory, used to store instructions executed by one or more processors of the system, and
    处理器,是系统的处理器之一,用于执行权利要求1至7中任一项所述的异构云存储系统的数据处理方法。The processor is one of the processors of the system, and is used to execute the data processing method of the heterogeneous cloud storage system according to any one of claims 1 to 7.
PCT/CN2020/106147 2020-04-10 2020-07-31 Data processing method for heterogeneous cloud storage system, and readable medium and system therefor WO2021203591A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010278779.9 2020-04-10
CN202010278779.9A CN111314493A (en) 2020-04-10 2020-04-10 Data processing method of heterogeneous cloud storage system and readable medium and system thereof

Publications (1)

Publication Number Publication Date
WO2021203591A1 true WO2021203591A1 (en) 2021-10-14

Family

ID=71161020

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/106147 WO2021203591A1 (en) 2020-04-10 2020-07-31 Data processing method for heterogeneous cloud storage system, and readable medium and system therefor

Country Status (2)

Country Link
CN (1) CN111314493A (en)
WO (1) WO2021203591A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111314493A (en) * 2020-04-10 2020-06-19 上海依图网络科技有限公司 Data processing method of heterogeneous cloud storage system and readable medium and system thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140181301A1 (en) * 2012-12-20 2014-06-26 Software Ag Usa, Inc. Heterogeneous cloud-store provider access systems, and/or associated methods
CN105162845A (en) * 2015-08-05 2015-12-16 深圳联友科技有限公司 Heterogeneous cloud storage system and data processing method thereof
CN106161634A (en) * 2016-07-20 2016-11-23 蔡雄 Use the data administrator of cloud storage
CN109710392A (en) * 2018-12-21 2019-05-03 万达信息股份有限公司 A kind of heterogeneous resource dispatching method based on mixed cloud
CN111314493A (en) * 2020-04-10 2020-06-19 上海依图网络科技有限公司 Data processing method of heterogeneous cloud storage system and readable medium and system thereof

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014522011A (en) * 2011-05-17 2014-08-28 データボード・インコーポレーテツド Providing access to mainframe data objects in a heterogeneous computing environment
CN108023746B (en) * 2016-11-02 2020-01-17 杭州海康威视数字技术股份有限公司 Video data processing method, device and system
CN110389817B (en) * 2018-04-20 2023-05-23 伊姆西Ip控股有限责任公司 Scheduling method, device and computer readable medium of multi-cloud system
CN110719325A (en) * 2019-09-30 2020-01-21 恩亿科(北京)数据科技有限公司 Method and device for responding to user request

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140181301A1 (en) * 2012-12-20 2014-06-26 Software Ag Usa, Inc. Heterogeneous cloud-store provider access systems, and/or associated methods
CN105162845A (en) * 2015-08-05 2015-12-16 深圳联友科技有限公司 Heterogeneous cloud storage system and data processing method thereof
CN106161634A (en) * 2016-07-20 2016-11-23 蔡雄 Use the data administrator of cloud storage
CN109710392A (en) * 2018-12-21 2019-05-03 万达信息股份有限公司 A kind of heterogeneous resource dispatching method based on mixed cloud
CN111314493A (en) * 2020-04-10 2020-06-19 上海依图网络科技有限公司 Data processing method of heterogeneous cloud storage system and readable medium and system thereof

Also Published As

Publication number Publication date
CN111314493A (en) 2020-06-19

Similar Documents

Publication Publication Date Title
WO2021018005A1 (en) Inter-process communication method, apparatus and device
JP5518946B2 (en) Method, system, and apparatus for activation of objects across protected area boundaries
WO2023098032A1 (en) Memory space extension method and apparatus, electronic device, and storage medium
US20090199213A1 (en) Automatic Connections Between Application Components
CN104866383A (en) Interface calling method and device and terminal
JP2005050334A (en) Synchronization of logical view independent of physical storage expression
CN111880866B (en) Cross-process callback execution method, device, equipment and storage medium
CN106648569B (en) Target serialization realization method and device
CN114385091B (en) Method and device for realizing network disk drive character, network disk and storage medium
CN114925084A (en) Distributed transaction processing method, system, device and readable storage medium
CN111796865A (en) Byte code file modification method and device, terminal equipment and medium
US12073116B2 (en) Systems, methods, and apparatus for computational storage functions
WO2021203591A1 (en) Data processing method for heterogeneous cloud storage system, and readable medium and system therefor
CN113434315B (en) Interface management method and device, storage medium and electronic equipment
CN111241346B (en) Object serialization method, device, machine-readable medium and system
CN109614089B (en) Automatic generation method, device, equipment and storage medium of data access code
US20230393980A1 (en) Techniques for runtime protocol conformance cache for third party applications
CN117827221A (en) Method, apparatus, device and storage medium for deploying program code
CN113220237B (en) Distributed storage method, device, equipment and storage medium
CN113934691A (en) Method for accessing file, electronic device and readable storage medium
CN115136120A (en) Database synchronization test method and device, computer equipment and storage medium
US20240291890A1 (en) System and method for managing end point presenting devices
US11954510B2 (en) Native-image in-memory cache for containerized ahead-of-time applications
TWI687822B (en) Method and device for storing and reading log files
CN113495869B (en) File system space adjusting method and device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20929805

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20929805

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205 DATED 27/03/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20929805

Country of ref document: EP

Kind code of ref document: A1