CN107426288A - A kind of resource-sharing schedule method and apparatus based on storage network - Google Patents
A kind of resource-sharing schedule method and apparatus based on storage network Download PDFInfo
- Publication number
- CN107426288A CN107426288A CN201710384000.XA CN201710384000A CN107426288A CN 107426288 A CN107426288 A CN 107426288A CN 201710384000 A CN201710384000 A CN 201710384000A CN 107426288 A CN107426288 A CN 107426288A
- Authority
- CN
- China
- Prior art keywords
- storage
- resource
- storage network
- servers
- found
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 238000012986 modification Methods 0.000 claims description 7
- 230000004048 modification Effects 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000004891 communication Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/48—Program initiating; Program switching, e.g. by interrupt
- G06F9/4806—Task transfer initiation or dispatching
- G06F9/4843—Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
- G06F9/4881—Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
Abstract
Description
技术领域technical field
本发明属于存储系统技术领域，特别是涉及一种基于存储网络的资源共享调度方法和装置。The invention belongs to the technical field of storage systems, and in particular relates to a storage network-based resource sharing scheduling method and device.
背景技术Background technique
现有的主机使用的存储方式基本为本地存储，也就是通过SAN(Storage AreaNetwork存储区域网络)存储，将磁盘映射给主机，或将文件存在NAS(Network AttachedStorage网络附属存储)。随着计算机技术的发展，虚拟化云计算的飞速进步，使得存储的需求越来越高，单独的本地存储根本无法满足需求，不同的使用需求，使用的存储也不同。SAN存储具有高速和高效的优点，但SAN存储不可共享，而NAS存储虽然可共享，但速度和效率都不高。The storage method used by existing hosts is basically local storage, that is, through SAN (Storage Area Network Storage Area Network) storage, disks are mapped to hosts, or files are stored in NAS (Network Attached Storage). With the development of computer technology and the rapid progress of virtualized cloud computing, the demand for storage is getting higher and higher. A single local storage cannot meet the demand at all. Different usage needs require different storage. SAN storage has the advantages of high speed and high efficiency, but SAN storage cannot be shared, while NAS storage can be shared, but the speed and efficiency are not high.
发明内容Contents of the invention
为解决上述问题，本发明提供了一种基于存储网络的资源共享调度方法和装置，能够将重复的资源进行整合，提供唯一的资源，保证数据唯一性，从而减少对存储设备空间的占用，提高存储设备的使用效率。In order to solve the above problems, the present invention provides a storage network-based resource sharing scheduling method and device, which can integrate repeated resources, provide unique resources, and ensure data uniqueness, thereby reducing the occupation of storage device space and improving Efficiency of use of storage devices.
本发明提供的一种基于存储网络的资源共享调度方法，包括：A storage network-based resource sharing scheduling method provided by the present invention includes:
利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统；Establish a storage network resource sharing system by using multiple clients, multiple storage servers and a storage scheduling server connected to the storage network switch at the same time;
接收所述客户端的资源访问需求，在本地索引中查找该资源的存储位置，如果能查到，则访问相应资源；Receiving the resource access requirement of the client, searching the storage location of the resource in the local index, and if found, accessing the corresponding resource;
如果查不到，则利用所述存储调度服务器在所述多个存储服务器中查找所需的资源，如果查到，则将数据返回到所述客户端，如果查不到，则返回错误信息。If not found, use the storage scheduling server to search for the required resources in the plurality of storage servers, if found, return the data to the client, if not found, return an error message.
优选的，在上述基于存储网络的资源共享调度方法中，还包括：Preferably, in the above storage network-based resource sharing scheduling method, it also includes:
接收所述客户端的资源修改需求，将数据复制到新的存储空间；receiving the resource modification requirement of the client, and copying the data to a new storage space;
将修改后的资源与所述多个存储服务器中的资源对比，如果存在相同的资源，则放弃数据的保存并记录已存在的资源的存储地址；Comparing the modified resource with the resources in the plurality of storage servers, if the same resource exists, abandoning the storage of the data and recording the storage address of the existing resource;
如果不存在相同的资源，则保存数据并更新所述存储调度服务器中的索引信息。If the same resource does not exist, save the data and update the index information in the storage scheduling server.
优选的，在上述基于存储网络的资源共享调度方法中，在所述利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统之后，还包括：Preferably, in the above storage network-based resource sharing scheduling method, after the resource sharing system of the storage network is established by using multiple clients, multiple storage servers and a storage scheduling server connected to the storage network switch at the same time, include:
对所述多个存储服务器进行负载均衡，将具有不同热度的资源分别存放至不同的存储服务器中。Load balancing is performed on the plurality of storage servers, and resources with different temperatures are respectively stored in different storage servers.
优选的，在上述基于存储网络的资源共享调度方法中，所述多个客户端、多个存储服务器和一个存储调度服务器与所述存储网络交换机之间利用iSCSI端口或FC端口进行存储网络连接。Preferably, in the storage network-based resource sharing scheduling method above, the multiple clients, multiple storage servers, and one storage scheduling server are connected to the storage network switch through iSCSI ports or FC ports.
本发明提供的一种基于存储网络的资源共享调度装置，包括：A storage network-based resource sharing scheduling device provided by the present invention includes:
建立单元，用于利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统；The establishment unit is used to establish a resource sharing system of the storage network by using multiple clients, multiple storage servers and a storage scheduling server connected to the storage network switch at the same time;
第一查找单元，用于接收所述客户端的资源访问需求，在本地索引中查找该资源的存储位置，如果能查到，则访问相应资源；The first search unit is configured to receive the resource access requirement of the client, search the storage location of the resource in the local index, and access the corresponding resource if it can be found;
第二查找单元，用于如果查不到，则利用所述存储调度服务器在所述多个存储服务器中查找所需的资源，如果查到，则将数据返回到所述客户端，如果查不到，则返回错误信息。The second search unit is configured to use the storage scheduling server to search for the required resources in the plurality of storage servers if not found, and return the data to the client if found, and if not found , an error message is returned.
优选的，在上述基于存储网络的资源共享调度装置中，还包括：Preferably, in the above storage network-based resource sharing scheduling device, further comprising:
复制单元，用于接收所述客户端的资源修改需求，将数据复制到新的存储空间；A copying unit, configured to receive the resource modification requirement of the client, and copy the data to a new storage space;
对比单元，用于将修改后的资源与所述多个存储服务器中的资源对比，如果存在相同的资源，则放弃数据的保存并记录已存在的资源的存储地址；A comparing unit, configured to compare the modified resource with the resources in the plurality of storage servers, and if the same resource exists, abandon the storage of the data and record the storage address of the existing resource;
保存单元，用于如果不存在相同的资源，则保存数据并更新所述存储调度服务器中的索引信息。The saving unit is configured to save the data and update the index information in the storage scheduling server if the same resource does not exist.
优选的，在上述基于存储网络的资源共享调度装置中，还包括：Preferably, in the above storage network-based resource sharing scheduling device, further comprising:
负载均衡单元，用于对所述多个存储服务器进行负载均衡，将具有不同热度的资源分别存放至不同的存储服务器中。The load balancing unit is configured to perform load balancing on the plurality of storage servers, and store resources with different temperatures in different storage servers.
优选的，在上述基于存储网络的资源共享调度装置中，所述建立单元具体用于将所述多个客户端、多个存储服务器和一个存储调度服务器与所述存储网络交换机之间利用iSCSI端口或FC端口进行存储网络连接。Preferably, in the above storage network-based resource sharing scheduling device, the establishment unit is specifically configured to connect the multiple clients, multiple storage servers, and a storage scheduling server with the storage network switch using an iSCSI port Or FC port for storage network connection.
通过上述描述可知，本发明提供的上述基于存储网络的资源共享调度方法和装置，由于该方法包括利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统；接收所述客户端的资源访问需求，在本地索引中查找该资源的存储位置，如果能查到，则访问相应资源；如果查不到，则利用所述存储调度服务器在所述多个存储服务器中查找所需的资源，如果查到，则将数据返回到所述客户端，如果查不到，则返回错误信息，因此能够将重复的资源进行整合，提供唯一的资源，保证数据唯一性，从而减少对存储设备空间的占用，提高存储设备的使用效率。It can be known from the above description that the resource sharing scheduling method and device based on the storage network provided by the present invention, because the method includes using multiple clients, multiple storage servers and a storage scheduling server connected to the storage network switch to establish a storage network resource sharing system; receive the resource access requirements of the client, search the storage location of the resource in the local index, if found, then access the corresponding resource; if not found, use the storage scheduling server in the Find the required resources in multiple storage servers. If found, the data will be returned to the client. If not found, an error message will be returned. Therefore, it is possible to integrate duplicate resources and provide unique resources to ensure Data uniqueness, thereby reducing the occupation of storage device space and improving the efficiency of storage device usage.
附图说明Description of drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍，显而易见地，下面描述中的附图仅仅是本发明的实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据提供的附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can also obtain other drawings according to the provided drawings without creative work.
图1为本申请实施例提供的第一种基于存储网络的资源共享调度方法的示意图；FIG. 1 is a schematic diagram of a first resource sharing scheduling method based on a storage network provided by an embodiment of the present application;
图2为存储网络的资源共享系统的示意图；FIG. 2 is a schematic diagram of a resource sharing system of a storage network;
图3为本申请实施例提供的第一种基于存储网络的资源共享调度装置的示意图。FIG. 3 is a schematic diagram of a first resource sharing scheduling device based on a storage network provided by an embodiment of the present application.
具体实施方式detailed description
本发明的核心思想在于提供一种基于存储网络的资源共享调度方法和装置，能够将重复的资源进行整合，提供唯一的资源，保证数据唯一性，从而减少对存储设备空间的占用，提高存储设备的使用效率。The core idea of the present invention is to provide a storage network-based resource sharing scheduling method and device, which can integrate repeated resources, provide unique resources, and ensure data uniqueness, thereby reducing the occupation of storage device space and improving storage device performance. usage efficiency.
下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.
本申请实施例提供的第一种基于存储网络的资源共享调度方法如图1所示，图1为本申请实施例提供的第一种基于存储网络的资源共享调度方法的示意图，该方法包括如下步骤：The first storage network-based resource sharing scheduling method provided in the embodiment of the present application is shown in Figure 1, and Figure 1 is a schematic diagram of the first storage network-based resource sharing scheduling method provided in the embodiment of the present application, the method includes the following step:
S1：利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统；S1: Establish a storage network resource sharing system by using multiple clients, multiple storage servers and a storage scheduling server connected to the storage network switch at the same time;
该存储网络的资源共享系统如图2所示，图2为存储网络的资源共享系统的示意图，通过在客户端定期获取存储调度服务器中所存放的索引数据来定位资源的存放位置，存储调度服务器定期更新存储中的资源索引信息，并且实时记录客户端的数据操作信息。客户端和存储调度服务器及存储服务器通过存储网络连接，以提高数据传输的速率，并且保证通信的安全性，存储端可通过横向扩展，多个存储服务器同时提供存储，保证足够存储空间。The resource sharing system of the storage network is shown in Figure 2. Figure 2 is a schematic diagram of the resource sharing system of the storage network. The storage location of the resource is located by periodically obtaining the index data stored in the storage scheduling server at the client, and the storage scheduling server Regularly update the resource index information in the storage, and record the data operation information of the client in real time. The client, the storage scheduling server and the storage server are connected through the storage network to increase the data transmission rate and ensure the security of the communication. The storage terminal can be expanded horizontally, and multiple storage servers provide storage at the same time to ensure sufficient storage space.
S2：接收所述客户端的资源访问需求，在本地索引中查找该资源的存储位置，如果能查到，则访问相应资源；S2: Receive the resource access requirement of the client, search the storage location of the resource in the local index, and access the corresponding resource if it can be found;
需要说明的是，在本地索引中能够查到该资源存储位置的话就直接访问，保证访问的高效性。It should be noted that if the storage location of the resource can be found in the local index, it can be accessed directly to ensure the efficiency of access.
S3：如果查不到，则利用所述存储调度服务器在所述多个存储服务器中查找所需的资源，如果查到，则将数据返回到所述客户端，如果查不到，则返回错误信息。S3: If not found, use the storage scheduling server to search for the required resources in the multiple storage servers, if found, return the data to the client, if not found, return an error information.
需要说明的是，正是由于将多个存储服务器都连接至存储调度服务器，因此提高了存储空间及存储性能，该存储调度服务器能够在所有的存储服务器中进行查询，当查询到的话就立即返回数据，保证高效性，而如果查不到的话则将错误信息返回，步骤结束。It should be noted that because multiple storage servers are connected to the storage scheduling server, the storage space and storage performance are improved. The storage scheduling server can query all the storage servers and return immediately if the query is found. Data to ensure high efficiency, and if it cannot be found, an error message will be returned, and the step ends.
通过上述描述可知，本申请实施例提供的第一种基于存储网络的资源共享调度方法，由于包括利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统；接收所述客户端的资源访问需求，在本地索引中查找该资源的存储位置，如果能查到，则访问相应资源；如果查不到，则利用所述存储调度服务器在所述多个存储服务器中查找所需的资源，如果查到，则将数据返回到所述客户端，如果查不到，则返回错误信息，因此能够将重复的资源进行整合，提供唯一的资源，保证数据唯一性，从而减少对存储设备空间的占用，提高存储设备的使用效率。It can be known from the above description that the first storage network-based resource sharing scheduling method provided by the embodiment of the present application includes the establishment of a storage network by using multiple clients, multiple storage servers, and a storage scheduling server connected to the storage network switch at the same time resource sharing system; receive the resource access requirements of the client, search the storage location of the resource in the local index, if found, then access the corresponding resource; if not found, use the storage scheduling server in the Find the required resources in multiple storage servers. If found, the data will be returned to the client. If not found, an error message will be returned. Therefore, it is possible to integrate duplicate resources and provide unique resources to ensure Data uniqueness, thereby reducing the occupation of storage device space and improving the efficiency of storage device usage.
本申请实施例提供的第二种基于存储网络的资源共享调度方法，是在上述第一种基于存储网络的资源共享调度方法的基础上，还包括如下技术特征：The second storage network-based resource sharing scheduling method provided in the embodiment of the present application is based on the above-mentioned first storage network-based resource sharing scheduling method, and also includes the following technical features:
接收所述客户端的资源修改需求，将数据复制到新的存储空间；receiving the resource modification requirement of the client, and copying the data to a new storage space;
将修改后的资源与所述多个存储服务器中的资源对比，如果存在相同的资源，则放弃数据的保存并记录已存在的资源的存储地址；Comparing the modified resource with the resources in the plurality of storage servers, if the same resource exists, abandoning the storage of the data and recording the storage address of the existing resource;
如果不存在相同的资源，则保存数据并更新所述存储调度服务器中的索引信息。If the same resource does not exist, save the data and update the index information in the storage scheduling server.
需要说明的是，利用这种资源共享的方式，既能避免数据的丢失，又能节省存储空间。It should be noted that using this resource sharing method can not only avoid data loss, but also save storage space.
本申请实施例提供的第三种基于存储网络的资源共享调度方法，是在上述第一种基于存储网络的资源共享调度方法的基础上，还包括如下技术特征：The third storage network-based resource sharing scheduling method provided by the embodiment of the present application is based on the above-mentioned first storage network-based resource sharing scheduling method, and also includes the following technical features:
在所述利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统之后，还包括：After the resource sharing system of the storage network is established by using multiple clients connected to the storage network switch, multiple storage servers and a storage scheduling server at the same time, it also includes:
对所述多个存储服务器进行负载均衡，将具有不同热度的资源分别存放至不同的存储服务器中。Load balancing is performed on the plurality of storage servers, and resources with different temperatures are respectively stored in different storage servers.
经过负载均衡，就能够保证热度较高的任务能够得到更加快速的处理，从而保证工作的高效性。After load balancing, it can ensure that hot tasks can be processed more quickly, thereby ensuring work efficiency.
本申请实施例提供的第四种基于存储网络的资源共享调度方法，是在上述第一种至第三种基于存储网络的资源共享调度方法中任一种的基础上，还包括如下技术特征：The fourth storage network-based resource sharing scheduling method provided in the embodiment of the present application is based on any one of the above-mentioned first to third storage network-based resource sharing scheduling methods, and further includes the following technical features:
所述多个客户端、多个存储服务器和一个存储调度服务器与所述存储网络交换机之间利用iSCSI端口或FC端口进行存储网络连接。The multiple clients, the multiple storage servers and one storage scheduling server are connected to the storage network switch by means of iSCSI ports or FC ports.
需要说明的是，通过存储网络带内通信，管理和业务数据流在相同的链路上传输，因此，能够提高效率及安全性。It should be noted that, through the in-band communication of the storage network, the management and service data streams are transmitted on the same link, so efficiency and security can be improved.
综上所述，上述方案通过存储网络将客户端与存储服务器与存储调度服务器进行连接，客户端共享存储服务器的资源，通过客户端本地的索引数据及存储调度服务器进行资源的调度，客户端定时从存储调度服务器更新本地的索引数据以保证资源索引信息的新鲜度，存储调度服务器定时从存储服务器进行资源地址的获取来更新自己的索引数据，并且实时记录客户端添加、修改资源到服务器的数据，及时更新索引信息。To sum up, the above solution connects the client with the storage server and the storage scheduling server through the storage network, the client shares the resources of the storage server, and schedules resources through the local index data of the client and the storage scheduling server. Update the local index data from the storage scheduling server to ensure the freshness of resource index information. The storage scheduling server regularly obtains the resource address from the storage server to update its own index data, and records the data added and modified by the client to the server in real time. , to update the index information in time.
本申请实施例提供的第一种基于存储网络的资源共享调度装置如图3所示，图3为本申请实施例提供的第一种基于存储网络的资源共享调度装置的示意图，该装置包括：The first storage network-based resource sharing scheduling device provided in the embodiment of the present application is shown in Figure 3. Figure 3 is a schematic diagram of the first storage network-based resource sharing scheduling device provided in the embodiment of the present application. The device includes:
建立单元201，用于利用同时与存储网络交换机连接的多个客户端、多个存储服务器和一个存储调度服务器建立存储网络的资源共享系统，通过在客户端定期获取存储调度服务器中所存放的索引数据来定位资源的存放位置，存储调度服务器定期更新存储中的资源索引信息，并且实时记录客户端的数据操作信息。客户端和存储调度服务器及存储服务器通过存储网络连接，以提高数据传输的速率，并且保证通信的安全性，存储端可通过横向扩展，多个存储服务器同时提供存储，保证足够存储空间；The establishment unit 201 is used to establish a resource sharing system of a storage network by using multiple clients, multiple storage servers and a storage scheduling server connected to the storage network switch at the same time, and regularly obtain the index stored in the storage scheduling server on the client side The data is used to locate the storage location of resources, and the storage scheduling server regularly updates the resource index information in the storage, and records the data operation information of the client in real time. The client, the storage scheduling server and the storage server are connected through the storage network to increase the rate of data transmission and ensure the security of communication. The storage terminal can be expanded horizontally, and multiple storage servers can provide storage at the same time to ensure sufficient storage space;
第一查找单元202，用于接收所述客户端的资源访问需求，在本地索引中查找该资源的存储位置，如果能查到，则访问相应资源，需要说明的是，在本地索引中能够查到该资源存储位置的话就直接访问，保证访问的高效性；The first search unit 202 is configured to receive the resource access requirement of the client, search the storage location of the resource in the local index, and if found, access the corresponding resource. It should be noted that the resource can be found in the local index If the storage location of the resource is accessed directly, the efficiency of access is guaranteed;
第二查找单元203，用于如果查不到，则利用所述存储调度服务器在所述多个存储服务器中查找所需的资源，如果查到，则将数据返回到所述客户端，如果查不到，则返回错误信息，需要说明的是，正是由于将多个存储服务器都连接至存储调度服务器，因此提高了存储空间及存储性能，该存储调度服务器能够在所有的存储服务器中进行查询，当查询到的话就立即返回数据，保证高效性，而如果查不到的话则将错误信息返回，步骤结束。The second search unit 203 is configured to use the storage scheduling server to search for the required resources in the plurality of storage servers if not found, and return the data to the client if found, if found If not, an error message will be returned. It should be noted that because multiple storage servers are connected to the storage scheduling server, the storage space and storage performance are improved, and the storage scheduling server can perform queries on all storage servers , when the query is found, the data will be returned immediately to ensure high efficiency, and if it cannot be found, an error message will be returned, and the step ends.
本申请实施例提供的第二种基于存储网络的资源共享调度装置，是在上述第一种基于存储网络的资源共享调度装置的基础上，还包括如下技术特征：The second storage network-based resource sharing scheduling device provided in the embodiment of the present application is based on the above-mentioned first storage network-based resource sharing scheduling device, and further includes the following technical features:
复制单元，用于接收所述客户端的资源修改需求，将数据复制到新的存储空间；A copying unit, configured to receive the resource modification requirement of the client, and copy the data to a new storage space;
对比单元，用于将修改后的资源与所述多个存储服务器中的资源对比，如果存在相同的资源，则放弃数据的保存并记录已存在的资源的存储地址；A comparing unit, configured to compare the modified resource with the resources in the plurality of storage servers, and if the same resource exists, abandon the storage of the data and record the storage address of the existing resource;
保存单元，用于如果不存在相同的资源，则保存数据并更新所述存储调度服务器中的索引信息。The saving unit is configured to save the data and update the index information in the storage scheduling server if the same resource does not exist.
需要说明的是，利用这种资源共享的方式，既能避免数据的丢失，又能节省存储空间。It should be noted that using this resource sharing method can not only avoid data loss, but also save storage space.
本申请实施例提供的第三种基于存储网络的资源共享调度装置，是在上述第一种基于存储网络的资源共享调度装置的基础上，还包括如下技术特征：The third storage network-based resource sharing scheduling device provided by the embodiment of the present application is based on the above-mentioned first storage network-based resource sharing scheduling device, and further includes the following technical features:
负载均衡单元，用于对所述多个存储服务器进行负载均衡，将具有不同热度的资源分别存放至不同的存储服务器中。The load balancing unit is configured to perform load balancing on the plurality of storage servers, and store resources with different temperatures in different storage servers.
经过负载均衡，就能够保证热度较高的任务能够得到更加快速的处理，从而保证工作的高效性。After load balancing, it can ensure that hot tasks can be processed more quickly, thereby ensuring work efficiency.
本申请实施例提供的第四种基于存储网络的资源共享调度装置，是在上述第一种至第三种基于存储网络的资源共享调度装置中任一种的基础上，还包括如下技术特征：The fourth storage network-based resource sharing scheduling device provided in the embodiment of the present application is based on any one of the above-mentioned first to third storage network-based resource sharing scheduling devices, and further includes the following technical features:
所述建立单元具体用于将所述多个客户端、多个存储服务器和一个存储调度服务器与所述存储网络交换机之间利用iSCSI端口或FC端口进行存储网络连接。The establishing unit is specifically configured to connect the plurality of clients, the plurality of storage servers, and one storage scheduling server to the storage network switch by using an iSCSI port or a FC port for storage network connection.
需要说明的是，通过存储网络带内通信，管理和业务数据流在相同的链路上传输，因此，能够提高效率及安全性。It should be noted that, through the in-band communication of the storage network, the management and service data streams are transmitted on the same link, so efficiency and security can be improved.
对所公开的实施例的上述说明，使本领域专业技术人员能够实现或使用本发明。对这些实施例的多种修改对本领域的专业技术人员来说将是显而易见的，本文中所定义的一般原理可以在不脱离本发明的精神或范围的情况下，在其它实施例中实现。因此，本发明将不会被限制于本文所示的这些实施例，而是要符合与本文所公开的原理和新颖特点相一致的最宽的范围。The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710384000.XA CN107426288A (en) | 2017-05-26 | 2017-05-26 | A kind of resource-sharing schedule method and apparatus based on storage network |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710384000.XA CN107426288A (en) | 2017-05-26 | 2017-05-26 | A kind of resource-sharing schedule method and apparatus based on storage network |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107426288A true CN107426288A (en) | 2017-12-01 |
Family
ID=60428373
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710384000.XA Pending CN107426288A (en) | 2017-05-26 | 2017-05-26 | A kind of resource-sharing schedule method and apparatus based on storage network |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107426288A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111131440A (en) * | 2019-12-20 | 2020-05-08 | 腾讯科技（深圳）有限公司 | Resource scheduling method and device and server |
| CN112000516A (en) * | 2020-08-12 | 2020-11-27 | 上海英方软件股份有限公司 | NAS quasi-real-time backup system and method |
| CN112114947A (en) * | 2020-09-17 | 2020-12-22 | 石家庄科林电气股份有限公司 | System resource scheduling method based on edge computing gateway |
| CN113422821A (en) * | 2021-06-21 | 2021-09-21 | 广东电网有限责任公司计量中心 | State update data packet scheduling method and system |
| WO2022121387A1 (en) * | 2020-12-11 | 2022-06-16 | 北京锐安科技有限公司 | Data storage method and apparatus, server, and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090063528A1 (en) * | 2007-09-05 | 2009-03-05 | Emc Corporation | De-duplication in a virtualized server environment |
| CN101764848A (en) * | 2010-01-12 | 2010-06-30 | 浪潮(北京)电子信息产业有限公司 | Method and device for transmitting network files |
| CN101841526A (en) * | 2010-03-04 | 2010-09-22 | 清华大学 | Cluster streaming media server system applied to large-scale user demand |
| CN102332008A (en) * | 2011-08-31 | 2012-01-25 | 北京邦诺存储科技有限公司 | Standard file access protocol-based file management method and equipment |
| CN103078944A (en) * | 2013-01-08 | 2013-05-01 | 赛凡信息科技（厦门）有限公司 | Distributed symmetrical file system-based data center architecture |
-
2017
- 2017-05-26 CN CN201710384000.XA patent/CN107426288A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090063528A1 (en) * | 2007-09-05 | 2009-03-05 | Emc Corporation | De-duplication in a virtualized server environment |
| CN101764848A (en) * | 2010-01-12 | 2010-06-30 | 浪潮(北京)电子信息产业有限公司 | Method and device for transmitting network files |
| CN101841526A (en) * | 2010-03-04 | 2010-09-22 | 清华大学 | Cluster streaming media server system applied to large-scale user demand |
| CN102332008A (en) * | 2011-08-31 | 2012-01-25 | 北京邦诺存储科技有限公司 | Standard file access protocol-based file management method and equipment |
| CN103078944A (en) * | 2013-01-08 | 2013-05-01 | 赛凡信息科技（厦门）有限公司 | Distributed symmetrical file system-based data center architecture |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111131440A (en) * | 2019-12-20 | 2020-05-08 | 腾讯科技（深圳）有限公司 | Resource scheduling method and device and server |
| CN112000516A (en) * | 2020-08-12 | 2020-11-27 | 上海英方软件股份有限公司 | NAS quasi-real-time backup system and method |
| CN112000516B (en) * | 2020-08-12 | 2023-03-24 | 上海英方软件股份有限公司 | NAS quasi-real-time backup system and method |
| CN112114947A (en) * | 2020-09-17 | 2020-12-22 | 石家庄科林电气股份有限公司 | System resource scheduling method based on edge computing gateway |
| CN112114947B (en) * | 2020-09-17 | 2024-02-02 | 石家庄科林电气股份有限公司 | System resource scheduling method based on edge computing gateway |
| WO2022121387A1 (en) * | 2020-12-11 | 2022-06-16 | 北京锐安科技有限公司 | Data storage method and apparatus, server, and medium |
| CN113422821A (en) * | 2021-06-21 | 2021-09-21 | 广东电网有限责任公司计量中心 | State update data packet scheduling method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6670274B2 (en) | Scaling of compute clusters in distributed computing systems | |
| CN107566533B (en) | Internal and external network file sharing system based on NAS (network attached storage) | |
| CN114756519B (en) | Managed file synchronization with stateless sync nodes | |
| CN105933376B (en) | A data manipulation method, server and storage system | |
| US20150215405A1 (en) | Methods of managing and storing distributed files based on information-centric network | |
| CN102708165B (en) | Document handling method in distributed file system and device | |
| CN111258978B (en) | Data storage method | |
| CN105025053A (en) | Distributed file upload method based on cloud storage technology and system | |
| CN104020961B (en) | Distributed data storage method, apparatus and system | |
| CN107426288A (en) | A kind of resource-sharing schedule method and apparatus based on storage network | |
| WO2018045860A1 (en) | File system mounting method, apparatus and equipment | |
| US8805849B1 (en) | Enabling use of analytic functions for distributed storage system data | |
| US10708379B1 (en) | Dynamic proxy for databases | |
| CN106210147A (en) | A kind of load-balancing method based on poll and device | |
| CN110958300B (en) | A method, system, apparatus, electronic device and computer-readable medium for uploading data | |
| US10284645B1 (en) | Backup from network attached storage to sequential access media in network data management protocol environments | |
| CN106790692A (en) | A kind of load-balancing method and device of many clusters | |
| CN111225003B (en) | NFS node configuration method and device | |
| CN113301079B (en) | Data acquisition method, system, computing device and storage medium | |
| CN103595799A (en) | Method for achieving distributed shared data bank | |
| CN109783018A (en) | A kind of method and device of data storage | |
| CN106155566A (en) | For storing method, the Apparatus and system of data | |
| US9813331B2 (en) | Assessing response routes in a network | |
| US20200272335A1 (en) | Data storage system with separate interfaces for bulk data ingestion and data access | |
| CN101789963A (en) | Data synchronization system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171201 |