CN108989461B - Multi-control storage balancing method, device, terminal and storage medium - Google Patents

Multi-control storage balancing method, device, terminal and storage medium Download PDF

Info

Publication number
CN108989461B
CN108989461B CN201810969138.0A CN201810969138A CN108989461B CN 108989461 B CN108989461 B CN 108989461B CN 201810969138 A CN201810969138 A CN 201810969138A CN 108989461 B CN108989461 B CN 108989461B
Authority
CN
China
Prior art keywords
controller
flow information
flow
monitoring
setting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201810969138.0A
Other languages
Chinese (zh)
Other versions
CN108989461A (en
Inventor
谭世伟
房永昌
范志超
张新玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201810969138.0A priority Critical patent/CN108989461B/en
Publication of CN108989461A publication Critical patent/CN108989461A/en
Application granted granted Critical
Publication of CN108989461B publication Critical patent/CN108989461B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1001Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
    • H04L67/1004Server selection for load balancing
    • H04L67/1008Server selection for load balancing based on parameters of servers, e.g. available memory or workload
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • H04L67/1097Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

The embodiment of the application provides a multi-control storage balancing method, a multi-control storage balancing device, a terminal and a storage medium, wherein the method comprises the following steps: acquiring front-end total flow information and flow information processed by a controller; setting a flow processing threshold of the controller; judging whether the flow information processed by the controller exceeds the flow processing threshold value: if yes, carrying out balanced distribution on the volume groups corresponding to the controller according to the total flow information and the flow information; otherwise, no equalization allocation is performed. The invention can realize dynamic balance, so that the data stream is directly issued to the corresponding volume group by the controller without being subjected to transfer, thereby improving the data processing efficiency and the storage performance.

Description

Multi-control storage balancing method, device, terminal and storage medium
Technical Field
The invention belongs to the technical field of multi-control storage, and particularly relates to a multi-control storage balancing method, a multi-control storage balancing device, a multi-control storage balancing terminal and a multi-control storage balancing storage medium.
Background
In the development and development test of storage, the storage system of the existing software platform is found to be the storage system of the A-A mode, but the volume has the attribute of the home controller, and the data must be issued by the subordinate controller. Therefore, when the volume belonging to the A control has a large amount of data reading and writing processes, the data processing capacity of the A control is limited, the B control is used for receiving the data and transmitting the data to the A control through the PCIE channel, and the A control sends the data to the bottom RAID. Thus, the data which is directly sent to the bottom layer RAID by the controller A is subjected to the relay of the controller B. This is disadvantageous in improving data processing and storage performance.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention provides a multi-control storage balancing method, a multi-control storage balancing device, a multi-control storage balancing terminal and a multi-control storage balancing storage medium, so as to solve the technical problems.
In a first aspect, an embodiment of the present application provides a multi-control storage balancing method, where the method includes:
acquiring front-end total flow information and flow information processed by a controller;
setting a flow processing threshold of the controller;
judging whether the flow information processed by the controller exceeds the flow processing threshold value:
if yes, carrying out balanced distribution on the volume groups corresponding to the controller according to the total flow information and the flow information;
otherwise, no equalization allocation is performed.
With reference to the first aspect, in a first implementation manner of the first aspect, the obtaining front-end total traffic information and traffic information processed by the controller includes:
setting a monitoring interval time;
setting a monitoring duration;
and monitoring the flow according to the monitoring interval time and the monitoring duration time.
With reference to the first aspect, in a second implementation manner of the first aspect, the performing balanced allocation on a volume group corresponding to a controller according to total traffic information and traffic information includes:
screening transit flow information in the flow information;
positioning a volume group and a transit controller corresponding to the transit flow information;
assigning the volume group to the transfer controller.
In a second aspect, an embodiment of the present application provides a multi-control storage balancing apparatus, where the apparatus includes:
the acquisition unit is configured to acquire total flow information of the front end and flow information processed by the controller;
a setting unit configured to set a flow rate processing threshold of the controller;
a judging unit configured to judge whether the traffic information processed by the controller exceeds the traffic processing threshold;
the balancing unit is configured to perform balanced distribution on the volume groups corresponding to the controllers according to the total flow information and the flow information;
a holding unit configured not to perform the equalization allocation.
With reference to the second aspect, in a first implementation manner of the second aspect, the obtaining unit includes:
the interval setting module is configured for setting monitoring interval time;
a duration setting module configured to set a monitoring duration;
and the flow monitoring module is configured to monitor the flow according to the monitoring interval time and the monitoring duration time.
With reference to the second aspect, in a second implementation manner of the second aspect, the equalizing unit includes:
the screening module is configured to screen transit flow information in the flow information;
the positioning module is used for positioning the volume group corresponding to the transfer flow information and the transfer controller;
an allocation module configured to allocate the volume group to the transfer controller.
In a third aspect, a terminal is provided, including:
a processor, a memory, wherein,
the memory is used for storing a computer program which,
the processor is configured to call and run the computer program from the memory, so that the terminal performs the above-mentioned method of the terminal.
In a fourth aspect, a computer storage medium is provided having stored therein instructions that, when executed on a computer, cause the computer to perform the method of the above aspects.
In a fifth aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the method of the above aspects.
The beneficial effect of the invention is that,
according to the multi-control storage balancing method, the multi-control storage balancing device, the terminal and the storage medium, whether the balanced distribution operation of the volume group is triggered or not is judged through the flow processing threshold of the controller and the acquired front-end total flow information and the flow information processed by the controller, dynamic balancing is achieved, the data flow is directly issued to the corresponding volume group by the controller without being subjected to transfer, and the data processing efficiency and the storage performance are improved.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
Drawings
In order to more clearly illustrate the embodiments or technical solutions in the prior art of the present invention, the drawings used in the description of the embodiments or prior art will be briefly described below, and it is obvious for those skilled in the art that other drawings can be obtained based on these drawings without creative efforts.
FIG. 1 is a schematic flow chart diagram of a method of one embodiment of the present application.
FIG. 2 is a schematic block diagram of an apparatus of one embodiment of the present application.
Fig. 3 is a schematic structural diagram of a terminal according to an embodiment of the present invention.
Detailed Description
In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention. In order to make those skilled in the art better understand the technical solution of the present invention, the technical solution in the embodiment of the present invention will be clearly and completely described below with reference to the drawings in the embodiment of the present invention, and it is obvious that the described embodiment is only a part of the embodiment of the present invention, and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The following explains key terms appearing in the present application.
FIG. 1 is a schematic flow chart diagram of a method of one embodiment of the present application. The execution main body in fig. 1 may be a multi-control storage balancing device.
As shown in fig. 1, the method 100 includes:
step 110, acquiring total flow information of a front end and flow information processed by a controller;
step 120, setting a flow processing threshold of the controller;
step 130, determining whether the traffic information processed by the controller exceeds the traffic processing threshold: if yes, carrying out balanced distribution on the volume groups corresponding to the controller according to the total flow information and the flow information; otherwise, no equalization allocation is performed.
In order to facilitate understanding of the present invention, the multi-control storage balancing method provided by the present invention is further described below by using the principle of the present invention for balancing multi-control storage in combination with the process of balancing multi-control storage in the embodiment.
Optionally, as an embodiment of the present application, the obtaining of the total front-end traffic information and the traffic information processed by the controller includes:
setting a monitoring interval time;
setting a monitoring duration;
and monitoring the flow according to the monitoring interval time and the monitoring duration time.
Optionally, as an embodiment of the present application, the performing balanced distribution on a volume group corresponding to a controller according to total traffic information and traffic information includes:
screening transit flow information in the flow information;
positioning a volume group and a transit controller corresponding to the transit flow information;
assigning the volume group to the transfer controller.
Specifically, the multi-control storage balancing method includes:
and S1, acquiring the front-end total flow information and the flow information processed by the controller.
Setting the monitoring interval time to be 60 minutes, setting the monitoring duration time to be 5 minutes, and monitoring the flow according to the monitoring interval time and the monitoring duration time.
The method includes the steps of collecting front-end total data flow within 5 minutes every 60-minute interval time, counting the number of luns issued by the total data flow once, and acquiring flow information processed by two controllers respectively according to the issued luns.
And S2, setting a flow processing threshold value of the controller.
In this embodiment, the flow processing threshold of the controller is set to 50% of the total front-end flow.
And S3, judging whether the flow information processed by the controller exceeds the flow processing threshold value.
If the flow processed by one of the controllers exceeds 50% of the total flow of the front end, triggering a balancing operation, wherein the specific volume group balancing distribution method comprises the following steps:
and screening the flow information transferred by the controller from the acquired flow information, wherein if the flow sent to the corresponding volume group by the controller A is transferred by the controller B, the controller B is a transfer controller. And positioning the volume group corresponding to the transit flow information and the transit controller according to the screened transit flow information, and distributing the volume group corresponding to the transit flow to the corresponding transit controller after positioning, namely removing the existing mapping relation of the volume group and establishing the mapping relation between the volume group and the transit controller.
As shown in fig. 2, the apparatus 200 includes:
an obtaining unit 210, where the obtaining unit 210 is configured to obtain total front-end traffic information and traffic information processed by a controller;
a setting unit 220, wherein the setting unit 220 is used for setting a flow processing threshold value of the controller;
a judging unit 230, wherein the judging unit 230 is used for judging whether the flow information processed by the controller exceeds the flow processing threshold value;
the equalizing unit 240 is configured to perform equalization allocation on the volume groups corresponding to the controllers according to the total traffic information and the traffic information;
a holding unit 250, the holding unit 250 configured to not perform an equalization distribution.
Optionally, as an embodiment of the present application, the obtaining unit includes:
the interval setting module is configured for setting monitoring interval time;
a duration setting module configured to set a monitoring duration;
and the flow monitoring module is configured to monitor the flow according to the monitoring interval time and the monitoring duration time.
Optionally, as an embodiment of the present application, the equalizing unit includes:
the screening module is configured to screen transit flow information in the flow information;
the positioning module is used for positioning the volume group corresponding to the transfer flow information and the transfer controller;
an allocation module configured to allocate the volume group to the transfer controller.
Fig. 3 is a schematic structural diagram of a terminal device 300 according to an embodiment of the present invention, where the terminal device 300 may be used to execute the method for updating the heat dissipation policy parameter according to the embodiment of the present application.
Among them, the terminal apparatus 300 may include: a processor 310, a memory 320, and a communication unit 330. The components communicate via one or more buses, and those skilled in the art will appreciate that the architecture of the servers shown in the figures is not limiting of the application, and may be a bus architecture, a star architecture, a combination of more or fewer components than those shown, or a different arrangement of components.
The memory 320 may be used for storing instructions executed by the processor 310, and the memory 320 may be implemented by any type of volatile or non-volatile storage terminal or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The executable instructions in memory 320, when executed by processor 310, enable terminal 300 to perform some or all of the steps in the method embodiments described below.
The processor 310 is a control center of the storage terminal, connects various parts of the entire electronic terminal using various interfaces and lines, and performs various functions of the electronic terminal and/or processes data by operating or executing software programs and/or modules stored in the memory 320 and calling data stored in the memory. The processor may be composed of an Integrated Circuit (IC), for example, a single packaged IC, or a plurality of packaged ICs connected with the same or different functions. For example, the processor 310 may include only a Central Processing Unit (CPU). In the embodiments of the present application, the CPU may be a single arithmetic core or may include multiple arithmetic cores.
A communication unit 330, configured to establish a communication channel so that the storage terminal can communicate with other terminals. And receiving user data sent by other terminals or sending the user data to other terminals.
The present application also provides a computer storage medium, wherein the computer storage medium may store a program, and the program may include some or all of the steps in the embodiments provided in the present application when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM) or a Random Access Memory (RAM).
Therefore, in the present application, by setting the traffic processing threshold of the controller, and determining whether to trigger the balanced allocation operation on the volume group according to the obtained front-end total traffic information and the traffic information processed by the controller, dynamic balancing is implemented, so that the data stream is directly issued to the corresponding volume group by the controller without being subjected to transfer, thereby improving data processing efficiency and storage performance.
Those skilled in the art will clearly understand that the techniques in the embodiments of the present application may be implemented by way of software plus a required general hardware platform. Based on such understanding, the technical solutions in the embodiments of the present application may be embodied in the form of a software product, where the computer software product is stored in a storage medium, such as a usb disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and the like, and includes several instructions to enable a computer terminal (which may be a personal computer, a server, or a second terminal, a network terminal, and the like) to perform all or part of the steps of the method according to the embodiments of the present invention.
The same and similar parts in the various embodiments in this specification may be referred to each other. Especially, for the terminal embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant points can be referred to the description in the method embodiment.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
Although the present invention has been described in detail by referring to the drawings in connection with the preferred embodiments, the present invention is not limited thereto. Various equivalent modifications or substitutions can be made on the embodiments of the present invention by those skilled in the art without departing from the spirit and scope of the present invention, and these modifications or substitutions are within the scope of the present invention/any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (6)

1. A multi-control storage balancing method, the method comprising:
acquiring front-end total flow information and flow information processed by a controller;
setting the flow processing threshold of the controller to be 50% of the total flow of the front end;
judging whether the flow information processed by the controller exceeds the flow processing threshold value:
if yes, carrying out balanced distribution on the volume groups corresponding to the controller according to the total flow information and the flow information;
if not, not executing the balance distribution;
the performing balanced distribution on the volume groups corresponding to the controllers according to the total flow information and the flow information includes:
screening transit flow information in the flow information;
positioning a volume group and a transit controller corresponding to the transit flow information;
assigning the volume group to the transfer controller.
2. The method of claim 1, wherein obtaining front end total traffic information and controller processed traffic information comprises:
setting a monitoring interval time;
setting a monitoring duration;
and monitoring the flow according to the monitoring interval time and the monitoring duration time.
3. A multi-control storage equalization apparatus, the apparatus comprising:
the acquisition unit is configured to acquire total flow information of the front end and flow information processed by the controller;
a setting unit configured to set a flow rate processing threshold of the controller;
a judging unit configured to judge whether the traffic information processed by the controller exceeds the traffic processing threshold;
the balancing unit is configured to perform balanced distribution on the volume groups corresponding to the controllers according to the total flow information and the flow information;
a holding unit configured not to perform the equalization allocation;
the equalization unit includes:
the screening module is configured to screen transit flow information in the flow information;
the positioning module is used for positioning the volume group corresponding to the transfer flow information and the transfer controller;
an allocation module configured to allocate the volume group to the transfer controller.
4. The apparatus of claim 3, wherein the obtaining unit comprises:
the interval setting module is configured for setting monitoring interval time;
a duration setting module configured to set a monitoring duration;
and the flow monitoring module is configured to monitor the flow according to the monitoring interval time and the monitoring duration time.
5. A terminal, comprising:
a processor;
a memory for storing instructions for execution by the processor;
wherein the processor is configured to perform the method of any of claims 1-2.
6. A computer-readable storage medium, in which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1-2.
CN201810969138.0A 2018-08-23 2018-08-23 Multi-control storage balancing method, device, terminal and storage medium Active CN108989461B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810969138.0A CN108989461B (en) 2018-08-23 2018-08-23 Multi-control storage balancing method, device, terminal and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810969138.0A CN108989461B (en) 2018-08-23 2018-08-23 Multi-control storage balancing method, device, terminal and storage medium

Publications (2)

Publication Number Publication Date
CN108989461A CN108989461A (en) 2018-12-11
CN108989461B true CN108989461B (en) 2021-10-22

Family

ID=64547173

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810969138.0A Active CN108989461B (en) 2018-08-23 2018-08-23 Multi-control storage balancing method, device, terminal and storage medium

Country Status (1)

Country Link
CN (1) CN108989461B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111026677B (en) * 2019-10-31 2022-02-18 苏州浪潮智能科技有限公司 Cache allocation method, system, terminal and storage medium based on EMA algorithm

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103827803A (en) * 2011-10-28 2014-05-28 株式会社日立制作所 Computer system and management system for performance optimisation in a storage network
CN104205059A (en) * 2012-04-27 2014-12-10 株式会社日立制作所 Storage system and storage control apparatus
CN106462447A (en) * 2014-04-11 2017-02-22 Netapp股份有限公司 Connectivity-aware storage controller load balancing
CN107547653A (en) * 2017-09-11 2018-01-05 华北水利水电大学 A kind of distributed file storage system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103827803A (en) * 2011-10-28 2014-05-28 株式会社日立制作所 Computer system and management system for performance optimisation in a storage network
CN104205059A (en) * 2012-04-27 2014-12-10 株式会社日立制作所 Storage system and storage control apparatus
CN106462447A (en) * 2014-04-11 2017-02-22 Netapp股份有限公司 Connectivity-aware storage controller load balancing
CN107547653A (en) * 2017-09-11 2018-01-05 华北水利水电大学 A kind of distributed file storage system

Also Published As

Publication number Publication date
CN108989461A (en) 2018-12-11

Similar Documents

Publication Publication Date Title
CN108683720B (en) Container cluster service configuration method and device
CN108776934B (en) Distributed data calculation method and device, computer equipment and readable storage medium
CN110601922B (en) Method and device for realizing comparison experiment, electronic equipment and storage medium
CN109981702B (en) File storage method and system
CN110795203A (en) Resource scheduling method, device and system and computing equipment
CN106502814B (en) Method and device for recording error information of PCIE (peripheral component interface express) equipment
CN109660422B (en) Network card bandwidth testing method, device, terminal and storage medium based on multiple processes
CN109597800B (en) Log distribution method and device
CN111290696A (en) Flow control method and device for application program assembly
CN110532187B (en) HDFS throughput performance testing method, system, terminal and storage medium
CN110765167B (en) Policy data processing method, policy data processing device and policy data processing equipment
CN108989461B (en) Multi-control storage balancing method, device, terminal and storage medium
CN113885794B (en) Data access method and device based on multi-cloud storage, computer equipment and medium
CN112463046B (en) Method, system, terminal and storage medium for dynamically adjusting bitmap space
CN113760187A (en) Method, system, terminal and storage medium for generating deduplication IO thread based on vdbench
CN111901405A (en) Multi-node monitoring method and device, electronic equipment and storage medium
CN117009221A (en) Processing method, device, equipment, storage medium and program product for product test
CN111475251A (en) Cluster container scheduling method, system, terminal and storage medium
CN107666401A (en) A kind of configuration information obtaining method and terminal
CN114741218A (en) Method, device, equipment, system and medium for extracting abnormal index of operating system
CN110703988B (en) Storage pool creating method, system, terminal and storage medium for distributed storage
CN110222084B (en) Method and device for reporting monitoring information of hotspot equipment, storage medium and terminal
CN108710508B (en) Processing method and device and electronic equipment
CN111124854A (en) Method, system, terminal and storage medium for distributing smoking test cases
CN108173689B (en) Output system of load balancing data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant