CN108763577A - node processing method and device, storage medium and electronic equipment - Google Patents
node processing method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN108763577A CN108763577A CN201810578276.6A CN201810578276A CN108763577A CN 108763577 A CN108763577 A CN 108763577A CN 201810578276 A CN201810578276 A CN 201810578276A CN 108763577 A CN108763577 A CN 108763577A
- Authority
- CN
- China
- Prior art keywords
- node
- routing
- slot data
- remaining
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/63—Routing a service request depending on the request content or context
Abstract
The invention discloses a kind of Node Processing Method and device, storage medium and electronic equipments, are related to technical field of data storage.The Node Processing Method includes：Obtain the routing statistics information of each slot data in each node of cluster；The routing pressure of remaining node in addition to a destination node in the cluster is determined according to the routing statistics information of each slot data；The slot data of the destination node is transferred on remaining described node according to the routing pressure of remaining node.The disclosure can preferably realize the contraction of influxdb clusters.
Description
Technical field
This disclosure relates to which technical field of data storage, fills in particular to a kind of Node Processing Method, node processing
It sets, storage medium and electronic equipment.
Background technology
The advantages that time series database is orderly with its time, intuitive, convenient for distinguishing, is increasingly favored by developer.Make
For one of highest time series database of current attention rate, influxdb has been widely used multiple applied fields of such as daily record monitoring
Jing Zhong.
Due to network, node hardware equipment, business tine etc., influxdb clusters may be with actual storage business not
Matching.The number of nodes of a kind of situation, influxdb clusters is excessive, and utilization rate is relatively low, at this time, it may be necessary to be received to cluster
Contracting；Another situation, when node reason such as hardware performance, network connection, practical business requirement can not adapt in cluster
When business, need to delete the node from cluster.And currently, not deleting the scheme of influxdb cluster interior joints.
It should be noted that information is only used for reinforcing the reason to the background of the disclosure disclosed in above-mentioned background technology part
Solution, therefore may include the information not constituted to the prior art known to persons of ordinary skill in the art.
Invention content
The disclosure is designed to provide a kind of Node Processing Method, node processing device, storage medium and electronic equipment,
And then solve the problems, such as that the relevant technologies are not present how to delete influxdb cluster interior joints at least to a certain extent.
According to one aspect of the disclosure, a kind of Node Processing Method is provided, influxdb clusters, the node are applied to
Processing method includes：Obtain the routing statistics information of each slot data in each node of cluster；According to the road of each slot data
The routing pressure of remaining node in addition to a destination node in the cluster is determined by statistical information；According to the road of remaining node
The slot data of the destination node is transferred on remaining described node by pressure.
In a kind of exemplary embodiment of the disclosure, the slot data of the destination node is being transferred to remaining described section
After on point, the Node Processing Method further includes：The destination node is deleted from the cluster.
In a kind of exemplary embodiment of the disclosure, the routing of each slot data in the cluster is united at predetermined time intervals
Meter information is persisted in a configuration file：Wherein, the routing statistics information of each slot data includes in acquisition each node of cluster：
From the routing statistics information for obtaining each slot data in each node of cluster in the configuration file.
In a kind of exemplary embodiment of the disclosure, the routing pressure is all slot datas on node when one is default
Between routing times in section.
In a kind of exemplary embodiment of the disclosure, according to the routing pressure of remaining node by the destination node
Slot data be transferred on remaining described node and include：Calculate the ratio of the routing pressure of remaining node；According to the ratio
The slot data of the destination node is transferred on remaining described node by example.
In a kind of exemplary embodiment of the disclosure, the slot data of the destination node is transferred to according to the ratio
Include on remaining described node：Obtain the weight of remaining node；According to the ratio and in conjunction with the power of remaining node
The slot data of the destination node is transferred on remaining described node again.
In a kind of exemplary embodiment of the disclosure, the Node Processing Method further includes：It will be handled in the cluster
Ability is determined as destination node less than the node of a preset standard；Or response one knot removal instruction, by the knot removal
Corresponding node is instructed to be determined as destination node.
According to one aspect of the disclosure, a kind of node processing device is provided, influxdb clusters, the node are applied to
Processing unit includes：Routing information acquisition module, the routing statistics information for obtaining each slot data in each node of cluster；Road
By pressure determining module, a destination node is removed in the cluster for being determined according to the routing statistics information of each slot data
The routing pressure of remaining outer node；Slot data shift module, for according to the routing pressure of remaining node by the target
The slot data of node is transferred on remaining described node.
In a kind of exemplary embodiment of the disclosure, node processing device further includes：Knot removal module is used for institute
Destination node is stated to delete from the cluster.
In a kind of exemplary embodiment of the disclosure, the routing of each slot data in the cluster is united at predetermined time intervals
Meter information is persisted in a configuration file；Wherein, routing information acquisition module includes：Routing information acquisition unit, for from
The routing statistics information of each slot data in each node of cluster is obtained in the configuration file.
In a kind of exemplary embodiment of the disclosure, routing pressure is all slot datas on node in a preset time period
Interior routing times.
In a kind of exemplary embodiment of the disclosure, slot data shift module includes：Ratio computing unit, for calculating
The ratio of the routing pressure of remaining node；Slot data buanch unit, for according to the ratio by the destination node
Slot data is transferred on remaining described node.
In a kind of exemplary embodiment of the disclosure, slot data buanch unit includes：Weight Acquisition subelement, for obtaining
Take the weight of remaining node；Slot data shifts subelement, for according to the ratio and in conjunction with the power of remaining node
The slot data of the destination node is transferred on remaining described node again.
In a kind of exemplary embodiment of the disclosure, node processing device further includes：First object node determining module,
It is determined as destination node for the node by processing capacity in the cluster less than a preset standard；Or second destination node it is true
The knot removal is instructed corresponding node to be determined as destination node by cover half block for responding knot removal instruction.
According to one aspect of the disclosure, a kind of storage medium is provided, computer program, the computer are stored thereon with
The Node Processing Method described in above-mentioned any one is realized when program is executed by processor.
According to one aspect of the disclosure, a kind of electronic equipment is provided, including：Processor；And memory, for storing
The executable instruction of the processor；Wherein, the processor is configured to above-mentioned to execute via the executable instruction is executed
Node Processing Method described in any one.
In the technical solution that some embodiments of the present disclosure are provided, by according to each slot data in each node of cluster
Routing statistics information determine the routing pressure of remaining node in addition to destination node, and according to the routing pressure determined by target
The slot data of node is transferred on remaining node, on the one hand, is saved by the way that the slot data of destination node is transferred to remaining in cluster
On point, cluster can be shunk, is avoided since number of nodes is excessive, the problem of waste of resource；On the other hand, the data of destination node
Slot transfer process is participated in without artificial, improves efficiency and the accuracy rate of transfer.
It should be understood that above general description and following detailed description is only exemplary and explanatory, not
The disclosure can be limited.
Description of the drawings
The drawings herein are incorporated into the specification and forms part of this specification, and shows the implementation for meeting the disclosure
Example, and together with specification for explaining the principles of this disclosure.It should be evident that the accompanying drawings in the following description is only the disclosure
Some embodiments for those of ordinary skill in the art without creative efforts, can also basis
These attached drawings obtain other attached drawings.In the accompanying drawings：
Fig. 1 diagrammatically illustrates the flow chart of Node Processing Method according to an exemplary embodiment of the present disclosure；
Fig. 2 diagrammatically illustrates the block diagram of node processing device according to an exemplary embodiment of the present disclosure；
Fig. 3 diagrammatically illustrates the block diagram of another node processing device according to an exemplary embodiment of the present disclosure；
Fig. 4 diagrammatically illustrates the block diagram of routing information acquisition module according to an exemplary embodiment of the present disclosure；
Fig. 5 diagrammatically illustrates the block diagram of slot data shift module according to an exemplary embodiment of the present disclosure；
Fig. 6 diagrammatically illustrates the block diagram of slot data buanch unit according to an exemplary embodiment of the present disclosure；
Fig. 7 diagrammatically illustrates the block diagram of another node processing device according to an exemplary embodiment of the present disclosure；
Fig. 8 shows the schematic diagram of storage medium according to an exemplary embodiment of the present disclosure；And
Fig. 9 diagrammatically illustrates the block diagram of electronic equipment according to an exemplary embodiment of the present disclosure.
Specific implementation mode
Example embodiment is described more fully with reference to the drawings.However, example embodiment can be with a variety of shapes
Formula is implemented, and is not understood as limited to example set forth herein；On the contrary, thesing embodiments are provided so that the disclosure will more
Fully and completely, and by the design of example embodiment comprehensively it is communicated to those skilled in the art.Described feature, knot
Structure or characteristic can be in any suitable manner incorporated in one or more embodiments.In the following description, it provides perhaps
More details fully understand embodiment of the present disclosure to provide.It will be appreciated, however, by one skilled in the art that can
It is omitted with technical solution of the disclosure one or more in the specific detail, or others side may be used
Method, constituent element, device, step etc..In other cases, be not shown in detail or describe known solution to avoid a presumptuous guest usurps the role of the host and
So that all aspects of this disclosure thicken.
In addition, attached drawing is only the schematic illustrations of the disclosure, it is not necessarily drawn to scale.Identical attached drawing mark in figure
Note indicates same or similar part, thus will omit repetition thereof.Some block diagrams shown in attached drawing are work(
Energy entity, not necessarily must be corresponding with physically or logically independent entity.Software form may be used to realize these work(
Energy entity, or these functional entitys are realized in one or more hardware modules or integrated circuit, or at heterogeneous networks and/or place
These functional entitys are realized in reason device device and/or microcontroller device.
Flow chart shown in attached drawing is merely illustrative, it is not necessary to including all steps.For example, the step of having
It can also decompose, and the step of having can merge or part merges, therefore the sequence actually executed is possible to according to actual conditions
Change.
Before the Node Processing Method and device of the illustrative embodiments of the description disclosure, to the cluster of influxdb
Slicing scheme illustrates.
Specifically, first, the data that client can be to be written to each distribute a unique mark；Then, on road
After obtaining these data by node, Hash can be carried out to unique mark and handle to obtain corresponding cryptographic Hash, by cryptographic Hash divided by
One preset value (for example, 16384) remainder afterwards, with the corresponding slot data (slot) of each data of determination；Next, by each
Data are sent on the corresponding influxdb nodes of slot data.Wherein, the correspondence of slot data and influxdb nodes is pre-
It is first configured, for example, can correspond to 16384 slot datas on two influxdb nodes respectively, wherein first
Influxdb nodes store the 1st slot data to the 8192nd slot data, and second influxdb node stores the 8193rd number
According to slot to the 16384th slot data.
However, the problem of influxdb clusters, is：When a node can not be expired due to node hardware, network connection etc.
When sufficient storage service demand, currently without the preferable scheme for deleting the node from cluster.In addition, working as cluster interior joint number
Amount is excessive, and when node utilization rate is relatively low, how cluster is shunk.
In consideration of it, present disclose provides a kind of Node Processing Method and device, to can preferably solve the above problems.
Fig. 1 diagrammatically illustrates the Node Processing Method of the illustrative embodiments of the disclosure, which can
To be applied to influxdb clusters.It is noted, however, that being also applied to using Node Processing Method described below
In other clusters.
With reference to figure 1, the Node Processing Method method of the illustrative embodiments of the disclosure may comprise steps of：
S12. the routing statistics information of each slot data in each node of cluster is obtained.
It should be understood that cluster can be made of multiple nodes, and each node may include one or more numbers
According to slot, server can write data into when data are written in some slot data of some node of cluster, the mistake being specifically written
Journey may refer to slicing scheme described above.In addition, when needing to read a data, server can be from cluster interior joint
The data are read in slot data.
The routing of slot data can mean to read data from slot data every time or the process of data is written.Described in the disclosure
Routing statistics information may include slot data routing frequency, that is, routing times in the unit interval.In addition, routing system
Meter information can also include that information, the disclosure such as total routing times, the route time of slot data do not limit this.
In the illustrative embodiments of the disclosure, for slot data when being route, server can obtain slot data
Routing iinformation, and counted to obtain routing statistics information.Furthermore it is possible at predetermined time intervals by each slot data in cluster
Routing statistics information is persisted in a configuration file, wherein and the predetermined time can be set based on actual business requirement,
For example, can be 8 hours, 24 hours etc..The configuration file can be the storage unit being present in server, can be with it
The file of his form configuration, the disclosure do not do particular determination to the specific format and storage location of configuration file.
Specifically, the routing statistics information that server obtains each slot data in each node of cluster may include from configuration text
The routing statistics information of each slot data in each node is directly acquired in part.
S14. remaining is determined in the cluster in addition to a destination node according to the routing statistics information of each slot data
The routing pressure of node.
For how to determine destination node, according to some embodiments of the present disclosure, server can be about in cluster certainly
Reason ability is determined as destination node less than the node of a preset standard, wherein preset standard can be by cluster management personnel voluntarily
Setting, for example, the preset standard can be set with combined factors such as the reading and writing data speed of reference mode, capacity, the preset standard
Can also be associated with actual storage business, particular determination is not done in this illustrative embodiment to this.
According to other embodiment, server can respond knot removal instruction, knot removal be instructed corresponding
Node is determined as destination node.Specifically, first, server can receive knot removal instruction, in knot removal instruction
The identification information (for example, address, nodename etc.) of node can be included, then, server is according to the identification information in cluster
The middle determination node corresponding with identification information is as destination node.
Although being illustrated for a node with destination node in the illustrative embodiments of the disclosure, however, being easy
Understand, the destination node described in the disclosure may refer to multiple nodes.
After determining destination node, server can determine the routing pressure of remaining node in addition to destination node in cluster
Power.Routing pressure described herein can be with routing times of all slot datas in a preset time period on finger joint point, this is default
Period can be, for example, 8 hours, 12 hours, 24 hours etc..In other examples of the disclosure, routing pressure can also be adopted
Determination is integrated with the statistical nature of the routing statistics information of all slot datas on node.Wherein, statistical nature may include but
It is not limited to average value, the standard deviation etc. of total routing times.
It can be seen that the routing pressure described in the disclosure can be shown in the form of numerical value.
S16. the slot data of the destination node is transferred to by remaining described section according to the routing pressure of remaining node
Point on.
According to some embodiments of the present disclosure, first, server can be calculated according to the routing pressure determined in step S14
The ratio of the routing pressure of remaining node, for example, remaining node is three nodes, the ratio of their routing pressure is, for example, 2:
3:5。
Next, remaining node can be transferred to the slot data of destination node according to calculated ratio.Still with above-mentioned
For, can the routing pressure of the according to target slot data of node the slot data of destination node is divided into 10 parts, specifically, by 5 parts
It is transferred to the node that routing pressure ratio is 2, the node that routing pressure ratio is 3 is transferred to by 3 parts, routing is transferred to by 2 parts
The node that pressure proportional is 5.
According to other embodiments of the disclosure, can weight be configured to each node in cluster in advance, wherein weight can
With related with the literacy of each node, that is to say, that the literacy of node is stronger, and weight is bigger.In addition, weight may be used also
With related with the memory capacity of each node.The disclosure can also consider literacy, memory capacity and other node categories
Property determines the weight of egress.In addition, the disclosure does not do particular determination to the storage address of weight information.
In this case, server can obtain the weight of remaining node in addition to destination node in cluster, then,
According to aforementioned proportion and combine the weight of remaining node that the slot data of destination node is transferred on remaining node.
It is easily understood that for each node in remaining above-mentioned node, routing pressure can be with the data that receive
Inversely, and weight can be proportional with the slot data quantity that receives for slot number amount.
Further, it should be noted that the unit of transfer is that slot data can be by slot data while shifting slot data
In data shift together.Thus, it is possible in the case where not influencing original data method of salary distribution, complete to destination node business
Release.In addition, the above process can preferably realize the load balancing of node.
After step S16, the illustrative embodiments of the disclosure can also include deleting destination node from cluster.
Destination node is rejected from the framework of cluster it should be noted that the term " deletion " of the disclosure can refer to.Delete target section
After point, there is also only the destination node has been not belonging to above-mentioned for the hardware physical form and the processing function of itself of destination node
The component part of cluster.
Above-mentioned Node Processing Method is illustrated below with reference to an example.
When slot data routing (such as write-in data), the number of routing can be stored in configuration file, configuration file note
The information of record can be similar as follows：
Slot data 1：Total routing times 10000, routing frequency 10/s；
Slot data 2：Total routing times 5000, routing frequency 1/s；
……
If there are three nodes A, B, C in cluster, when needing deletion of node C (i.e. node C is above-mentioned destination node)
When, server can count the routing pressure of node A, node B, node C respectively, and routing pressure herein can be institute on node
There are routing times of the slot data in 1 hour.The node A that counts as a result, node B, node C routing pressure can distinguish
It is 10000,5000,15000.
It follows that the ratio of the routing pressure of node A and node B is 2:1.In such a case, it is possible to by node C's
Node pressure presses 2:1 point is 10000 and 5000, can 5000 routing times be transferred to node A, by 10000 routing time
Number is transferred to node B.For example, being shifted since the 1st slot data of node, the routing times for each slot data that adds up, until tired
When being added to the routing times of node C and reaching 5000, this corresponding slot data of part routing times is transferred to node A.Example at this time
As displaced 65 slot datas.Next, using the 66th slot data as starting, cumulative routing times of starting from scratch, directly
It is scanned to reach 10000 or all slot datas to cumulative routing times, this partial data slot is transferred to node B.Certainly,
Due to there was only the slot data of node A and the C transfers of Node-B receiver node, the slot data counted can be transferred to node A
Afterwards, remaining slot data is directly transferred to node B.
In addition, in another example, the transfer of slot data can be realized in conjunction with weight.Still for above-mentioned, if
The weight of node A is 1, and the weight of node B is 2, then can the slot data routing times of node C be pressed 1:4 are divided.At this
In the case of kind, the routing times for the slot data that node A is obtained are 3000, and the slot data for receiving node C transfers may be the 1st
Slot data is to the 50th slot data；The routing times for the slot data that node B is obtained are 12000, receive the data of node C transfers
Slot may be the 51st slot data to the 180th slot data.
In the Node Processing Method of the illustrative embodiments of the disclosure, on the one hand, by by the data of destination node
The problem of slot is transferred in cluster on remaining node, can shrink cluster, is avoided since number of nodes is excessive, waste of resource；Separately
On the one hand, the slot data transfer process of destination node is participated in without artificial, improves efficiency and the accuracy rate of transfer；Another side
Face, due to realizing the transfer of slot data according to routing pressure.The load balancing of system is preferably realized as a result,.
It should be noted that although describing each step of method in the disclosure with particular order in the accompanying drawings, this is simultaneously
Undesired or hint must execute these steps according to the particular order, or have to carry out the step ability shown in whole
Realize desired result.Additional or alternative, it is convenient to omit multiple steps are merged into a step and executed by certain steps,
And/or a step is decomposed into execution of multiple steps etc..
Further, a kind of node processing device is additionally provided in this example embodiment, the node processing device application
In influxdb clusters.
Fig. 2 diagrammatically illustrates the block diagram of the node processing device of the illustrative embodiments of the disclosure.With reference to figure 2,
Node processing device 2 according to an exemplary embodiment of the present disclosure may include routing information acquisition module 21, routing pressure
Determining module 23 and slot data shift module 25.
Specifically, routing information acquisition module 21 can be used for obtaining the routing statistics of each slot data in each node of cluster
Information；Routing pressure determining module 23 can be used for being determined in the cluster according to the routing statistics information of each slot data
The routing pressure of remaining node in addition to a destination node；Slot data shift module 25 can be used for the road according to remaining node
The slot data of the destination node is transferred on remaining described node by pressure.
In the node processing device of the illustrative embodiments of the disclosure, on the one hand, by by the data of destination node
The problem of slot is transferred in cluster on remaining node, can shrink cluster, is avoided since number of nodes is excessive, waste of resource；Separately
On the one hand, the slot data transfer process of destination node is participated in without artificial, improves efficiency and the accuracy rate of transfer.
According to an exemplary embodiment of the present disclosure, with reference to figure 3, node processing device 3 is removed compared to node processing device 2
Can also include node outside including routing information acquisition module 21, routing pressure determining module 23 and slot data shift module 25
Removing module 31.
Specifically, knot removal module 31 can be used for deleting the destination node from the cluster.
According to an exemplary embodiment of the present disclosure, the routing statistics of each slot data in the cluster are believed at predetermined time intervals
Breath is persisted in a configuration file.With reference to figure 4, routing information acquisition module 21 may include routing information acquisition unit 401.
Specifically, routing information acquisition unit 401 can be used for from acquisition each node of cluster in the configuration file often
The routing statistics information of one slot data.
According to an exemplary embodiment of the present disclosure, routing pressure is all slot datas on node in a preset time period
Routing times.
According to an exemplary embodiment of the present disclosure, with reference to figure 5, slot data shift module 25 includes ratio computing unit 501
With slot data buanch unit 503.
Specifically, ratio computing unit 501 can be used for calculating the ratio of the routing pressure of remaining node；Slot data
Buanch unit 503 can be used for that the slot data of the destination node being transferred on remaining described node according to the ratio.
According to an exemplary embodiment of the present disclosure, with reference to figure 6, slot data buanch unit 503 may include Weight Acquisition
Unit 6001 and slot data shift subelement 6003.
Specifically, Weight Acquisition subelement 6001 can be used for obtaining the weight of remaining node；Slot data transfer
Unit 6003 can be used for turning according to the ratio and in conjunction with the weight of remaining node by the slot data of the destination node
It moves on on remaining described node.
According to an exemplary embodiment of the present disclosure, with reference to figure 7, node processing device 7 is removed compared to node processing device 3
Outside including routing information acquisition module 21, routing pressure determining module 23, slot data shift module 25 and knot removal module 31,
Can also include first object node determining module 71 or the second destination node determining module 73.
Specifically, first object node determining module 71 can be used for processing capacity in the cluster less than a pre- bidding
Accurate node is determined as destination node；Second destination node determining module 73 can be used for responding knot removal instruction, by institute
Stating knot removal instructs corresponding node to be determined as destination node.
Since each function module of the program analysis of running performance device of embodiment of the present invention is invented with the above method
It is identical in embodiment, therefore details are not described herein.
In an exemplary embodiment of the disclosure, a kind of computer readable storage medium is additionally provided, energy is stored thereon with
Enough realize the program product of this specification above method.In some possible embodiments, various aspects of the invention may be used also
In the form of being embodied as a kind of program product comprising program code, when described program product is run on the terminal device, institute
State program code for make the terminal device execute described in above-mentioned " illustrative methods " part of this specification according to this hair
The step of bright various illustrative embodiments.
Refering to what is shown in Fig. 8, describing the program product for realizing the above method according to the embodiment of the present invention
800, portable compact disc read only memory (CD-ROM) may be used and include program code, and can in terminal device,
Such as it is run on PC.However, the program product of the present invention is without being limited thereto, in this document, readable storage medium storing program for executing can be with
To be any include or the tangible medium of storage program, the program can be commanded execution system, device either device use or
It is in connection.
The arbitrary combination of one or more readable mediums may be used in described program product.Readable medium can be readable letter
Number medium or readable storage medium storing program for executing.Readable storage medium storing program for executing for example can be but be not limited to electricity, magnetic, optical, electromagnetic, infrared ray or
System, device or the device of semiconductor, or the arbitrary above combination.The more specific example of readable storage medium storing program for executing is (non exhaustive
List) include：It is electrical connection, portable disc, hard disk, random access memory (RAM) with one or more conducting wires, read-only
Memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disc read only memory
(CD-ROM), light storage device, magnetic memory device or above-mentioned any appropriate combination.
Computer-readable signal media may include in a base band or as the data-signal that a carrier wave part is propagated,
In carry readable program code.The data-signal of this propagation may be used diversified forms, including but not limited to electromagnetic signal,
Optical signal or above-mentioned any appropriate combination.Readable signal medium can also be any readable Jie other than readable storage medium storing program for executing
Matter, which can send, propagate either transmission for used by instruction execution system, device or device or and its
The program of combined use.
The program code for including on readable medium can transmit with any suitable medium, including but not limited to wirelessly, have
Line, optical cable, RF etc. or above-mentioned any appropriate combination.
It can be write with any combination of one or more programming languages for executing the program that operates of the present invention
Code, described program design language include object oriented program language-Java, C++ etc., further include conventional
Procedural programming language-such as " C " language or similar programming language.Program code can be fully in user
It executes on computing device, partly execute on a user device, being executed as an independent software package, partly in user's calculating
Upper side point is executed or is executed in remote computing device or server completely on a remote computing.It is being related to far
In the situation of journey computing device, remote computing device can pass through the network of any kind, including LAN (LAN) or wide area network
(WAN), it is connected to user calculating equipment, or, it may be connected to external computing device (such as utilize ISP
To be connected by internet).
In an exemplary embodiment of the disclosure, a kind of electronic equipment that can realize the above method is additionally provided.
Person of ordinary skill in the field it is understood that various aspects of the invention can be implemented as system, method or
Program product.Therefore, various aspects of the invention can be embodied in the following forms, i.e.,：It is complete hardware embodiment, complete
The embodiment combined in terms of full Software Implementation (including firmware, microcode etc.) or hardware and software, can unite here
Referred to as circuit, " module " or " system ".
The electronic equipment 900 of this embodiment according to the present invention is described referring to Fig. 9.The electronics that Fig. 9 is shown
Equipment 900 is only an example, should not bring any restrictions to the function and use scope of the embodiment of the present invention.
As shown in figure 9, electronic equipment 900 is showed in the form of universal computing device.The component of electronic equipment 900 can wrap
It includes but is not limited to：Above-mentioned at least one processing unit 910, above-mentioned at least one storage unit 920, connection different system component
The bus 930 of (including storage unit 920 and processing unit 910), display unit 940.
Wherein, the storage unit has program stored therein code, and said program code can be held by the processing unit 910
Row so that the processing unit 910 executes various according to the present invention described in above-mentioned " illustrative methods " part of this specification
The step of illustrative embodiments.For example, the processing unit 910 can execute step S12 as shown in fig. 1 to step
S16。
Storage unit 920 may include the readable medium of volatile memory cell form, such as Random Access Storage Unit
(RAM) 9201 and/or cache memory unit 9202, it can further include read-only memory unit (ROM) 9203.
Storage unit 920 can also include program/utility with one group of (at least one) program module 9205
9204, such program module 9205 includes but not limited to：Operating system, one or more application program, other program moulds
Block and program data may include the realization of network environment in each or certain combination in these examples.
Bus 930 can be to indicate one or more in a few class bus structures, including storage unit bus or storage
Cell controller, peripheral bus, graphics acceleration port, processing unit use the arbitrary bus structures in a variety of bus structures
Local bus.
Electronic equipment 900 can also be with one or more external equipments 1000 (such as keyboard, sensing equipment, bluetooth equipment
Deng) communication, can also be enabled a user to one or more equipment interact with the electronic equipment 900 communicate, and/or with make
Any equipment that the electronic equipment 900 can be communicated with one or more of the other computing device (such as router, modulation /demodulation
Device etc.) communication.This communication can be carried out by input/output (I/O) interface 950.Also, electronic equipment 900 can be with
By network adapter 960 and one or more network (such as LAN (LAN), wide area network (WAN) and/or public network,
Such as internet) communication.As shown, network adapter 960 is communicated by bus 930 with other modules of electronic equipment 900.
It should be understood that although not shown in the drawings, other hardware and/or software module can not used in conjunction with electronic equipment 900, including but not
It is limited to：Microcode, device driver, redundant processing unit, external disk drive array, RAID system, tape drive and
Data backup storage system etc..
Through the above description of the embodiments, those skilled in the art is it can be readily appreciated that example described herein is implemented
Mode can also be realized by software realization in such a way that software is in conjunction with necessary hardware.Therefore, according to the disclosure
The technical solution of embodiment can be expressed in the form of software products, the software product can be stored in one it is non-volatile
Property storage medium (can be CD-ROM, USB flash disk, mobile hard disk etc.) in or network on, including some instructions are so that a calculating
Equipment (can be personal computer, server, terminal installation or network equipment etc.) is executed according to disclosure embodiment
Method.
In addition, above-mentioned attached drawing is only the schematic theory of the processing included by method according to an exemplary embodiment of the present invention
It is bright, rather than limit purpose.It can be readily appreciated that the time that above-mentioned processing shown in the drawings did not indicated or limited these processing is suitable
Sequence.In addition, being also easy to understand, these processing for example can be executed either synchronously or asynchronously in multiple modules.
It should be noted that although being referred to several modules or list for acting the equipment executed in above-detailed
Member, but this division is not enforceable.In fact, according to embodiment of the present disclosure, it is above-described two or more
The feature and function of module either unit can embody in a module or unit.Conversely, an above-described mould
Either the feature and function of unit can be further divided into and embodied by multiple modules or unit block.
Those skilled in the art after considering the specification and implementing the invention disclosed here, will readily occur to its of the disclosure
His embodiment.This application is intended to cover any variations, uses, or adaptations of the disclosure, these modifications, purposes or
Adaptive change follow the general principles of this disclosure and include the undocumented common knowledge in the art of the disclosure or
Conventional techniques.The description and examples are only to be considered as illustrative, and the true scope and spirit of the disclosure are by claim
It points out.
It should be understood that the present disclosure is not limited to the precise structures that have been described above and shown in the drawings, and
And various modifications and changes may be made without departing from the scope thereof.The scope of the present disclosure is only limited by the attached claims.
Claims (10)
1. a kind of Node Processing Method, it is applied to influxdb clusters, which is characterized in that the Node Processing Method includes：
Obtain the routing statistics information of each slot data in each node of cluster；
The road of remaining node in addition to a destination node in the cluster is determined according to the routing statistics information of each slot data
By pressure；
The slot data of the destination node is transferred on remaining described node according to the routing pressure of remaining node.
2. Node Processing Method according to claim 1, which is characterized in that shifted by the slot data of the destination node
After on to remaining described node, the Node Processing Method further includes：
The destination node is deleted from the cluster.
3. Node Processing Method according to claim 1, which is characterized in that at predetermined time intervals by each number in the cluster
It is persisted in a configuration file according to the routing statistics information of slot；Wherein, the routing of each slot data in each node of cluster is obtained
Statistical information includes：
From the routing statistics information for obtaining each slot data in each node of cluster in the configuration file.
4. Node Processing Method according to claim 1, which is characterized in that the routing pressure is all data on node
Routing times of the slot in a preset time period.
5. Node Processing Method according to claim 2 or 4, which is characterized in that according to the routing pressure of remaining node
The slot data of the destination node is transferred on remaining described node by power：
Calculate the ratio of the routing pressure of remaining node；
The slot data of the destination node is transferred on remaining described node according to the ratio.
6. Node Processing Method according to claim 5, which is characterized in that according to the ratio by the destination node
Slot data is transferred on remaining described node：
Obtain the weight of remaining node；
Described in being transferred to according to the ratio and in conjunction with the weight of remaining node by the slot data of the destination node remaining
On node.
7. Node Processing Method according to claim 2, which is characterized in that the Node Processing Method further includes：
Node by processing capacity in the cluster less than a preset standard is determined as destination node；Or
Knot removal instruction is responded, instructs corresponding node to be determined as destination node the knot removal.
8. a kind of node processing device, it is applied to influxdb clusters, which is characterized in that the node processing device includes：
Routing information acquisition module, the routing statistics information for obtaining each slot data in each node of cluster；
Routing pressure determining module removes a mesh for being determined according to the routing statistics information of each slot data in the cluster
Mark the routing pressure of remaining outer node of node；
Slot data shift module, for being transferred to the slot data of the destination node according to the routing pressure of remaining node
On remaining described node.
9. a kind of storage medium, is stored thereon with computer program, which is characterized in that the computer program is executed by processor
Node Processing Method described in any one of Shi Shixian claims 1 to 7.
10. a kind of electronic equipment, which is characterized in that including：
Processor；And
Memory, the executable instruction for storing the processor；
Wherein, the processor is configured to come described in any one of perform claim requirement 1 to 7 via the execution executable instruction
Node Processing Method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810578276.6A CN108763577A (en) | 2018-06-05 | 2018-06-05 | node processing method and device, storage medium and electronic equipment |
| PCT/CN2018/101023 WO2019232932A1 (en) | 2018-06-05 | 2018-08-17 | Node processing method and apparatus, and computer-readable storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810578276.6A CN108763577A (en) | 2018-06-05 | 2018-06-05 | node processing method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108763577A true CN108763577A (en) | 2018-11-06 |
Family
ID=64000312
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810578276.6A Withdrawn CN108763577A (en) | 2018-06-05 | 2018-06-05 | node processing method and device, storage medium and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108763577A (en) |
| WO (1) | WO2019232932A1 (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113312329B (en) * | 2020-02-26 | 2024-03-01 | 阿里巴巴集团控股有限公司 | Scheduling method, device and equipment for data files |
| CN112016793B (en) * | 2020-07-15 | 2024-04-26 | 北京淇瑀信息科技有限公司 | Resource allocation method and device based on target user group and electronic equipment |
| CN113791827B (en) * | 2020-10-14 | 2023-11-03 | 北京京东振世信息技术有限公司 | Page loading method, service processing method, device, storage medium and equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102891879A (en) * | 2011-07-22 | 2013-01-23 | 国际商业机器公司 | Method and device for supporting cluster expansion |
| CN103810265B (en) * | 2014-01-27 | 2017-04-26 | 南京邮电大学 | Database optimization method based on WiMAX local routing |
| CN104684041B (en) * | 2015-02-06 | 2018-01-12 | 中国科学院上海微系统与信息技术研究所 | A kind of real-time wireless sensing network route method for supporting extensive node application |
| CN105915630A (en) * | 2016-06-01 | 2016-08-31 | 东软集团股份有限公司 | Cross-network data transmission system and load balancing scheduling method |
| CN106161610A (en) * | 2016-06-29 | 2016-11-23 | 华为技术有限公司 | A kind of method and system of distributed storage |
-
2018
- 2018-06-05 CN CN201810578276.6A patent/CN108763577A/en not_active Withdrawn
- 2018-08-17 WO PCT/CN2018/101023 patent/WO2019232932A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019232932A1 (en) | 2019-12-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104699423B (en) | The method and apparatus that drive is bound in linux system | |
| CN109766497A (en) | Ranking list generation method and device, storage medium, electronic equipment | |
| CN108763577A (en) | node processing method and device, storage medium and electronic equipment | |
| CN105339924A (en) | Efficient data compression and analysis as a service | |
| CN103106069A (en) | Method and system for identifying components of bundled software product | |
| US20180241638A1 (en) | Method and system for discovering and presenting access information of network applications | |
| CN109783472A (en) | Moving method, device, computer equipment and the storage medium of table data | |
| US11100458B2 (en) | Asset and device management | |
| CN109656885A (en) | Memory space monitoring method and device, electric terminal, storage medium | |
| WO2008091037A1 (en) | Realtime unification management information data conversion and monitoring apparatus and method for thereof | |
| CN101673289A (en) | Method and device for constructing distributed file storage framework | |
| CN107133263A (en) | POI recommends method, device, equipment and computer-readable recording medium | |
| CN109213604A (en) | A kind of management method and device of data source | |
| CN109067649A (en) | node processing method and device, storage medium and electronic equipment | |
| CN111044062A (en) | Path planning and recommending method and device | |
| CN105022753B (en) | A kind of date storage method and system | |
| CN104063377B (en) | Information processing method and use its electronic equipment | |
| CN107169005A (en) | POI recommends method, device, equipment and computer-readable recording medium | |
| CN110457318A (en) | The update method of data field, device, medium, electronic equipment in block chain | |
| CN109783440A (en) | Date storage method and data retrieval method, device, medium, electronic equipment | |
| CN109376148A (en) | The data processing method of slowly varying dimension table, device, electronic equipment | |
| CN115145959A (en) | Data storage method and device, electronic equipment and storage medium | |
| CN104869171A (en) | Information processing method and smart home equipment | |
| CN111815339A (en) | Marketing information pushing method and equipment | |
| CN106528577B (en) | Method and device for setting file to be cleaned |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20181106 |
|
| WW01 | Invention patent application withdrawn after publication |