CN109375873B - Initialization method of data processing daemon in distributed storage cluster - Google Patents

Initialization method of data processing daemon in distributed storage cluster Download PDF

Info

Publication number
CN109375873B
CN109375873B CN201811131214.7A CN201811131214A CN109375873B CN 109375873 B CN109375873 B CN 109375873B CN 201811131214 A CN201811131214 A CN 201811131214A CN 109375873 B CN109375873 B CN 109375873B
Authority
CN
China
Prior art keywords
data processing
daemon
initialization
distributed storage
daemons
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811131214.7A
Other languages
Chinese (zh)
Other versions
CN109375873A (en
Inventor
史宗华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhengzhou Yunhai Information Technology Co Ltd
Original Assignee
Zhengzhou Yunhai Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhengzhou Yunhai Information Technology Co Ltd filed Critical Zhengzhou Yunhai Information Technology Co Ltd
Priority to CN201811131214.7A priority Critical patent/CN109375873B/en
Publication of CN109375873A publication Critical patent/CN109375873A/en
Application granted granted Critical
Publication of CN109375873B publication Critical patent/CN109375873B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0604Improving or facilitating administration, e.g. storage management
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • G06F3/0632Configuration or reconfiguration of storage systems by initialisation or re-initialisation of storage systems
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention discloses an initialization method, device and equipment of a data processing daemon in a distributed storage cluster and a computer readable storage medium, wherein the method comprises the following steps: acquiring a plurality of process numbers by a cluster monitoring daemon of a distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster; triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize; and acquiring the result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon. Therefore, the process initialization speed is greatly improved, and the cluster deployment efficiency is further improved.

Description

Initialization method of data processing daemon in distributed storage cluster
Technical Field
The present invention relates to the field of distributed storage cluster technology, and more particularly, to a method, an apparatus, a device, and a computer-readable storage medium for initializing a data processing daemon in a distributed storage cluster.
Background
With the rapid development of the internet, data is also increasing explosively. The traditional general storage cannot meet the increase of mass data, and the distributed storage for processing the mass data is produced. However, with the increase of the amount of data to be stored, when the distributed storage cluster is deployed, more and more data processing daemons for using the disk need to be initialized, so that the time for deploying the cluster is longer and longer, and the efficiency of deploying the storage cluster is seriously affected.
In a traditional deployment mode, each data processing daemon is initialized sequentially, that is, each node included in a distributed storage cluster is initialized sequentially, and each node initializes each data processing daemon included in the node in sequence.
In summary, the technical solutions for implementing initialization of the data processing daemon in the prior art have the problems of slow initialization speed and low cluster deployment efficiency.
Disclosure of Invention
The invention aims to provide an initialization method, device and equipment of a data processing daemon in a distributed storage cluster and a computer readable storage medium, which can solve the problems of low initialization speed and low cluster deployment efficiency in the technical scheme for realizing initialization of the data processing daemon in the prior art.
In order to achieve the above purpose, the invention provides the following technical scheme:
a method for initializing a data processing daemon in a distributed storage cluster comprises the following steps:
acquiring a plurality of process numbers by a cluster monitoring daemon of a distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster;
triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize;
and acquiring the result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon.
Preferably, the obtaining of the result of initialization of each data processing daemon includes:
and acquiring a result containing the process number of each data processing daemon and information whether the corresponding data processing daemon successfully realizes initialization.
Preferably, the step of returning the result of initializing each data processing daemon to the cluster monitoring daemon includes:
and storing the acquired process numbers of the data processing daemons and information on whether the corresponding data processing daemons successfully realize initialization in a data table in a one-to-one corresponding relationship, and returning the data table to the cluster monitoring daemons.
Preferably, the obtaining, by the cluster monitoring daemon of the distributed storage cluster, the plurality of process numbers includes:
and determining the number of data processing daemons needing to be initialized in the distributed storage cluster, and acquiring the number of the determined number of processes from the cluster monitoring daemons.
An initialization device for a data processing daemon in a distributed storage cluster comprises:
an allocation acquisition module to: acquiring a plurality of process numbers by a cluster monitoring daemon of a distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster;
an initialization module to: triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize;
a result return module to: and acquiring the result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon.
Preferably, the result returning module includes:
a result acquisition unit configured to: and acquiring a result containing the process number of each data processing daemon and information whether the corresponding data processing daemon successfully realizes initialization.
Preferably, the result returning module includes:
a result returning unit operable to: and storing the acquired process numbers of the data processing daemons and information on whether the corresponding data processing daemons successfully realize initialization in a data table in a one-to-one corresponding relationship, and returning the data table to the cluster monitoring daemons.
Preferably, the allocation obtaining module includes:
a process number acquisition unit configured to: and determining the number of data processing daemons needing to be initialized in the distributed storage cluster, and acquiring the number of the determined number of processes from the cluster monitoring daemons.
An initialization device for a data processing daemon in a distributed storage cluster, comprising:
a memory for storing a computer program;
a processor, configured to implement the steps of the initialization method for the data processing daemon in the distributed storage cluster as described in any one of the above when the computer program is executed.
A computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of a method of initializing a data processing daemon in a distributed storage cluster as claimed in any one of the preceding claims.
The invention provides a method, a device, equipment and a computer readable storage medium for data processing daemon in a distributed storage cluster, wherein the method comprises the following steps: acquiring a plurality of process numbers by a cluster monitoring daemon of a distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster; triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize; and acquiring the result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon. In the technical scheme disclosed by the invention, through the distribution of the process numbers, each node and the data processing daemon on each node can independently realize the initialization process independent of a distributed storage cluster, and further realize concurrent initialization from two dimensions of the node and the data processing daemon.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
Fig. 1 is a flowchart of an initialization method for a data processing daemon in a distributed storage cluster according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of an initialization apparatus for a data processing daemon in a distributed storage cluster according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1, a flowchart of an initialization method for a data processing daemon in a distributed storage cluster according to an embodiment of the present invention is shown, where the initialization method includes:
s11: and acquiring a plurality of process numbers by a cluster monitoring daemon of the distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster.
The execution subject of the initialization method for the data processing daemon in the distributed storage cluster provided in the embodiment of the present invention may be a corresponding initialization device, and the initialization device may be disposed in the distributed storage cluster or a master node of the distributed storage cluster. The cluster monitoring daemon has the same meaning as the corresponding concept in the prior art and is a process for realizing distributed storage cluster monitoring, and a plurality of process numbers acquired by the cluster monitoring daemon are different from each other, namely each process number has uniqueness, so that the process numbers are distributed to all nodes.
S12: and triggering all the nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all the nodes distribute the process numbers obtained by distribution to all the data processing daemons contained in the nodes one to one, and triggering all the data processing daemons contained in the nodes in parallel to initialize.
The parallel triggering of each node for initialization may be realized by a corresponding instruction, and of course, may also be triggered by other manners according to actual needs, all of which are within the protection scope of the present invention. And triggering each node to perform an initialization process by using the process number allocated to the node in parallel, so that each node allocates a group of process numbers allocated to the node to each data processing daemon corresponding to the disk in the initialization process, and concurrently initializing each data processing daemon with a unique identifier (process number). Therefore, the method and the device can realize concurrent initialization of two dimensions, and specifically comprise the following steps:
(1) concurrence of node dimensions: when a distributed storage cluster is built, a plurality of nodes are involved, each node in a traditional deployment mode is serially subjected to an initialization process of a data processing daemon process, namely after a first node completes initialization of the data processing daemon process corresponding to all disks on the node, the initialization process of a second node is carried out. Because the resource of each node is relatively independent, and the initialization flow of the data processing daemon corresponding to the disk of the node is basically consistent for each node, the process number is distributed to each node, so that after the initialization of the data processing daemon of the disk on each node is realized based on the process number, each node can concurrently initialize the data processing daemon of the disk on the node without mutual interference.
(2) Concurrence of process dimensions: initializing a data processing daemon corresponding to the disk, wherein each disk is basically the same (only for disks with different media, when the disks are used for different purposes, some special processing needs to be performed); moreover, after the process number for uniquely identifying the monitored data processing daemon is obtained, the initialization process of the data processing daemon corresponding to each disk does not depend on other resources in the distributed storage cluster any more, but can independently perform initialization tasks, so that concurrent initialization can be performed from the dimensionality of the data processing daemon.
The initialization is performed from the two dimensions, process scheduling, resource waiting, network delay time and the like can be eliminated, and the initialization time of all the data processing daemons in the distributed storage cluster can be theoretically compressed to the initialization time of initializing one data processing daemon, so that the initialization speed is greatly improved.
S13: and acquiring the result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon.
After each data processing daemon is initialized, a corresponding initialization result can be obtained, and the result is returned to the cluster monitoring daemon, so that the cluster monitoring daemon can conveniently realize a corresponding monitoring function.
In the technical scheme disclosed by the invention, through the distribution of the process numbers, each node and the data processing daemon on each node can independently realize the initialization process independent of a distributed storage cluster, and further realize concurrent initialization from two dimensions of the node and the data processing daemon.
The method for initializing data processing daemons in a distributed storage cluster, provided by the embodiment of the present invention, for obtaining the result of initializing each data processing daemon, may include:
and acquiring a result containing the process number of each data processing daemon and information whether the corresponding data processing daemon successfully realizes initialization.
It should be noted that in the sequential initialization mode in the prior art, if the initialization of the data processing daemon corresponding to one of the disks fails, the cluster deployment process may report an error and exit, and the disk with the problem needs to be skipped or repaired by human intervention before deployment, which greatly reduces the cluster deployment speed. In the concurrent initialization mode, because each data processing process is concurrently initialized, if a damaged disk is encountered, the disk can be skipped, so that the time consumption caused by the fact that the damaged disk must be processed first in the conventional deployment method and the subsequent disk initialization process can be continued is avoided, and a user can process the failed disk after the initialization process is finished. Correspondingly, the result returned to the cluster monitoring daemon process can contain the process number of each data processing daemon process and information on whether initialization is successfully realized, so that whether a disk to which the data processing daemon process corresponding to the process number belongs has a fault can be directly positioned on the basis of the information, and a user can conveniently realize disk fault processing; of course, other contents can be added to the returned result according to actual needs, and the contents are within the protection scope of the invention.
The method for initializing data processing daemons in a distributed storage cluster according to the embodiment of the present invention returns the result of initializing each data processing daemon to the cluster monitoring daemon, and may include:
and storing the acquired process numbers of the data processing daemons and information on whether the corresponding data processing daemons successfully realize initialization in a data table in a one-to-one corresponding relationship, and returning the data table to the cluster monitoring daemons.
It should be noted that, a data table may be provided in the present application, where the data table is used to store the process number of each data processing daemon and information on whether initialization is successfully implemented, and then directly return the data table to the cluster monitoring daemon, which not only facilitates management of results by the cluster monitoring daemon, but also facilitates intuitive acquisition of relevant information corresponding to a user by directly displaying the data table by the cluster monitoring daemon.
The initialization method for the data processing daemon in the distributed storage cluster provided by the embodiment of the invention obtains a plurality of process numbers from the cluster monitoring daemon of the distributed storage cluster, and the method can comprise the following steps:
determining the number of data processing daemons needing to be initialized in the distributed storage cluster, and acquiring the number of the determined number of processes from the cluster monitoring daemons.
It should be noted that the number of data processing daemons that need to be initialized in the distributed cluster may be determined, and then the process numbers of the corresponding number are obtained. Because the data processing daemon process with the process number may be stored in the distributed storage cluster, the process number is obtained in such a way, and the waste of resources caused by obtaining redundant process numbers can be avoided.
Therefore, the technical scheme disclosed by the invention achieves the purpose of quickly initializing the data processing daemon from the concurrence of two dimensions of the node and the process. Specifically, the following steps may be included:
(1) confirming the number of data processing daemons needing to be initialized on each node (if N nodes) in the distributed storage cluster (if each node has X data processing daemons needing to be initialized);
(2) according to the assumption of the step (1), confirming that the total number of the data processing daemons is N X, applying N X process numbers for uniquely identifying the monitored data processing daemons to the cluster monitoring daemons, wherein the process numbers can be from 0 to N X-1 (if Y data processing daemons exist in the original distributed storage cluster, the process numbers obtained by applying are from Y to Y + N X-1), according to the number (X) of the data processing daemon processes of each node confirmed in the step (1), distributing the applied process numbers for each node (for example, the node 1 distributes and obtains the process numbers 0-X-1, the node 2 distributes and obtains the process numbers X-2X-1, …, and the like), and triggering each node to start an initialization process in parallel;
(3) the process for initialization on each node distributes a group of process numbers distributed to the process to each data processing daemon, taking node 1 as an example, the process for initialization on node 1 distributes the process numbers 0-X-1 to the process to itself and then to each data processing daemon of node 1, and after each data processing daemon obtains the process number distributed to itself, each data processing daemon is triggered in parallel to initialize;
(4) the initialization process on each node waits for and records the initialization result of each data processing daemon on the node, the main node waits for and records the initialization result of each node, and after the initialization is completed, the main node returns the initialization result.
An embodiment of the present invention further provides an initialization apparatus for a data processing daemon in a distributed storage cluster, as shown in fig. 2, the initialization apparatus may include:
an allocation obtaining module 11, configured to: acquiring a plurality of process numbers by a cluster monitoring daemon of the distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster;
an initialization module 12 configured to: triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize;
a result returning module 13 for: and acquiring the result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon.
In the apparatus for initializing a data processing daemon in a distributed storage cluster provided in an embodiment of the present invention, the result returning module may include:
a result acquisition unit configured to: and acquiring a result containing the process number of each data processing daemon and information whether the corresponding data processing daemon successfully realizes initialization.
In the apparatus for initializing a data processing daemon in a distributed storage cluster provided in an embodiment of the present invention, the result returning module may include:
a result returning unit operable to: and storing the acquired process numbers of the data processing daemons and information on whether the corresponding data processing daemons successfully realize initialization in a data table in a one-to-one corresponding relationship, and returning the data table to the cluster monitoring daemons.
In an initialization apparatus for a data processing daemon in a distributed storage cluster provided in an embodiment of the present invention, a distribution acquisition module may include:
a process number acquisition unit configured to: determining the number of data processing daemons needing to be initialized in the distributed storage cluster, and acquiring the number of the determined number of processes from the cluster monitoring daemons.
An embodiment of the present invention further provides an initialization device for a data processing daemon in a distributed storage cluster, where the initialization device may include:
a memory for storing a computer program;
and the processor is used for realizing the steps of the initialization method of the data processing daemon in any one of the distributed storage clusters when executing the computer program.
An embodiment of the present invention further provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method for initializing a data processing daemon in any one of the distributed storage clusters may be implemented.
It should be noted that for the description of the device, the apparatus, and the computer-readable storage medium for the data processing daemon in the distributed storage cluster provided in the embodiment of the present invention, please refer to the detailed description of the corresponding part in the method for the data processing daemon in the distributed storage cluster provided in the embodiment of the present invention, and details are not repeated herein. In addition, parts of the technical solutions provided in the embodiments of the present invention that are consistent with the implementation principles of the corresponding technical solutions in the prior art are not described in detail, so as to avoid redundant description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (8)

1. A method for initializing a data processing daemon in a distributed storage cluster is characterized by comprising the following steps:
acquiring a plurality of process numbers by a cluster monitoring daemon of a distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster;
triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize;
acquiring a result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon;
obtaining the result of initialization of each data processing daemon, comprising:
and acquiring a result containing the process number of each data processing daemon and information whether the corresponding data processing daemon successfully realizes initialization.
2. The method of claim 1, wherein returning results of initialization of each data processing daemon to the cluster monitoring daemon comprises:
and storing the acquired process numbers of the data processing daemons and information on whether the corresponding data processing daemons successfully realize initialization in a data table in a one-to-one corresponding relationship, and returning the data table to the cluster monitoring daemons.
3. The method of claim 2, wherein obtaining, by a cluster monitoring daemon of the distributed storage cluster, the plurality of process numbers comprises:
and determining the number of data processing daemons needing to be initialized in the distributed storage cluster, and acquiring the number of the determined number of processes from the cluster monitoring daemons.
4. An initialization apparatus for a data processing daemon in a distributed storage cluster, comprising:
an allocation acquisition module to: acquiring a plurality of process numbers by a cluster monitoring daemon of a distributed storage cluster, and distributing the process numbers to each node contained in the distributed storage cluster;
an initialization module to: triggering all nodes in parallel to initialize by using the process numbers obtained by distribution so as to indicate that all nodes distribute the process numbers obtained by distribution to all data processing daemons contained in the nodes one to one, and triggering all data processing daemons contained in the nodes in parallel to initialize;
a result return module to: acquiring a result of initialization of each data processing daemon, and returning the result to the cluster monitoring daemon;
the result returning module comprises:
a result acquisition unit configured to: and acquiring a result containing the process number of each data processing daemon and information whether the corresponding data processing daemon successfully realizes initialization.
5. The apparatus of claim 4, wherein the result return module comprises:
a result returning unit operable to: and storing the acquired process numbers of the data processing daemons and information on whether the corresponding data processing daemons successfully realize initialization in a data table in a one-to-one corresponding relationship, and returning the data table to the cluster monitoring daemons.
6. The apparatus of claim 5, wherein the allocation obtaining module comprises:
a process number acquisition unit configured to: and determining the number of data processing daemons needing to be initialized in the distributed storage cluster, and acquiring the number of the determined number of processes from the cluster monitoring daemons.
7. An initialization device for a data processing daemon in a distributed storage cluster, comprising:
a memory for storing a computer program;
a processor for implementing the steps of the initialization method of the data processing daemon in the distributed storage cluster according to any one of claims 1 to 3 when executing the computer program.
8. A computer-readable storage medium, having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method for initializing a data processing daemon in a distributed storage cluster according to any one of claims 1 to 3.
CN201811131214.7A 2018-09-27 2018-09-27 Initialization method of data processing daemon in distributed storage cluster Active CN109375873B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811131214.7A CN109375873B (en) 2018-09-27 2018-09-27 Initialization method of data processing daemon in distributed storage cluster

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811131214.7A CN109375873B (en) 2018-09-27 2018-09-27 Initialization method of data processing daemon in distributed storage cluster

Publications (2)

Publication Number Publication Date
CN109375873A CN109375873A (en) 2019-02-22
CN109375873B true CN109375873B (en) 2022-02-18

Family

ID=65402687

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811131214.7A Active CN109375873B (en) 2018-09-27 2018-09-27 Initialization method of data processing daemon in distributed storage cluster

Country Status (1)

Country Link
CN (1) CN109375873B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111858076B (en) * 2020-07-14 2022-07-08 苏州浪潮智能科技有限公司 Target daemon process synchronization method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101556546A (en) * 2009-05-27 2009-10-14 北京联合大学 Method for processing compression program parallelization based on computer clusters
CN104036031A (en) * 2014-06-27 2014-09-10 北京航空航天大学 Large-scale CFD parallel computing method based on distributed Mysql cluster storage
CN104918264A (en) * 2015-06-24 2015-09-16 华南理工大学 Wireless sensor network layout method and wireless sensor network layout system based on parallel decomposition type evolution
CN105045934A (en) * 2015-09-09 2015-11-11 长春工程学院 Parallel clustering method for processing large geographical grid data
CN106933659A (en) * 2015-12-30 2017-07-07 华为技术有限公司 The method and apparatus of managing process
CN108445537A (en) * 2018-02-07 2018-08-24 中国地质大学(武汉) Earthquake data before superposition AVO elastic parameter inversion methods based on Spark and system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140201114A1 (en) * 2011-08-15 2014-07-17 Nec Corporation Device of managing distributed processing and method of managing distributed processing
CN102665251B (en) * 2012-05-25 2014-12-17 重庆大学 WSN (Wireless Sensor Network) distributed-type non-uniform clustering method
CN104516790B (en) * 2014-12-24 2017-08-25 西安电子科技大学 Check point record and the system and method recovered under a kind of distributed environment
EP3561672B1 (en) * 2015-04-07 2022-06-01 Huawei Technologies Co., Ltd. Method and apparatus for a mobile device based cluster computing infrastructure
CN106330523A (en) * 2015-07-03 2017-01-11 中国移动通信集团广西有限公司 Cluster server disaster recovery system and method, and server node
US20170364473A1 (en) * 2016-03-31 2017-12-21 Wave Computing, Inc. Program counter alignment across a reconfigurable hum fabric
CN108334410A (en) * 2018-01-26 2018-07-27 福建星瑞格软件有限公司 A kind of distributed application program client light weight method and computer equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101556546A (en) * 2009-05-27 2009-10-14 北京联合大学 Method for processing compression program parallelization based on computer clusters
CN104036031A (en) * 2014-06-27 2014-09-10 北京航空航天大学 Large-scale CFD parallel computing method based on distributed Mysql cluster storage
CN104918264A (en) * 2015-06-24 2015-09-16 华南理工大学 Wireless sensor network layout method and wireless sensor network layout system based on parallel decomposition type evolution
CN105045934A (en) * 2015-09-09 2015-11-11 长春工程学院 Parallel clustering method for processing large geographical grid data
CN106933659A (en) * 2015-12-30 2017-07-07 华为技术有限公司 The method and apparatus of managing process
CN108445537A (en) * 2018-02-07 2018-08-24 中国地质大学(武汉) Earthquake data before superposition AVO elastic parameter inversion methods based on Spark and system

Also Published As

Publication number Publication date
CN109375873A (en) 2019-02-22

Similar Documents

Publication Publication Date Title
CN107463582B (en) Distributed Hadoop cluster deployment method and device
CN104050045B (en) Virtual resource allocation method and device based on disk I/O
US9547605B2 (en) Method for data backup, device and system
EP3627358B1 (en) Method, system, and apparatus for cloud application redundancy
JP5932043B2 (en) Volatile memory representation of non-volatile storage set
US8850156B2 (en) Method and system for managing virtual machine storage space and physical host
US20150234674A1 (en) Method, System and Apparatus for Creating Virtual Machine
US9104501B2 (en) Preparing parallel tasks to use a synchronization register
JP6492977B2 (en) Parallel computing device, parallel computing system, node allocation program, and node allocation method
CN106326226B (en) The method and system of log-on data library service in a kind of public cloud
CN107818104B (en) Database deployment method, database deployment device, control equipment and system
CN110633130B (en) Virtual memory management method and device based on memory hot plug technology
JP2023504870A (en) Cluster resource control method and device, and cloud computing system
CN105357042A (en) High-availability cluster system, master node and slave node
KR101765725B1 (en) System and Method for connecting dynamic device on mass broadcasting Big Data Parallel Distributed Processing
CN113282649A (en) Distributed task processing method and device and computer equipment
CN104793981B (en) A kind of online snapshot management method and device of cluster virtual machine
US20080178187A1 (en) Method and computer program product for job selection and resource alolocation of a massively parallel processor
CN109375873B (en) Initialization method of data processing daemon in distributed storage cluster
CN111338756A (en) GPU pooling method, device, equipment and computer readable storage medium
CN109379223A (en) A kind of method and apparatus for realizing network interface card automated setting
CN110990329B (en) Federal computing high availability method, equipment and medium
CN112486664A (en) Node capacity expansion method, system, terminal and storage medium
CN109324867A (en) A kind of virtual machine temporary storage method, restoration methods and device
CN113656181A (en) Method and device for issuing real-time application cluster instance resources

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant