CN110989933A - Message queue RockMq smooth migration method - Google Patents
Message queue RockMq smooth migration method Download PDFInfo
- Publication number
- CN110989933A CN110989933A CN201911234565.5A CN201911234565A CN110989933A CN 110989933 A CN110989933 A CN 110989933A CN 201911234565 A CN201911234565 A CN 201911234565A CN 110989933 A CN110989933 A CN 110989933A
- Authority
- CN
- China
- Prior art keywords
- migrated
- machine room
- message queue
- storage node
- main storage
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 31
- 230000005012 migration Effects 0.000 title claims abstract description 28
- 238000013508 migration Methods 0.000 title claims abstract description 28
- 238000004590 computer program Methods 0.000 claims description 6
- 230000008569 process Effects 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/0647—Migration mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/0614—Improving the reliability of storage systems
- G06F3/0619—Improving the reliability of storage systems in relation to data integrity, e.g. data losses, bit errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2209/00—Indexing scheme relating to G06F9/00
- G06F2209/54—Indexing scheme relating to G06F9/54
- G06F2209/548—Queue
Abstract
The invention discloses a message queue RockMq smooth migration method, which relates to the technical field of computers.
Description
Technical Field
The invention belongs to the technical field of computers, and particularly relates to a message queue RocktMq smooth migration method.
Background
At present, in the message queue rockmq migration process, a message queue rockmq generation server migrated out of a computer room needs to be offline, so that the message queue rockmq cannot be migrated without influencing the use of online application, and further cannot be guaranteed to complete migration without losing data.
Disclosure of Invention
Aiming at the defects in the prior art, the embodiment of the invention provides a message queue RocktMq smooth migration method, which comprises the following steps:
establishing at least two configuration nodes in a machine room to be migrated;
respectively configuring corresponding main storage nodes for the at least two configuration nodes, wherein one configuration node is associated with one main storage node, and one main storage node is associated with one slave storage node;
configuring titles consistent with the main storage nodes of the machine room to be migrated for each main storage node of the machine room to be migrated respectively;
after the capacity expansion of the machine room to be migrated is completed and before the migration of the message queue RocktMq is completed, write forbidding commands are sequentially sent to each main storage node of the machine room to be migrated, and the work of each main storage node is sequentially stopped;
and respectively configuring domain name addresses consistent with the configuration nodes of the machine room to be migrated for each configuration node of the machine room to be migrated, and finishing smooth migration of the message queue RocktMq.
Preferably, after the smooth migration of the message queue rockmq between the to-be-migrated machine room and the to-be-migrated machine room is completed, the method further includes:
and sending a write forbidding command to each configuration node of the machine room to be migrated, and stopping the work of each configuration node.
Preferably, after the smooth migration of the message queue rockmq between the to-be-migrated machine room and the to-be-migrated machine room is completed, the method further includes:
and when the throughput of each consumption message server of the machine room to be migrated is zero, sending a write forbidding command to each slave storage node of the machine room to be migrated, and stopping the work of each slave storage node.
The message queue RockMq smooth migration method provided by the embodiment of the invention has the following beneficial effects:
under the condition of ensuring that data is not lost, smooth migration of the message queue RocktMq is realized.
Detailed Description
The present invention will be described in detail with reference to the following embodiments.
The message queue RockMq smooth migration method provided by the embodiment of the invention comprises the following steps:
s101, at least two configuration nodes are established in the machine room to be migrated.
S102, configuring corresponding main storage nodes for at least two configuration nodes respectively, wherein one configuration node is associated with one main storage node, and one main storage node is associated with one slave storage node.
Wherein, the slave storage node is a spare storage when the master storage node has problems.
S103, configuring titles consistent with the main storage nodes of the machine room to be migrated for each main storage node of the machine room to be migrated respectively.
Wherein the header identifies which data each primary storage node is responsible for receiving and sending.
And S104, after the capacity expansion of the machine room to be migrated is completed and before the migration of the message queue RockettMq is completed, sequentially sending write forbidding commands to each main storage node of the machine room to be migrated, and sequentially stopping the work of each main storage node.
The purpose of stopping the work of each main storage node in sequence is to ensure that the main storage nodes which work normally exist before the completion of the message queue RockettMq migration;
after the capacity expansion of the machine room to be migrated is completed, all the main storage nodes have write permission and the throughput of each production message server is consistent.
And S105, respectively configuring domain name addresses consistent with the configuration nodes of the machine room to be migrated for the configuration nodes of the machine room to be migrated, and finishing smooth migration of the message queue RocktMq.
Optionally, after the smooth migration of the message queue rockmq between the to-be-migrated machine room and the to-be-migrated machine room is completed, the method further includes:
and sending a write forbidding command to each configuration node of the machine room to be migrated, and stopping the work of each configuration node.
Optionally, after the smooth migration of the message queue rockmq between the to-be-migrated machine room and the to-be-migrated machine room is completed, the method further includes:
and when the throughput of each consumption message server of the machine room to be migrated is zero, sending a write forbidding command to each slave storage node of the machine room to be migrated, and stopping the work of each slave storage node.
According to the message queue RocktMq smooth migration method provided by the embodiment of the invention, at least two configuration nodes are established in the machine room to be migrated, corresponding main storage nodes are respectively configured for the at least two configuration nodes, and a header consistent with the main storage node of the machine room to be migrated is respectively configured for each main storage node of the machine room to be migrated, so that smooth migration of the message queue RocktMq is realized under the condition of ensuring no data loss.
In the foregoing embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.
It will be appreciated that the relevant features of the method and apparatus described above are referred to one another. It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
The algorithms and displays presented herein are not inherently related to any particular computer, virtual machine, or other apparatus. Various general purpose systems may also be used with the teachings herein. The required structure for constructing such a system will be apparent from the description above. Moreover, the present invention is not directed to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any descriptions of specific languages are provided above to disclose the best mode of the invention.
In addition, the memory may include volatile memory in a computer readable medium, Random Access Memory (RAM) and/or nonvolatile memory such as Read Only Memory (ROM) or flash memory (flash RAM), and the memory includes at least one memory chip.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
In a typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other identical elements in the process, method, article, or apparatus that comprises the element.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
It should be noted that the above-mentioned embodiments do not limit the present invention in any way, and all technical solutions obtained by using equivalent alternatives or equivalent variations fall within the protection scope of the present invention.
Claims (4)
1. A message queue RockMq smooth migration method is characterized by comprising the following steps:
establishing at least two configuration nodes in a machine room to be migrated;
respectively configuring corresponding main storage nodes for the at least two configuration nodes, wherein one configuration node is associated with one main storage node, and one main storage node is associated with one slave storage node;
configuring titles consistent with the main storage nodes of the machine room to be migrated for each main storage node of the machine room to be migrated respectively;
respectively configuring domain name addresses consistent with the configuration nodes of the machine room to be migrated for each configuration node of the machine room to be migrated;
after the capacity expansion of the machine room to be migrated is completed and before the migration of the message queue RocktMq is completed, write forbidding commands are sequentially sent to each main storage node of the machine room to be migrated, the work of each main storage node is sequentially stopped, and the smooth migration of the message queue RocktMq is completed.
2. The message queue rocktmq smooth migration method according to claim 1, wherein after smooth migration of the message queue rockmq between the room to be migrated and the room to be migrated is completed, the method further includes:
and sending a write forbidding command to each configuration node of the machine room to be migrated, and stopping the work of each configuration node.
3. The message queue rocktmq smooth migration method according to claim 1, wherein after smooth migration of the message queue rockmq between the room to be migrated and the room to be migrated is completed, the method further includes:
and when the throughput of each consumption message server of the machine room to be migrated is zero, sending a write forbidding command to each slave storage node of the machine room to be migrated, and stopping the work of each slave storage node.
4. A computer arrangement comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of claims 1-3 are implemented when the computer program is executed by the processor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911234565.5A CN110989933A (en) | 2019-12-05 | 2019-12-05 | Message queue RockMq smooth migration method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911234565.5A CN110989933A (en) | 2019-12-05 | 2019-12-05 | Message queue RockMq smooth migration method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110989933A true CN110989933A (en) | 2020-04-10 |
Family
ID=70090404
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911234565.5A Pending CN110989933A (en) | 2019-12-05 | 2019-12-05 | Message queue RockMq smooth migration method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110989933A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111897656A (en) * | 2020-08-06 | 2020-11-06 | 北京中电兴发科技有限公司 | Main queue load balancing method based on mirror image queue |
| CN112769924A (en) * | 2020-12-31 | 2021-05-07 | 平安科技（深圳）有限公司 | Distributed deployment method, device, equipment and medium of RocktMQ |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080216094A1 (en) * | 2001-04-30 | 2008-09-04 | The Commonwealth Of Australia | Event handling system |
| CN108256002A (en) * | 2017-12-31 | 2018-07-06 | 广东欧珀移动通信有限公司 | Across computer room method of data synchronization, device, system and server |
| CN108549574A (en) * | 2018-03-12 | 2018-09-18 | 深圳市万普拉斯科技有限公司 | Threading scheduling management method, device, computer equipment and storage medium |
-
2019
- 2019-12-05 CN CN201911234565.5A patent/CN110989933A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080216094A1 (en) * | 2001-04-30 | 2008-09-04 | The Commonwealth Of Australia | Event handling system |
| CN108256002A (en) * | 2017-12-31 | 2018-07-06 | 广东欧珀移动通信有限公司 | Across computer room method of data synchronization, device, system and server |
| CN108549574A (en) * | 2018-03-12 | 2018-09-18 | 深圳市万普拉斯科技有限公司 | Threading scheduling management method, device, computer equipment and storage medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111897656A (en) * | 2020-08-06 | 2020-11-06 | 北京中电兴发科技有限公司 | Main queue load balancing method based on mirror image queue |
| CN111897656B (en) * | 2020-08-06 | 2022-08-16 | 北京中电兴发科技有限公司 | Main queue load balancing method based on mirror image queue |
| CN112769924A (en) * | 2020-12-31 | 2021-05-07 | 平安科技（深圳）有限公司 | Distributed deployment method, device, equipment and medium of RocktMQ |
| CN112769924B (en) * | 2020-12-31 | 2022-04-15 | 平安科技（深圳）有限公司 | Distributed deployment method, device, equipment and medium of RocktMQ |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108389118B (en) | Asset management system, method and device and electronic equipment | |
| US9959337B2 (en) | Independent data processing environments within a big data cluster system | |
| EP3474516B1 (en) | Data processing method and device | |
| US20180218058A1 (en) | Data synchronization method and system | |
| US8738624B1 (en) | Increasing distributed database capacity | |
| CN111953780B (en) | Micro-service gray level publishing method, device, equipment, system and storage medium | |
| US10140194B2 (en) | Storage system transactions | |
| CN104111897A (en) | Data processing method, data processing device and computer system | |
| CN110989933A (en) | Message queue RockMq smooth migration method | |
| US10447763B2 (en) | Distributed storage method and system | |
| CN111880956B (en) | Data synchronization method and device | |
| CN105190581A (en) | Memory sharing over a network | |
| CN108595451A (en) | Service request processing method and device | |
| US11386054B2 (en) | Blockchain-based hierarchical data storage | |
| CN110134503B (en) | Timed task processing method and device in cluster environment and storage medium | |
| CN107920101B (en) | File access method, device and system and electronic equipment | |
| CN102725746B (en) | Method and apparatus for managing memories in distributed computer system | |
| CN106570029B (en) | Data processing method and system for distributed relational database | |
| CN107295063A (en) | Increase the method and reciprocity distributed system of node newly in reciprocity distributed system | |
| CN107422986A (en) | A kind of control device and method of cloud storage system concurrent reading and writing request | |
| CN110674187A (en) | Method for generating global unique serial number | |
| CN110569112B (en) | Log data writing method and object storage daemon device | |
| CN112634975A (en) | Data storage error correction method and device and electronic equipment | |
| CN111324464A (en) | Load distribution method based on micro-service architecture | |
| US10901972B2 (en) | Table partition configuration method, apparatus and system for database system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200410 |
|
| RJ01 | Rejection of invention patent application after publication |