CN110622478A - 数据同步处理的方法和装置 - Google Patents
数据同步处理的方法和装置 Download PDFInfo
- Publication number
- CN110622478A CN110622478A CN201880004742.8A CN201880004742A CN110622478A CN 110622478 A CN110622478 A CN 110622478A CN 201880004742 A CN201880004742 A CN 201880004742A CN 110622478 A CN110622478 A CN 110622478A
- Authority
- CN
- China
- Prior art keywords
- thread
- processed
- information
- node
- buffer module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000012545 processing Methods 0.000 title claims abstract description 150
- 238000000034 method Methods 0.000 title claims abstract description 138
- 230000001360 synchronised effect Effects 0.000 title claims description 64
- 230000008569 process Effects 0.000 claims abstract description 68
- 238000003672 processing method Methods 0.000 claims abstract description 14
- 230000015654 memory Effects 0.000 claims description 57
- 238000005259 measurement Methods 0.000 claims description 56
- 238000004590 computer program Methods 0.000 claims description 11
- 238000001514 detection method Methods 0.000 description 50
- 230000000875 corresponding effect Effects 0.000 description 35
- 230000007717 exclusion Effects 0.000 description 24
- 230000006870 function Effects 0.000 description 23
- 230000003139 buffering effect Effects 0.000 description 19
- 238000004422 calculation algorithm Methods 0.000 description 19
- 238000010586 diagram Methods 0.000 description 17
- 230000001960 triggered effect Effects 0.000 description 9
- 230000002596 correlated effect Effects 0.000 description 8
- 238000004891 communication Methods 0.000 description 6
- 230000008859 change Effects 0.000 description 4
- 238000003780 insertion Methods 0.000 description 4
- 230000037431 insertion Effects 0.000 description 4
- 230000007958 sleep Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 101100204393 Arabidopsis thaliana SUMO2 gene Proteins 0.000 description 2
- 101100534673 Arabidopsis thaliana SUMO3 gene Proteins 0.000 description 2
- 101100116390 Schizosaccharomyces pombe (strain 972 / ATCC 24843) ded1 gene Proteins 0.000 description 2
- 101100311460 Schizosaccharomyces pombe (strain 972 / ATCC 24843) sum2 gene Proteins 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 101150112492 SUM-1 gene Proteins 0.000 description 1
- 101150096255 SUMO1 gene Proteins 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000010076 replication Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Hardware Redundancy (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本申请提供了一种数据同步处理方法和装置,应用于计算机系统中的主节点,该计算机系统还包括与主节点连接的备节点,该方法包括:通过第一线程获取第一待处理信息,第一待处理信息为第一数据包或第一指示信息,第一指示信息用于指示第一数据包,其中,第一线程为执行非线程安全代码的线程;通过第一线程将第一待处理信息写入缓冲模块;通过第二线程对第一待处理信息执行一致性协商处理,该一致性协商处理用于同步主节点和备节点处理第一数据包的顺序;根据一致性协商处理的结果通过第一线程处理第一数据包。该方法和装置能够使得主节点在进行主备虚拟机的同步处理时利用主虚拟机处理其它任务,提高主节点的性能。
Description
PCT国内申请,说明书已公开。
Claims (23)
- PCT国内申请,权利要求书已公开。
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2018/082225 WO2019195969A1 (zh) | 2018-04-08 | 2018-04-08 | 数据同步处理的方法和装置 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN110622478A true CN110622478A (zh) | 2019-12-27 |
CN110622478B CN110622478B (zh) | 2020-11-06 |
Family
ID=68162760
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201880004742.8A Active CN110622478B (zh) | 2018-04-08 | 2018-04-08 | 数据同步处理的方法和装置 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN110622478B (zh) |
WO (1) | WO2019195969A1 (zh) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111767339A (zh) * | 2020-05-11 | 2020-10-13 | 北京奇艺世纪科技有限公司 | 一种数据同步方法、装置、电子设备及存储介质 |
CN112954133A (zh) * | 2021-01-20 | 2021-06-11 | 浙江大华技术股份有限公司 | 同步节点时间的方法、装置、电子装置和存储介质 |
CN115454657A (zh) * | 2022-08-12 | 2022-12-09 | 科东(广州)软件科技有限公司 | 一种用户态虚拟机任务间的同步与互斥的方法及装置 |
CN117632799A (zh) * | 2023-12-05 | 2024-03-01 | 合芯科技有限公司 | 数据处理方法、装置、设备及存储介质 |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10860618B2 (en) | 2017-09-25 | 2020-12-08 | Splunk Inc. | Low-latency streaming analytics |
US10997180B2 (en) | 2018-01-31 | 2021-05-04 | Splunk Inc. | Dynamic query processor for streaming and batch queries |
US10936585B1 (en) | 2018-10-31 | 2021-03-02 | Splunk Inc. | Unified data processing across streaming and indexed data sets |
US11238048B1 (en) | 2019-07-16 | 2022-02-01 | Splunk Inc. | Guided creation interface for streaming data processing pipelines |
CN111352944B (zh) * | 2020-02-10 | 2023-08-18 | 北京百度网讯科技有限公司 | 数据处理方法、装置、电子设备与存储介质 |
US11614923B2 (en) | 2020-04-30 | 2023-03-28 | Splunk Inc. | Dual textual/graphical programming interfaces for streaming data processing pipelines |
CN112714185B (zh) * | 2020-12-30 | 2022-03-18 | 威创集团股份有限公司 | 一种接入坐席系统 |
US20220245156A1 (en) | 2021-01-29 | 2022-08-04 | Splunk Inc. | Routing data between processing pipelines via a user defined data stream |
US11687487B1 (en) * | 2021-03-11 | 2023-06-27 | Splunk Inc. | Text files updates to an active processing pipeline |
US11663219B1 (en) | 2021-04-23 | 2023-05-30 | Splunk Inc. | Determining a set of parameter values for a processing pipeline |
US11989592B1 (en) | 2021-07-30 | 2024-05-21 | Splunk Inc. | Workload coordinator for providing state credentials to processing tasks of a data processing pipeline |
CN115643237B (zh) * | 2022-10-13 | 2023-08-11 | 北京华建云鼎科技股份公司 | 一种用于会议的数据处理系统 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101609419A (zh) * | 2009-06-29 | 2009-12-23 | 北京航空航天大学 | 虚拟机持续在线迁移的数据备份方法及装置 |
CN102279766A (zh) * | 2011-08-30 | 2011-12-14 | 华为技术有限公司 | 并行模拟多个处理器的方法及系统、调度器 |
CN103678024A (zh) * | 2012-09-18 | 2014-03-26 | 横河电机株式会社 | 容错系统和用于执行容错的方法 |
CN104683444A (zh) * | 2015-01-26 | 2015-06-03 | 电子科技大学 | 一种数据中心多虚拟机的数据迁移方法 |
CN104915151A (zh) * | 2015-06-02 | 2015-09-16 | 杭州电子科技大学 | 多虚拟机系统中一种主动共享的内存超量分配方法 |
CN106168885A (zh) * | 2016-07-18 | 2016-11-30 | 浪潮(北京)电子信息产业有限公司 | 一种基于lvm的逻辑卷动态扩容的方法及系统 |
US9740563B2 (en) * | 2013-05-24 | 2017-08-22 | International Business Machines Corporation | Controlling software processes that are subject to communications restrictions by freezing and thawing a computational process in a virtual machine from writing data |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101773166B1 (ko) * | 2011-02-21 | 2017-08-30 | 삼성전자주식회사 | 가상 머신 스케줄 시점 조절 장치 및 방법 |
CN103309858B (zh) * | 2012-03-06 | 2016-04-13 | 深圳市腾讯计算机系统有限公司 | 一种多线程日志管理的方法及装置 |
CN103501290B (zh) * | 2013-09-18 | 2017-10-24 | 万达信息股份有限公司 | 一种基于动态备份虚拟机的高可靠服务系统构建方法 |
CN105224391B (zh) * | 2015-10-12 | 2018-10-12 | 浪潮(北京)电子信息产业有限公司 | 一种虚拟机的在线备份方法及系统 |
CN105607962B (zh) * | 2015-10-22 | 2019-03-19 | 华为技术有限公司 | 一种虚拟机备份的方法和装置 |
CN107729129A (zh) * | 2017-09-18 | 2018-02-23 | 惠州Tcl移动通信有限公司 | 一种基于同步锁的多线程处理方法、终端以及存储介质 |
-
2018
- 2018-04-08 CN CN201880004742.8A patent/CN110622478B/zh active Active
- 2018-04-08 WO PCT/CN2018/082225 patent/WO2019195969A1/zh active Application Filing
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101609419A (zh) * | 2009-06-29 | 2009-12-23 | 北京航空航天大学 | 虚拟机持续在线迁移的数据备份方法及装置 |
CN102279766A (zh) * | 2011-08-30 | 2011-12-14 | 华为技术有限公司 | 并行模拟多个处理器的方法及系统、调度器 |
CN103678024A (zh) * | 2012-09-18 | 2014-03-26 | 横河电机株式会社 | 容错系统和用于执行容错的方法 |
US9740563B2 (en) * | 2013-05-24 | 2017-08-22 | International Business Machines Corporation | Controlling software processes that are subject to communications restrictions by freezing and thawing a computational process in a virtual machine from writing data |
CN104683444A (zh) * | 2015-01-26 | 2015-06-03 | 电子科技大学 | 一种数据中心多虚拟机的数据迁移方法 |
CN104915151A (zh) * | 2015-06-02 | 2015-09-16 | 杭州电子科技大学 | 多虚拟机系统中一种主动共享的内存超量分配方法 |
CN106168885A (zh) * | 2016-07-18 | 2016-11-30 | 浪潮(北京)电子信息产业有限公司 | 一种基于lvm的逻辑卷动态扩容的方法及系统 |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111767339A (zh) * | 2020-05-11 | 2020-10-13 | 北京奇艺世纪科技有限公司 | 一种数据同步方法、装置、电子设备及存储介质 |
CN111767339B (zh) * | 2020-05-11 | 2023-06-30 | 北京奇艺世纪科技有限公司 | 一种数据同步方法、装置、电子设备及存储介质 |
CN112954133A (zh) * | 2021-01-20 | 2021-06-11 | 浙江大华技术股份有限公司 | 同步节点时间的方法、装置、电子装置和存储介质 |
CN112954133B (zh) * | 2021-01-20 | 2023-03-14 | 浙江大华技术股份有限公司 | 同步节点时间的方法、装置、电子装置和存储介质 |
CN115454657A (zh) * | 2022-08-12 | 2022-12-09 | 科东(广州)软件科技有限公司 | 一种用户态虚拟机任务间的同步与互斥的方法及装置 |
CN117632799A (zh) * | 2023-12-05 | 2024-03-01 | 合芯科技有限公司 | 数据处理方法、装置、设备及存储介质 |
Also Published As
Publication number | Publication date |
---|---|
CN110622478B (zh) | 2020-11-06 |
WO2019195969A1 (zh) | 2019-10-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN110622478B (zh) | 数据同步处理的方法和装置 | |
WO2017008675A1 (zh) | 一种用于虚拟化环境下传输数据的方法与设备 | |
US20190370223A1 (en) | Blockchain-based data migration method and apparatus | |
JP6557323B2 (ja) | データベース障害時のデータ記憶 | |
CN112596960B (zh) | 一种分布式存储服务切换方法及装置 | |
US8910160B1 (en) | Handling of virtual machine migration while performing clustering operations | |
US9798639B2 (en) | Failover system and method replicating client message to backup server from primary server | |
WO2018049873A1 (zh) | 一种应用调度方法及装置 | |
US20140215176A1 (en) | Memory allocation control method, recording medium, and information processing device | |
US11675622B2 (en) | Leader election with lifetime term | |
CN107291527B (zh) | 预拷贝迁移停止预判方法及装置 | |
US20140068165A1 (en) | Splitting a real-time thread between the user and kernel space | |
US20160203030A1 (en) | Load calculation method, load calculation program, and load calculation apparatus | |
US20170054803A1 (en) | Information processing device, method, and system | |
US20190114284A1 (en) | Memory access broker system with application-controlled early write acknowledgment support | |
CN114564435A (zh) | 异构多核芯片的核间通信方法、装置及介质 | |
CN114928579A (zh) | 数据处理方法、装置、计算机设备及存储介质 | |
JP2015530679A (ja) | 高効率アトミック演算を使用した方法および装置 | |
JP6523707B2 (ja) | ラップ読出しから連続読出しを行うメモリサブシステム | |
CN110209548B (zh) | 服务控制方法、系统、电子设备及计算机可读存储介质 | |
WO2015139327A1 (zh) | 失效切换方法、装置和系统 | |
CN116304390B (zh) | 时序数据处理方法、装置、存储介质及电子设备 | |
Li et al. | Predictable communication and migration in the Quest-V separation kernel | |
CN111488373A (zh) | 用于处理请求的方法和系统 | |
US11669516B2 (en) | Fault tolerance for transaction mirroring |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20220209 Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province Patentee after: Huawei Cloud Computing Technologies Co.,Ltd. Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen Patentee before: HUAWEI TECHNOLOGIES Co.,Ltd. |
|
TR01 | Transfer of patent right |