WO2021189283A1 - Method and device for data processing, electronic device, and storage medium - Google Patents

Method and device for data processing, electronic device, and storage medium Download PDF

Info

Publication number
WO2021189283A1
WO2021189283A1 PCT/CN2020/081046 CN2020081046W WO2021189283A1 WO 2021189283 A1 WO2021189283 A1 WO 2021189283A1 CN 2020081046 W CN2020081046 W CN 2020081046W WO 2021189283 A1 WO2021189283 A1 WO 2021189283A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
computer room
memory
time stamp
content
Prior art date
Application number
PCT/CN2020/081046
Other languages
French (fr)
Chinese (zh)
Inventor
汤见乐
郭祥
Original Assignee
深圳市欢太科技有限公司
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市欢太科技有限公司, Oppo广东移动通信有限公司 filed Critical 深圳市欢太科技有限公司
Priority to PCT/CN2020/081046 priority Critical patent/WO2021189283A1/en
Priority to CN202080096825.1A priority patent/CN115104295A/en
Publication of WO2021189283A1 publication Critical patent/WO2021189283A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/42Mailbox-related aspects, e.g. synchronisation of mailboxes

Definitions

  • This application relates to the field of distributed data management technology, and in particular to a data processing method, device, electronic device, and storage medium.
  • the management mode of a multi-active computer room manages a part of data for each computer room or region.
  • the data is written in one computer room first, and then synchronized to other computer rooms.
  • this method writes the same data in multiple computer rooms at the same time, it is impossible to determine which data will prevail, that is, there is a simultaneous write conflict, which affects the stability of the multiple-active computer room.
  • the management mode of a multi-active computer room manages a part of data for each computer room or region.
  • the data is written in one computer room first, and then synchronized to other computer rooms.
  • this method writes the same data in multiple computer rooms at the same time, it is impossible to determine which data will prevail, that is, there is a simultaneous write conflict, which affects the stability of the multiple-active computer room.
  • the first aspect of the embodiments of the present application provides a data processing method, which is applied to a first-level computer room, where the first-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or Multiple secondary computer rooms, the method includes:
  • the second aspect of the embodiments of the present application provides a data processing method, which is applied to a second-level computer room, where the second-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or more In a secondary computer room, the method includes:
  • the first data comes from a first-level computer room, extract the first content and the first time stamp contained in the first data;
  • the third aspect of the embodiments of the present application provides a data processing device, which is applied to a first-level computer room, where the first-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or Multiple secondary computer rooms, the device includes:
  • the first extraction module is configured to extract the first content and the first time stamp contained in the first data when the first data sent by the secondary computer room is received;
  • the second extraction module is configured to extract the second time stamp of the second data if the second data that is the same as the first content exists in the memory of the first-level computer room;
  • the processing module is configured to delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room if the first time stamp is greater than the second time stamp middle.
  • the fourth aspect of the embodiments of the present application provides a data processing device, which is applied to a second-level computer room, where the second-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or Multiple secondary computer rooms, the device includes:
  • the obtaining module is used to obtain the source of the first data to be written when the data is detected to be written;
  • the first extraction module is configured to extract the second time stamp included in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
  • a second extraction module configured to extract a second time stamp included in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
  • a processing module configured to delete the second data in the secondary computer room memory and store the first data in the secondary computer room memory if the first time stamp is greater than the second time stamp middle.
  • the fifth aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program that is stored in the memory and can run on the processor.
  • the processor executes the computer program, The steps in the data processing method provided by the first aspect and the second aspect.
  • the sixth aspect of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the data processing method provided in the first aspect and the second aspect are implemented.
  • the data processing method, device, storage medium, and electronic device provided by the present application include: when receiving first data sent by a secondary computer room, acquiring first content and a first time stamp included in the first data;
  • This method divides the multi-active computer room into a first-level computer room and a second-level computer room.
  • the second-level computer room sends data to the first-level computer room, and the first-level computer room determines which data to save according to the timestamp. When multiple computer rooms are written at the same time, these written data are all sent to the first-level computer room.
  • the received data is saved. If the data with the same content as the received data already exists in the first-level computer room, the time stamp of the data is compared, and the data with a larger time stamp is saved. In this way, the problem of simultaneous write conflicts in multiple computer rooms can be avoided, and the stability of data processing in multiple computer rooms can be improved.
  • Figure 1 is a schematic diagram of the structure of a distributed data management system
  • FIG. 2 is a schematic flowchart of a data processing method provided by an embodiment of the application
  • FIG. 3 is a schematic diagram of another flow of the data processing method provided by an embodiment of the application.
  • FIG. 4 is a schematic structural diagram of a data processing device provided by an embodiment of this application.
  • FIG. 5 is another schematic diagram of the structure of the data processing device provided by an embodiment of the application.
  • FIG. 6 is a schematic diagram of the structure of an electronic device.
  • FIG. 1 shows a schematic structural diagram of a distributed data management system.
  • the data processing method provided in the embodiment of the present application can be applied to the distributed data management system 10 shown in FIG. 1.
  • the distributed data management system 10 includes a first-level computer room 101 and one or more second-level computer rooms 102 (only three are shown in the figure).
  • the first-level computer room 101 is used to receive the synchronized data information of the second-level computer room 102, and synchronize the information to other second-level computer rooms, so as to maintain data consistency.
  • the secondary computer room 102 can receive written data from a local user, and synchronize the written data to the primary computer room 101.
  • the secondary computer room 102 can also receive data synchronized by the primary computer room 101.
  • FIG. 2 is a schematic flow diagram of a data processing method provided in an embodiment of the application.
  • the data processing method is applied to a first-level computer room, and the method includes the following steps:
  • Step 201 When receiving the first data sent by the secondary computer room, extract the first content and the first time stamp included in the first data.
  • the secondary computer room synchronizes the data written by the local user to the primary computer room so that the first-level computer room synchronizes the data Give it to other secondary computer rooms to ensure the consistency of data in the multi-active computer room.
  • the first-level computer room receives the first data sent by the second-level computer room
  • the first-level computer room performs information extraction on the first data before synchronously writing the first data into the memory of the first-level computer room, and extracts the first data.
  • the so-called time stamp refers to a complete, verifiable data that can indicate that a piece of data has existed before a certain time.
  • a timestamp is a piece of data, and the size of the timestamp can reflect the time when a piece of data is generated. Specifically, the larger the timestamp, the later the time when the data is generated.
  • the first data contains the first time stamp information, which indicates that when the data in the secondary computer room is written, the secondary computer room will give the written data a time stamp.
  • Step 202 If there is second data with the same content as the first content in the memory of the first-level computer room, extract the time stamp of the second data.
  • the first content of the received first data after extracting the first content of the received first data, it is retrieved in the memory of the first-level computer room whether there is data with the same content as the first content.
  • the second time stamp of the second data is extracted. It is understandable that since the secondary computer room will give time stamps to the written data when writing data, and the data in the primary computer room is synchronized from the secondary computer room, the primary computer room itself does not have data writing Therefore, the data stored in the memory of the first-level computer room is also data with a time stamp. That is, the second time stamp contained in the second data can be extracted from the second data.
  • Step 203 If the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room.
  • the extracted first time stamp is compared with the second time stamp.
  • the first time stamp is greater than the second time stamp, it means that the generation time of the first data is at the time when the second data is generated. Later.
  • the data generated earlier is deleted from the memory of the first-level computer room, and the data generated later is stored in the memory of the first-level computer room, that is, the first data is stored in the memory.
  • the first timestamp is less than the second timestamp, it means that the generation time of the first data is before the generation time of the second data. Therefore, the second data stored in the first-level computer room is still needed to be saved, so the first-level computer room refuses Writing of the first data.
  • the data processing method includes: when receiving the first data sent by the second-level computer room, extracting the first content and the first time stamp contained in the first data; There is second data with the same content as the first content in the memory, extract the time stamp of the second data; if the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room and store the first data In the memory of the first-level computer room.
  • This method is based on a hierarchical distributed data storage system.
  • the first-level computer room judges the data to be written synchronously according to the content of the data and the time stamp of the data. For data with the same content, It only accepts synchronous writing of data with larger timestamps, thus avoiding data writing conflicts and improving the stability of the multi-active computer room.
  • the method further includes:
  • the first-level computer room after determining that the first data meets the writing condition and storing the first data in the memory of the first-level computer room, the first-level computer room resynchronizes and sends the first data to all the second-level computer rooms, so as to achieve The consistency of the latest data in all computer rooms. It is understandable that the foregoing first data is also synchronized from one of the second-level computer rooms to the first-level computer room.
  • the second-level computer room that sends the first data to the first-level computer room may be referred to as the initial computer room. After the first data is stored in the memory of the first-level computer room, the first data may no longer be synchronously sent to the original computer room by the first-level computer room. Just send it to other secondary computer rooms.
  • the above-mentioned data processing method further includes:
  • the first data is stored in the memory of the first-level computer room to realize data synchronization.
  • the first-level computer room After storing the first data in the memory of the first-level computer room, the first-level computer room sends the first data to all the second-level computer rooms to realize the consistency of the data in all the computer rooms.
  • FIG. 3 another schematic flow chart of the data processing method provided by this embodiment of the application.
  • the data processing method is applied to a secondary computer room, and the method includes the following steps:
  • Step 301 Obtain the source of the first data to be written when the first data write request is detected
  • the source of the first data to be written is acquired.
  • the first data to be written into the second-level computer room can be sent from the first-level computer room to the second-level computer room during data synchronization, or it can be written by a local user in the second-level computer room.
  • Step 302 If the first data comes from a first-level computer room, extract the first content and the first time stamp included in the first data.
  • the first data source is from the first-level computer room
  • the first data is sent to the second-level computer room for data synchronization
  • the first content and the second data contained in the first data A timestamp for extraction.
  • Step 303 If there is second data with the same content as the first content in the memory of the secondary computer room, extract the second time stamp included in the second data.
  • the memory of the secondary computer room is searched for whether there is second data with the same content as the first content based on the first content.
  • the second time stamp included in the second data is extracted.
  • Step 304 If the first time stamp is greater than the second time stamp, delete the second data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room.
  • the first time stamp of the extracted first data is compared with the second time stamp of the second data.
  • the first time stamp is greater than the second time stamp, it indicates that the first data is generated
  • the secondary computer room does not accept the writing of the first data and still retains the first data. Two data. Further, since the second data stored in the second-level computer room will also be synchronized to the first-level computer room, the first-level computer room will update the first data stored in the memory of the first-level computer room to the second data and synchronize the second data to Other secondary computer rooms, so as to achieve data consistency in multi-active computer rooms.
  • the above method also includes:
  • the first data is stored in the memory of the secondary computer room.
  • the above method also includes:
  • the first data source is locally input from the secondary computer room, obtain the third content contained in the first data and generate a third time stamp for the first data;
  • the fifth data is generated.
  • the fifth data includes the third content and the fifth time stamp.
  • the value of the fifth time stamp is equal to the fourth time stamp plus one, and the fifth data is stored in The fifth data is sent to the first-level computer room in the memory of the second-level computer room.
  • the content of the data is obtained, the first data content is determined to be the third content, and the secondary computer room automatically generates the corresponding data according to the time of data input The third timestamp. retrieve whether there is fourth data with the same content as the third content in the memory of the secondary computer room, and if it exists, obtain the fourth time stamp of the fourth data.
  • the third time stamp is greater than the fourth time stamp, delete the fourth data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room, The first data is sent to the first-level computer room so that the first-level computer room can synchronize the data to other second-level computer rooms. If the third time stamp is not greater than the fourth time stamp, then fifth data is generated, the fifth data includes the third content and the fifth time stamp, and the value of the fifth time stamp is equal to the fourth time stamp plus 1.
  • the third time stamp of the input first data is 123456
  • the fourth time stamp of the fourth data stored in the storage of the secondary computer room is 123459, indicating that the fourth data is not input locally but synchronized from the primary computer room
  • the time stamp of the data stored in the secondary computer room may be greater than the time stamp of the same data input locally.
  • the fifth data includes the third content and the fifth time stamp.
  • the fifth data is stored in the memory of the second-level computer room, and the fifth data is sent to the first-level computer room so that the first-level computer room can synchronize the data to other second-level computer rooms.
  • the data processing method provided by the method ensures that the locally input data can be input, and the time stamp of the data can be kept increasing, avoiding data writing conflicts, and can effectively ensure the consistency of the data stored in the multi-active computer room.
  • the above method also includes:
  • the locally input data is stored in the memory of the computer room, and the data is synchronized to the primary computer room.
  • Computer room so that the first-level computer room can synchronize the data to other second-level computer rooms.
  • FIG. 4 this is a schematic structural diagram of a data processing device provided by an embodiment of this application.
  • the data processing device is used in a first-level computer room, and the data processing device includes the following modules:
  • the first extraction module 401 is configured to extract the first content and the first time stamp contained in the first data when the first data sent by the secondary computer room is received;
  • the second extraction module 402 is configured to extract the second time stamp of the second data when the second data that is the same as the first content exists in the memory of the first-level computer room;
  • the processing module 403 is configured to delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room if the first time stamp is greater than the second time stamp.
  • FIG. 5 another schematic diagram of the structure of the data processing device provided in this embodiment of the application.
  • the data processing device is used in a secondary computer room, and the data processing device includes the following modules:
  • the obtaining module 501 is configured to obtain the source of the first data to be written when the first data writing request is detected;
  • the first extraction module 502 is configured to extract the second time stamp contained in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
  • the second extraction module 503 is configured to extract the second time stamp contained in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
  • the processing module 504 is configured to delete the second data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room if the first time stamp is greater than the second time stamp.
  • an embodiment of the present application also provides an electronic device.
  • the electronic device can be used to implement the data processing method in the foregoing embodiment.
  • the electronic device mainly includes:
  • the processor 602 executes the computer program, it implements the data processing method in the foregoing embodiment.
  • the number of processors can be one or more.
  • the memory 601 may be a high-speed random access memory (RAM, Random Access Memory) memory, or a non-volatile memory (non-volatile memory). memory), such as disk storage.
  • RAM Random Access Memory
  • non-volatile memory non-volatile memory
  • memory such as disk storage.
  • the memory 601 is used to store executable program codes, and the processor 602 is coupled with the memory 601.
  • an embodiment of the present application also provides a storage medium
  • the storage medium may be the electronic device provided in the foregoing embodiments
  • the computer-readable storage medium may be the memory in the foregoing embodiment shown in FIG. 6 .
  • a computer program is stored on the storage medium, and when the program is executed by the processor, the data processing method in the foregoing embodiment is implemented.
  • the computer storage medium may also be a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), RAM, magnetic disks or optical disks and other media that can store program codes.
  • the disclosed device and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of modules is only a logical function division, and there may be other divisions in actual implementation, for example, multiple modules or components can be combined or integrated. To another system, or some features can be ignored, or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or modules, and may be in electrical, mechanical or other forms.
  • the modules described as separate components may or may not be physically separate, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or software function modules.
  • the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer readable storage medium.
  • the technical solution of this application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a readable storage.
  • the medium includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present application.
  • the aforementioned readable storage medium includes: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and other media that can store program codes.

Abstract

Provided in the present application are a method and device for data processing, an electronic device, and a storage medium. The method comprises: when first data transmitted by a level-two server room is received, acquiring a first content and a first timestamp that the first data comprises; if second data of which the content is identical to the first content is present in a storage device of a level-one server room, acquiring a second timestamp of the second data; if the first timestamp is greater than the second timestamp, deleting the second data in the storage device of the level-one server room, and storing the first data in the storage device of the level-one server room. The method divides multiple redundant server rooms into the level-one server room and the level-two server room, the level-two server room transmits data to the level-one server room, and the level-one server room determines, on the basis of the timestamps, which data is to be retained. The method effectively avoids a concurrent write conflict for multiple redundant server rooms, and ensures data consistency for the multiple redundant server rooms.

Description

数据处理方法、装置、电子装置及存储介质Data processing method, device, electronic device and storage medium 技术领域Technical field
本申请涉及分布式数据管理技术领域,尤其涉及一种数据处理方法、装置、电子装置及存储介质。This application relates to the field of distributed data management technology, and in particular to a data processing method, device, electronic device, and storage medium.
背景技术Background technique
如今社会已进入互联网、大数据时代,面向互联网用户的企业,做到一定规模后,就必然需要考虑规避单机房故障问题。异地机房多活是解决该问题的有效途径。另外,机房多活还可以提升用户访问速度、降低部署成本等优势。Now that society has entered the era of the Internet and big data, Internet-oriented companies will inevitably need to consider avoiding the problem of single computer room failures after reaching a certain scale. Living more in a remote computer room is an effective way to solve this problem. In addition, more activity in the computer room can also improve user access speed and reduce deployment costs.
目前多活机房的管理模式为每个机房或者地区管理一部分数据,数据在一个机房先行写入,再同步到其他机房。该方法在多个机房同时写入相同数据时,无法确定以哪个数据为准,即存在同时写入冲突,影响多活机房的稳定性。At present, the management mode of a multi-active computer room manages a part of data for each computer room or region. The data is written in one computer room first, and then synchronized to other computer rooms. When this method writes the same data in multiple computer rooms at the same time, it is impossible to determine which data will prevail, that is, there is a simultaneous write conflict, which affects the stability of the multiple-active computer room.
技术问题technical problem
目前多活机房的管理模式为每个机房或者地区管理一部分数据,数据在一个机房先行写入,再同步到其他机房。该方法在多个机房同时写入相同数据时,无法确定以哪个数据为准,即存在同时写入冲突,影响多活机房的稳定性。At present, the management mode of a multi-active computer room manages a part of data for each computer room or region. The data is written in one computer room first, and then synchronized to other computer rooms. When this method writes the same data in multiple computer rooms at the same time, it is impossible to determine which data will prevail, that is, there is a simultaneous write conflict, which affects the stability of the multiple-active computer room.
技术解决方案Technical solutions
本申请实施例第一方面提供了一种数据处理方法,应用于一级机房,所述一级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,所述方法包括:The first aspect of the embodiments of the present application provides a data processing method, which is applied to a first-level computer room, where the first-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or Multiple secondary computer rooms, the method includes:
接收到二级机房发送的第一数据时,提取所述第一数据包含的第一内容及第一时间戳;When receiving the first data sent by the secondary computer room, extract the first content and the first time stamp included in the first data;
若所述一级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据的第二时间戳;If there is second data with the same content as the first content in the memory of the first-level computer room, extract the second time stamp of the second data;
若所述第一时间戳大于所述第二时间戳,删除所述一级机房的存储器中的第二数据并将所述第一数据存储于所述一级机房的存储器中。If the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room.
本申请实施例第二方面提供一种数据处理方法,应用于二级机房,所述二级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,所述方法包括:The second aspect of the embodiments of the present application provides a data processing method, which is applied to a second-level computer room, where the second-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or more In a secondary computer room, the method includes:
检测到数据写入时,获取待写入的第一数据的来源;When data writing is detected, obtain the source of the first data to be written;
若所述第一数据来源自一级机房,提取所述第一数据包含的第一内容以及第一时间戳;If the first data comes from a first-level computer room, extract the first content and the first time stamp contained in the first data;
若所述二级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据包含的第二时间戳;If there is second data with the same content as the first content in the memory of the secondary computer room, extract the second time stamp included in the second data;
若所述第一时间戳大于所述第二时间戳,删除所述二级机房存储器中的所述第二数据并将所述第一数据存储于所述二级机房的存储器中。If the first time stamp is greater than the second time stamp, delete the second data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room.
本申请实施例第三方面提供了一种数据处理装置,应用于一级机房,所述一级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,所述装置包括:The third aspect of the embodiments of the present application provides a data processing device, which is applied to a first-level computer room, where the first-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or Multiple secondary computer rooms, the device includes:
第一提取模块,用于接收到二级机房发送的第一数据时,提取所述第一数据包含的第一内容及第一时间戳;The first extraction module is configured to extract the first content and the first time stamp contained in the first data when the first data sent by the secondary computer room is received;
第二提取模块,用于若所述一级机房的存储器中存在与所述第一内容相同的第二数据时,提取所述第二数据的第二时间戳;The second extraction module is configured to extract the second time stamp of the second data if the second data that is the same as the first content exists in the memory of the first-level computer room;
处理模块,用于若所述第一时间戳大于所述第二时间戳时,删除所述一级机房的存储器中的第二数据并将所述第一数据存储于所述一级机房的存储器中。The processing module is configured to delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room if the first time stamp is greater than the second time stamp middle.
本申请实施例第四方面提供了一种数据处理装置,应用于二级机房,所述二级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,所述装置包括:The fourth aspect of the embodiments of the present application provides a data processing device, which is applied to a second-level computer room, where the second-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or Multiple secondary computer rooms, the device includes:
获取模块,用于检测到数据写入时,获取待写入的第一数据的来源;The obtaining module is used to obtain the source of the first data to be written when the data is detected to be written;
第一提取模块,用于若所述二级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据包含的第二时间戳;The first extraction module is configured to extract the second time stamp included in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
第二提取模块,用于若所述二级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据包含的第二时间戳;A second extraction module, configured to extract a second time stamp included in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
处理模块,用于若所述第一时间戳大于所述第二时间戳,删除所述二级机房存储器中的所述第二数据并将所述第一数据存储于所述二级机房的存储器中。A processing module, configured to delete the second data in the secondary computer room memory and store the first data in the secondary computer room memory if the first time stamp is greater than the second time stamp middle.
本申请第五方面提供了一种电子装置,包括:存储器、处理器以及存储在所述存储器上并可在所述处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现第一方面以及第二方面提供的数据处理方法中的步骤。The fifth aspect of the present application provides an electronic device, including: a memory, a processor, and a computer program that is stored in the memory and can run on the processor. When the processor executes the computer program, The steps in the data processing method provided by the first aspect and the second aspect.
本申请第六方面提供了一种存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现第一方面以及第二方面提供的数据处理方法中的步骤。The sixth aspect of the present application provides a storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the data processing method provided in the first aspect and the second aspect are implemented.
有益效果Beneficial effect
本申请提供的数据处理方法、装置、存储介质及电子装置,方法包括:接收到二级机房发送的第一数据时,获取第一数据包含的第一内容及第一时间戳;The data processing method, device, storage medium, and electronic device provided by the present application include: when receiving first data sent by a secondary computer room, acquiring first content and a first time stamp included in the first data;
若一级机房的存储器中存在内容与第一内容相同的第二数据,获取第二数据的第二时间戳;若第一时间戳大于第二时间戳,删除一级机房的存储器中的第二数据并将第一数据存储于一级机房的存储器中。该方法将多活机房分为一级机房和二级机房,二级机房将数据发送至一级机房,由一级机房根据时间戳确定保存哪一个数据。在多个机房同时写入时,这些写入的数据均发送到一级机房,如果一级机房中不存在与接收到的数据内容相同的数据,则对接收到的数据进行保存。如果一级机房中已经存在与接收到的数据内容相同的数据,则对数据的时间戳进行比对,保存时间戳更大的数据。如此可以避免多机房同时写入冲突问题,提升了多活机房数据处理的稳定性。If there is second data with the same content as the first content in the memory of the first-level computer room, obtain the second time stamp of the second data; if the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room Data and store the first data in the memory of the first-level computer room. This method divides the multi-active computer room into a first-level computer room and a second-level computer room. The second-level computer room sends data to the first-level computer room, and the first-level computer room determines which data to save according to the timestamp. When multiple computer rooms are written at the same time, these written data are all sent to the first-level computer room. If there is no data with the same content as the received data in the first-level computer room, the received data is saved. If the data with the same content as the received data already exists in the first-level computer room, the time stamp of the data is compared, and the data with a larger time stamp is saved. In this way, the problem of simultaneous write conflicts in multiple computer rooms can be avoided, and the stability of data processing in multiple computer rooms can be improved.
附图说明Description of the drawings
图1为一种分布式数据管理系统的结构示意图;Figure 1 is a schematic diagram of the structure of a distributed data management system;
图2为本申请实施例提供的数据处理方法的一种流程示意图;FIG. 2 is a schematic flowchart of a data processing method provided by an embodiment of the application;
图3为本申请实施例提供的数据处理方法的又一流程示意图;FIG. 3 is a schematic diagram of another flow of the data processing method provided by an embodiment of the application;
图4为本申请实施例提供的数据处理装置的一种结构示意图;FIG. 4 is a schematic structural diagram of a data processing device provided by an embodiment of this application;
图5为本申请实施例提供的数据处理装置的又一结构示意图;FIG. 5 is another schematic diagram of the structure of the data processing device provided by an embodiment of the application;
图6为一种电子装置的结构示意图。FIG. 6 is a schematic diagram of the structure of an electronic device.
本发明的实施方式Embodiments of the present invention
为使得本申请的发明目的、特征、优点能够更加的明显和易懂,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而非全部实施例。基于本申请中的实施例,本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the purposes, features, and advantages of the present application more obvious and understandable, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the description The embodiments are only a part of the embodiments of the present application, but not all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative work shall fall within the protection scope of this application.
图1示出了一种分布式数据管理系统的结构示意图,本申请实施例提供的数据处理方法可应用于如图1所示的分布式数据管理系统10中。FIG. 1 shows a schematic structural diagram of a distributed data management system. The data processing method provided in the embodiment of the present application can be applied to the distributed data management system 10 shown in FIG. 1.
如图1所示,分布式数据管理系统10包括一处一级机房101、以及一处或多处二级机房102(图中仅示出3处)。一级机房101用于接收二级机房102同步的数据信息,并将该信息同步至其他二级机房,从而保持数据的一致性。二级机房102可以接收本地用户的写入数据,并将该写入的数据同步至一级机房101。二级机房102还可以接收一级机房101同步过来的数据。As shown in FIG. 1, the distributed data management system 10 includes a first-level computer room 101 and one or more second-level computer rooms 102 (only three are shown in the figure). The first-level computer room 101 is used to receive the synchronized data information of the second-level computer room 102, and synchronize the information to other second-level computer rooms, so as to maintain data consistency. The secondary computer room 102 can receive written data from a local user, and synchronize the written data to the primary computer room 101. The secondary computer room 102 can also receive data synchronized by the primary computer room 101.
基于上述分布式数据管理系统10,为了解决在此类分布式数据管理系统中多个二级机房同时写入相同数据时,存在同时写入冲突,影响机房稳定性的问题,本申请提供了一种数据处理方法,如图2所示为本申请实施例提供的数据处理方法的流程示意图,该数据处理方法应用于一级机房,该方法包括如下步骤:Based on the above-mentioned distributed data management system 10, in order to solve the problem of simultaneous writing conflicts when multiple secondary computer rooms write the same data at the same time in such a distributed data management system, which affects the stability of the computer room, this application provides a A data processing method, as shown in FIG. 2 is a schematic flow diagram of a data processing method provided in an embodiment of the application. The data processing method is applied to a first-level computer room, and the method includes the following steps:
步骤201,接收到二级机房发送的第一数据时,提取第一数据包含的第一内容及第一时间戳。Step 201: When receiving the first data sent by the secondary computer room, extract the first content and the first time stamp included in the first data.
在本申请实施例中,当一个二级机房的本地用户在该二级机房中写入数据后,该二级机房将本地用户写入的数据同步给一级机房以便一级机房将该数据同步给其他二级机房,从而保证多活机房数据的一致性。当一级机房接收到该二级机房发送的第一数据时,一级机房在将该第一数据同步写入至一级机房的存储器中之前,先对该第一数据进行信息提取,提取该一级数据中包含的第一内容以及第一时间戳。所谓时间戳,指一个能表示一份数据在某个特定时间之前已经存在的、完整的、可验证的数据。时间戳为一个数据,时间戳的大小可以反映一个数据产生的时间早晚。具体地,时间戳越大,说明数据产生的时间越晚。第一数据中包含第一时间戳信息,表明二级机房的数据在写入时,二级机房会赋予写入的数据一个时间戳。In this embodiment of the application, after a local user in a secondary computer room writes data in the secondary computer room, the secondary computer room synchronizes the data written by the local user to the primary computer room so that the first-level computer room synchronizes the data Give it to other secondary computer rooms to ensure the consistency of data in the multi-active computer room. When the first-level computer room receives the first data sent by the second-level computer room, the first-level computer room performs information extraction on the first data before synchronously writing the first data into the memory of the first-level computer room, and extracts the first data. The first content and the first time stamp contained in the primary data. The so-called time stamp refers to a complete, verifiable data that can indicate that a piece of data has existed before a certain time. A timestamp is a piece of data, and the size of the timestamp can reflect the time when a piece of data is generated. Specifically, the larger the timestamp, the later the time when the data is generated. The first data contains the first time stamp information, which indicates that when the data in the secondary computer room is written, the secondary computer room will give the written data a time stamp.
步骤202,若一级机房的存储器中存在内容与第一内容相同的第二数据,提取第二数据的时间戳。Step 202: If there is second data with the same content as the first content in the memory of the first-level computer room, extract the time stamp of the second data.
在本申请实施例中,在提取出接收的第一数据的第一内容后,在一级机房的存储器中检索是否存在内容与第一内容相同的数据,若检索到存在内容与第一内容相同的第二数据,提取该第二数据的第二时间戳。可以理解的是,由于二级机房在进行数据写入时均会给写入的数据赋予时间戳,而一级机房中的数据又是从二级机房同步过来,一级机房本身不具备数据写入功能,因此一级机房的存储器中存储的数据也均是具有时间戳的数据。即可以从第二数据中提取出第二数据包含的第二时间戳。In the embodiment of the present application, after extracting the first content of the received first data, it is retrieved in the memory of the first-level computer room whether there is data with the same content as the first content. The second time stamp of the second data is extracted. It is understandable that since the secondary computer room will give time stamps to the written data when writing data, and the data in the primary computer room is synchronized from the secondary computer room, the primary computer room itself does not have data writing Therefore, the data stored in the memory of the first-level computer room is also data with a time stamp. That is, the second time stamp contained in the second data can be extracted from the second data.
步骤203,若第一时间戳大于第二时间戳,删除一级机房的存储器中的第二数据并将第一数据存储于一级机房的存储器中。Step 203: If the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room.
在本申请实施例中,对提取出的第一时间戳与第二时间戳进行比对,当第一时间戳大于第二时间戳时,说明第一数据的生成时间在第二数据的生成时间之后。将在先生成的数据从一级机房的存储器中删除,并将在后生成的数据存储于一级机房的存储器中,即将第一数据存储于存储器中。若第一时间戳小于第二时间戳,则说明第一数据的生成时间在第二数据的生成时间之前,因此需要保存的仍是存储于一级机房中的第二数据,因此一级机房拒绝第一数据的写入。In this embodiment of the application, the extracted first time stamp is compared with the second time stamp. When the first time stamp is greater than the second time stamp, it means that the generation time of the first data is at the time when the second data is generated. Later. The data generated earlier is deleted from the memory of the first-level computer room, and the data generated later is stored in the memory of the first-level computer room, that is, the first data is stored in the memory. If the first timestamp is less than the second timestamp, it means that the generation time of the first data is before the generation time of the second data. Therefore, the second data stored in the first-level computer room is still needed to be saved, so the first-level computer room refuses Writing of the first data.
根据上述描述可知,本申请实施例提供的数据处理方法,方法包括:接收到二级机房发送的第一数据时,提取第一数据包含的第一内容及第一时间戳;若一级机房的存储器中存在内容与第一内容相同的第二数据,提取第二数据的时间戳;若第一时间戳大于第二时间戳,删除一级机房的存储器中的第二数据并将第一数据存储于一级机房的存储器中。本方法基于分级的分布式数据存储系统,二级机房将数据同步至一级机房时,一级机房根据数据的内容以及数据的时间戳对待同步写入的数据进行判断,对于内容相同的数据,仅接受时间戳更大的数据同步写入,从而避免了数据写入冲突,提升了多活机房的稳定性。According to the above description, the data processing method provided by the embodiment of the present application includes: when receiving the first data sent by the second-level computer room, extracting the first content and the first time stamp contained in the first data; There is second data with the same content as the first content in the memory, extract the time stamp of the second data; if the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room and store the first data In the memory of the first-level computer room. This method is based on a hierarchical distributed data storage system. When the second-level computer room synchronizes data to the first-level computer room, the first-level computer room judges the data to be written synchronously according to the content of the data and the time stamp of the data. For data with the same content, It only accepts synchronous writing of data with larger timestamps, thus avoiding data writing conflicts and improving the stability of the multi-active computer room.
进一步地,若第一时间戳大于第二时间戳,删除一级机房的存储器中的第二数据并将第一数据存储于一级机房的存储器中之后,还包括:Further, if the first time stamp is greater than the second time stamp, after deleting the second data in the memory of the first-level computer room and storing the first data in the memory of the first-level computer room, the method further includes:
将第一数据发送至所有二级机房。Send the first data to all secondary computer rooms.
在本申请实施例中,在判定第一数据满足写入条件并将第一数据存储于一级机房的存储器中之后,一级机房将第一数据再同步发送到所有二级机房,如此以实现最新的数据在所有机房中的一致性。可以理解的是,上述第一数据也是由其中的某一个二级机房同步至一级机房中,此处可以称发送上述第一数据给一级机房的二级机房为初始机房。一级机房将第一数据存储至一级机房的存储器中之后也可以不再将第一数据同步发送至初始机房。仅发送给其他二级机房即可。In the embodiment of the present application, after determining that the first data meets the writing condition and storing the first data in the memory of the first-level computer room, the first-level computer room resynchronizes and sends the first data to all the second-level computer rooms, so as to achieve The consistency of the latest data in all computer rooms. It is understandable that the foregoing first data is also synchronized from one of the second-level computer rooms to the first-level computer room. Here, the second-level computer room that sends the first data to the first-level computer room may be referred to as the initial computer room. After the first data is stored in the memory of the first-level computer room, the first data may no longer be synchronously sent to the original computer room by the first-level computer room. Just send it to other secondary computer rooms.
进一步地,上述数据处理方法还包括:Further, the above-mentioned data processing method further includes:
若一级机房的存储器中不存在内容与第一内容相同的第二数据,将第一数据存储于一级机房的存储器中;If the second data with the same content as the first content does not exist in the memory of the first-level computer room, store the first data in the memory of the first-level computer room;
将一级数据发送至所有二级机房。Send first-level data to all second-level computer rooms.
在本申请实施例中,若在一级机房的存储器中检索确定不存在与第一数据内容相同的第二数据,则将第一数据存储至一级机房的存储器中,实现数据的同步。将第一数据存储至一级机房的存储器中之后,一级机房再将第一数据发送到所有二级机房,实现数据在所有机房中的一致。In the embodiment of the present application, if it is determined that there is no second data with the same content as the first data after searching in the memory of the first-level computer room, the first data is stored in the memory of the first-level computer room to realize data synchronization. After storing the first data in the memory of the first-level computer room, the first-level computer room sends the first data to all the second-level computer rooms to realize the consistency of the data in all the computer rooms.
如图3所示,为本申请实施例提供的数据处理方法的又一流程示意图,该数据处理方法应用于二级机房,该方法包括如下步骤:As shown in FIG. 3, another schematic flow chart of the data processing method provided by this embodiment of the application. The data processing method is applied to a secondary computer room, and the method includes the following steps:
步骤301,检测到第一数据写入请求时,获取待写入的第一数据的来源;Step 301: Obtain the source of the first data to be written when the first data write request is detected;
在本申请实施例中,当二级机房检测到有数据写入时,对待写入的第一数据的来源进行获取。待写入二级机房的第一数据可以来源自一级机房进行数据同步时发送至二级机房,也可以来源自二级机房本地用户的写入。In the embodiment of the present application, when the secondary computer room detects that data is written, the source of the first data to be written is acquired. The first data to be written into the second-level computer room can be sent from the first-level computer room to the second-level computer room during data synchronization, or it can be written by a local user in the second-level computer room.
步骤302,若第一数据来源自一级机房,提取第一数据包含的第一内容以及第一时间戳。Step 302: If the first data comes from a first-level computer room, extract the first content and the first time stamp included in the first data.
在本申请实施例中,当确定第一数据来源自一级机房,即上述第一数据为一级机房进行数据同步时发送至二级机房,则对该第一数据包含的第一内容以及第一时间戳进行提取。In the embodiment of the present application, when it is determined that the first data source is from the first-level computer room, that is, when the first data is sent to the second-level computer room for data synchronization, the first content and the second data contained in the first data A timestamp for extraction.
步骤303,若二级机房的存储器中存在内容与第一内容相同的第二数据,提取第二数据包含的第二时间戳。Step 303: If there is second data with the same content as the first content in the memory of the secondary computer room, extract the second time stamp included in the second data.
在本申请实施例中,提取出第一数据的第一内容后,依据此第一内容在该二级机房的存储器中检索是否存在内容与该第一内容相同的第二数据。当检索到该二级机房的存储器中存在内容与该第一内容相同的第二数据时,提取该第二数据包含的第二时间戳。In the embodiment of the present application, after the first content of the first data is extracted, the memory of the secondary computer room is searched for whether there is second data with the same content as the first content based on the first content. When it is retrieved that there is second data with the same content as the first content in the memory of the secondary computer room, the second time stamp included in the second data is extracted.
步骤304,若第一时间戳大于第二时间戳,删除二级机房存储器中的第二数据并将第一数据存储于二级机房的存储器中。Step 304: If the first time stamp is greater than the second time stamp, delete the second data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room.
在本申请实施例中,对提取出的第一数据的第一时间戳与第二数据的第二时间戳进行比对,当第一时间戳大于第二时间戳时,表明第一数据的生成时间晚于第二数据的生成时间,将二级机房的存储器中存储的第二数据删除并将第一数据存储于二级机房的存储器中,即将二级机房存储器中存储的数据更新为第一数据,亦即将一级机房中的第一数据同步至二级机房中。可以理解的是,若第一时间错不大于第二时间戳,表面第一数据的生成时间早于第二数据的生成时间,如此则二级机房不接受第一数据的写入,仍然保留第二数据。进一步地,由于二级机房中存储的第二数据也会同步至一级机房,该一级机房会将一级机房的存储器中存储的第一数据更新为第二数据并将第二数据同步至其他二级机房,从而实现多活机房数据的一致性。In the embodiment of the present application, the first time stamp of the extracted first data is compared with the second time stamp of the second data. When the first time stamp is greater than the second time stamp, it indicates that the first data is generated When the time is later than the generation time of the second data, delete the second data stored in the memory of the secondary computer room and store the first data in the memory of the secondary computer room, that is, update the data stored in the memory of the secondary computer room to the first Data, that is, the first data in the first-level computer room is synchronized to the second-level computer room. It is understandable that if the first time error is not greater than the second time stamp, it appears that the generation time of the first data is earlier than the generation time of the second data. In this case, the secondary computer room does not accept the writing of the first data and still retains the first data. Two data. Further, since the second data stored in the second-level computer room will also be synchronized to the first-level computer room, the first-level computer room will update the first data stored in the memory of the first-level computer room to the second data and synchronize the second data to Other secondary computer rooms, so as to achieve data consistency in multi-active computer rooms.
进一步地,上述方法还包括:Further, the above method also includes:
若二级机房存储器中不存在内容与第一内容相同的第二数据,将第一数据存储于二级机房的存储器中。If the second data with the same content as the first content does not exist in the memory of the secondary computer room, the first data is stored in the memory of the secondary computer room.
在本申请实施例中,当检测到二级机房存储器中不存在内容与一级机房发送的第一数据的内容相同的第二数据,说明第一数据为新数据,因此将此第一数据存储于二级机房的存储器中。In the embodiment of the present application, when it is detected that there is no second data in the storage of the secondary computer room with the same content as the first data sent by the primary computer room, it indicates that the first data is new data, so the first data is stored In the memory of the secondary computer room.
进一步地,上述方法还包括:Further, the above method also includes:
若第一数据来源自二级机房本地输入,获取第一数据包含的第三内容并给第一数据生成第三时间戳;If the first data source is locally input from the secondary computer room, obtain the third content contained in the first data and generate a third time stamp for the first data;
若二级机房的存储器中存在内容与第三内容相同的第四数据,获取第四数据包含的第四时间戳;If there is fourth data with the same content as the third content in the memory of the secondary computer room, obtain the fourth time stamp included in the fourth data;
若第三时间戳大于第四时间戳,删除二级机房存储器中的第四数据并将第一数据存储于二级机房的存储器中,将第一数据发送至一级机房;If the third time stamp is greater than the fourth time stamp, delete the fourth data in the secondary computer room memory and store the first data in the secondary computer room memory, and send the first data to the primary computer room;
若第三时间戳不大于第四时间戳,生成第五数据,第五数据包含第三内容以及第五时间戳,第五时间戳的值等于第四时间戳加一,将第五数据存储于二级机房的存储器中并将第五数据发送至一级机房。If the third time stamp is not greater than the fourth time stamp, the fifth data is generated. The fifth data includes the third content and the fifth time stamp. The value of the fifth time stamp is equal to the fourth time stamp plus one, and the fifth data is stored in The fifth data is sent to the first-level computer room in the memory of the second-level computer room.
在本申请实施例中,若识别确定第一数据来源自二级机房本地输入,则获取数据的内容,确定第一数据内容为第三内容,二级机房自动根据数据输入的时间为数据生成对应的第三时间戳。检索二级机房的存储器中是否存在内容与第三内容相同的第四数据,如果存在,则获取第四数据的第四时间戳。将第三时间错与第四时间戳进行比对,若第三时间戳大于第四时间戳,则删除二级机房存储器中的第四数据并将第一数据存储于二级机房的存储器中,将第一数据发送至一级机房以便一级机房将该数据同步至其他二级机房。若第三时间戳不大于第四时间戳,则生成第五数据,第五数据包含第三内容及第五时间戳,第五时间戳的值等于第四时间戳加1。例如,输入的第一数据的第三时间戳为123456,而存储于二级机房存储器中的第四数据的第四时间戳为123459,说明该第四数据非本地输入而是一级机房同步过来的数据,由于不同二级机房的本地戳存在一定差异,导致存储于二级机房中的数据的时间戳可能大于本地输入相同数据的时间戳。此时确定一个第五时间戳为123459+1=123460,确定第五数据包含第三内容以及第五时间戳。将第五数据存储于二级机房的存储器中,并将该第五数据发送至一级机房以便一级机房将该数据同步至其他二级机房。In this embodiment of the application, if it is identified that the first data source is locally input from the secondary computer room, the content of the data is obtained, the first data content is determined to be the third content, and the secondary computer room automatically generates the corresponding data according to the time of data input The third timestamp. Retrieve whether there is fourth data with the same content as the third content in the memory of the secondary computer room, and if it exists, obtain the fourth time stamp of the fourth data. Compare the third time error with the fourth time stamp, if the third time stamp is greater than the fourth time stamp, delete the fourth data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room, The first data is sent to the first-level computer room so that the first-level computer room can synchronize the data to other second-level computer rooms. If the third time stamp is not greater than the fourth time stamp, then fifth data is generated, the fifth data includes the third content and the fifth time stamp, and the value of the fifth time stamp is equal to the fourth time stamp plus 1. For example, the third time stamp of the input first data is 123456, and the fourth time stamp of the fourth data stored in the storage of the secondary computer room is 123459, indicating that the fourth data is not input locally but synchronized from the primary computer room Because of the certain differences in the local stamps of different secondary computer rooms, the time stamp of the data stored in the secondary computer room may be greater than the time stamp of the same data input locally. At this time, it is determined that a fifth time stamp is 123459+1=123460, and it is determined that the fifth data includes the third content and the fifth time stamp. The fifth data is stored in the memory of the second-level computer room, and the fifth data is sent to the first-level computer room so that the first-level computer room can synchronize the data to other second-level computer rooms.
本方法提供的数据处理方法,保证了本地输入的数据一定可以输入,且可以使得数据的时间戳保持递增,避免了数据写入冲突且可以有效保证多活机房存储的数据的一致性。The data processing method provided by the method ensures that the locally input data can be input, and the time stamp of the data can be kept increasing, avoiding data writing conflicts, and can effectively ensure the consistency of the data stored in the multi-active computer room.
进一步地,上述方法还包括:Further, the above method also includes:
若二级机房的存储器中不存在内容与第三内容相同的第四数据,将第一数据存储于二级机房的存储器中;If the fourth data with the same content as the third content does not exist in the memory of the secondary computer room, store the first data in the memory of the secondary computer room;
将第一数据发送至一级机房。Send the first data to the first-level computer room.
在本申请实施例中,当二级机房本地输入的数据在其存储器中检索不到具有相同内容的数据时,就将本地输入的数据存储于机房的存储器中,并将该数据同步至一级机房,以便一级机房将该数据同步至其他二级机房。In the embodiment of the present application, when the data input locally in the secondary computer room cannot be retrieved in its memory with the same content, the locally input data is stored in the memory of the computer room, and the data is synchronized to the primary computer room. Computer room, so that the first-level computer room can synchronize the data to other second-level computer rooms.
如图4所示,为本申请实施例提供的数据处理装置的结构示意图,该数据处理装置用于一级机房,该数据处理装置包括如下模块:As shown in FIG. 4, this is a schematic structural diagram of a data processing device provided by an embodiment of this application. The data processing device is used in a first-level computer room, and the data processing device includes the following modules:
第一提取模块401,用于接收到二级机房发送的第一数据时,提取第一数据包含的第一内容及第一时间戳;The first extraction module 401 is configured to extract the first content and the first time stamp contained in the first data when the first data sent by the secondary computer room is received;
第二提取模块402,用于若一级机房的存储器中存在与第一内容相同的第二数据时,提取第二数据的第二时间戳;The second extraction module 402 is configured to extract the second time stamp of the second data when the second data that is the same as the first content exists in the memory of the first-level computer room;
处理模块403,用于若第一时间戳大于第二时间戳时,删除一级机房的存储器中的第二数据并将第一数据存储于一级机房的存储器中。The processing module 403 is configured to delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room if the first time stamp is greater than the second time stamp.
可以理解的是,本申请实施例提供的数据处理装置的各模块的功能与图2实施例中记载的各步骤的内容一致,此处不再予以赘述。It can be understood that the functions of the modules of the data processing apparatus provided in the embodiment of the present application are consistent with the content of the steps recorded in the embodiment of FIG. 2, and will not be repeated here.
进一步地,如图5所示,为本申请实施例提供的数据处理装置的又一结构示意图,该数据处理装置用于二级机房,该数据处理装置包括如下模块:Further, as shown in FIG. 5, another schematic diagram of the structure of the data processing device provided in this embodiment of the application. The data processing device is used in a secondary computer room, and the data processing device includes the following modules:
获取模块501,用于检测到第一数据写入请求时,获取待写入的第一数据的来源;The obtaining module 501 is configured to obtain the source of the first data to be written when the first data writing request is detected;
第一提取模块502,用于若二级机房的存储器中存在内容与第一内容相同的第二数据,提取第二数据包含的第二时间戳;The first extraction module 502 is configured to extract the second time stamp contained in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
第二提取模块503,用于若二级机房的存储器中存在内容与第一内容相同的第二数据,提取第二数据包含的第二时间戳;The second extraction module 503 is configured to extract the second time stamp contained in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
处理模块504,用于若第一时间戳大于第二时间戳,删除二级机房存储器中的第二数据并将第一数据存储于二级机房的存储器中。The processing module 504 is configured to delete the second data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room if the first time stamp is greater than the second time stamp.
可以理解的是,本申请实施例提供的数据处理装置的各模块的功能与图3实施例提供的数据处理方法的各步骤的内容相同,此处不再予以赘述。It is understandable that the functions of the modules of the data processing apparatus provided in the embodiment of the present application are the same as the content of the steps of the data processing method provided in the embodiment of FIG. 3, and will not be repeated here.
进一步地,本申请实施例还提供一种电子装置。该电子装置可用于实现前述实施例中的数据处理方法。如图6所示,该电子装置主要包括:Further, an embodiment of the present application also provides an electronic device. The electronic device can be used to implement the data processing method in the foregoing embodiment. As shown in Figure 6, the electronic device mainly includes:
存储器601、处理器602、总线603及存储在存储器601上并可在处理器602上运行的计算机程序,存储器601和处理器602通过总线603连接。处理器602执行该计算机程序时,实现前述实施例中的数据处理方法。其中,处理器的数量可以是一个或多个。A memory 601, a processor 602, a bus 603, and a computer program stored on the memory 601 and capable of running on the processor 602, and the memory 601 and the processor 602 are connected through the bus 603. When the processor 602 executes the computer program, it implements the data processing method in the foregoing embodiment. Among them, the number of processors can be one or more.
存储器601可以是高速随机存取记忆体(RAM,Random Access Memory)存储器,也可为非不稳定的存储器(non-volatile memory),例如磁盘存储器。存储器601用于存储可执行程序代码,处理器602与存储器601耦合。The memory 601 may be a high-speed random access memory (RAM, Random Access Memory) memory, or a non-volatile memory (non-volatile memory). memory), such as disk storage. The memory 601 is used to store executable program codes, and the processor 602 is coupled with the memory 601.
进一步的,本申请实施例还提供了一种存储介质,该存储介质可以是设置于上述各实施例中的电子装置中,该计算机可读存储介质可以是前述图6所示实施例中的存储器。Further, an embodiment of the present application also provides a storage medium, the storage medium may be the electronic device provided in the foregoing embodiments, and the computer-readable storage medium may be the memory in the foregoing embodiment shown in FIG. 6 .
该存储介质上存储有计算机程序,该程序被处理器执行时实现前述实施例中的数据处理方法。进一步的,该计算机可存储介质还可以是U盘、移动硬盘、只读存储器(ROM,Read-Only Memory)、RAM、磁碟或者光盘等各种可以存储程序代码的介质。A computer program is stored on the storage medium, and when the program is executed by the processor, the data processing method in the foregoing embodiment is implemented. Further, the computer storage medium may also be a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), RAM, magnetic disks or optical disks and other media that can store program codes.
在本申请所提供的几个实施例中,应该理解到,所揭露的装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个模块或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或模块的间接耦合或通信连接,可以是电性,机械或其它的形式。In the several embodiments provided in this application, it should be understood that the disclosed device and method may be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of modules is only a logical function division, and there may be other divisions in actual implementation, for example, multiple modules or components can be combined or integrated. To another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or modules, and may be in electrical, mechanical or other forms.
作为分离部件说明的模块可以是或者也可以不是物理上分开的,作为模块显示的部件可以是或者也可以不是物理模块,即可以位于一个地方,或者也可以分布到多个网络模块上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。The modules described as separate components may or may not be physically separate, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
另外,在本申请各个实施例中的各功能模块可以集成在一个处理模块中,也可以是各个模块单独物理存在,也可以两个或两个以上模块集成在一个模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。In addition, each functional module in each embodiment of the present application may be integrated into one processing module, or each module may exist alone physically, or two or more modules may be integrated into one module. The above-mentioned integrated modules can be implemented in the form of hardware or software function modules.
集成的模块如果以软件功能模块的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个可读存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例方法的全部或部分步骤。而前述的可读存储介质包括:U盘、移动硬盘、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a readable storage. The medium includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods in the various embodiments of the present application. The aforementioned readable storage medium includes: U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk and other media that can store program codes.
需要说明的是,对于前述的各方法实施例,为了简便描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请并不受所描述的动作顺序的限制,因为依据本申请,某些步骤可以采用其它顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作和模块并不一定都是本申请所必须的。It should be noted that for the foregoing method embodiments, for simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should know that this application is not limited by the described sequence of actions. Because according to this application, some steps can be performed in other order or at the same time. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the involved actions and modules are not necessarily all required by this application.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其它实施例的相关描述。In the above-mentioned embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.
以上为对本申请所提供的数据处理方法、装置、电子装置及可读存储介质的描述,对于本领域的技术人员,依据本申请实施例的思想,在具体实施方式及应用范围上均会有改变之处,综上,本说明书内容不应理解为对本申请的限制。The above is a description of the data processing method, device, electronic device, and readable storage medium provided by this application. For those skilled in the art, according to the ideas of the embodiments of this application, there will be changes in the specific implementation and the scope of application. In summary, the content of this specification should not be construed as a limitation to this application.

Claims (11)

  1. 一种数据处理方法,应用于一级机房,所述一级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,其特征在于,所述方法包括:A data processing method is applied to a first-level computer room, the first-level computer room is in a distributed data management system, and the distributed data management system includes one first-level computer room and one or more second-level computer rooms, and is characterized in , The method includes:
    接收到二级机房发送的第一数据时,提取所述第一数据包含的第一内容及第一时间戳;When receiving the first data sent by the secondary computer room, extract the first content and the first time stamp included in the first data;
    若所述一级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据的第二时间戳;If there is second data with the same content as the first content in the memory of the first-level computer room, extract the second time stamp of the second data;
    若所述第一时间戳大于所述第二时间戳,删除所述一级机房的存储器中的第二数据并将所述第一数据存储于所述一级机房的存储器中。If the first time stamp is greater than the second time stamp, delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room.
  2. 根据权利要求1所述的数据处理方法,其特征在于,所述若所述第一时间戳大于所述第二时间戳,删除所述一级机房的存储器中的第二数据并将所述第一数据存储于所述一级机房的存储器中之后,还包括:The data processing method according to claim 1, wherein if the first time stamp is greater than the second time stamp, the second data in the memory of the first-level computer room is deleted and the first time After a piece of data is stored in the memory of the first-level computer room, it further includes:
    将所述第一数据发送至所有二级机房。Send the first data to all secondary computer rooms.
  3. 根据权利要求2所述的数据处理方法,其特征在于,所述方法还包括:The data processing method according to claim 2, wherein the method further comprises:
    若所述一级机房的存储器中不存在内容与所述第一内容相同的第二数据,将所述第一数据存储于所述一级机房的存储器中;If there is no second data with the same content as the first content in the memory of the first-level computer room, storing the first data in the memory of the first-level computer room;
    将所述第一数据发送至所有二级机房。Send the first data to all secondary computer rooms.
  4. 一种数据处理方法,应用于二级机房,所述二级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,其特征在于,所述方法包括:A data processing method is applied to a secondary computer room, the secondary computer room is in a distributed data management system, and the distributed data management system includes a primary computer room and one or more secondary computer rooms, and is characterized in , The method includes:
    检测到第一数据写入请求时,获取待写入的第一数据的来源;When the first data write request is detected, obtain the source of the first data to be written;
    若所述第一数据来源自一级机房,提取所述第一数据包含的第一内容以及第一时间戳;If the first data comes from a first-level computer room, extract the first content and the first time stamp contained in the first data;
    若所述二级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据包含的第二时间戳;If there is second data with the same content as the first content in the memory of the secondary computer room, extract the second time stamp included in the second data;
    若所述第一时间戳大于所述第二时间戳,删除所述二级机房存储器中的所述第二数据并将所述第一数据存储于所述二级机房的存储器中。If the first time stamp is greater than the second time stamp, delete the second data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room.
  5. 根据权利要求4所述的数据处理方法,其特征在于,所述方法还包括:The data processing method according to claim 4, wherein the method further comprises:
    若所述二级机房存储器中不存在内容与所述第一内容相同的第二数据,将所述第一数据存储于所述二级机房的存储器中。If the second data with the same content as the first content does not exist in the memory of the secondary computer room, the first data is stored in the memory of the secondary computer room.
  6. 根据权利要求5所述的数据处理方法,其特征在于,所述方法还包括:The data processing method according to claim 5, wherein the method further comprises:
    若所述第一数据来源自所述二级机房本地输入,获取所述第一数据包含的第三内容并给所述第一数据生成第三时间戳;If the first data source is locally input from the secondary computer room, acquiring the third content included in the first data and generating a third time stamp for the first data;
    若所述二级机房的存储器中存在内容与所述第三内容相同的第四数据,获取所述第四数据包含的第四时间戳;If there is fourth data with the same content as the third content in the memory of the secondary computer room, acquiring the fourth time stamp included in the fourth data;
    若所述第三时间戳大于所述第四时间戳,删除所述二级机房存储器中的所述第四数据并将所述第一数据存储于所述二级机房的存储器中,将所述第一数据发送至所述第一机房;If the third time stamp is greater than the fourth time stamp, delete the fourth data in the memory of the secondary computer room and store the first data in the memory of the secondary computer room, and store the Sending the first data to the first computer room;
    若所述第三时间戳不大于所述第四时间戳,生成第五数据,所述第五数据包含所述第三内容以及第五时间戳,所述第五时间戳的值等于所述第四时间戳加一,将所述第五数据存储于所述二级机房的存储器中并将所述第五数据发送至所述一级机房。If the third time stamp is not greater than the fourth time stamp, fifth data is generated, the fifth data includes the third content and a fifth time stamp, and the value of the fifth time stamp is equal to the first time stamp. Four timestamps plus one, store the fifth data in the memory of the secondary computer room and send the fifth data to the primary computer room.
  7. 根据权利要求6所述的数据处理方法,其特征在于,所述方法还包括:The data processing method according to claim 6, wherein the method further comprises:
    若所述二级机房的存储器中不存在内容与所述第三内容相同的第四数据,将所述第一数据存储于所述二级机房的存储器中;If the fourth data with the same content as the third content does not exist in the memory of the secondary computer room, storing the first data in the memory of the secondary computer room;
    将所述第一数据发送至所述一级机房。Sending the first data to the first-level computer room.
  8. 一种数据处理装置,应用于一级机房,所述一级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,其特征在于,所述装置包括:A data processing device is applied to a first-level computer room, the first-level computer room is in a distributed data management system, and the distributed data management system includes a first-level computer room and one or more second-level computer rooms, and is characterized in , The device includes:
    第一提取模块,用于接收到二级机房发送的第一数据时,提取所述第一数据包含的第一内容及第一时间戳;The first extraction module is configured to extract the first content and the first time stamp contained in the first data when the first data sent by the secondary computer room is received;
    第二提取模块,用于若所述一级机房的存储器中存在与所述第一内容相同的第二数据时,提取所述第二数据的第二时间戳;The second extraction module is configured to extract the second time stamp of the second data if the second data that is the same as the first content exists in the memory of the first-level computer room;
    处理模块,用于若所述第一时间戳大于所述第二时间戳时,删除所述一级机房的存储器中的第二数据并将所述第一数据存储于所述一级机房的存储器中。The processing module is configured to delete the second data in the memory of the first-level computer room and store the first data in the memory of the first-level computer room if the first time stamp is greater than the second time stamp middle.
  9. 一种数据处理装置,应用于二级机房,所述二级机房处于分布式数据管理系统,所述分布式数据管理系统包括一处一级机房以及一处或多处二级机房,其特征在于,所述装置包括:A data processing device is applied to a secondary computer room, the secondary computer room is in a distributed data management system, and the distributed data management system includes a primary computer room and one or more secondary computer rooms, and is characterized in , The device includes:
    获取模块,用于检测到第一数据写入请求时,获取待写入的第一数据的来源;The obtaining module is used to obtain the source of the first data to be written when the first data writing request is detected;
    第一提取模块,用于若所述二级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据包含的第二时间戳;The first extraction module is configured to extract the second time stamp included in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
    第二提取模块,用于若所述二级机房的存储器中存在内容与所述第一内容相同的第二数据,提取所述第二数据包含的第二时间戳;A second extraction module, configured to extract a second time stamp included in the second data if there is second data with the same content as the first content in the memory of the secondary computer room;
    处理模块,用于若所述第一时间戳大于所述第二时间戳,删除所述二级机房存储器中的所述第二数据并将所述第一数据存储于所述二级机房的存储器中。A processing module, configured to delete the second data in the secondary computer room memory and store the first data in the secondary computer room memory if the first time stamp is greater than the second time stamp middle.
  10. 一种电子装置,包括:存储器、处理器及存储在所述存储器上并可在所述处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时,实现权利要求1至7中任意一项所述数据处理方法中的步骤。An electronic device, comprising: a memory, a processor, and a computer program stored on the memory and running on the processor, wherein the processor implements claim 1 when the processor executes the computer program Steps in the data processing method described in any one of to 7.
  11. 一种存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时,实现权利要求1至7中的任意一项所述的数据处理方法中的步骤。A storage medium having a computer program stored thereon, wherein the computer program implements the steps in the data processing method of any one of claims 1 to 7 when the computer program is executed by a processor.
PCT/CN2020/081046 2020-03-25 2020-03-25 Method and device for data processing, electronic device, and storage medium WO2021189283A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2020/081046 WO2021189283A1 (en) 2020-03-25 2020-03-25 Method and device for data processing, electronic device, and storage medium
CN202080096825.1A CN115104295A (en) 2020-03-25 2020-03-25 Data processing method, data processing device, electronic device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/081046 WO2021189283A1 (en) 2020-03-25 2020-03-25 Method and device for data processing, electronic device, and storage medium

Publications (1)

Publication Number Publication Date
WO2021189283A1 true WO2021189283A1 (en) 2021-09-30

Family

ID=77889926

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/081046 WO2021189283A1 (en) 2020-03-25 2020-03-25 Method and device for data processing, electronic device, and storage medium

Country Status (2)

Country Link
CN (1) CN115104295A (en)
WO (1) WO2021189283A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114546270A (en) * 2022-02-15 2022-05-27 杭州隆埠科技有限公司 Data storage method and device and electronic equipment
US11695853B1 (en) 2022-04-07 2023-07-04 T-Mobile Usa, Inc. Content management systems providing zero recovery point objective

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006268609A (en) * 2005-03-25 2006-10-05 Fujitsu Ltd File update program and file update method
US20120150796A1 (en) * 2010-12-10 2012-06-14 Sap Ag Transparent Caching of Configuration Data
CN103297529A (en) * 2013-06-06 2013-09-11 浙江大学 Timestamp-based tree structure data synchronization method
CN104202375A (en) * 2014-08-22 2014-12-10 广州华多网络科技有限公司 Method and system for synchronous data
CN105162879A (en) * 2015-09-24 2015-12-16 北京奇虎科技有限公司 Method, device and system for realizing data consistency among plurality of machine rooms
CN105512283A (en) * 2015-12-04 2016-04-20 国网江西省电力公司信息通信分公司 Data quality management and control method and device
CN109831372A (en) * 2019-02-12 2019-05-31 北京云中融信网络科技有限公司 Message synchronization method and instant communicating system

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9705686B2 (en) * 2013-08-22 2017-07-11 Red Hat, Inc. Measuring resource consumption in a multi-tenant platform-as-a-service (PaaS) system
CN110300015A (en) * 2019-05-09 2019-10-01 网宿科技股份有限公司 Method of data synchronization and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006268609A (en) * 2005-03-25 2006-10-05 Fujitsu Ltd File update program and file update method
US20120150796A1 (en) * 2010-12-10 2012-06-14 Sap Ag Transparent Caching of Configuration Data
CN103297529A (en) * 2013-06-06 2013-09-11 浙江大学 Timestamp-based tree structure data synchronization method
CN104202375A (en) * 2014-08-22 2014-12-10 广州华多网络科技有限公司 Method and system for synchronous data
CN105162879A (en) * 2015-09-24 2015-12-16 北京奇虎科技有限公司 Method, device and system for realizing data consistency among plurality of machine rooms
CN105512283A (en) * 2015-12-04 2016-04-20 国网江西省电力公司信息通信分公司 Data quality management and control method and device
CN109831372A (en) * 2019-02-12 2019-05-31 北京云中融信网络科技有限公司 Message synchronization method and instant communicating system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114546270A (en) * 2022-02-15 2022-05-27 杭州隆埠科技有限公司 Data storage method and device and electronic equipment
CN114546270B (en) * 2022-02-15 2024-02-09 杭州隆埠科技有限公司 Data storage method and device and electronic equipment
US11695853B1 (en) 2022-04-07 2023-07-04 T-Mobile Usa, Inc. Content management systems providing zero recovery point objective

Also Published As

Publication number Publication date
CN115104295A (en) 2022-09-23

Similar Documents

Publication Publication Date Title
CN106815218B (en) Database access method and device and database system
CN103530362B (en) A kind of computer data reading/writing method for many copies distributed system
CN110045912A (en) Data processing method and device
CN102955845A (en) Data access method and device as well as distributed database system
CN102272751B (en) Data integrity in a database environment through background synchronization
WO2018137327A1 (en) Data transmission method for host and standby devices, control node, and database system
US11748215B2 (en) Log management method, server, and database system
US20120278429A1 (en) Cluster system, synchronization controlling method, server, and synchronization controlling program
CN106802892A (en) For the method and apparatus of master/slave data consistency verification
WO2021189283A1 (en) Method and device for data processing, electronic device, and storage medium
CN113094430B (en) Data processing method, device, equipment and storage medium
CN105610917B (en) Method and system for realizing synchronous data repair in system
CN113407637A (en) Data synchronization method and device, electronic equipment and storage medium
CN113010549A (en) Data processing method based on remote multi-active system, related equipment and storage medium
US10579604B2 (en) Database system, information processing device, method and medium
CN110196680B (en) Data processing method, device and storage medium
CN108460047B (en) Data synchronization method and device
WO2021212493A1 (en) Data synchronization method and device, data storage system and computer-readable medium
US10572503B2 (en) Database system, information processing device, method and medium
JP6626976B2 (en) High throughput, high reliability data processing system
US11809385B1 (en) Efficient data backup in a distributed storage system
CN116303789A (en) Parallel synchronization method and device for multi-fragment multi-copy database and readable medium
CN113905054A (en) Kudu cluster data synchronization method, device and system based on RDMA
CN107368390B (en) Backup method and device for database logs and server
CN110121712A (en) A kind of blog management method, server and Database Systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20927590

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 01/03/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20927590

Country of ref document: EP

Kind code of ref document: A1