CN105630635A - Data disaster tolerance system and method - Google Patents
Data disaster tolerance system and method Download PDFInfo
- Publication number
- CN105630635A CN105630635A CN201511009851.3A CN201511009851A CN105630635A CN 105630635 A CN105630635 A CN 105630635A CN 201511009851 A CN201511009851 A CN 201511009851A CN 105630635 A CN105630635 A CN 105630635A
- Authority
- CN
- China
- Prior art keywords
- commodity information
- database
- reconciliation
- commodity
- message queue
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
The invention provides a data disaster tolerance system and method. The system comprises a commodity database configured to store commodity information, an operation management center configured to inputting the commodity information to an information sequence when an operation failure of the commodity information is responded and the commodity database cannot be updated, and an information process configured to process the commodity information from the information sequence and send the processed result to the commodity database.
Description
Technical field
The application relates to data processing field, specifically, it relates to a kind of data disaster tolerance system and method.
Background technology
Along with the fast development of ecommerce, the accuracy of commodity information becomes more and more important. Such as, the accuracy of commodity information may have influence on the crucial performance index (KPI) of employee, warehouse-in with the commodity relevant classification system any with outbound and other of storehouse.
In order to prevent user when operating commodity owing to sporadic server is delayed machine and network interrupt procedure and caused commodity information to go wrong (such as, commodity information errors or commodity information dropout etc.), need a kind of data disaster tolerance system and method, to guarantee the completeness and efficiency of commodity information.
Summary of the invention
The present invention provides a kind of data disaster tolerance system and method, it is possible to guarantee the completeness and efficiency of commodity information.
Example embodiment according to the present invention, it provides a kind of data disaster tolerance system, it is possible to comprising: merchandising database, be configured to store commodity information; Operations control center, when being configured to upgrade merchandising database in response to the operation failure to commodity information, puts into message queue by described commodity information; And Message Processing device, it is configured to process the commodity information from message queue, and result is sent to merchandising database.
Described data disaster tolerance system can also comprise: reconciliation database, wherein operations control center is while putting into message queue by described commodity information, described commodity information is stored into reconciliation database, reconciliation scheduling device, is configured to determine whether to exist in reconciliation database the commodity information of the omission not being stored in merchandising database.
Described commodity information can comprise the operation of unique identifier of commodity, the attribute information of commodity and the attribute information to commodity.
Described data disaster tolerance system can also comprise: message queue Distribution Center, is configured to set up multiple message queue, and multiple commodity information is put into described multiple Message Queuing respectively.
Described reconciliation scheduling device can also be configured to, when determining to there is the commodity information omitted, the commodity information of omission is sent to Message Processing device, and the commodity information omitted is processed by Message Processing device, and result is sent to merchandising database.
Described reconciliation scheduling device can be configured to: by regularly the commodity information in reconciliation database and the commodity information in merchandising database being compared, determines whether there is the commodity information of omission.
Described Message Processing device can also be configured to while result is sent to merchandising database, described result is also sent to reconciliation database complete to identify the process of described commodity information, and described reconciliation scheduling device can also be configured to: check whether commodity information has been identified as process and has completed by the commodity information in carousel reconciliation database, it is determined whether there is the commodity information omitted.
Described method can comprise: when cannot upgrade merchandising database in response to the operation failure to commodity information, described commodity information is put into message queue; And process is from the commodity information of message queue, and result is sent to merchandising database.
Described method can also comprise: while described commodity information is put into message queue, and described commodity information is stored into reconciliation database; Determine whether reconciliation database exists the commodity information of omission.
Described commodity information is put into message queue can also comprising: when there is multiple message queue, respectively multiple commodity information being put into each Message Queuing.
Accompanying drawing explanation
Below in conjunction with accompanying drawing, will more know the above-mentioned of the example embodiment of the present invention and other side, feature and advantage, in accompanying drawing:
Fig. 1 shows the data disaster tolerance system of the first example embodiment according to the present invention;
Fig. 2 shows the schema of the data disaster tolerance method of the first example embodiment according to the present invention;
Fig. 3 shows the schema of the data disaster tolerance method of the 2nd example embodiment according to the present invention; And
Fig. 4 shows a kind of implementation according to illustrated embodiments of the invention.
Embodiment
Implement below with reference to the example drawings describing the present invention. The present invention provides a kind of data disaster tolerance system and method, it is possible to guarantee the completeness and efficiency of commodity information.
Specifically, Fig. 1 shows the data disaster tolerance system 100 of the first example embodiment according to the present invention. Described data disaster tolerance system 100 comprises: merchandising database 101, is configured to for store commodity information, the operation of unique identifier of wherein said commodity information commodity, information attribute value and the attribute information to commodity; Operations control center 102, when being configured to upgrade merchandising database 101 in response to the operation failure to commodity information, puts into message queue by described commodity information; And Message Processing device 103, it is configured to process the commodity information from message queue, and result is sent to merchandising database 101.
With reference to figure 2, describe the first embodiment 200 of the data disaster tolerance method that data disaster tolerance system 100 as shown in Figure 1 performs. Specifically, in step 201, when operation failure having occurred as operator when commodity information being operated, described commodity information is put into message queue by operations control center 102, the operation of unique identifier of wherein said commodity information commodity, information attribute value and the attribute information to commodity. In step 202, process the commodity information from message queue via Message Processing device 103, and result is sent to merchandising database 101. Such as, the information attribute value in the commodity information being included in message queue is performed the operation being included in this commodity information equally by Message Processing device 103.
Such as, there are 2 commodity information, one is designated 110221, and one is 119023. When the operation failure of commodity information cannot be upgraded merchandising database 101 by operations control center 102, these two information are put into message queue. Message Processing device 103 processes this two information, and result is sent to merchandising database 101. Like this, commodity information cannot be operated delaying machine (or other reasons) due to operations control center, thus when cannot upgrade merchandising database, complete the operation to commodity information, solve the appearance calamity problem of commodity information.
When the commodity information in message queue is too much, it may occur that the phenomenon of commodity information dropout. In order to prevent omitting commodity information, it is proposed that another implementation. Specifically, Fig. 3 shows data disaster tolerance method 300 according to the second embodiment of the present invention. Except the assembly shown in Fig. 1, reconciliation database and reconciliation scheduling device can also be comprised for realizing the data disaster tolerance system of second embodiment of the invention. Data of description disaster recovery method 300 is carried out below with reference to data disaster tolerance system according to a second embodiment of the present invention. For convenience of description, by omitting, the content identical with the data disaster tolerance method 200 shown in Fig. 2 is described.
First, being similar to the data disaster tolerance method 200 shown in Fig. 2, in step 301, when cannot upgrade merchandising database in response to the operation failure to commodity information, described commodity information is put into message queue by operations control center 102. It is noted that different from data disaster tolerance method 200, now described commodity information is also stored into reconciliation database by operation management center 102. In step 302, Message Processing device 103 processes the commodity information from message queue, and result is sent to merchandising database 101 (or merchandising database and reconciliation database both). In step 303, reconciliation scheduling device determines whether to exist in reconciliation database the commodity information of omission, and the commodity information wherein omitted refers to the commodity information not being stored in merchandising database. Such as, the means of the described commodity information determining whether to exist in reconciliation database omission can comprise: by regularly the commodity information in reconciliation database and the commodity information in merchandising database being compared, determines whether there is the information of omission. Alternatively, Message Processing device 103 can also be configured to that described result is also sent to reconciliation database while result is sent to merchandising database 101 and completes to have identified the process to described commodity information. When configured as such, by the commodity information in carousel reconciliation database, reconciliation scheduling device can check whether commodity information has been identified as process and has completed, it is determined whether there is the commodity information omitted.
When determining to there is the commodity information omitted, in step 304, the commodity information of omission is sent to Message Processing device 103 by reconciliation scheduling device, the commodity information omitted is processed by Message Processing device 103 in step 305, and in step 306, result is sent to merchandising database 101 (or the configuration according to Message Processing device 103, it is possible to be sent to both merchandising database and reconciliation database).
Therefore, it is achieved that a kind of data disaster tolerance method. Described data disaster tolerance method can solve on the basis holding calamity problem, it is ensured that the consistence of data, thus ensures not obliterated data.
In addition, in order to prevent from message queue occurs the situation that commodity information is too much, above-mentioned data disaster tolerance system can also comprise message queue Distribution Center, it is configured to set up multiple message queue, and multiple commodity information is put into described multiple Message Queuing respectively, to guarantee to occur owing to the commodity information in message queue too much omits the phenomenon of data. Specifically, such as, commodity information can be put into different message queues according to the quantity of the commodity information that each the message queue in multiple message queue comprises by message queue Distribution Center. Alternatively, message queue Distribution Center corresponding goods information puts into selectively corresponding commodity queue according to unique identifier of commodity.
Fig. 4 shows a kind of implementation according to illustrated embodiments of the invention. Although showing two merchandising databases in accompanying drawing for convenience of description, these two merchandising databases represent identical merchandising database. Operator when item property is operated, it is easy to the situation of operation failure occurs, and relatively more frequent. When finding that operations control center (OMC) cannot be connected to item property database, by commodity information by being written in message queue, commodity information contains unique identifier, information attribute value, to the operation etc. of information attribute value, such as, in this scheme, having 2 commodity information, one is designated 110221, and one is 119023. When upgrading merchandising database, these two information are sent in message queue by operations control center. On the other hand, described system has Message Processing device, processes the message from message queue, when obtaining the commodity information of 110221, this commodity information can be resolved, and aftertreatment, process after successfully, it is possible to this commodity information related content is stored in merchandising database. This completes the treatment scheme of commodity information updating failure. When the commodity information of message queue extruding is too much, have sporadic loss of learning (here, commodity 119023 due to the commodity information in message queue too much, be dropped). In order to avoid this kind of situation to occur, while commodity information is write message queue, also commodity information is written in reconciliation database, it is noted that, in order to prevent operations control center and merchandising database from delaying machine, it is possible to merchandising database and reconciliation database are separated. In addition, when this commodity information related content is stored in merchandising database by Message Processing device, also result being written in reconciliation database, mark has processed this commodity information. In order to ensure the consistence of data, also performing reconciliation scheduling task, the commodity information being used in carousel reconciliation database record, once find that there is the commodity information lost by message queue, will be found by reconciliation, and processing in time. After process terminates, result can be written to merchandising database, and record reconciliation process information. In addition, in order to prevent the situation of message queue excessive extrusion from occurring (here, commodity 119023 due to the commodity information in message queue too much, it is dropped), message queue Distribution Center is set, set up multiple message queue passage, write based on identifier in batches, reduce the probability that message queue extruding occurs.
Above scheme is only the specific implementation illustrating present inventive concept, the invention is not restricted to above-mentioned implementation. Can omit or skip the part process in above-mentioned implementation, and not depart from the spirit and scope of the present invention.
Method above can be realized with the program command form that can hold by multiple computer device and be recorded in computer readable recording medium storing program for performing. In this case, computer readable recording medium storing program for performing can comprise independent program command, data file, data structure or its combination. Meanwhile, record program command in the recording medium can specialized designs or be configured for the present invention, or technician's known applications of computer software fields. Computer readable recording medium storing program for performing comprises the magnet-optical medium of the magnetic mediums such as such as hard disk, floppy disk or tape, the such as optical medium such as compact disk read-only storage (CD-ROM) or digital universal disc (DVD), such as optomagnetic floppy disk and such as stores and the hardware unit such as the ROM of steering routine order, RAM, flash memory. In addition, program command comprises machine language code and the High-Level Language that can perform with the use of interpretive routine of computer that compiler is formed. Hardware unit above can be configured to operate the operation to perform the present invention as at least one software module, and contrary operation is also the same.
Although illustrate and describe the operation of this paper method with particular order, but the order of the operation of each method can be changed so that specific operation can be performed with phase reverse-order or make it possible to perform specific operation with other operation at least in part simultaneously. In addition, the invention is not restricted to above-mentioned example embodiment, it under the prerequisite not departing from spirit and scope of the present disclosure, can comprise other parts one or more or operation, or omits other parts one or more or operation.
Below show the present invention in conjunction with the preferred embodiments of the present invention, but it will be appreciated by those skilled in the art that, without departing from the spirit and scope of the present invention, it is possible to the present invention is carried out various amendment, replacement and change. Therefore, the present invention should do not limited by above-described embodiment, and should limit by claims and Equivalent thereof.
Claims (10)
1. a data disaster tolerance system, comprising:
Merchandising database, is configured to store commodity information;
Operations control center, when being configured to upgrade merchandising database in response to the operation failure to commodity information, puts into message queue by described commodity information; And
Message Processing device, is configured to process the commodity information from message queue, and result is sent to merchandising database.
2. data disaster tolerance system according to claim 1, also comprises:
Reconciliation database, wherein operations control center is while putting into message queue by described commodity information, and described commodity information is stored into reconciliation database,
Reconciliation scheduling device, is configured to determine whether to exist in reconciliation database the commodity information of the omission not being stored in merchandising database.
3. data disaster tolerance system according to claim 1, the operation of wherein said unique identifier of commodity information commodity, the attribute information of commodity and the attribute information to commodity.
4. data disaster tolerance system according to claim 1, also comprises:
Message queue Distribution Center, is configured to set up multiple message queue, and multiple commodity information is put into described multiple Message Queuing respectively.
5. data disaster tolerance system according to claim 2, wherein said reconciliation scheduling device is also configured to, when determining to there is the commodity information omitted, the commodity information of omission is sent to Message Processing device,
The commodity information omitted is processed by Message Processing device, and result is sent to merchandising database.
6. data disaster tolerance system according to claim 2, wherein said reconciliation scheduling device is configured to:
By regularly the commodity information in reconciliation database and the commodity information in merchandising database being compared, determine whether there is the commodity information of omission.
7. data disaster tolerance system according to claim 2, wherein Message Processing device is also configured to while result is sent to merchandising database, described result is also sent to reconciliation database and completes to identify the process of described commodity information,
Described reconciliation scheduling device is also configured to: check whether commodity information has been identified as process and has completed by the commodity information in carousel reconciliation database, it is determined whether there is the commodity information omitted.
8. a data disaster tolerance method, described method comprises:
When cannot upgrade merchandising database in response to the operation failure to commodity information, described commodity information is put into message queue; And
Process the commodity information from message queue, and result is sent to merchandising database.
9. method according to claim 8, also comprises:
While described commodity information is put into message queue, described commodity information is stored into reconciliation database;
Determine whether reconciliation database exists the commodity information of omission.
10. method according to claim 8, wherein said commodity information is put into message queue also comprise:
When there is multiple message queue, respectively multiple commodity information is put into each Message Queuing.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511009851.3A CN105630635B (en) | 2015-12-29 | 2015-12-29 | Data disaster tolerance system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201511009851.3A CN105630635B (en) | 2015-12-29 | 2015-12-29 | Data disaster tolerance system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN105630635A true CN105630635A (en) | 2016-06-01 |
| CN105630635B CN105630635B (en) | 2019-07-30 |
Family
ID=56045610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201511009851.3A Active CN105630635B (en) | 2015-12-29 | 2015-12-29 | Data disaster tolerance system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105630635B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111953506A (en) * | 2019-05-15 | 2020-11-17 | 北京沃东天骏信息技术有限公司 | Message processing method and system |
| CN114511273A (en) * | 2022-03-16 | 2022-05-17 | 湖南兴盛优选电子商务有限公司 | Retail warehousing management system and method |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100368998C (en) * | 2004-07-23 | 2008-02-13 | 中兴通讯股份有限公司 | Multiple data base data syne method |
| CN101102281B (en) * | 2007-08-16 | 2010-04-07 | 中兴通讯股份有限公司 | Data processing method for reporting a large number of data in mobile communication system |
| CN102971711B (en) * | 2010-07-02 | 2016-06-01 | 国际商业机器公司 | For processing the Apparatus for () and method therefor of batch working cell |
| CN103425658B (en) * | 2012-05-15 | 2017-06-09 | 阿里巴巴集团控股有限公司 | The storage of merchandise news, searching method and mobile terminal and server |
| CN103049317B (en) * | 2013-01-10 | 2016-03-23 | 中国南方电网有限责任公司超高压输电公司 | Based on the high concurrent data no write de-lay system and method for queue under cloud environment |
| CN103209115A (en) * | 2013-04-07 | 2013-07-17 | 北京京东世纪贸易有限公司 | Message sending system |
| CN104243438B (en) * | 2013-06-24 | 2017-08-08 | 阿里巴巴集团控股有限公司 | A kind of db transaction processing method and server |
| CN103856392B (en) * | 2013-06-26 | 2017-05-24 | 上海携程商务有限公司 | Message push method, outgoing server using message push method and outgoing server system |
| CN104252481B (en) * | 2013-06-27 | 2018-10-19 | 阿里巴巴集团控股有限公司 | The dynamic check method and apparatus of master-slave database consistency |
| CN104951852A (en) * | 2014-03-24 | 2015-09-30 | 阿里巴巴集团控股有限公司 | Method and system for processing periodic order information |
| CN103886079B (en) * | 2014-03-26 | 2018-03-30 | 北京京东尚科信息技术有限公司 | A kind of data processing method and system |
| CN104156863B (en) * | 2014-08-08 | 2017-12-22 | 上海携程商务有限公司 | The order processing system and method for OTA websites |
| CN104731912B (en) * | 2015-03-24 | 2017-12-19 | 浪潮集团有限公司 | A kind of message-oriented middleware MQ method for message transmission and device |
-
2015
- 2015-12-29 CN CN201511009851.3A patent/CN105630635B/en active Active
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111953506A (en) * | 2019-05-15 | 2020-11-17 | 北京沃东天骏信息技术有限公司 | Message processing method and system |
| CN114511273A (en) * | 2022-03-16 | 2022-05-17 | 湖南兴盛优选电子商务有限公司 | Retail warehousing management system and method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN105630635B (en) | 2019-07-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8725969B2 (en) | Distributed content storage system supporting different redundancy degrees | |
| US9384202B1 (en) | Gateway module to access different types of databases | |
| JP6097880B2 (en) | Byzantine fault tolerance data replication method and system | |
| US9218133B2 (en) | Data deduplication in a removable storage device | |
| US20120089580A1 (en) | Update management apparatus, update management method, and computer-readable medium storing update management program | |
| US11853279B2 (en) | Data storage using vectors of vectors | |
| US10572335B2 (en) | Metadata recovery method and apparatus | |
| US9087014B1 (en) | Tape backup and restore in a disk storage environment | |
| US20210294514A1 (en) | Removable media based object store | |
| CN105302665A (en) | Improved copy-on-write snapshot method and system | |
| CN105630635A (en) | Data disaster tolerance system and method | |
| US7487172B2 (en) | Three-dimensional data structure for storing data of multiple domains and the management thereof | |
| US9645897B2 (en) | Using duplicated data to enhance data security in RAID environments | |
| CN112364021B (en) | Service data processing method, device and storage medium | |
| JP2018514886A (en) | Aggregate large amounts of time data from many overlapping sources | |
| US9111570B1 (en) | Replication of tape cartridge data | |
| CN103164172A (en) | Data flow storage method and device | |
| CN105892954A (en) | Data storage method and device based on multiple copies | |
| CN109542860B (en) | Service data management method based on HDFS and terminal equipment | |
| JP2018014036A (en) | Database system, data processing program and data processing method | |
| US9778845B2 (en) | File management system | |
| US11061720B2 (en) | Processing system and method of detecting congestion in processing system | |
| JP7326803B2 (en) | Document management device, document management method, and program | |
| US20170061996A1 (en) | Encoding information on tape using write offset gaps | |
| US8422348B2 (en) | Reproducing system for mediums and method for reproducing digital data and identifying the same |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |