CN107395415A - A kind of data processing method and system - Google Patents
A kind of data processing method and system Download PDFInfo
- Publication number
- CN107395415A CN107395415A CN201710595927.8A CN201710595927A CN107395415A CN 107395415 A CN107395415 A CN 107395415A CN 201710595927 A CN201710595927 A CN 201710595927A CN 107395415 A CN107395415 A CN 107395415A
- Authority
- CN
- China
- Prior art keywords
- server
- interchanger
- storage system
- data
- cluster
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/0654—Management of faults, events, alarms or notifications using network fault recovery
- H04L41/0663—Performing the actions predefined by failover planning, e.g. switching to standby network elements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/16—Error detection or correction of the data by redundancy in hardware
- G06F11/20—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements
- G06F11/202—Error detection or correction of the data by redundancy in hardware using active fault-masking, e.g. by switching out faulty elements or by switching in spare elements where processing functionality is redundant
- G06F11/2023—Failover techniques
- G06F11/2033—Failover techniques switching over of hardware resources
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/25—Routing or path finding in a switch fabric
- H04L49/252—Store and forward routing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/104—Peer-to-peer [P2P] networks
- H04L67/1044—Group management mechanisms
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application provides a kind of data processing method and system.Data handling system includes cluster, interchanger and the storage system being made up of multiple servers, wherein the cluster uses Microsoft Cluster Service technologies, local disk of the storage system as each server in the cluster.Method includes：First server sends data processing request and is forwarded to the storage system to the interchanger, and via the interchanger；The first server is any server in the cluster；The storage system responds the data processing request, response results is sent to the interchanger, and be forwarded to the first server via the interchanger.The application proposes the technical scheme that storage system is combined with MSCS technologies, for whole cluster system, is not only able to realize the high availability of data, and also reduce the input and maintenance cost of enterprise.
Description
Technical field
The application is related to field of computer technology, more particularly to a kind of data processing method and system.
Background technology
In the reading of data or ablation process, if server fail or pause, data will be unable to normally read
Or storage, therefore, industry releases cluster software, single node failure can be avoided by such software or delay machine when, ensure data
Still it can be accessed or store.
However, the deployment and maintenance of this cluster environment, for some medium-sized and small enterprises, not only add input cost, and
And the maintenance cost in later stage also increased.
The content of the invention
In view of this, the application provides a kind of data processing method and system, to reduce cluster environment deployment and safeguard
Cost.Technical scheme is as follows：
One side based on the application, the application provides a kind of data processing method, described applied to data handling system
Data handling system includes cluster, interchanger and the storage system being made up of multiple servers, wherein the cluster uses
Microsoft Cluster Service technologies, local disk of the storage system as each server in the cluster；Methods described bag
Include：
First server sends data processing request and is forwarded to the storage to the interchanger, and via the interchanger
System；The first server is any server in the cluster；
The storage system responds the data processing request, and response results are sent to the interchanger, and via institute
State interchanger and be forwarded to the first server.
Preferably, when the first server breaks down or delayed machine, methods described further comprises：
Handover mechanism is started based on the Microsoft Cluster Services technology, by all moneys in the first server
Source switches to second server, and the second server is to be different from the first server in the cluster, and with described the
Any server of one server redundancy；
The second server sends the data processing request to the interchanger, and is forwarded via the interchanger
To the storage system；
The storage system responds the data processing request, and response results are sent to the interchanger, and via institute
State interchanger and be forwarded to the second server.
Preferably, the data processing request includes data read request；The storage system responds the data processing
Request, response results, which are sent to the interchanger, to be included：
The storage system searches target data, the target data is sent to institute according to the data read request
State interchanger.
Preferably, the data processing request includes data write request；The storage system responds the data processing
Request, response results, which are sent to the interchanger, to be included：
The storage system is written into data write-in designated storage area, will write according to the data write request
Result is completed to send to the interchanger.
Another aspect based on the application, the application also provide a kind of data handling system, the data handling system bag
The cluster being made up of multiple servers, interchanger and storage system are included, the cluster uses Microsoft Cluster Service technologies,
Local disk of the storage system as each server in the cluster；
First server in the cluster is used to send data processing request to the interchanger；The first server
For any server in the cluster；
The interchanger is used to the data processing request being forwarded to the storage system；
The storage system is used to respond the data processing request, and response results are sent to the interchanger；
The interchanger is additionally operable to the response results being forwarded to the first server.
Preferably, when the first server breaks down or delayed machine, the data handling system is used for, based on described
Microsoft Cluster Services technology starts handover mechanism, by all resource switch in the first server to second service
Device, the second server are be different from the first server in the cluster, and with times of the first server redundancy
One server；
The second server is used to send the data processing request to the interchanger；
The interchanger is used to the data processing request being forwarded to the storage system；
The storage system is used to respond the data processing request, and response results are sent to the interchanger；
The interchanger is additionally operable to the response results being forwarded to the second server.
Preferably, the data processing request includes data read request；The storage system is used to respond the data
Processing request, response results, which are sent to the interchanger, to be included：
The storage system searches target data, the target data is sent to institute according to the data read request
State interchanger.
Preferably, the data processing request includes data write request；The storage system is used to respond the data
Processing request, response results, which are sent to the interchanger, to be included：
The storage system is written into data write-in designated storage area, will write according to the data write request
Result is completed to send to the interchanger.
In data processing method and system that the application provides, data handling system includes the group being made up of multiple servers
Collection, interchanger and storage system, wherein cluster use MSCS (Microsoft Cluster Service, Microsoft clusters
Service) technology, local disk of the storage system as each server in cluster.The application proposes storage system and MSCS technologies
The technical scheme being combined, for whole cluster system, it is not only able to realize the high availability of data, and also reduces
The input and maintenance cost of enterprise.
Brief description of the drawings
, below will be to embodiment or existing in order to illustrate more clearly of the embodiment of the present application or technical scheme of the prior art
There is the required accompanying drawing used in technology description to be briefly described, it should be apparent that, drawings in the following description are only this
The embodiment of application, for those of ordinary skill in the art, on the premise of not paying creative work, can also basis
The accompanying drawing of offer obtains other accompanying drawings.
Fig. 1 is a kind of structural representation for data handling system that the application provides；
Fig. 2 is a kind of flow chart for data processing method that the application provides；
Fig. 3 is a kind of timing diagram for method for reading data that the application provides；
Fig. 4 is a kind of timing diagram for method for writing data that the application provides；
Fig. 5 is the flow chart for another data processing method that the application provides.
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present application, the technical scheme in the embodiment of the present application is carried out clear, complete
Site preparation describes, it is clear that described embodiment is only some embodiments of the present application, rather than whole embodiments.It is based on
Embodiment in the application, those of ordinary skill in the art are obtained every other under the premise of creative work is not made
Embodiment, belong to the scope of the application protection.
As shown in figure 1, the structural representation of the data handling system provided it illustrates the application.The number that the application provides
Cluster system or cluster environment can be also referred to as according to processing system, is specifically included：The cluster 100 that is made up of multiple servers, exchange
Machine 200 and storage system 300.Wherein cluster 100 is using Microsoft Cluster Services (MSCS, Microsoft Cluster
Service) technology, storage system 300 establish mapping relations with each server in cluster 100 respectively, as each in cluster 100
A shared local disk of server.
The application, which innovates, to be proposed, MSCS technologies is combined with storage system 300 so that each server in cluster 100
Shared memory systems 300.In the application practical application, application program is installed on multiple servers in MSCS, but it is in office
One moment, application program are only on line state on one node., will when application program failure or server outage
The application program is transferred to restarting on other available nodes (this process is referred to as " failure transfer "), so as to farthest
Ensure normal reading, the write-in of data, improve the high availability of data.And for whole cluster system, without pin respectively
The memory capacity of the local disk of each server in cluster is accounted for and designed, developer is reduced and writes identification cluster
The difficulty of application program in system, so as to reduce the design cost of cluster system, that is, reduce enterprise input and safeguard into
This.
The data handling system provided based on the application, the application also provide a kind of data processing method, as shown in Fig. 2
Method includes：
Step 201, first server sends data processing request to interchanger, and is forwarded to storage system via interchanger
System.
Wherein, first server is any server in cluster 100.
Step 202, storage system responds the data processing request, and response results are sent to interchanger, and via friendship
Change planes and be forwarded to first server.
Below, applicant will be respectively that data read request and data write request illustrate with data processing request.
As shown in figure 3, a kind of timing diagram of the method for reading data provided it illustrates the application, including：
Step 301, first server sends data read request to interchanger.
Wherein data read request includes the information such as the address of data to be read, mark.
Step 302, data read request is forwarded to storage system by interchanger.
Step 303, after storage system receives data read request, according to data read request, target data is searched.
Step 304, storage system sends the target data found to interchanger.
After storage system receives data read request, the address of the data to be read included according to data read request,
The information searching target datas such as mark, and then the target data found is sent to interchanger.
Step 305, target data is forwarded to first server by interchanger.
As shown in figure 4, a kind of timing diagram of the method for writing data provided it illustrates the application, including：
Step 401, first server sends data write request to interchanger.
Wherein data write request includes data to be written, can also include the information such as the storage address of data to be written.
Step 402, interchanger writes data into request and is forwarded to storage system.
Step 403, after storage system receives data write request, it is written into data write-in designated storage area.
After storage system receives data write request, if data write request includes the storage of data to be written
Location, then it is written into data and writes storage region corresponding to the storage address, if does not include in data write request to be written
The storage address of data, then it can be written into the storage region given tacit consent in data write-in storage system.
Step 404, storage system will write completion result and send to interchanger.
Storage system is completed result after the storage of data to be written is completed, by write-in and sent to interchanger.
Step 405, interchanger will write completion result and be forwarded to first server.
Step 406, first server receives write-in and completes result, determines that data to be written successfully complete write-in.
Above example is based on each server in cluster 100 and is in normal operating conditions, and works as some server, such as
First server breaks down, and (including the application program in first server breaks down or first server breaks down in itself
Deng) or first server delay machine when, the application provide data processing method further comprise, as shown in Figure 5：
Step 501, handover mechanism is started based on MSCS technologies, by all resource switch in first server to the second clothes
Be engaged in device, the second server is to be different from first server in cluster, and with any server of first server redundancy.
After starting handover mechanism based on MSCS technologies, startup separator transfer process inside cluster system, by first server
On all resources, including application program switches to second server.
It should be noted that it is highly developed based on the failover method prior art that MSCS technologies are realized, specifically may be used
Refering to http://baike.baidu.com/linkUrl=5egqoiGa-S1sdnW22WR9uK5p6Wq9VKjSxUFQWstx
QB-hWUnFKjaQEzozazLyg5Xldj8Wyn_2LiuKUAxYA8ELB_, herein applicant repeat no more.
Step 502, second server sends the data processing request to interchanger, and is forwarded to and deposits via interchanger
Storage system.
Step 503, storage system responds the data processing request, and response results are sent to interchanger, and via friendship
Change planes and be forwarded to second server.
Unlike previous embodiment, in the present embodiment, when first server breaks down or delayed machine, first server
When can not be communicated, data handling system can trigger handover mechanism automatically, by all resource switch in first server extremely
Second server, first server is replaced to complete the relevant treatment of data by second server.Wherein, second server is sent
Data read request or data write request send data read request to the follow-up implementation process of interchanger with first server
Or the follow-up implementation process of data write request to interchanger duplicates.For foregoing Fig. 3, Fig. 4, then the present embodiment simply will figure
3rd, the first server in Fig. 4 changes second server into.
The data processing method and system provided using the application, data handling system include what is be made up of multiple servers
Cluster, interchanger and storage system, wherein cluster use MSCS technologies, local of the storage system as each server in cluster
Disk.The application proposes the technical scheme that storage system is combined with MSCS technologies, for whole cluster system, not only can
The high availability of data is enough realized, and also reduces the input and maintenance cost of enterprise.
It should be noted that herein, such as first and second or the like relational terms are used merely to a reality
Body or operation make a distinction with another entity or operation, and not necessarily require or imply and deposited between these entities or operation
In any this actual relation or order.Moreover, term " comprising ", "comprising" or its any other variant are intended to
Nonexcludability includes, so that process, method, article or equipment including a series of elements not only will including those
Element, but also the other element including being not expressly set out, or it is this process, method, article or equipment also to include
Intrinsic key element.In the absence of more restrictions, the key element limited by sentence "including a ...", it is not excluded that
Other identical element also be present in process, method, article or equipment including the key element.
A kind of data processing method and system provided herein are described in detail above, it is used herein
Specific case is set forth to the principle and embodiment of the application, and the explanation of above example is only intended to help and understands this
The method and its core concept of application；Meanwhile for those of ordinary skill in the art, according to the thought of the application, specific
There will be changes in embodiment and application, in summary, this specification content should not be construed as to the application's
Limitation.
Claims (8)
1. a kind of data processing method, applied to data handling system, it is characterised in that the data handling system is included by more
Cluster, interchanger and the storage system that individual server is formed, wherein the cluster uses Microsoft Cluster Service technologies, institute
State local disk of the storage system as each server in the cluster；Methods described includes：
First server sends data processing request to the interchanger, and is forwarded to the storage via the interchanger and is
System；The first server is any server in the cluster；
The storage system responds the data processing request, and response results are sent to the interchanger, and via the friendship
Change planes and be forwarded to the first server.
2. according to the method for claim 1, it is characterised in that when the first server breaks down or delayed machine, institute
The method of stating further comprises：
Handover mechanism is started based on the Microsoft Cluster Services technology, all resources in the first server are cut
Second server is shifted to, the second server is to be different from the first server in the cluster, and is taken with described first
Any server for device redundancy of being engaged in；
The second server sends the data processing request to the interchanger, and is forwarded to institute via the interchanger
State storage system；
The storage system responds the data processing request, and response results are sent to the interchanger, and via the friendship
Change planes and be forwarded to the second server.
3. method according to claim 1 or 2, it is characterised in that the data processing request includes data read request；
The storage system responds the data processing request, and response results, which are sent to the interchanger, to be included：
The storage system searches target data, the target data is sent to the friendship according to the data read request
Change planes.
4. method according to claim 1 or 2, it is characterised in that the data processing request includes data write request；
The storage system responds the data processing request, and response results, which are sent to the interchanger, to be included：
The storage system is written into data write-in designated storage area, write-in is completed according to the data write request
As a result send to the interchanger.
A kind of 5. data handling system, it is characterised in that the data handling system include be made up of multiple servers cluster,
Interchanger and storage system, the cluster use Microsoft Cluster Service technologies, and the storage system is as in the cluster
The local disk of each server；
First server in the cluster is used to send data processing request to the interchanger；The first server is institute
State any server in cluster；
The interchanger is used to the data processing request being forwarded to the storage system；
The storage system is used to respond the data processing request, and response results are sent to the interchanger；
The interchanger is additionally operable to the response results being forwarded to the first server.
6. system according to claim 5, it is characterised in that when the first server breaks down or delayed machine, institute
State data handling system to be used for, handover mechanism is started based on the Microsoft Cluster Services technology, by the first server
On all resource switch to second server, the second server is to be different from the first server in the cluster,
And with any server of the first server redundancy；
The second server is used to send the data processing request to the interchanger；
The interchanger is used to the data processing request being forwarded to the storage system；
The storage system is used to respond the data processing request, and response results are sent to the interchanger；
The interchanger is additionally operable to the response results being forwarded to the second server.
7. the system according to claim 5 or 6, it is characterised in that the data processing request includes data read request；
The storage system is used to respond the data processing request, and response results, which are sent to the interchanger, to be included：
The storage system searches target data, the target data is sent to the friendship according to the data read request
Change planes.
8. the system according to claim 5 or 6, it is characterised in that the data processing request includes data write request；
The storage system is used to respond the data processing request, and response results, which are sent to the interchanger, to be included：
The storage system is written into data write-in designated storage area, write-in is completed according to the data write request
As a result send to the interchanger.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710595927.8A CN107395415A (en) | 2017-07-20 | 2017-07-20 | A kind of data processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710595927.8A CN107395415A (en) | 2017-07-20 | 2017-07-20 | A kind of data processing method and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN107395415A true CN107395415A (en) | 2017-11-24 |
Family
ID=60337383
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710595927.8A Pending CN107395415A (en) | 2017-07-20 | 2017-07-20 | A kind of data processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107395415A (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1323422A (en) * | 1998-10-09 | 2001-11-21 | 奥本维夫系统公司 | Shared-everything file storage for clustered system |
| US20040139196A1 (en) * | 2003-01-09 | 2004-07-15 | Dell Products L.P. | System and method for releasing device reservations |
| CN1860731A (en) * | 2003-09-30 | 2006-11-08 | 国际商业机器公司 | System and method for generating perspectives of a san topology |
| CN101131623A (en) * | 2004-04-14 | 2008-02-27 | 株式会社日立制作所 | Storage system |
| CN202406144U (en) * | 2011-12-07 | 2012-08-29 | 辽宁畅通数据通信有限公司 | Software as a Service (SaaS) integrated management system |
| CN103534688A (en) * | 2013-05-29 | 2014-01-22 | 华为技术有限公司 | Data recovery method, storage equipment and storage system |
-
2017
- 2017-07-20 CN CN201710595927.8A patent/CN107395415A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1323422A (en) * | 1998-10-09 | 2001-11-21 | 奥本维夫系统公司 | Shared-everything file storage for clustered system |
| US20040139196A1 (en) * | 2003-01-09 | 2004-07-15 | Dell Products L.P. | System and method for releasing device reservations |
| CN1860731A (en) * | 2003-09-30 | 2006-11-08 | 国际商业机器公司 | System and method for generating perspectives of a san topology |
| CN101131623A (en) * | 2004-04-14 | 2008-02-27 | 株式会社日立制作所 | Storage system |
| CN202406144U (en) * | 2011-12-07 | 2012-08-29 | 辽宁畅通数据通信有限公司 | Software as a Service (SaaS) integrated management system |
| CN103534688A (en) * | 2013-05-29 | 2014-01-22 | 华为技术有限公司 | Data recovery method, storage equipment and storage system |
Non-Patent Citations (4)
| Title |
|---|
| 周昌权: "MCSE认证考试知识点——简述Microsoft群集服务", 《电脑知识与技术》 * |
| 张强: "Windows2003服务器群集技术在网站中的应用", 《零陵学院学报》 * |
| 杨应全: "微软故障转移群集在图书馆中的应用", 《图书馆自动化》 * |
| 杨应全: "微软故障转移群集在图书馆中的应用", 《现代图书情报技术》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101997823B (en) | Distributed file system and data access method thereof | |
| CN105960639B (en) | Prioritization data reconstruct in distributed memory system | |
| RU2596585C2 (en) | Method for sending data, data receiving method and data storage device | |
| US9639437B2 (en) | Techniques to manage non-disruptive SAN availability in a partitioned cluster | |
| US8443062B2 (en) | Quorum based transactionally consistent membership management in distributed storage systems | |
| US8661457B2 (en) | Pipeline across isolated computing environments | |
| US20240064214A1 (en) | Automatic data replica manager in distributed caching and data processing systems | |
| JP2016522514A (en) | Replication method, program, and apparatus for online hot standby database | |
| US8984332B2 (en) | Active/passive database management across clusters | |
| CN103268318A (en) | Distributed key value database system with strong consistency and read-write method thereof | |
| JP2019519025A (en) | Division and movement of ranges in distributed systems | |
| US10185636B2 (en) | Method and apparatus to virtualize remote copy pair in three data center configuration | |
| CN102299904A (en) | System and method for realizing service data backup | |
| CN103714097A (en) | Method and device for accessing database | |
| CN102629268A (en) | Data synchronization method, system and date access device | |
| US20100169289A1 (en) | Two Phase Commit With Grid Elements | |
| CN103942112A (en) | Magnetic disk fault-tolerance method, device and system | |
| EP4213038A1 (en) | Data processing method and apparatus based on distributed storage, device, and medium | |
| JP2012234333A (en) | Cluster system, synchronization control method, server device and synchronization control program | |
| CN105830061A (en) | Tagging images with emotional state information | |
| CN103150225B (en) | Disk full abnormity fault tolerance method of object parallel storage system based on application level agent | |
| CN102959548A (en) | Data storage method, search method and device | |
| CN102708166A (en) | Data replication method, data recovery method and data recovery device | |
| US20200142977A1 (en) | Distributed file system with thin arbiter node | |
| US10210013B1 (en) | Systems and methods for making snapshots available |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20171124 |