CN1547119A - Method for constructing large-scale high-availability cluster operating system - Google Patents

Method for constructing large-scale high-availability cluster operating system Download PDF

Info

Publication number
CN1547119A
CN1547119A CNA200310117036XA CN200310117036A CN1547119A CN 1547119 A CN1547119 A CN 1547119A CN A200310117036X A CNA200310117036X A CN A200310117036XA CN 200310117036 A CN200310117036 A CN 200310117036A CN 1547119 A CN1547119 A CN 1547119A
Authority
CN
China
Prior art keywords
process device
node
cluster
subregion
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA200310117036XA
Other languages
Chinese (zh)
Other versions
CN100429629C (en
Inventor
詹剑锋
王磊
黄伟
孟丹
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Institute of Computing Technology of CAS
Original Assignee
Institute of Computing Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Institute of Computing Technology of CAS filed Critical Institute of Computing Technology of CAS
Priority to CNB200310117036XA priority Critical patent/CN100429629C/en
Publication of CN1547119A publication Critical patent/CN1547119A/en
Application granted granted Critical
Publication of CN100429629C publication Critical patent/CN100429629C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Hardware Redundancy (AREA)
  • Debugging And Monitoring (AREA)

Abstract

The invention is a method for constructing a large-scale high practicability armada operation system. The method divides the system into several physical areas, a managing process device is set in each area, and a local detection process device is set on each joint. The detection process device sends heat beat to managing process device in the area through the network, the managing process device acquires the network state and joint running state according to the received heat beat, thus carries on central monitoring and uniform management to the area. There uses distributed structure between the managing process devices in each area, then are equal in logic, cooperates, and maintains the uniform view for the running state and network state of all joints.

Description

A kind of method of constructing the available PC cluster of extensive height
Technical field
The present invention relates to the computer systems technology field, particularly a kind of method of constructing the available PC cluster of extensive height.
Technical background
A group of planes has compared the main fluid architecture that becomes high-performance calculation rapidly with its good extensibility and competitive P/C since coming out, also be used widely at commercial fields such as Internet service, database services.
PC cluster is based upon on the node operating system basis, for providing single system mapping, domestic consumer, software developer and system manager support, and be system software collection the most basic in the group of planes.
High availability is an important requirement of Network of Workstation, when a high available PC cluster requirement self is highly reliable, must in time survey and repair inefficacy when Network of Workstation lost efficacy.The inefficacy of Network of Workstation mainly comprises uses inefficacy, node failure and network failure.The inefficacy of using need application itself provides the processing of inefficacy, and if PC cluster can in time provide node failure and network failure information, can do a complete judgement to failure conditions thereby use.Therefore, in PC cluster, realize the detection of node running status and meshed network state timely, can provide reliably fail message timely for the operating system upper layer module, thereby guarantee that PC cluster is highly reliable.When system broke down, the system manager can obtain failure message timely, and analyzing failure cause, helps in time fixing a breakdown.The application program that is positioned on the PC cluster can be learnt fail message timely, and utilizes the crash handling mechanism of oneself, carries out necessary processing, guarantees the normal execution of using.
The node running status of PC cluster and network status monitoring adopt centralized control or this dual mode of distributed control.As shown in Figure 1, centralized mode is to be responsible for the running status and the network status monitoring of all nodes of a group of planes by a managing process device, and this managing process device is collected the running status of all nodes of a group of planes and the information of network state.As shown in Figure 2, distributed mode is to be finished the running status and the network status monitoring of cluster nodes by one of a plurality of managing process device collaborative work, all managing process devices are reciprocity fully in logic, they are collaborative work together, and keeps the uniform view of all node running statuses of a group of planes and network state.
The node running status of existing PC cluster and the network status monitoring modes that adopt centralized control more, but this structure is along with the continuous increase of Network of Workstation scale, the load of managing process device is increased, and become system bottleneck, meanwhile the managing process device also is the single failpoint of system, in order to guarantee its high availability, also need to do corresponding complex process.If adopt the distributed control structure of equity fully, just on each node, all move a managing process device, for large scale system, can make agreement very complicated, though do not have certain node to become bottleneck, the load of each node of total system all can increase the weight of.In order to address the above problem, need to adopt the structure of layering.What show as Fig. 3 is the centralized control of layering, just system is divided into a plurality of subregions, and the inner mode that adopts centralized control of subregion is managed concentratedly the running status and the network status monitoring of all nodes in the subregion by a process device.Also adopt the mode of centralized control between the subregion, the managing process device of all subregions of managing process device management of a system.The centralized control of layering can solve the problem of extendability, but does not still solve the problem (the centralized management process device of the superiors can become single failpoint) of single failpoint.What show as Fig. 4 is the distributed control of layering, exactly system is divided into a plurality of subregions, and the inner distributed frame of equity fully that adopts of subregion all moves a managing process device on each node; Also adopt the mode of distributed control between the subregion, each subregion selects a managing process device to form distributed management structure.There is the very problem of complicacy of agreement in the distributed control of layering, and can be very complicated when specific implementation, is difficult to guarantee the reliability of software.
Summary of the invention
The objective of the invention is to design a kind of method of constructing the available PC cluster of extensive height; this method can provide the monitoring of the node state and the network state of an extensive group of planes, and provides high available service support for Network of Workstation software and the commercial application software that makes full use of group of planes characteristic.
A kind of method of constructing the available PC cluster of extensive height, the architecture that adopts centralized control to combine with the control that distributes, Network of Workstation is divided into a plurality of Physical Extents, each node is installed a local detecting process device, each Physical Extents is installed a managing process device, node running status and network status monitoring in the subregion adopt centralized control, and adopt distributed control between the partition management process device.
This method adopts distributed control and centralized control structure combining.
This method physically is divided into a plurality of subregions with Network of Workstation.
Node running status and network status monitoring in each subregion adopt centralized control.
By a managing process device node state and the network-in-dialing degree of its place subregion carried out unified management.
The architecture that this method adopts centralized control to combine with distributed control.Network of Workstation is divided into a plurality of Physical Extents, and each Physical Extents is installed a managing process device, and a local detecting process device all is installed on each node.Local detecting process device sends heartbeat (heartbeat) by the managing process device of all networks in this subregion, heartbeat is that heartbeat signal is sent in monitored node timing (as every 1 second), if monitoring facilities is not received any heartbeat signal that sends from certain node within a certain period of time, judge that then this node breaks down.And the heartbeat message that the managing process device sends according to this locality detecting process device obtains the network state and the node running status of place node, thereby node running status in the subregion and network state are carried out centralized monitoring and unified management.Adopt distributed frame between the managing process device of each subregion, they are logically reciprocity fully, collaborative work together, and the uniform view of maintenance all node running statuses of a group of planes and network state.
Effect of the present invention is embodied in:
1. this method is applicable to extensive Network of Workstation, can solve the drawback of using centralized configuration fully or equation structures is carried out cluster nodes running status and meshed network condition monitoring under large-scale Network of Workstation situation.
2. the structure in conjunction with centralized control and distributed control that this method adopted is with good expansibility.The variation of system such as can adapt to that node increase and minimizing, subregion increase and less.
3. this method has solved single failpoint problem, has high availability.Can also can provide high available support for Network of Workstation software provides high available service support for the commercial application software that makes full use of group of planes characteristic.
Description of drawings
Fig. 1 is centralized cluster nodes state and network status monitoring structural drawing.
Fig. 2 is distributed cluster nodes state and network status monitoring structural drawing.
Fig. 3 is the centralized cluster nodes state and the network status monitoring structural drawing of layering.
Fig. 4 is the distributed cluster nodes state and the network status monitoring structural drawing of layering.
Fig. 5 is the architecture that method adopted in conjunction with the extensive high available PC cluster of structure of distributed control and centralized control.
Fig. 6 is the structural map of local detecting process device.
Fig. 7 is the structural map of partition management process device.
Fig. 8 is the synoptic diagram after the partition management process device initialization success.
Fig. 9 is that partition management process device begins operate as normal preparation flow process before.
Figure 10 is the synoptic diagram after the local detecting process device initialization success.
Figure 11 is that local detecting process device begins operate as normal preparation flow process before.
Figure 12 is the flow process of system's operate as normal.
Figure 13 is the synoptic diagram that high available service is used.
Embodiment
Dispose:
As shown in Figure 5, a local detecting process device all is housed on each node of a group of planes, each Physical Extents of a group of planes all has a managing process device, partition management process device is in charge of subregion node state and network-in-dialing degree, adopts the distributed control mode management between the managing process device.GSD among Fig. 5 (Group Service Daemon) is the managing process device (being called for short the managing process device) of each Physical Extents interior nodes and network UNICOM state.WD (watch Daemon) is this locality detecting process device (being called for short local detecting process device) of installing on each node.
Fig. 6 is the structural map of local detecting process device, and its software module comprises that heartbeat sends and the module that takes orders, and hardware then comprises many cover physical networks, internal memory and CPU.
Fig. 7 is the structural map of partition management process device, and its software module comprises reception heartbeat module and crash handling module, and hardware then comprises many cover physical networks, internal memory and CPU.
Initialization:
As shown in Figure 8, the managing process device in each Physical Extents of a group of planes is initialized to the group that adopts the distributed way management.
Fig. 9 has provided the managing process device and has begun operate as normal preparation flow process before, is specially: step (9-1), startup managing process device on Physical Extents; The managing process device of step (9-2), first Physical Extents is as leader (caretaker manager of distributed group); The managing process device of step (9-3), other Physical Extents sends to leader and joins request; After step (9-4), leader receive joining request of all partition management process devices, notify their initialization success; After step (9-5), leader receive that the notice of all partition management process devices is replied, the initialization success.
The managing process device is finished and is prepared after the flow process, and local detecting process device was finished the preparation flow process before the beginning operate as normal, as shown in figure 10, forms the structure of centralized management in subregion.
Provided local detecting process device as Figure 11 and begun preparation flow process before the operate as normal, be specially: after step (11-1), the partition management process device initialization success, all be set to the node state of this subregion unavailable; This locality detecting process device in step (11-2), the boot partition on each node; The managing process device of detecting process device in this locality in this subregion in step (11-3), the subregion on all nodes sends heartbeat; After step (11-4), managing process device are received the heartbeat that this locality detecting process device on the subregion interior nodes of being managed sends, be changed to the node state of correspondence available; Step (11-5), local detecting process device regularly the managing process device in this subregion send heartbeat, and receive the managing process device order in this subregion, form the centralized management structure in the subregion.
Normal workflow:
After managing process device and local arrangement for detecting were finished and prepared flow process, GSD began the node of this subregion is monitored, and Figure 12 has provided normal workflow, specifically describes as follows: step (12-1), GSD all are changed to the node state of this subregion unavailable.Step (12-2), respond after receiving the joining request of this locality detecting process device (WD) on certain node, and node state is changed into available.Use many cover networks after step (12-3), WD add successfully and send heartbeat to GSD, after GSD receives the heartbeat of WD, the recorder time.Step (12-4), GSD judge network state and the node life or death of WD by regularly watching the heart time mark of WD.Step (12-5) is if GSD can not receive the heartbeat that WD sends by certain cover network in a period of time, and this cover network state of this node is changed to malfunction.If find that the all-network state of certain node all is a malfunction, illustrate then that this node may break down or this node on WD break down.
The treatment scheme that node breaks down is: step (12-6) is if node state is for normal, and a period of time can not receive heartbeat, and GSD is by many cover networks transmission query messages: if receive and reply, GSD does not do any operation.If GSD do not receive and replys, profiling error type then.If the type of error that returns is " connecting refusal ", process failure is described, node state is changed to " WD malfunction ", network state is reverted to normally, and restart the WD process by remote command.If the type of error that returns is " resource can not obtain " temporarily, node is closed, and node state is changed to " node failure ".Step (12-7) can not receive the heartbeat of two nets if node state is the WD fault in a period of time, node is closed, and node state is changed to " node failure ".If node state is the WD fault, receive the heartbeat of WD, then state is changed to normally.Step (12-8) is received the heartbeat of WD if node state is a malfunction, then state is changed to normally.
After the managing process device initialization in this subregion, form group, the running status of all nodes of a group of planes and the uniform view of network state externally are provided by the distributed way management.
As shown in figure 13, managing process device in this subregion can provide high available support for the Network of Workstation software on upper strata, as long as node with managing process device (GSD) place of Network of Workstation Software deployment in this subregion, and call the interface that GSD provides, system software just can obtain the high available service that the managing process device in this subregion provides.What be different among the figure that ellipse that GSD white fills represents is the commercial application software that need have the system software of high available characteristic or make full use of group of planes characteristic.

Claims (19)

1, a kind of method of constructing the available PC cluster of extensive height, the architecture that adopts centralized control to combine with the control that distributes, Network of Workstation is divided into a plurality of Physical Extents, it is characterized in that local detecting process device of each node installation, each Physical Extents is installed a managing process device, node running status and network status monitoring in the subregion adopt centralized control, and adopt distributed control between the partition management process device.
2, the method for the extensive high available PC cluster of structure according to claim 1, it is characterized in that: this method adopts distributed control and centralized control structure combining.
3, the method for the extensive high available PC cluster of structure according to claim 1, it is characterized in that: this method physically is divided into a plurality of subregions with Network of Workstation.
4, the method for the extensive high available PC cluster of structure according to claim 1, it is characterized in that: node running status and network status monitoring in each subregion adopt centralized control.
5, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: by a managing process device node state and the network-in-dialing degree of its place subregion carried out unified management.
6, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that adopting distributed frame between the managing process device of each subregion, and their are equity fully logically.
7, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: collaborative work together between the managing process device of each subregion, the uniform view of maintenance all node running statuses of a group of planes and network state.
8, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: use this method, a local detecting process device all is housed on each node in the group of planes.
9, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: this method all has the managing process device of a subregion node state and network-in-dialing degree in each Physical Extents of a group of planes.
10, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: this locality of each node detecting process device sends heartbeat by all networks to partition management process device in this method, subregion.
11, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: partition management process device obtains the network state and the node running status of local detecting process device place node according to the information of the heartbeat of the detecting of this locality on each node process device transmission.
12, the method for the extensive high available PC cluster of structure according to claim 1, it is characterized in that: this method, by the distributed way management, externally provide the uniform view of all node running statuses of a group of planes and network state between the partition management process device.
13, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: this method, partition management process device can provide high available support for the upper system software of a group of planes.
14, the method for the extensive high available PC cluster of structure according to claim 1 is characterized in that: this method, partition management process device can provide high available support for the commercial application software that makes full use of group of planes characteristic.
15, the method for the extensive high available PC cluster of structure according to claim 1, it is characterized in that: this method, as long as with the node of Network of Workstation Software deployment at partition management process device place, system software just can obtain the high available service that partition management process device provides.
16, the method for the extensive high available PC cluster of structure according to claim 1, it is characterized in that: this method, need only the node that commercial application software is deployed in partition management process device place, the commercial application software that makes full use of group of planes characteristic just can obtain the high available service that partition management process device provides.
17, according to the method for the extensive high available PC cluster of the structure of claim 1, its step is as follows: step (12-1), GSD all are changed to the node state of this subregion unavailable; Step (12-2), respond after receiving the joining request of this locality detecting process device (WD) on certain node, and node state is changed into available; Use many cover networks after step (12-3), WD add successfully and send heartbeat to GSD, after GSD receives the heartbeat of WD, the recorder time; Step (12-4), GSD judge network state and the node life or death of WD by regularly watching the heart time mark of WD; Step (12-5) is if GSD can not receive the heartbeat that WD sends by certain cover network in a period of time, and this cover network state of this node is changed to malfunction; If find that the all-network state of certain node all is a malfunction, illustrate then that this node may break down or this node on WD break down,
The treatment scheme that node breaks down is: step (12-6) is if node state is for normal, and a period of time can not receive heartbeat, and GSD is by many cover networks transmission query messages: if receive and reply, GSD does not do any operation; If GSD do not receive and replys, profiling error type then; If the type of error that returns is " connecting refusal ", process failure is described, node state is changed to " WD malfunction ", network state is reverted to normally, and restart the WD process by remote command, if the type of error that returns is " resource can not obtain " temporarily, node is closed, and node state is changed to " node failure "; Step (12-7) is if node state is the WD fault, can not receive the heartbeat of two nets in a period of time, node is closed, and node state is changed to " node failure ", if node state is the WD fault, receive the heartbeat of WD, then state is changed to normally, step (12-8) is received the heartbeat of WD if node state is a malfunction, then state is changed to normally.
18, according to the method for the extensive high available PC cluster of the structure of claim 17, the managing process device begins the preparation flow process before the operate as normal, and concrete steps are: step (9-1), start the managing process device on Physical Extents; The managing process device of step (9-2), first Physical Extents is as leader (caretaker manager of distributed group); The managing process device of step (9-3), other Physical Extents sends to leader and joins request; After step (9-4), leader receive joining request of all partition management process devices, notify their initialization success; After step (9-5), leader receive that the notice of all partition management process devices is replied, the initialization success.Attitude is changed to normally.
19, according to the method for the extensive high available PC cluster of the structure of claim 17, local detecting process device begins the preparation flow process before the operate as normal, concrete steps are: after step (11-1), the initialization of the partition management process device success, all be set to the node state of this subregion unavailable; This locality detecting process device in step (11-2), the boot partition on each node; The managing process device of detecting process device in this locality in this subregion in step (11-3), the subregion on all nodes sends heartbeat; After step (11-4), managing process device are received the heartbeat that this locality detecting process device on the subregion interior nodes of being managed sends, be changed to the node state of correspondence available; Step (11-5), local detecting process device regularly the managing process device in this subregion send heartbeat, and receive the managing process device order in this subregion, form the centralized management structure in the subregion.
CNB200310117036XA 2003-12-04 2003-12-04 Method for constructing large-scale high-availability cluster operating system Expired - Fee Related CN100429629C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200310117036XA CN100429629C (en) 2003-12-04 2003-12-04 Method for constructing large-scale high-availability cluster operating system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200310117036XA CN100429629C (en) 2003-12-04 2003-12-04 Method for constructing large-scale high-availability cluster operating system

Publications (2)

Publication Number Publication Date
CN1547119A true CN1547119A (en) 2004-11-17
CN100429629C CN100429629C (en) 2008-10-29

Family

ID=34337678

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200310117036XA Expired - Fee Related CN100429629C (en) 2003-12-04 2003-12-04 Method for constructing large-scale high-availability cluster operating system

Country Status (1)

Country Link
CN (1) CN100429629C (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100375080C (en) * 2005-04-15 2008-03-12 中国人民解放军国防科学技术大学 Input / output group throttling method in large scale distributed shared systems
CN102571960A (en) * 2012-01-12 2012-07-11 浪潮(北京)电子信息产业有限公司 Method and device for monitoring high-availability cluster state
CN102594596A (en) * 2012-02-15 2012-07-18 华为技术有限公司 Method and device for recognizing available partitions, and clustering network system
CN102629942A (en) * 2012-03-22 2012-08-08 广东威创视讯科技股份有限公司 Cradle head control method, corresponding system and centralized cradle head control node
CN105187804A (en) * 2015-10-10 2015-12-23 上海慧体网络科技有限公司 Method for monitoring a plenty of remote sports building hardware in centralized manner cross Internet
CN106462631A (en) * 2014-06-18 2017-02-22 微软技术许可有限责任公司 Consistent views of partitioned data in eventually consistent systems
CN107402968A (en) * 2017-06-26 2017-11-28 北京小度信息科技有限公司 Progress control method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10187638A (en) * 1996-10-28 1998-07-21 Mitsubishi Electric Corp Cluster control system
US6253230B1 (en) * 1998-09-22 2001-06-26 International Business Machines Corporation Distributed scalable device for selecting a server from a server cluster and a switched path to the selected server

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100375080C (en) * 2005-04-15 2008-03-12 中国人民解放军国防科学技术大学 Input / output group throttling method in large scale distributed shared systems
CN102571960A (en) * 2012-01-12 2012-07-11 浪潮(北京)电子信息产业有限公司 Method and device for monitoring high-availability cluster state
CN102594596A (en) * 2012-02-15 2012-07-18 华为技术有限公司 Method and device for recognizing available partitions, and clustering network system
CN102594596B (en) * 2012-02-15 2014-08-20 华为技术有限公司 Method and device for recognizing available partitions, and clustering network system
CN102629942A (en) * 2012-03-22 2012-08-08 广东威创视讯科技股份有限公司 Cradle head control method, corresponding system and centralized cradle head control node
CN102629942B (en) * 2012-03-22 2014-09-24 广东威创视讯科技股份有限公司 Cradle head control method, corresponding system and centralized cradle head control node
CN106462631A (en) * 2014-06-18 2017-02-22 微软技术许可有限责任公司 Consistent views of partitioned data in eventually consistent systems
US10318618B2 (en) 2014-06-18 2019-06-11 Microsoft Technology Licensing, Llc Consistent views of partitioned data in eventually consistent systems
CN106462631B (en) * 2014-06-18 2020-06-09 微软技术许可有限责任公司 Consistent view of partitioned data in a final consistent system
CN105187804A (en) * 2015-10-10 2015-12-23 上海慧体网络科技有限公司 Method for monitoring a plenty of remote sports building hardware in centralized manner cross Internet
CN107402968A (en) * 2017-06-26 2017-11-28 北京小度信息科技有限公司 Progress control method and device

Also Published As

Publication number Publication date
CN100429629C (en) 2008-10-29

Similar Documents

Publication Publication Date Title
CN105703940B (en) Monitoring system and monitoring method for multi-level scheduling distributed parallel computation
KR100956638B1 (en) Large Scale Cluster Monitoring System, And Automatic Building And Restoration Method Thereof
CA2467813C (en) Real composite objects for providing high availability of resources on networked systems
US9747183B2 (en) Method and system for intelligent distributed health monitoring in switching system equipment
Castelli et al. Proactive management of software aging
US7260818B1 (en) System and method for managing software version upgrades in a networked computer system
US7269611B2 (en) Storage system and storage system control method
US7234072B2 (en) Method and system for making an application highly available
US7913105B1 (en) High availability cluster with notification of resource state changes
US8301599B2 (en) Cluster arrangement
CN102325192A (en) Cloud computing implementation method and system
US20020198996A1 (en) Flexible failover policies in high availability computing systems
CN110825544A (en) Computing node, failure detection method thereof and cloud data processing system
JP2004246892A (en) Remotely accessible resource management method in multi-node distributed data processing system
CN101996106A (en) Method for monitoring software running state
JPH03503588A (en) Information gathering and display device regarding the status of communication network
JP2004062535A (en) Method of dealing with failure for multiprocessor system, multiprocessor system and node
CN105592139B (en) A kind of the HA implementation method and device of distributed file system management platform
CN1547119A (en) Method for constructing large-scale high-availability cluster operating system
CN114064414A (en) High-availability cluster state monitoring method and system
Huda et al. An agent oriented proactive fault-tolerant framework for grid computing
Lu et al. Iaso: an autonomous fault-tolerant management system for supercomputers
EP1565822A2 (en) Clustering system and method having interconnect
US20050259572A1 (en) Distributed high availability system and method
US20100185714A1 (en) Distributed communications between database instances

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20081029

Termination date: 20191204