CN113590696B - Management method and system for distributed application coordination service - Google Patents
Management method and system for distributed application coordination service Download PDFInfo
- Publication number
- CN113590696B CN113590696B CN202110679570.8A CN202110679570A CN113590696B CN 113590696 B CN113590696 B CN 113590696B CN 202110679570 A CN202110679570 A CN 202110679570A CN 113590696 B CN113590696 B CN 113590696B
- Authority
- CN
- China
- Prior art keywords
- user
- distributed application
- module
- execution
- file system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007726 management method Methods 0.000 title abstract description 22
- 238000012544 monitoring process Methods 0.000 claims abstract description 80
- 238000013507 mapping Methods 0.000 claims abstract description 67
- 238000000034 method Methods 0.000 claims abstract description 34
- 230000008569 process Effects 0.000 claims abstract description 14
- 238000006243 chemical reaction Methods 0.000 claims description 62
- 239000008186 active pharmaceutical agent Substances 0.000 description 9
- 238000004590 computer program Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003203 everyday effect Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 239000012790 adhesive layer Substances 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 239000010410 layer Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/252—Integrating or interfacing systems involving database management systems between a Database Management System and a front-end application
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/3003—Monitoring arrangements specially adapted to the computing system or computing system component being monitored
- G06F11/302—Monitoring arrangements specially adapted to the computing system or computing system component being monitored where the computing system component is a software system
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention provides a management method and a system for distributed application coordination service, wherein the method comprises the following steps: mapping the operation executed by the user in the local file resource manager to a user file system; converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service; executing an operation instruction; and monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager. The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened.
Description
Technical Field
The invention relates to the technical field of inquiry and management of storage systems, in particular to a management method and system of distributed application coordination service.
Background
The ZooKeeper is a distributed application coordination service of open source codes, is an open source implementation of Chubbby of Google, and is an important component of Hadoop and Hbase. It is a software providing a consistency service for distributed applications, the provided functions include: configuration maintenance, domain name service, distributed synchronization, group service, etc.
In ZooKeeper, data is stored in a tree-like structure. In the memory data, the ZooKeeper stores the content of the whole tree, including all node paths and node data. The node path is similar to a file name and the node data is similar to a file system.
The storage format of the tree structure is very similar to the file system that we touch every day, but the data in the ZooKeeper is to be accessed and managed, the API interface of the tree structure must be implemented through its own client or using a programming language, and such management manner is not friendly and not intuitive.
Disclosure of Invention
Aiming at the problems that the access and management of data in a ZooKeeper are not friendly and intuitive, the invention provides a management method and a system for distributed application coordination service, wherein the API interface of the ZooKeeper is realized through a self-contained client or a programming language.
The technical scheme of the invention is as follows:
on the one hand, the technical scheme of the invention provides a management method of distributed application coordination service, which comprises the following steps:
mapping the operation executed by the user in the local file resource manager to a user file system;
converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service;
executing an operation instruction;
and monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager.
And mapping the operation of the user on the local resource manager, converting to obtain an actual operation instruction of the distributed application coordination service, transmitting the actual operation instruction to a server where the distributed application coordination service is located for execution, monitoring an execution result, and notifying the local resource manager. And the local resource manager performs related operations such as file content refreshing after receiving the notification.
Preferably, the step of mapping the operations performed by the user at the local file resource manager to the user-mode file system includes:
acquiring an operation executed by a user in a local file resource manager;
and mapping the acquired operation to the user file system through the conversion of the virtual file system. By mapping the file operation of the local resource manager to the storage structure FUSE of the Zookeeper, a simpler and faster management mode is realized.
Preferably, the step of converting the operation mapped to the user-mode file system into an operation instruction of the actual distributed application coordination service includes:
the user state file system sends the obtained operation to a protocol conversion end;
and the protocol conversion end converts the operation sent by the user-mode file system into an operation instruction of the actual distributed application coordination service. The distributed application coordination service is made to operate as quickly and simply as the files on the local disk.
Preferably, the step of converting the received operation into an operation instruction of the actual distributed application coordination service includes:
and addressing the operation instruction and then sending the operation instruction to a server where the distributed application coordination service is located. The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened.
Meanwhile, the monitoring is introduced, so that the monitoring which can be realized only by relying on a third-party web page and a series of complex APIs becomes more natural, and the basic statistical information can be counted by directly observing the local resource manager.
On the other hand, the technical scheme of the invention also provides a management system of the distributed application coordination service, which comprises a mapping module, a protocol conversion module, a protocol execution module, a monitoring module, an execution end and a user file system;
the mapping module is used for mapping the operation executed by the user in the local file resource manager to the user file system;
the protocol conversion module is used for converting the operation mapped to the user file system into an operation instruction for the actual operation of the distributed application coordination service;
the protocol execution module is used for sending an operation instruction to the execution end for execution;
and the monitoring module is used for monitoring the process of executing the operation instruction by the execution end and feeding back the monitoring result to the local file resource manager.
After mapping the operation of the user to the local resource manager, the actual operation instruction of the distributed application coordination service is obtained through conversion of the protocol conversion module, the protocol execution module sends the operation instruction to the server where the distributed application coordination service is located for execution, and the monitoring module is arranged to monitor the execution result and inform the local resource manager. And the local resource manager performs related operations such as file content refreshing after receiving the notification.
Preferably, the mapping module is a virtual file system built in an operating system, and comprises an operation acquisition unit and a mapping unit;
the operation acquisition unit is used for acquiring the operation executed by the user on the local file resource manager;
and the mapping unit is used for mapping the acquired operation to the FUSE through the conversion of the virtual file system.
Preferably, the protocol conversion module is specifically configured to convert the operation mapped to the FUSE into an operation instruction of the actual distributed application coordination service, and send the operation instruction to the protocol execution module.
Preferably, the protocol executing module is specifically configured to receive the operation instruction sent by the protocol conversion module, address the received operation instruction, send the operation instruction to a server where the distributed application coordination service is located for execution, and notify the monitoring module of the execution operation. The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened.
Preferably, the monitoring module is specifically configured to monitor the execution result of the server where the distributed application coordination service notified by the protocol execution module is located, and feed back the execution result to the local file manager in good time.
Preferably, the monitoring module is further configured to monitor all events of the server where the distributed application coordination service is located and inform the local file manager.
Meanwhile, the monitoring module is introduced, so that the monitoring which can be realized only by relying on a third-party web page and a series of complex APIs becomes more natural, and the basic statistical information can be counted by directly observing the local resource manager.
From the above technical scheme, the invention has the following advantages: the method enables the distributed application coordination service to be seamlessly integrated with the file manager which is most frequently used by us, and the distributed application coordination service is operated as fast and simple as the operation of the files on the local computer disk. The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened. Meanwhile, the monitoring module is introduced, so that the monitoring which can be realized only by relying on a third-party web page and a series of complex APIs becomes more natural, and the basic statistical information can be counted by directly observing the local resource manager.
In addition, the invention has reliable design principle, simple structure and very wide application prospect.
It can be seen that the present invention has outstanding substantial features and significant advances over the prior art, as well as its practical advantages.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings that are required to be used in the description of the embodiments or the prior art will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.
FIG. 1 is a schematic flow chart of a method of one embodiment of the invention.
Fig. 2 is a schematic flow chart of a method of another embodiment of the invention.
FIG. 3 is a schematic block diagram of a system of one embodiment of the present invention.
In the figure, a 1-local file resource manager, a 2-virtual file system, a 3-user file system, a 4-protocol conversion module, a 5-protocol execution module, a 6-monitoring module and a 7-server.
Detailed Description
In order to make the technical solution of the present invention better understood by those skilled in the art, the technical solution of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention. FUSE: filesystem in Userspace, user-oriented file system. Is a file system framework of user space, allows non-privileged users to build a file system with complete functions without recompilation of the kernel;
VFS: virtual File System, virtual file system. The function is to use the standard Unix system to call and read and write different file systems on different physical media, i.e. to provide a unified operation interface and application programming interface for various file systems. VFS is an adhesive layer that allows open, read, write, etc. system calls to operate without concern for the underlying storage medium and file system type.
As shown in fig. 1, an embodiment of the present invention provides a method for managing a distributed application coordination service, including the following steps:
s11: mapping the operation executed by the user in the local file resource manager to a user file system;
s12: converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service;
s13: executing an operation instruction;
s14: and monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager.
And mapping the operation of the user on the local resource manager, converting to obtain an actual operation instruction of the distributed application coordination service, transmitting the actual operation instruction to a server where the distributed application coordination service is located for execution, monitoring an execution result, and notifying the local resource manager. And the local resource manager performs related operations such as file content refreshing after receiving the notification.
Another embodiment of the present invention provides a method for managing a distributed application coordination service, including the following steps:
s21: acquiring an operation executed by a user in a local file resource manager;
s22: mapping the obtained operation to a user file system through the conversion of the virtual file system;
s23: converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service;
s24: executing an operation instruction;
s25: and monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager.
By mapping the file operation of the local resource manager to the storage structure FUSE of the Zookeeper, a simpler and faster management mode is realized.
And mapping the operation of the user on the local resource manager, converting to obtain an actual operation instruction of the distributed application coordination service, transmitting the actual operation instruction to a server where the distributed application coordination service is located for execution, monitoring an execution result, and notifying the local resource manager. And the local resource manager performs related operations such as file content refreshing after receiving the notification.
As shown in fig. 2, another embodiment of the present invention provides a method for managing a distributed application coordination service, including the following steps:
s31: acquiring an operation executed by a user in a local file resource manager;
s32: mapping the obtained operation to a user file system through the conversion of the virtual file system;
s33: the user state file system sends the obtained operation to a protocol conversion end;
s34: the protocol conversion end converts the operation sent by the user file system into an operation instruction of the actual distributed application coordination service, and sends the operation instruction to the execution control end;
s35: the execution control end sends the received operation instruction to the execution end;
s36: the execution end executes the operation instruction;
s37: and the monitoring execution end executes the process of the operation instruction and feeds the monitoring result back to the local file resource manager.
By mapping the file operation of the local resource manager to the storage structure FUSE of the Zookeeper, a simpler and faster management mode is realized.
And mapping the operation of the user on the local resource manager, converting to obtain an actual operation instruction of the distributed application coordination service, transmitting the actual operation instruction to a server where the distributed application coordination service is located for execution, monitoring an execution result, and notifying the local resource manager. And the local resource manager performs related operations such as file content refreshing after receiving the notification. The distributed application coordination service is made to operate as quickly and simply as the files on the local disk.
It should be noted that, the executing end is a server end where the distributed application coordination service is located. Further, the step S35 specifically includes: and the execution control end addresses the operation instruction and then sends the operation instruction to a server where the distributed application coordination service is located.
The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened.
Meanwhile, the monitoring is introduced, so that the monitoring which can be realized only by relying on a third-party web page and a series of complex APIs becomes more natural, and the basic statistical information can be counted by directly observing the local resource manager.
The storage format of the tree structure is very similar to the file system that we touch every day, but the data in the ZooKeeper is to be accessed and managed, the API interface of the tree structure must be implemented through its own client or using a programming language, and such management manner is not friendly and not intuitive. Another embodiment of the present invention provides a method for managing a distributed application coordination service, by which a ZooKeeper and a file manager most frequently used by us are seamlessly fused, and the operation of the ZooKeeper is as fast and simple as the operation of a file on a local computer disk. The method and the device can improve the friendliness of the user operation interface, so that the operation is simpler and clearer, and the operation path is shortened. Meanwhile, monitoring is introduced, so that monitoring which can be realized by relying on a third-party web page and a series of complex APIs becomes more natural, and basic statistical information such as node number change can be counted by directly observing a local resource manager. The basic idea is as follows: the basic idea is as follows: the operation of the local resource manager is converted into an actual Zookeeper operation instruction by a protocol converter through the mapping of FUSE; the protocol executor sends the instruction to a server where the Zookeeper is located for execution; feeding back a Zookeeper execution result to the event monitor; the event listener notifies the local resource manager to respond. The user-level operation, namely Application operation, is mapped to the file read-write operation of FUSE through the conversion of VFS, and then the FUSE operation is subjected to protocol conversion and corresponds to the real operation of the server, namely Daemon, so that the management operation of the local disk file is mapped to the operation of the back-end service. The method is as follows;
(1) When a user executes resource adding, deleting and checking operations in a local file resource manager, the operations are mapped to FUSE through the conversion of the VFS built in the operating system;
(2) FUSE obtains operation instructions such as file reading, writing, checking and deleting;
(3) Converting operations such as file reading, writing, checking, deleting and the like into operation instructions corresponding to the ZooKeeper;
(4) And (3) sending the operation instruction obtained in the step (3) to an actual ZooKeeper server for execution after addressing, monitoring the execution result of the ZooKeeper server, and feeding back to a local file manager at proper time.
The storage system with the similar tree structure like the ZooKeeper is managed more conveniently, the friendliness of a user operation interface can be greatly improved, the operation difficulty is reduced, the faster gift deleting and checking is realized, the operation efficiency is improved, and the monitoring is simpler and more visual.
The embodiment of the invention also provides a management system of the distributed application coordination service, which comprises a local file resource manager 1, a mapping module, a protocol conversion module 4, a protocol execution module 5, a monitoring module 6, a user file system 3 and an execution end;
the mapping module is used for mapping the operation to the user file system 3 when the user performs the operation by the local file resource manager 1;
the protocol conversion module 4 is used for converting the operation mapped to the user state file system 3 into an operation instruction of the actual distributed application coordination service;
the protocol execution module 5 is used for sending an operation instruction to the execution end for execution; wherein the execution end is a service end 7 where the distributed application coordination service is located.
And the monitoring module 6 is used for monitoring the execution process of the operation instruction and feeding back the monitoring result to the local file resource manager 1.
After mapping the operation of the user on the local resource manager 1, the actual operation instruction of the distributed application coordination service is obtained through conversion of the protocol conversion module 4, the protocol execution module 5 sends the operation instruction to the server 7 where the distributed application coordination service is located for execution, and the monitoring module 6 is arranged to monitor the execution result and inform the local resource manager 1. The local resource manager 1 performs relevant operations such as file content refreshing after receiving the notification.
As shown in fig. 3, the embodiment of the present invention further provides a management system for a distributed application coordination service, including a local file resource manager 1, a mapping module, a protocol conversion module 4, a protocol execution module 5, a monitoring module 6, a user file system 3 and an execution end;
the mapping module is used for mapping the operation to the FUSE when the user performs the operation by the local file resource manager 1;
the protocol conversion module 4 is used for converting the operation mapped to the user state file system 3 into an operation instruction of the actual distributed application coordination service;
the protocol execution module 5 is used for sending an operation instruction to the execution end for execution;
and the monitoring module 6 is used for monitoring the execution process of the operation instruction and feeding back the monitoring result to the local file resource manager 1.
Wherein the execution end is a service end 7 where the distributed application coordination service is located.
After mapping the operation of the user on the local resource manager 1, the actual operation instruction of the distributed application coordination service is obtained through conversion of the protocol conversion module 4, the protocol execution module 4 sends the operation instruction to the server 7 where the distributed application coordination service is located for execution, and the monitoring module 6 is arranged to monitor the execution result and inform the local resource manager 1. The local resource manager 1 performs relevant operations such as file content refreshing after receiving the notification.
The mapping module comprises an operation acquisition unit and a mapping unit;
the operation acquisition unit is used for acquiring the operation executed by the user on the local file resource manager;
and the mapping unit is used for mapping the acquired operation to the FUSE through the conversion of the virtual file system.
It should be noted that, the mapping module may actually be a virtual file system 2 built in the operating system, and when the user executes the resource adding, deleting and checking operations by the local file resource manager 1, these operations are mapped to the user-state file system 3 through the virtual file system conversion 2 built in the operating system.
The embodiment of the invention also provides a management system of the distributed application coordination service, which comprises a local file resource manager 1, a mapping module, a protocol conversion module 4, a protocol execution module 5, a monitoring module 6, a user file system 3 and an execution end;
the mapping module is used for mapping the operation to the FUSE when the user performs the operation by the local file resource manager 1;
the protocol conversion module 4 is used for converting the operation mapped to the user state file system 3 into an operation instruction of the actual distributed application coordination service;
the protocol execution module 5 is used for sending an operation instruction to the execution end for execution;
and the monitoring module 6 is used for monitoring the execution process of the operation instruction and feeding back the monitoring result to the local file resource manager 1.
Wherein the execution end is a service end 7 where the distributed application coordination service is located.
After mapping the operation of the user on the local resource manager 1, the actual operation instruction of the distributed application coordination service is obtained through conversion of the protocol conversion module 4, the protocol execution module 4 sends the operation instruction to the server 7 where the distributed application coordination service is located for execution, and the monitoring module 6 is arranged to monitor the execution result and inform the local resource manager 1. The local resource manager 1 performs relevant operations such as file content refreshing after receiving the notification.
The mapping module comprises an operation acquisition unit and a mapping unit;
the operation acquisition unit is used for acquiring the operation executed by the user on the local file resource manager;
and the mapping unit is used for mapping the acquired operation to the FUSE through the conversion of the virtual file system.
It should be noted that, the mapping module may actually be a virtual file system 2 built in the operating system, and when the user executes the resource adding, deleting and checking operations by the local file resource manager 1, these operations are mapped to the user-state file system 3 through the virtual file system conversion 2 built in the operating system.
The protocol conversion module 4 is specifically configured to convert the operation sent by the user mode file system 3 into an operation instruction of an actual distributed application coordination service, and send the operation instruction to the protocol execution module 5.
The protocol execution module 5 is specifically configured to receive the operation instruction sent by the protocol conversion module 4, address the received operation instruction, send the operation instruction to the server 7 where the distributed application coordination service is located for execution, and notify the monitoring module 6 of the execution operation. The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened.
The embodiment of the invention also provides a management system of the distributed application coordination service, which comprises a local file resource manager 1, a mapping module, a protocol conversion module 4, a protocol execution module 5, a monitoring module 6, a user file system 3 and an execution end;
the mapping module is used for mapping the operation to the FUSE when the user performs the operation by the local file resource manager 1;
the protocol conversion module 4 is used for converting the operation mapped to the user state file system 3 into an operation instruction of the actual distributed application coordination service;
the protocol execution module 5 is used for sending an operation instruction to the execution end for execution;
and the monitoring module 6 is used for monitoring the execution process of the operation instruction and feeding back the monitoring result to the local file resource manager 1.
Wherein the execution end is a service end 7 where the distributed application coordination service is located.
After mapping the operation of the user on the local resource manager 1, the actual operation instruction of the distributed application coordination service is obtained through conversion of the protocol conversion module 4, the protocol execution module 4 sends the operation instruction to the server 7 where the distributed application coordination service is located for execution, and the monitoring module 6 is arranged to monitor the execution result and inform the local resource manager 1. The local resource manager 1 performs relevant operations such as file content refreshing after receiving the notification.
The mapping module comprises an operation acquisition unit and a mapping unit;
the operation acquisition unit is used for acquiring the operation executed by the user on the local file resource manager;
and the mapping unit is used for mapping the acquired operation to the FUSE through the conversion of the virtual file system.
It should be noted that, the mapping module may actually be a virtual file system 2 built in the operating system, and when the user executes the resource adding, deleting and checking operations by the local file resource manager 1, these operations are mapped to the user-state file system 3 through the virtual file system conversion 2 built in the operating system.
The protocol conversion module 4 is specifically configured to convert the operation sent by the user mode file system 3 into an operation instruction of an actual distributed application coordination service, and send the operation instruction to the protocol execution module 5.
The protocol execution module 5 is specifically configured to receive the operation instruction sent by the protocol conversion module 4, address the received operation instruction, send the operation instruction to the server 7 where the distributed application coordination service is located for execution, and notify the monitoring module 6 of the execution operation. The user-friendly performance of the user operation interface can be improved, so that the operation is more concise and clear, and the operation path is shortened.
The monitoring module 6 is specifically configured to monitor the execution result of the server 7 where the distributed application coordination service notified by the protocol execution module 5 is located, and timely feed back the execution result to the local file manager 1, and is also configured to monitor all events of the server 7 where the distributed application coordination service is located and notify the local file manager 1.
Meanwhile, the monitoring module 6 is introduced, so that monitoring which can be realized only by relying on a third-party web page and a series of complex APIs becomes more natural, and basic statistical information can be counted by directly observing a local resource manager.
The invention also provides a management system for coordination service of the distributed Application program, wherein the operation of the user layer, namely Application operation, is mapped to the file read-write operation of the FUSE through the conversion of the VFS (virtual file system), and then the operation of the FUSE is subjected to protocol conversion and corresponds to the real operation of the service end, namely Daemon, so that the management operation of the local disk file is mapped to the operation of the back-end service. The system specifically comprises a local file resource manager, a protocol conversion module, a protocol execution module, a monitoring module, a VFS (virtual file system) built in an operating system, FUSE and a server; when a user executes resource adding, deleting and checking operations in a local file resource manager, the operations are mapped to FUSE through the conversion of the VFS built in the operating system; the FUSE obtains operation instructions such as file reading, writing, checking and deleting and sends the obtained instructions to a protocol conversion module, and the protocol conversion module converts the operations such as file reading, writing, checking and deleting into operation instructions corresponding to the ZooKeeper; for example: opening a folder zookeeper.is (), deleting a file zookeeper.rm (dir), and creating a new file zookeeper.set (key, value); the protocol execution module sends the operation instruction obtained by the conversion of the protocol conversion module to the actual ZooKeeper server for execution after addressing, and meanwhile informs the monitoring module of the execution operation; the monitoring module monitors the execution result of the ZooKeeper server and feeds back the execution result to the local file manager at proper time. Meanwhile, besides the protocol execution module notifying the event of the monitoring module, the monitoring module also monitors all events of the ZooKeeper server and notifies the local file manager.
By introducing the VFS and FUSE of the operating system, the checking and management of the ZooKeeper service stored in the tree structure become simpler and faster, the monitoring is more visual and natural, the user friendliness is greatly improved when ZooKeeper resources are managed, the operation is simpler and faster, and meanwhile, the monitoring of the ZooKeeper is simpler and more direct due to the introduction of the monitoring module.
In addition to mapping virtual file systems for stored services of a tree structure such as ZooKeeper, the method proposed by the present application can be effective for all services stored similarly in a tree structure.
Embodiments of the present invention disclose a computer program product comprising a computer program stored on a non-transitory computer readable storage medium, the computer program comprising program instructions which, when executed by a computer, enable the computer to perform the methods provided by the method embodiments described above, for example comprising: s11: mapping the operation executed by the user in the local file resource manager to a user file system; s12: converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service; s13: executing an operation instruction; s14: and monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager.
Embodiments of the present invention provide a non-transitory computer readable storage medium storing computer instructions that cause a computer to perform the methods provided by the above-described method embodiments, for example, including: s11: mapping the operation executed by the user in the local file resource manager to a user file system; s12: converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service; s13: executing an operation instruction; s14: and monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager.
Those of ordinary skill in the art will appreciate that: all or part of the steps for implementing the above method embodiments may be implemented by hardware associated with program instructions, where the foregoing program may be stored in a computer readable storage medium, and when executed, the program performs steps including the above method embodiments; and the aforementioned storage medium includes: various media that can store program code, such as ROM, RAM, magnetic or optical disks.
From the above description of the embodiments, it will be apparent to those skilled in the art that the embodiments may be implemented by means of software plus necessary general hardware platforms, or of course may be implemented by means of hardware. Based on this understanding, the foregoing technical solution may be embodied essentially or in a part contributing to the prior art in the form of a software product, which may be stored in a computer readable storage medium, such as ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the respective embodiments or some parts of the embodiments.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention, and are not limiting; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims (7)
1. A method for managing a distributed application coordination service, comprising the steps of:
mapping the operation executed by the user in the local file resource manager to a user file system;
converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service;
executing an operation instruction;
monitoring the execution process of the operation instruction, and feeding back a monitoring result to the local file resource manager;
the step of mapping the operation executed by the user in the local file resource manager to the user file system comprises the following steps:
acquiring an operation executed by a user in a local file resource manager;
mapping the obtained operation to a user file system through the conversion of the virtual file system;
the step of converting the operation mapped to the user state file system into an operation instruction for the actual operation of the distributed application coordination service comprises the following steps:
the user state file system sends the obtained operation to a protocol conversion end;
and the protocol conversion end converts the operation sent by the user-mode file system into an operation instruction of the actual distributed application coordination service.
2. The method for managing distributed application coordination services according to claim 1, wherein said step of converting the operation mapped to the user-mode file system into an operation instruction for the actual operation of the distributed application coordination service comprises:
and addressing the operation instruction and then sending the operation instruction to a server where the distributed application coordination service is located.
3. The management system of the distributed application coordination service is characterized by comprising a mapping module, a protocol conversion module, a protocol execution module, a monitoring module, an execution end and a user file system;
the mapping module is used for mapping the operation executed by the user in the local file resource manager to the user file system;
the protocol conversion module is used for converting the operation mapped to the user file system into an operation instruction for the actual operation of the distributed application coordination service;
the protocol execution module is used for sending an operation instruction to the execution end for execution;
the monitoring module is used for monitoring the process of executing the operation instruction by the execution end and feeding back the monitoring result to the local file resource manager;
the mapping module is a virtual file system built in an operating system and comprises an operation acquisition unit and a mapping unit;
the operation acquisition unit is used for acquiring the operation executed by the user on the local file resource manager;
the mapping unit is used for mapping the acquired operation to the FUSE through the conversion of the virtual file system;
the user state file system sends the obtained operation to a protocol conversion end; and the protocol conversion end converts the operation sent by the user-mode file system into an operation instruction of the actual distributed application coordination service.
4. A distributed application coordination service management system according to claim 3, wherein the protocol conversion module is specifically configured to convert an operation mapped to the user-mode file system into an operation instruction for actually operating the distributed application coordination service, and send the operation instruction to the protocol execution module.
5. The system according to claim 4, wherein the protocol execution module is specifically configured to receive the operation instruction sent by the protocol conversion module, address the received operation instruction, send the operation instruction to a server where the distributed application coordination service is located for execution, and notify the monitoring module of the execution operation.
6. The system according to claim 5, wherein the monitoring module is specifically configured to monitor an execution result of a server where the distributed application coordination service is located, which is notified by the protocol execution module, and feed the execution result back to the local file manager at a proper time.
7. The system of claim 6, wherein the monitor module is further configured to monitor all events at a server where the distributed application coordination service is located and notify the local file manager.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110679570.8A CN113590696B (en) | 2021-06-18 | 2021-06-18 | Management method and system for distributed application coordination service |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110679570.8A CN113590696B (en) | 2021-06-18 | 2021-06-18 | Management method and system for distributed application coordination service |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113590696A CN113590696A (en) | 2021-11-02 |
| CN113590696B true CN113590696B (en) | 2023-12-22 |
Family
ID=78244225
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110679570.8A Active CN113590696B (en) | 2021-06-18 | 2021-06-18 | Management method and system for distributed application coordination service |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113590696B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101420547A (en) * | 2008-11-28 | 2009-04-29 | 深圳创维数字技术股份有限公司 | Digital television receiver, resource manager and resource management method thereof |
| CN105959390A (en) * | 2016-06-13 | 2016-09-21 | 乐视控股（北京）有限公司 | Unified management system and method of micro services |
| CN110659248A (en) * | 2019-09-05 | 2020-01-07 | 上海交通大学 | User mode file system design method and system based on nonvolatile memory |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11016932B2 (en) * | 2017-09-21 | 2021-05-25 | Alibaba Group Holding Limited | Systems, methods, and apparatuses for simplifying filesystem operations utilizing a key-value storage system |
-
2021
- 2021-06-18 CN CN202110679570.8A patent/CN113590696B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101420547A (en) * | 2008-11-28 | 2009-04-29 | 深圳创维数字技术股份有限公司 | Digital television receiver, resource manager and resource management method thereof |
| CN105959390A (en) * | 2016-06-13 | 2016-09-21 | 乐视控股（北京）有限公司 | Unified management system and method of micro services |
| CN110659248A (en) * | 2019-09-05 | 2020-01-07 | 上海交通大学 | User mode file system design method and system based on nonvolatile memory |
Non-Patent Citations (1)
| Title |
|---|
| 校园级元计算机的单一映像文件系统的研究;桂小林, 钱德沛;西安交通大学学报(第06期);第32-35页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113590696A (en) | 2021-11-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108536761B (en) | Report data query method and server | |
| WO2019134226A1 (en) | Log collection method, device, terminal apparatus, and storage medium | |
| US8707194B1 (en) | System and method for decentralized performance monitoring of host systems | |
| JP6381801B2 (en) | Dynamic scaling of storage volume for storage client file system | |
| CN101640587B (en) | Data synchronization method and data synchronization device | |
| EP3076307A1 (en) | Method and device for responding to a request, and distributed file system | |
| CN109918435A (en) | A kind of processing method and system of business interface | |
| CN107181821A (en) | A kind of information push method and device based on SSE specifications | |
| KR20080043517A (en) | Apparatus and method for parsing domain profile in software communication architecture | |
| CN112698921A (en) | Logic code operation method and device, computer equipment and storage medium | |
| WO2024103912A1 (en) | Request processing method and apparatus, and device and non-volatile readable storage medium | |
| WO2023092580A1 (en) | Page display method and apparatus, storage medium, and electronic device | |
| JP6338257B2 (en) | Network element data access method and apparatus, and network management system | |
| CN105978802B (en) | A kind of method and device of Message Processing | |
| JP2019067288A (en) | Log managing apparatus, information processing system and program | |
| US9218205B2 (en) | Resource management in ephemeral environments | |
| CN113590696B (en) | Management method and system for distributed application coordination service | |
| Zhou et al. | Sfmapreduce: An optimized mapreduce framework for small files | |
| CN109347936A (en) | Implementation method, system, storage medium and the electronic equipment of Redis agent client | |
| CN113094166A (en) | Link tracking method, device, medium and computing equipment | |
| US7546313B1 (en) | Method and framework for using XML files to modify network resource configurations | |
| WO2012171363A1 (en) | Method and equipment for data operation in distributed cache system | |
| CN114490540B (en) | Data storage method, medium, device and computing equipment | |
| CN116204540A (en) | Operation log recording method, device, equipment and storage medium | |
| CN113867628B (en) | Data deleting method, device, storage medium and computing equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |