CN113407504B - Data processing method, user space file system and storage medium - Google Patents
Data processing method, user space file system and storage medium Download PDFInfo
- Publication number
- CN113407504B CN113407504B CN202110662238.0A CN202110662238A CN113407504B CN 113407504 B CN113407504 B CN 113407504B CN 202110662238 A CN202110662238 A CN 202110662238A CN 113407504 B CN113407504 B CN 113407504B
- Authority
- CN
- China
- Prior art keywords
- file
- request
- monitoring
- file system
- configuration
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/1734—Details of monitoring file system events, e.g. by the use of hooks, filter drivers, logs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/70—Software maintenance or management
- G06F8/71—Version control; Configuration management
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/50—Network services
- H04L67/60—Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources
- H04L67/63—Routing a service request depending on the request content or context
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the invention discloses a data processing method, a file system and a storage medium. The method is applied to a user space file system installed on a host application and comprises the following steps: receiving a file request sent by a Restful server through a file system splitter, and distributing the file request to a configuration file system or a monitoring file system, wherein the request types comprise: a configuration request and a monitoring request; when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request; and through the monitoring file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is obtained from the host application, and the performance data is returned to the client. The technical scheme of the embodiment of the invention ensures that the user space file system simultaneously provides the client with software performance monitoring and software real-time configuration for the host application.
Description
Technical Field
The embodiment of the invention relates to the technical field of communication, in particular to a data processing method, a user space file system and a storage medium.
Background
A file system is a software mechanism in an operating system that is responsible for managing and storing file information. In recent years, particularly in the rapid development of Fast File Systems (FFS) and UNIX File Systems (UFS), the File systems are not only used for storage formats and access modes of external storage devices, but also are extended to a general data access mode.
For an application software system, on-site debugging is needed in many cases, two debugging modes are currently used, namely, debugging is carried out according to a system log, and debugging is carried out according to information such as threads and memories recorded by general software in the running process of the system. But both of these approaches have limitations. When using system logs for debugging, if the number of the logs is too small, it is difficult to accurately locate the problems in the system, and if the number of the logs is too large, the system performance is seriously affected. When debugging is performed using generic software, some complex, highly customized requirements cannot be met.
In addition to field debugging problems, application software systems also involve software configuration problems. The common software configuration method comprises the following steps: 1. and when the system is started, reading configuration information in the configuration file and applying the configuration information. 2. During the running process of the system, the configuration files are periodically polled, and new configuration is applied to the file system. Both approaches have their drawbacks. For configuration information loaded at system start-up, it is necessary to restart the system once the configuration information changes. For the mode of periodically polling configuration files, in order to ensure the performance of the system, the polling period is not too short, so that the configuration information cannot be changed in real time to be effective in real time. In addition, because of more kinds of configuration information, a plurality of similar polling behaviors exist in different modules, which can cause waste of system resources and affect the overall performance of the system.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a user space file system and a storage medium, so that the user space file system can provide a software performance monitoring function and a software real-time configuration function for a host application for a client under the condition of ensuring the system performance.
In a first aspect, an embodiment of the present invention provides a data processing method applied to a user space file system installed on a host application, where the method includes:
receiving a file request sent by a Restful server through a file system splitter, and distributing the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises: a configuration request and a monitoring request;
when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request;
and through the monitoring file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is obtained from the host application, and the performance data is returned to the client.
Optionally, receiving, by the file system splitter, a file request sent by the Restful server, including:
and receiving a file request sent by a Restful server by using a general Restful interface through a file system splitter, wherein the file request is generated by the Restful server according to the Restful request sent by a client.
By adopting the technical scheme, the file system splitter acquires the file request by using the universal Restful interface, and can unify the interfaces of data operation, so that different operation types respectively correspond to different HTTP methods. For example, the GET method is used to acquire resources, the POST method is used to create resources or update resources, the PUT method is used to update resources, and the DELETE method is used to DELETE resources. And the front end and the rear end can be separated, the flow is reduced, and the rear end is only responsible for data processing.
Optionally, through the configuration file system, when receiving a configuration request distributed by the file system splitter, performing configuration modification operation on a target component in the host application, including:
through a configuration file system, when a configuration request distributed by a file system splitter is received, configuration information and a target component to be configured are extracted from the configuration request;
determining a first system file corresponding to the target component through a configuration file system;
and modifying the first system file according to the configuration information through the configuration file system so as to trigger an observer of the first system file to perform configuration modification operation on the target component.
By adopting the technical scheme, when the configuration file system carries out software configuration operation on the host application, an observer mode is adopted, and the separation of a representation layer and a data logic layer is realized by establishing abstract coupling between an observed object and an observer, so that the maintainability and reusability of an application program are improved, and the configuration file system is easier to expand.
Optionally, by monitoring the file system, when receiving the monitoring request distributed by the file system splitter, acquiring performance data matched with the monitoring request from the host application, including:
determining a second system file matched with the monitoring request when the monitoring request distributed by the file system splitter is received through the monitoring file system;
and reading the second system file through the monitoring file system to acquire the performance data matched with the monitoring request from the host application in real time.
Optionally, the reading operation is performed on the second system file through the monitoring file system, so as to obtain, in real time, performance data matched with the monitoring request from the host application, including:
responding to the reading operation of the second system file by the monitoring file system, inquiring the mapping relation between the file request and the monitoring node, and determining a target monitoring node corresponding to the monitoring request;
and acquiring performance data matched with the monitoring request from the target monitoring node through the monitoring file system.
By adopting the technical scheme, the performance index to be monitored does not generate any data and extra performance consumption when the system is in normal operation, and only when an external request occurs, the data acquisition operation is executed once to acquire the related performance data. In this way, the use of journaling to monitor performance data is avoided, producing a persistent impact on system performance.
Optionally, the performance data includes: intrinsic attribute data of the host application, and/or specific performance index data obtained by the monitoring node by performing a specific operation.
By adopting the technical scheme, log data do not need to be printed all the time when the performance of the host application is monitored, and the influence on the system performance can be greatly reduced. Meanwhile, specific observation indexes can be highly customized, for example, the number of threads currently active in a certain thread pool is checked through a Restful interface when needed. Further, a series of observation strategies may also be formulated, such as periodically checking system performance, to ensure the health of the system.
In a second aspect, an embodiment of the present invention further provides a user space file system installed on a host application, including: the system comprises a Restful server, a file system splitter, a configuration file system and a monitoring file system;
the file system splitter is used for receiving the file request sent by the Restful server and distributing the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises: a configuration request and a monitoring request;
the configuration file system is used for carrying out configuration modification operation on a target component in the host application when receiving a configuration request distributed by the file system splitter, wherein the target component is matched with the configuration request;
and the monitoring file system is used for acquiring the performance data matched with the monitoring request from the host application and returning the performance data to the client when the monitoring request distributed by the file system splitter is received.
Optionally, a profile system is configured to:
when a configuration request distributed by a file system splitter is received, extracting configuration information and a target component to be configured from the configuration request;
determining a first system file corresponding to the target component;
and carrying out modification operation on the first system file according to the configuration information so as to trigger an observer of the first system file to carry out configuration modification operation on the target component.
Optionally, the monitoring file system is configured to:
when a monitoring request distributed by a file system splitter is received, determining a second system file matched with the monitoring request;
and reading the second system file to acquire the performance data matched with the monitoring request from the host application in real time.
In a third aspect, an embodiment of the present invention further provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the data processing method provided by any embodiment of the present invention.
The embodiment of the invention is applied to a user space file system installed on a host application, receives a file request sent by a Restful server through a file system splitter, distributes the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises the following steps: a configuration request and a monitoring request; when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request; by monitoring the file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is acquired from the host application, and the performance data is returned to the client, so that the problem that the field debugging or software configuration of the file system cannot consider the system performance in the prior art is solved, and the user space file system can simultaneously provide a software performance monitoring function and a software real-time configuration function for the host application for the client under the condition of ensuring the system performance.
Drawings
FIG. 1a is a flow chart of a data processing method according to a first embodiment of the present invention;
FIG. 1b is a flow chart of a file system processing request in accordance with a first embodiment of the present invention;
FIG. 2 is a flow chart of a data processing method in a second embodiment of the invention;
fig. 3 is a schematic structural diagram of a user space file system according to a third embodiment of the present invention.
Detailed Description
The invention is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting thereof. It should be further noted that, for convenience of description, only some, but not all of the structures related to the present invention are shown in the drawings.
Example 1
FIG. 1a is a flowchart of a data processing method according to a first embodiment of the present invention, which is applicable to a case of performing performance monitoring or software configuration on a host application in real time using a user space file system, and the method may be performed by the user space file system installed on the host application, and specifically includes the following steps:
In this embodiment, the user space file system refers to a file system customized in the user space field, and is installed in the host application, so that the customized user space file system can provide a software performance monitoring function and a software real-time configuration function for the host application to the client at the same time by setting the monitoring file system and the configuration file system in the file system at the same time. As shown in fig. 1b, a file system splitter in the file system, which is an integral portal to the file system, may receive a file request sent using a Restful server and determine the type of file request. If the configuration request is determined, sending the file request to a configuration file system; if the monitoring request is determined, the file request is sent to a monitoring file system.
Wherein, the file request carries the type of operation to be executed in addition to the request type, including: adding data, reading data, deleting data and updating data.
Optionally, receiving, by the file system splitter, the file request sent by the Restful server may include: and receiving a file request sent by a Restful server by using a general Restful interface through a file system splitter, wherein the file request is generated by the Restful server according to the Restful request sent by a client.
By adopting the technical scheme, the Restful server acquires a Restful request sent by a Restful client of any application using a host, converts the Restful request into a file request, and sends the file request to a file system splitter by using a general Restful interface. The interfaces of the data operations can be unified so that different operation types respectively correspond to different HTTP methods. For example, the GET method is used to acquire resources, the POST method is used to create resources or update resources, the PUT method is used to update resources, and the DELETE method is used to DELETE resources. And the front end and the rear end can be separated, the flow is reduced, and the rear end is only responsible for data processing.
And 120, performing configuration modification operation on a target component in the host application by the configuration file system when receiving a configuration request distributed by the file system splitter, wherein the target component is matched with the configuration request.
In this embodiment, as shown in fig. 1b, when the configuration file system receives a configuration request, an observer mode may be used to perform a configuration modification operation on a configurable component corresponding to the configuration request in the host application. The observer pattern is actually a dependency relationship between an observed object and observers, the observers register themselves in a container of the observed object, when the observed object changes in some way, all registered observers are notified of the change, and the observers respond correspondingly.
Optionally, by configuring the file system, when receiving a configuration request distributed by the file system splitter, performing a configuration modification operation on a target component in the host application may include: through a configuration file system, when a configuration request distributed by a file system splitter is received, configuration information and a target component to be configured are extracted from the configuration request; determining a first system file corresponding to the target component through a configuration file system; and modifying the first system file according to the configuration information through the configuration file system so as to trigger an observer of the first system file to perform configuration modification operation on the target component.
In this embodiment, each configurable component in the host application corresponds to a system file, and each system file is used as an observed object and corresponds to at least one observer respectively. After the configuration file system receives the configuration request distributed by the file system splitter, the configuration request can be analyzed to obtain configuration information and a target component to be configured. And then determining a first system file corresponding to the target component, and performing corresponding writing operation on the first system file according to the configuration information. When the first system file changes, the change condition is notified to the observer, and the observer is triggered to apply the change of the first system file to the configuration information of the target component, so that a certain configuration of the host application is added, modified or deleted, and the configuration is effective in real time.
By adopting the technical scheme, when the configuration file system carries out software configuration operation on the host application, an observer mode is adopted, and the separation of a representation layer and a data logic layer is realized by establishing abstract coupling between an observed object and an observer, so that the maintainability and reusability of an application program are improved, and the configuration file system is easier to expand.
In this embodiment, the configuration file system may modify configuration information of any application program, and the configuration modification is effective immediately, without restarting the system, and without generating additional burden on performance of the system.
And 130, through the monitoring file system, when a monitoring request distributed by the file system splitter is received, acquiring performance data matched with the monitoring request from the host application, and returning the performance data to the client.
In this embodiment, as shown in fig. 1b, when the monitoring file system receives the monitoring request distributed by the file system splitter, various performance data matched with the monitoring request inside the host application are obtained in real time by performing a read operation on a system file in the monitoring file system. And sending the acquired performance data to a file system splitter, and returning the performance data to the Restful client through the file system splitter. Illustratively, the Restful client may be an open source file transfer tool, curl, that works in a command line manner using URL syntax, may be a browser, or other tool that monitors the host application.
It should be noted that, the steps 120 and 130 described in the embodiment of the method may be performed in a different order and/or performed in parallel. For example, if the file system splitter receives both a monitoring request and a configuration request, and the file system splitter distributes the monitoring request to the monitoring system and the configuration request to the configuration system, the monitoring file system and the configuration file system may respond to the request at the same time.
Optionally, by monitoring the file system, when receiving the monitoring request distributed by the file system splitter, obtaining performance data matched with the monitoring request from the host application may include: determining, by the monitoring file system, that a second system file matches the monitoring request when the monitoring request distributed by the file system splitter is received; and reading the second system file through the monitoring file system to acquire the performance data matched with the monitoring request from the host application in real time.
In this embodiment, in order to avoid using log data and reduce the influence on the system performance, when the monitoring file system receives the monitoring request distributed by the file system splitter, the second system file matched with the monitoring request is determined according to the URL parameter in the monitoring request. And triggering the real-time acquisition operation of the performance data by accessing and reading the second system file, and acquiring the performance data matched with the monitoring request from the host application in real time.
The second system file is a virtual file, is stored in the memory, and is not stored on the hard disk. The second system file is just a carrier and the acquisition of performance data is triggered in real time by accessing the second system file. The acquired performance data is not stored but disappears after being returned.
Optionally, the reading operation of the second system file by the monitoring file system to obtain, in real time, performance data matching the monitoring request from the host application may include: responding to the reading operation of the second system file by the monitoring file system, inquiring the mapping relation between the file request and the monitoring node, and determining a target monitoring node corresponding to the monitoring request; and acquiring performance data matched with the monitoring request from the target monitoring node through the monitoring file system.
In this embodiment, each file request may find a corresponding monitoring node in the hosting application, and when the monitoring file system performs a reading operation on the second system file, the mapping relationship between the file request and the monitoring node is queried according to the related information in the monitoring request, so as to find the target monitoring node. And indicating a target monitoring node on the host application through the monitoring file system, and acquiring performance data matched with the monitoring request.
By adopting the technical scheme, the performance index to be monitored does not generate any data and extra performance consumption when the system is in normal operation, and only when an external request occurs, the data acquisition operation is executed once to acquire the related performance data. In this way, the use of journaling to monitor performance data is avoided, producing a persistent impact on system performance.
Optionally, the performance data includes: intrinsic attribute data of the host application, and/or specific performance index data obtained by the monitoring node by performing a specific operation.
In this embodiment, the performance data monitored by the monitoring file system can be divided into two types, one is fixed performance data, for example, the maximum memory of the application, the maximum capacity of the hard disk, and the like. The other is dynamic performance data that can be obtained only by operation, for example, the current size of a certain data buffer, the number of threads currently active in a certain thread pool, and the number of connections currently active in a certain connection pool. Where some dynamically changing performance data may require the monitoring node to perform some complex operations to obtain, for example, detecting whether a certain device is reachable via a ping command. Alternatively, the monitoring node may be required to perform a particular task and return a result, e.g., to determine that the current persona is chatting with several individuals at the same time.
By adopting the technical scheme, log data do not need to be printed all the time when the performance of the host application is monitored, and the influence on the system performance can be greatly reduced. Meanwhile, specific observation indexes can be highly customized, for example, the number of threads currently active in a certain thread pool is checked through a Restful interface when needed. Further, a series of observation strategies may also be formulated, such as periodically checking system performance, to ensure the health of the system.
The embodiment of the invention is applied to a user space file system installed on a host application, receives a file request sent by a Restful server through a file system splitter, distributes the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises the following steps: a configuration request and a monitoring request; when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request; by monitoring the file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is acquired from the host application, and the performance data is returned to the client, so that the problem that the field debugging or software configuration of the file system cannot consider the system performance in the prior art is solved, and the user space file system can simultaneously provide a software performance monitoring function and a software real-time configuration function for the host application for the client under the condition of ensuring the system performance.
Example two
Fig. 2 is a flowchart of a data processing method in a second embodiment of the present invention. This embodiment can be combined with each of the alternatives in the above embodiments. Specifically, referring to fig. 2, the method may include the steps of:
step 210, receiving a file request sent by a Restful server by using a universal Restful interface through a file system splitter, and determining the type of the file request.
The embodiment of the invention is applied to a user space file system installed on a host application, receives a file request sent by a Restful server through a file system splitter, distributes the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises the following steps: a configuration request and a monitoring request; when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request; by monitoring the file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is acquired from the host application, and the performance data is returned to the client, so that the problem that the field debugging or software configuration of the file system cannot consider the system performance in the prior art is solved, and the user space file system can simultaneously provide a software performance monitoring function and a software real-time configuration function for the host application for the client under the condition of ensuring the system performance.
Example III
Fig. 3 is a schematic structural diagram of a user space file system according to a third embodiment of the present invention, where the present embodiment is applicable to a case of performing performance monitoring or software configuration on a host application in real time using the user space file system. As shown in fig. 3, the file system includes: a Restful server 310, a file system splitter 320, a configuration file system 330, and a monitoring file system 340;
a file system splitter 320, configured to receive a file request sent by the Restful server 310, and distribute the file request to a configuration file system or a monitoring file system according to a type of the file request, where the type of the file request includes: a configuration request and a monitoring request;
a configuration file system 330, configured to perform configuration modification operation on a target component in the host application when receiving a configuration request distributed by the file system splitter, where the target component matches the configuration request;
the monitoring file system 340 is configured to, when receiving a monitoring request distributed by the file system splitter, obtain performance data matching the monitoring request from the host application, and return the performance data to the client.
The embodiment of the invention is applied to a user space file system installed on a host application, receives a file request sent by a Restful server through a file system splitter, distributes the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises the following steps: a configuration request and a monitoring request; when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request; by monitoring the file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is acquired from the host application, and the performance data is returned to the client, so that the problem that the field debugging or software configuration of the file system cannot consider the system performance in the prior art is solved, and the user space file system can simultaneously provide a software performance monitoring function and a software real-time configuration function for the host application for the client under the condition of ensuring the system performance.
Optionally, a file system splitter 320 is configured to: and receiving a file request sent by a Restful server by using a general Restful interface through a file system splitter, wherein the file request is generated by the Restful server according to the Restful request sent by a client.
A profile system 330 for:
when a configuration request distributed by a file system splitter is received, extracting configuration information and a target component to be configured from the configuration request;
determining a first system file corresponding to the target component;
and carrying out modification operation on the first system file according to the configuration information so as to trigger an observer of the first system file to carry out configuration modification operation on the target component.
Optionally, the monitoring file system 340 is configured to:
when a monitoring request distributed by a file system splitter is received, determining a second system file matched with the monitoring request;
and reading the second system file to acquire the performance data matched with the monitoring request from the host application in real time.
Optionally, the monitoring file system 340 is specifically configured to:
responding to the reading operation of the second system file, inquiring the mapping relation between the file request and the monitoring node, and determining a target monitoring node corresponding to the monitoring request;
performance data matching the monitoring request is obtained from the target monitoring node.
Optionally, the performance data includes: intrinsic attribute data of the host application, and/or specific performance index data obtained by the monitoring node by performing a specific operation.
Example IV
The fourth embodiment of the present invention also discloses a computer storage medium having stored thereon a computer program which, when executed by a processor, implements a data processing method applied to a user space file system installed on a host application, the method comprising:
receiving a file request sent by a Restful server through a file system splitter, and distributing the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises: a configuration request and a monitoring request;
when a configuration request distributed by a file system splitter is received through a configuration file system, performing configuration modification operation on a target component in a host application, wherein the target component is matched with the configuration request;
and through the monitoring file system, when a monitoring request distributed by the file system splitter is received, performance data matched with the monitoring request is obtained from the host application, and the performance data is returned to the client.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
Note that the above is only a preferred embodiment of the present invention and the technical principle applied. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, while the invention has been described in connection with the above embodiments, the invention is not limited to the embodiments, but may be embodied in many other equivalent forms without departing from the spirit or scope of the invention, which is set forth in the following claims.
Claims (10)
1. A data processing method for use with a user space file system installed on a host application, the method comprising:
receiving a file request sent by a Restful server through a file system splitter, and distributing the file request to a configuration file system or a monitoring file system according to the type of the file request, wherein the type of the file request comprises: a configuration request and a monitoring request;
modifying, by a configuration file system, a first system file corresponding to a target component in the host application when a configuration request distributed by a file system splitter is received, so as to trigger an observer of the first system file to perform configuration modification operation on the target component, wherein the target component is matched with the configuration request;
acquiring performance data matched with a monitoring request from the host application when the monitoring request distributed by a file system splitter is received through a monitoring file system, and returning the performance data to a client;
the performance data is obtained by accessing a second system file in a real-time triggering manner; the second system file is stored in the memory, cannot be stored on the hard disk, and is a virtual file matched with the monitoring request; the performance data is not stored after acquisition but disappears after being returned.
2. The method of claim 1, wherein receiving, via the file system splitter, the file request sent by the Restful server, comprises:
and receiving a file request sent by a Restful server by using a general Restful interface through a file system splitter, wherein the file request is generated by the Restful server according to the Restful request sent by a client.
3. The method of claim 1, wherein performing, by the configuration file system, configuration modification operations on the target component in the host application upon receiving a configuration request distributed by the file system splitter comprises:
through a configuration file system, when a configuration request distributed by a file system splitter is received, configuration information and a target component to be configured are extracted from the configuration request;
determining a first system file corresponding to the target component through a configuration file system;
and modifying the first system file according to the configuration information through a configuration file system so as to trigger an observer of the first system file to perform configuration modification operation on the target component.
4. The method of claim 1, wherein upon receiving a monitoring request distributed by a file system splitter by monitoring a file system, obtaining performance data from the host application that matches the monitoring request comprises:
determining a second system file matched with a monitoring request when the monitoring request distributed by a file system splitter is received through a monitoring file system;
and reading the second system file through the monitoring file system to acquire the performance data matched with the monitoring request from the host application in real time.
5. The method of claim 4, wherein performing a read operation on a second system file by monitoring a file system to obtain performance data matching the monitoring request from the host application in real time comprises:
responding to a reading operation of a second system file by a monitoring file system, inquiring a mapping relation between a file request and a monitoring node, and determining a target monitoring node corresponding to the monitoring request;
and acquiring performance data matched with the monitoring request from the target monitoring node through a monitoring file system.
6. The method of claim 5, wherein the performance data comprises: intrinsic attribute data of the host application, and/or specific performance index data obtained by the monitoring node by performing specific operations.
7. A user space file system for installation on a host application, comprising: the system comprises a Restful server, a file system splitter, a configuration file system and a monitoring file system;
the file system splitter is configured to receive a file request sent by the Restful server, and distribute the file request to a configuration file system or a monitoring file system according to a type of the file request, where the type of the file request includes: a configuration request and a monitoring request;
the configuration file system is used for modifying a first system file corresponding to a target component in the host application when a configuration request distributed by the file system splitter is received, so as to trigger an observer of the first system file to perform configuration modification operation on the target component, and the target component is matched with the configuration request;
the monitoring file system is used for acquiring performance data matched with the monitoring request from the host application when receiving the monitoring request distributed by the file system splitter, and returning the performance data to the client;
the performance data is obtained by accessing a second system file in a real-time triggering manner; the second system file is stored in the memory, cannot be stored on the hard disk, and is a virtual file matched with the monitoring request; the performance data is not stored after acquisition but disappears after being returned.
8. The system of claim 7, wherein the profile system is configured to:
when a configuration request distributed by a file system splitter is received, extracting configuration information and a target component to be configured from the configuration request;
determining a first system file corresponding to the target component;
and carrying out modification operation on the first system file according to the configuration information so as to trigger an observer of the first system file to carry out configuration modification operation on the target component.
9. The system of claim 7, wherein the monitoring file system is configured to:
when a monitoring request distributed by a file system splitter is received, determining a second system file matched with the monitoring request;
and reading the second system file to acquire the performance data matched with the monitoring request from the host application in real time.
10. A computer-readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements a data processing method as claimed in any one of claims 1-6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110662238.0A CN113407504B (en) | 2021-06-15 | 2021-06-15 | Data processing method, user space file system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110662238.0A CN113407504B (en) | 2021-06-15 | 2021-06-15 | Data processing method, user space file system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113407504A CN113407504A (en) | 2021-09-17 |
| CN113407504B true CN113407504B (en) | 2023-05-23 |
Family
ID=77683971
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110662238.0A Active CN113407504B (en) | 2021-06-15 | 2021-06-15 | Data processing method, user space file system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113407504B (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109033869A (en) * | 2018-07-04 | 2018-12-18 | 深圳虚觅者科技有限公司 | Encrypted file system hanging method and device |
| CN109522287A (en) * | 2018-09-18 | 2019-03-26 | 平安科技（深圳）有限公司 | Monitoring method, system, equipment and the medium of distributed document storage cluster |
| CN111078508A (en) * | 2019-12-31 | 2020-04-28 | 杭州当虹科技股份有限公司 | Monitoring method based on user mode file system |
| CN111309557A (en) * | 2020-02-16 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Monitoring method, device, equipment and medium for multiple operating systems |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101621405B (en) * | 2009-07-07 | 2012-02-29 | 中兴通讯股份有限公司 | Distributed type management monitoring system, monitoring method and establishing method thereof |
| CN104636237A (en) * | 2015-01-19 | 2015-05-20 | 上海新炬网络信息技术有限公司 | Monitoring method for Web application system service performance based on Java platform |
| US10158737B2 (en) * | 2016-10-07 | 2018-12-18 | Bank Of America Corporation | Real time event capture and analysis of transient data for an information network |
| CN110858229B (en) * | 2018-08-23 | 2023-04-07 | 阿里巴巴集团控股有限公司 | Data processing method, device, access control system and storage medium |
| CN109672583A (en) * | 2018-09-25 | 2019-04-23 | 平安科技（深圳）有限公司 | Method for monitoring network, equipment, storage medium and device |
| CN111338812B (en) * | 2020-01-22 | 2023-07-21 | 中国民航信息网络股份有限公司 | Data processing method and device |
| CN111654414B (en) * | 2020-05-27 | 2022-04-19 | 华青融天(北京)软件股份有限公司 | Application system monitoring method and device and electronic equipment |
| CN111966465B (en) * | 2020-08-21 | 2023-06-02 | 苏州浪潮智能科技有限公司 | Method, system, equipment and medium for modifying host configuration parameters in real time |
-
2021
- 2021-06-15 CN CN202110662238.0A patent/CN113407504B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109033869A (en) * | 2018-07-04 | 2018-12-18 | 深圳虚觅者科技有限公司 | Encrypted file system hanging method and device |
| CN109522287A (en) * | 2018-09-18 | 2019-03-26 | 平安科技（深圳）有限公司 | Monitoring method, system, equipment and the medium of distributed document storage cluster |
| CN111078508A (en) * | 2019-12-31 | 2020-04-28 | 杭州当虹科技股份有限公司 | Monitoring method based on user mode file system |
| CN111309557A (en) * | 2020-02-16 | 2020-06-19 | 苏州浪潮智能科技有限公司 | Monitoring method, device, equipment and medium for multiple operating systems |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113407504A (en) | 2021-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110795257B (en) | Method, device, equipment and storage medium for processing multi-cluster job record | |
| CN109710615B (en) | Database access management method, system, electronic device and storage medium | |
| US11687488B2 (en) | Directory deletion method and apparatus, and storage server | |
| CN110046133B (en) | Metadata management method, device and system for storage file system | |
| CN104735112A (en) | Resource file sending method and resource file caching method and device | |
| CN112364110A (en) | Metadata management method, device and equipment and computer storage medium | |
| US10657099B1 (en) | Systems and methods for transformation and analysis of logfile data | |
| US20170153909A1 (en) | Methods and Devices for Acquiring Data Using Virtual Machine and Host Machine | |
| CN115640110B (en) | Distributed cloud computing system scheduling method and device | |
| CN111382023A (en) | Code fault positioning method, device, equipment and storage medium | |
| CN112506755A (en) | Log collection method and device, computer equipment and storage medium | |
| US20150186246A1 (en) | Including kernel object information in a user dump | |
| CN112433921A (en) | Method and apparatus for dynamic point burying | |
| CN115883407A (en) | Data acquisition method, system, equipment and storage medium | |
| CN117271584A (en) | Data processing method and device, computer readable storage medium and electronic equipment | |
| CN113407504B (en) | Data processing method, user space file system and storage medium | |
| CN112187509A (en) | Multi-architecture cloud platform execution log management method, system, terminal and storage medium | |
| KR20210044281A (en) | Method and apparatus for ensuring continuous device operation stability in cloud degraded mode | |
| US9733871B1 (en) | Sharing virtual tape volumes between separate virtual tape libraries | |
| CN114816914A (en) | Data processing method, equipment and medium based on Kubernetes | |
| CN110515803B (en) | Processing method and device for log message and electronic equipment | |
| CN111580476B (en) | Intelligent production management method, equipment and computer readable medium | |
| CN110753136B (en) | Domain name resolution method, device, equipment and storage medium | |
| CN114489622A (en) | Js application, electronic device, and storage medium | |
| CN112667589A (en) | Log management method, device and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |