CN105138706A - Data diagnosis method, device and system for distributed type file system - Google Patents
Data diagnosis method, device and system for distributed type file system Download PDFInfo
- Publication number
- CN105138706A CN105138706A CN201510641019.9A CN201510641019A CN105138706A CN 105138706 A CN105138706 A CN 105138706A CN 201510641019 A CN201510641019 A CN 201510641019A CN 105138706 A CN105138706 A CN 105138706A
- Authority
- CN
- China
- Prior art keywords
- data
- diagnosis
- information
- diagnosed
- file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003745 diagnosis Methods 0.000 title claims abstract description 307
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000012423 maintenance Methods 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 10
- 238000002405 diagnostic procedure Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Test And Diagnosis Of Digital Computers (AREA)
Abstract
The embodiment of the invention provides a data diagnosis method, a data diagnosis device and a data diagnosis system for a distributed type file system. The method comprises the following steps: sending a data diagnosis instruction to a server by a client; receiving data to be diagnosed determined by the server according to the data diagnosis instruction, and sending diagnosis information which is searched according to the data to be diagnosed to the client, wherein the diagnosis information comprises data catalogue item information, data session control information and data index node information; generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed are wrong or not according to the diagnosis file. According to the data diagnosis method, the data to be diagnosed in the distributed type file system are not needed to be diagnosed at the client by dynamically running the data to be diagnosed, so that diagnosis of the data is simpler and more convenient, and the maintenance difficulty is low, so that the data diagnosis efficiency of the client is improved.
Description
Technical Field
The invention relates to the technical field of data processing in a distributed file system, in particular to a method, a device and a system for diagnosing data of the distributed file system.
Background
Currently, in a distributed file system, there is no dedicated data diagnosis method at the client. When a system maintainer needs to diagnose data in a distributed file system, the data to be diagnosed needs to be operated at a client, then operation logs of a program are generated by tracking the operation of the program in a kernel of the client, and finally whether the data to be diagnosed in the system is wrong is judged by checking the operation logs, and the data to be diagnosed can be known whether the data to be diagnosed is wrong only by dynamically operating the data to be diagnosed at the client, so that the data is inconvenient to diagnose, the maintenance difficulty is high, and the workload is wasted.
Disclosure of Invention
In view of this, embodiments of the present invention provide a method, an apparatus, and a system for diagnosing distributed file system data, so as to solve the problems in the prior art that it is necessary to dynamically run data to be diagnosed to know whether the data to be diagnosed is incorrect, the data is inconvenient to diagnose, the maintenance difficulty is high, and the workload is wasted.
In order to achieve the above purpose, the embodiments of the present invention provide the following technical solutions:
a distributed file system data diagnostic method, comprising:
the client sends a data diagnosis instruction to the server;
receiving the diagnosis information sent to the client after the server determines the data to be diagnosed according to the data diagnosis instruction and searches for the diagnosis information according to the data to be diagnosed, wherein the diagnosis information comprises: data directory entry information, data session control information and data index node information;
and generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed is wrong or not according to the diagnosis file.
Wherein, the judging whether the data to be diagnosed has errors according to the diagnosis file comprises:
determining the file name of the data to be diagnosed according to the data directory entry information, judging whether all the file names are unique, and if not, judging that the data to be diagnosed is wrong;
determining whether the data to be diagnosed is abnormally changed or not according to the data session control information, and if so, judging that the data to be diagnosed is wrong;
and determining the index number of the data to be diagnosed according to the node information of the data, judging whether all the index numbers are unique, and if not, judging that the data to be diagnosed has errors.
Wherein the generating a diagnostic file according to the diagnostic information comprises:
judging whether diagnosis information is received or not;
if so, generating a diagnosis file, wherein the diagnosis file is in an info format;
and writing all the received diagnosis information into the diagnosis file.
The method comprises the following steps that after the client sends a data diagnosis instruction to the server, the method further comprises the following steps:
judging whether the diagnosis information sent by the server is received within preset time;
and if not, sending the data diagnosis instruction to the server again.
Wherein, the generating of the diagnosis file according to the diagnosis information further comprises: and displaying the diagnosis file through a display screen.
A distributed file system data diagnostic apparatus comprising: the system comprises an instruction sending module, a data receiving module and a data diagnosis module; wherein,
the instruction sending module is used for sending a data diagnosis instruction to the server;
the data receiving module is configured to receive data to be diagnosed, which is determined by the server according to the data diagnosis instruction, and send diagnosis information to the client after obtaining the diagnosis information according to the data to be diagnosed, where the diagnosis information includes: data directory entry information, data session control information and data index node information;
and the data diagnosis module is used for generating a diagnosis file comprising the diagnosis information according to the diagnosis information and judging whether the data to be diagnosed is wrong or not according to the diagnosis file.
Wherein the data diagnosis module comprises: a first diagnostic unit, a second diagnostic unit and a third diagnostic unit; wherein;
the first diagnosis unit is used for determining the file names of the data to be diagnosed according to the data directory entry information, judging whether all the file names are unique, and if not, judging that the data to be diagnosed is wrong;
the second diagnosis unit is used for determining whether the data to be diagnosed is abnormally changed or not according to the data session control information, and if the data to be diagnosed is abnormally changed, the data to be diagnosed is judged to be wrong;
and the third diagnosis unit is used for determining the index number of the data to be diagnosed according to the node information of the data, judging whether all the index numbers are unique, and if not, judging that the data to be diagnosed is wrong.
Wherein the data diagnosis module further comprises: the device comprises a judging unit, a file generating unit and an information writing unit; wherein,
the judging unit is used for judging whether the diagnosis information is received or not;
the file generating unit is used for generating a diagnosis file when diagnosis information is received, wherein the diagnosis file is in an info format;
the information writing unit is used for writing all the received diagnosis information into the diagnosis file.
Wherein the distributed file system data diagnosis apparatus further comprises: the judging module is used for judging whether the diagnosis information sent by the server is received within preset time after the instruction sending module sends the data diagnosis instruction to the server; if not, the instruction sending module sends the data diagnosis instruction to the server again.
A distributed file system data diagnostic system comprising: a client and a server; wherein,
the client is used for sending a data diagnosis instruction to the server; receiving the diagnosis information sent to the client after the server determines the data to be diagnosed according to the data diagnosis instruction and searches for the diagnosis information according to the data to be diagnosed, wherein the diagnosis information comprises: data directory entry information, data session control information and data index node information; generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed is wrong or not according to the diagnosis file;
the server is used for receiving the data diagnosis instruction sent by the client, determining data to be diagnosed according to the data diagnosis instruction, searching according to the data to be diagnosed to obtain diagnosis information, and sending the diagnosis information to the client.
Based on the above technical solution, in the method, the device, and the system for diagnosing distributed file system data provided by the embodiments of the present invention, a client sends a data diagnosis instruction to a server, the server receives the data diagnosis instruction to determine data to be diagnosed, and sends diagnosis information to the client after obtaining the diagnosis information according to the data to be diagnosed, where the diagnosis information includes: after the client receives the diagnosis information sent by the server, a diagnosis file comprising the diagnosis information is generated according to the diagnosis information, and whether the data to be diagnosed is wrong or not is judged according to the diagnosis file. When system maintenance personnel need to diagnose data in the distributed file system, the client can receive three types of diagnosis information, namely data directory item information, data session control information and data index node information, sent by the server only by sending a data diagnosis instruction to the server through the client, generate a diagnosis file according to the diagnosis information, judge whether the data to be diagnosed is wrong according to the diagnosis file, and diagnose the data to be diagnosed in the distributed file system without dynamically operating the data to be diagnosed at the client.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the provided drawings without creative efforts.
FIG. 1 is a flow chart of a distributed file system data diagnosis method according to an embodiment of the present invention;
fig. 2 is a flowchart of a method for determining whether data to be diagnosed is incorrect according to a diagnostic file in a data diagnosis method for a distributed file system according to an embodiment of the present invention;
fig. 3 is a flowchart of a method for generating a diagnostic file according to diagnostic information in a distributed file system data diagnostic method according to an embodiment of the present invention;
fig. 4 is a flowchart of a method for determining whether to send a data diagnosis instruction to a server again in the distributed file system data diagnosis method according to the embodiment of the present invention;
FIG. 5 is a system block diagram of a distributed file system data diagnosis apparatus according to an embodiment of the present invention;
fig. 6 is a block diagram illustrating a data diagnosis module in a distributed file system data diagnosis apparatus according to an embodiment of the present invention;
FIG. 7 is another block diagram of a data diagnosis module in the distributed file system data diagnosis apparatus according to the embodiment of the present invention;
FIG. 8 is another system block diagram of a distributed file system data diagnosis apparatus according to an embodiment of the present invention;
fig. 9 is a system block diagram of a distributed file system data diagnosis system according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart of a data diagnosis method for a distributed file system according to an embodiment of the present invention, where only a data diagnosis instruction needs to be sent to a server by a client, the client may receive three types of diagnosis information, namely data directory entry information, data session control information, and data index node information, sent by the server, generate a diagnosis file according to the diagnosis information, determine whether data to be diagnosed is incorrect according to the diagnosis file, and diagnose the data to be diagnosed in the distributed file system without dynamically operating the data to be diagnosed at the client, so that data diagnosis is simpler and more convenient, maintenance difficulty is lower, and efficiency of data diagnosis at the client is improved; referring to fig. 1, the distributed file system data diagnosis method may include:
step S100: the client sends a data diagnosis instruction to the server;
optionally, after the client sends the data diagnosis instruction to the server, it may be further determined whether the diagnosis information sent by the server is received within a predetermined time, and if the diagnosis information sent by the server is not received within the predetermined time, it may be considered that the data diagnosis instruction sent to the server is not received by the server, and the data diagnosis instruction may be sent to the server again.
Step S110: receiving the diagnosis information sent to the client after the server determines the data to be diagnosed according to the data diagnosis instruction and searches for the diagnosis information according to the data to be diagnosed, wherein the diagnosis information comprises: data directory entry information, data session control information and data index node information;
after the server receives the data diagnosis instruction sent by the client, the server determines data to be diagnosed according to the received data diagnosis instruction, searches for diagnosis information according to the data to be diagnosed, and sends the searched diagnosis information to the client. Wherein the searched diagnosis information includes: data directory entry information, data session control information, and data inode information.
Step S120: and generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed is wrong or not according to the diagnosis file.
After receiving the diagnosis information sent by the server, the client generates a diagnosis file comprising the diagnosis information according to the diagnosis information, and after obtaining the diagnosis file, the client can judge whether the data to be diagnosed is wrong according to the diagnosis file.
Optionally, the file names of the data to be diagnosed can be determined according to the data directory entry information in the received diagnosis information, whether the file names are all unique is determined, that is, whether the file names are all unique is determined, whether a file with the same name exists is determined, and if not, that is, the file with the same name exists is determined, it can be determined that the data to be diagnosed is wrong.
Optionally, it may be determined whether the data to be diagnosed is abnormally changed, for example, data is abnormally added, data loss and abnormal data replacement are sent, according to the data session control information in the received diagnosis information, and if it is determined that the data to be diagnosed is abnormally changed, it may be determined that the data to be diagnosed is in error.
Optionally, the index numbers of the data to be diagnosed may be determined through the node information in the received diagnosis information, and it is determined whether the index numbers are all unique, that is, it is determined whether the index numbers are all unique, and it is determined whether the same index number exists in all the index numbers, and if it is determined that not all the index numbers are unique, that is, the same index number exists, it may be determined that the data to be diagnosed is erroneous.
And only when all file names of the data to be diagnosed are determined to be unique, normal change is not carried out, and all index numbers are determined to be unique, the data to be diagnosed are determined to be wrong.
Alternatively, the diagnostic file may be generated by generating a diagnostic file after receiving the diagnostic information, and then writing all the received diagnostic information into the diagnostic file, where the diagnostic file includes all the received diagnostic information.
Optionally, the generated diagnostic file may be an info format file.
Optionally, after the diagnostic file is generated according to the diagnostic information, the diagnostic file may be displayed through a display screen.
Based on the above technical solution, in the distributed file system data diagnosis method provided in the embodiments of the present invention, a client sends a data diagnosis instruction to a server, the server receives the data diagnosis instruction to determine data to be diagnosed, and sends diagnosis information to the client after obtaining the diagnosis information according to the data to be diagnosed, where the diagnosis information includes: after the client receives the diagnosis information sent by the server, a diagnosis file comprising the diagnosis information is generated according to the diagnosis information, and whether the data to be diagnosed is wrong or not is judged according to the diagnosis file. When system maintenance personnel need to diagnose data in the distributed file system, the client can receive three types of diagnosis information, namely data directory item information, data session control information and data index node information, sent by the server only by sending a data diagnosis instruction to the server through the client, generate a diagnosis file according to the diagnosis information, judge whether the data to be diagnosed is wrong according to the diagnosis file, and diagnose the data to be diagnosed in the distributed file system without dynamically operating the data to be diagnosed at the client.
Optionally, fig. 2 shows a flowchart of a method for determining whether data to be diagnosed is incorrect according to a diagnostic file in the distributed file system data diagnosis method provided by the embodiment of the present invention, and referring to fig. 2, the method for determining whether data to be diagnosed is incorrect according to the diagnostic file may include:
step S200: determining the file name of the data to be diagnosed according to the data directory entry information, judging whether all the file names are unique, and if not, judging that the data to be diagnosed is wrong;
the file names of the data to be diagnosed can be determined according to the data directory entry information in the received diagnosis information, after the file names of the data to be diagnosed are determined, whether the file names are all unique can be judged, and if not, the data to be diagnosed is judged to be wrong.
Step S210: determining whether the data to be diagnosed is abnormally changed or not according to the data session control information, and if so, judging that the data to be diagnosed is wrong;
and determining whether the data to be diagnosed is abnormally changed or not according to the data session control information in the received diagnosis information, for example, abnormally increasing the data, sending data loss and abnormally replacing the data, and if the data to be diagnosed is abnormally changed, indicating that the data to be diagnosed is wrong.
Step S220: and determining the index number of the data to be diagnosed according to the node information of the data, judging whether all the index numbers are unique, and if not, judging that the data to be diagnosed has errors.
The index number of the data to be diagnosed can be determined according to the node information in the received diagnosis information, after the index number of the data to be diagnosed is determined, whether the index numbers are all unique can be judged, and if not, the data to be diagnosed is judged to be wrong.
It should be noted that there is no logical sequence relationship in execution among the steps S200, S210 and S220, no matter how the execution sequence of the steps S200, S210 and S220 is, and whether the steps S200, S210 and S220 are executed simultaneously, the process of determining whether the data to be diagnosed is incorrect can be completed as long as the steps S200, S210 and S220 are completed.
Compared with the method for judging whether the data to be diagnosed is wrong or not by running the log, the method for judging whether the data to be diagnosed is wrong or not can be completed only by simple comparison without a system maintainer understanding a complex program, and is more convenient and simpler.
Optionally, fig. 3 is a flowchart illustrating a method for generating a diagnostic file according to diagnostic information in a distributed file system data diagnostic method according to an embodiment of the present invention, and referring to fig. 3, the method for generating a diagnostic file according to diagnostic information may include:
step S300: judging whether diagnosis information is received or not;
when the client generates the diagnosis file according to the diagnosis information, whether the diagnosis information is received needs to be judged first, and the diagnosis file can be generated according to the received diagnosis information after the diagnosis information is judged to be received.
The diagnostic information may include data directory entry information, data session control information, and data inode information, among others.
Step S310: if so, generating a diagnosis file, wherein the diagnosis file is in an info format;
if the diagnostic information is determined to be received, a diagnostic file in the info format may be generated first for writing all the received diagnostic information.
Step S320: and writing all the received diagnosis information into the diagnosis file.
After the diagnostic file is generated, all the received diagnostic information can be written into the diagnostic file to obtain the diagnostic file comprising all the received diagnostic information, and whether the data to be diagnosed is wrong or not is judged through the diagnostic file.
Optionally, fig. 4 shows a flowchart of a method for determining whether to send a data diagnosis instruction to the server again in the distributed file system data diagnosis method provided in the embodiment of the present invention, and referring to fig. 4, the method for determining whether to send a data diagnosis instruction to the server again may include:
step S400: judging whether the diagnosis information sent by the server side is received within preset time;
optionally, after the client sends the data diagnosis instruction to the server, whether the server receives the diagnosis instruction may be determined by determining whether the diagnosis information sent by the server is received within a predetermined time.
Step S410: and if not, sending the data diagnosis instruction to the server again.
If the diagnosis information sent by the server is not received within the preset time, the data diagnosis instruction sent to the server can be considered not to be received by the server, and the data diagnosis instruction can be sent to the server again.
According to the data diagnosis method for the distributed file system, provided by the embodiment of the invention, the client can receive three types of diagnosis information, namely data directory item information, data session control information and data index node information, sent by the server only by sending a data diagnosis instruction to the server through the client, generate a diagnosis file according to the diagnosis information, judge whether the data to be diagnosed is wrong according to the diagnosis file, and diagnose the data to be diagnosed in the distributed file system without dynamically operating the data to be diagnosed at the client, so that the data diagnosis is simpler and more convenient, the maintenance difficulty is lower, and the data diagnosis efficiency of the client is improved.
In the following, the distributed file system data diagnosis device provided by the embodiment of the present invention is introduced, and the distributed file system data diagnosis device described below and the distributed file system data diagnosis method described above may be referred to correspondingly.
Fig. 5 is a system block diagram of a distributed file system data diagnosis apparatus according to an embodiment of the present invention, and referring to fig. 5, the distributed file system data diagnosis apparatus may include: the instruction sending module 100, the data receiving module 200 and the data diagnosis module 300; wherein,
the instruction sending module 100 is configured to send a data diagnosis instruction to a server;
a data receiving module 200, configured to receive data to be diagnosed determined by the server according to the data diagnosis instruction, and send diagnostic information to the client after obtaining diagnostic information according to the data to be diagnosed, where the diagnostic information includes: data directory entry information, data session control information and data index node information;
the data diagnosis module 300 is configured to generate a diagnosis file including the diagnosis information according to the diagnosis information, and determine whether the data to be diagnosed is incorrect according to the diagnosis file.
Alternatively, fig. 6 shows a block diagram of a data diagnosis module 300 in the distributed file system data diagnosis apparatus according to the embodiment of the present invention, and referring to fig. 6, the data diagnosis module 300 may include: a first diagnostic unit 310, a second diagnostic unit 320 and a third diagnostic unit 330; wherein,
the first diagnosis unit 310 is configured to determine file names of the data to be diagnosed according to the data directory entry information, determine whether all the file names are unique, and if not, determine that the data to be diagnosed is incorrect;
the second diagnosis unit 320 is configured to determine whether the data to be diagnosed is abnormally changed according to the data session control information, and if the data to be diagnosed is abnormally changed, determine that the data to be diagnosed is in error;
a third diagnosing unit 330, configured to determine, according to the node information of the data, an index number of the data to be diagnosed, determine whether all the index numbers are unique, and if not, determine that the data to be diagnosed is in error.
Optionally, fig. 7 shows another structural block diagram of the data diagnosis module 300 in the distributed file system data diagnosis apparatus according to the embodiment of the present invention, and referring to fig. 7, the data diagnosis module 300 may further include: a judgment unit 340, a file generation unit 350, and an information writing unit 360; wherein,
a judging unit 340 for judging whether the diagnosis information is received;
a file generating unit 350, configured to generate a diagnostic file when diagnostic information is received, where the diagnostic file is in an info format;
an information writing unit 360, configured to write all the received diagnostic information into the diagnostic file.
Optionally, fig. 8 shows another system block diagram of the distributed file system data diagnosis apparatus according to the embodiment of the present invention, and referring to fig. 8, the distributed file system data diagnosis apparatus may further include: a decision block 400.
The judging module 400 is configured to judge whether the diagnostic information sent by the server is received within a predetermined time after the instruction sending module 100 sends the data diagnostic instruction to the server; if not, the instruction sending module 100 sends the data diagnosis instruction to the server again.
According to the data diagnosis device for the distributed file system, provided by the embodiment of the invention, the client can receive three types of diagnosis information, namely data directory item information, data session control information and data index node information, sent by the server only by sending a data diagnosis instruction to the server through the client, generate a diagnosis file according to the diagnosis information, judge whether the data to be diagnosed is wrong according to the diagnosis file, and diagnose the data to be diagnosed in the distributed file system without dynamically operating the data to be diagnosed at the client, so that the data diagnosis is simpler and more convenient, the maintenance difficulty is lower, and the efficiency of data diagnosis of the client is improved.
In the following description of the distributed file system data diagnosis system provided by the embodiment of the present invention, the distributed file system data diagnosis system described below includes the above-described distributed file system data diagnosis, and can be used to implement the above-described distributed file system data diagnosis method.
Fig. 9 is a system block diagram of a distributed file system data diagnosis system according to an embodiment of the present invention, and referring to fig. 9, the distributed file system data diagnosis system may include: a client 10 and a server 20; wherein,
the client 10 is used for sending a data diagnosis instruction to the server 20; receiving the diagnostic information sent to the client after the server 20 determines the data to be diagnosed according to the data diagnosis instruction and searches for the diagnostic information according to the data to be diagnosed, wherein the diagnostic information includes: data directory entry information, data session control information and data index node information; generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed is wrong or not according to the diagnosis file;
the server 20 is configured to receive the data diagnosis instruction sent by the client 10, determine data to be diagnosed according to the data diagnosis instruction, search for diagnosis information according to the data to be diagnosed, and send the diagnosis information to the client 10.
According to the data diagnosis system of the distributed file system, provided by the embodiment of the invention, the client can receive three types of diagnosis information, namely data directory item information, data session control information and data index node information, sent by the server only by sending a data diagnosis instruction to the server through the client, generate a diagnosis file according to the diagnosis information, judge whether the data to be diagnosed is wrong according to the diagnosis file, and diagnose the data to be diagnosed in the distributed file system without dynamically operating the data to be diagnosed at the client, so that the data diagnosis is simpler and more convenient, the maintenance difficulty is lower, and the efficiency of data diagnosis of the client is improved.
The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. For the device and the system disclosed by the embodiment, the description is simple because the device and the system correspond to the method disclosed by the embodiment, and the relevant points can be referred to the method part for description.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A distributed file system data diagnosis method is characterized by comprising the following steps:
the client sends a data diagnosis instruction to the server;
receiving the diagnosis information sent to the client after the server determines the data to be diagnosed according to the data diagnosis instruction and searches for the diagnosis information according to the data to be diagnosed, wherein the diagnosis information comprises: data directory entry information, data session control information and data index node information;
and generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed is wrong or not according to the diagnosis file.
2. The method according to claim 1, wherein the determining whether the data to be diagnosed is incorrect according to the diagnosis file comprises:
determining the file name of the data to be diagnosed according to the data directory entry information, judging whether all the file names are unique, and if not, judging that the data to be diagnosed is wrong;
determining whether the data to be diagnosed is abnormally changed or not according to the data session control information, and if so, judging that the data to be diagnosed is wrong;
and determining the index number of the data to be diagnosed according to the node information of the data, judging whether all the index numbers are unique, and if not, judging that the data to be diagnosed has errors.
3. The distributed file system data diagnosis method according to claim 1, wherein the generating a diagnosis file according to the diagnosis information comprises:
judging whether diagnosis information is received or not;
if so, generating a diagnosis file, wherein the diagnosis file is in an info format;
and writing all the received diagnosis information into the diagnosis file.
4. The distributed file system data diagnosis method according to claim 1, wherein after the client sends the data diagnosis instruction to the server, the method further comprises:
judging whether the diagnosis information sent by the server is received within preset time;
and if not, sending the data diagnosis instruction to the server again.
5. The method for diagnosing data in a distributed file system according to claim 1, wherein the step of generating a diagnostic file according to the diagnostic information further comprises: and displaying the diagnosis file through a display screen.
6. A distributed file system data diagnostic apparatus, comprising: the system comprises an instruction sending module, a data receiving module and a data diagnosis module; wherein,
the instruction sending module is used for sending a data diagnosis instruction to the server;
the data receiving module is configured to receive data to be diagnosed, which is determined by the server according to the data diagnosis instruction, and send diagnosis information to the client after obtaining the diagnosis information according to the data to be diagnosed, where the diagnosis information includes: data directory entry information, data session control information and data index node information;
and the data diagnosis module is used for generating a diagnosis file comprising the diagnosis information according to the diagnosis information and judging whether the data to be diagnosed is wrong or not according to the diagnosis file.
7. The distributed file system data diagnostic apparatus of claim 6, wherein the data diagnostic module comprises: a first diagnostic unit, a second diagnostic unit and a third diagnostic unit; wherein;
the first diagnosis unit is used for determining the file names of the data to be diagnosed according to the data directory entry information, judging whether all the file names are unique, and if not, judging that the data to be diagnosed is wrong;
the second diagnosis unit is used for determining whether the data to be diagnosed is abnormally changed or not according to the data session control information, and if the data to be diagnosed is abnormally changed, the data to be diagnosed is judged to be wrong;
and the third diagnosis unit is used for determining the index number of the data to be diagnosed according to the node information of the data, judging whether all the index numbers are unique, and if not, judging that the data to be diagnosed is wrong.
8. The distributed file system data diagnostic apparatus of claim 6, wherein the data diagnostic module further comprises: the device comprises a judging unit, a file generating unit and an information writing unit; wherein,
the judging unit is used for judging whether the diagnosis information is received or not;
the file generating unit is used for generating a diagnosis file when diagnosis information is received, wherein the diagnosis file is in an info format;
the information writing unit is used for writing all the received diagnosis information into the diagnosis file.
9. The distributed file system data diagnostic apparatus according to claim 6, further comprising: the judging module is used for judging whether the diagnosis information sent by the server is received within preset time after the instruction sending module sends the data diagnosis instruction to the server; if not, the instruction sending module sends the data diagnosis instruction to the server again.
10. A distributed file system data diagnostic system, comprising: a client and a server; wherein,
the client is used for sending a data diagnosis instruction to the server; receiving the diagnosis information sent to the client after the server determines the data to be diagnosed according to the data diagnosis instruction and searches for the diagnosis information according to the data to be diagnosed, wherein the diagnosis information comprises: data directory entry information, data session control information and data index node information; generating a diagnosis file comprising the diagnosis information according to the diagnosis information, and judging whether the data to be diagnosed is wrong or not according to the diagnosis file;
the server is used for receiving the data diagnosis instruction sent by the client, determining data to be diagnosed according to the data diagnosis instruction, searching according to the data to be diagnosed to obtain diagnosis information, and sending the diagnosis information to the client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510641019.9A CN105138706A (en) | 2015-09-30 | 2015-09-30 | Data diagnosis method, device and system for distributed type file system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510641019.9A CN105138706A (en) | 2015-09-30 | 2015-09-30 | Data diagnosis method, device and system for distributed type file system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105138706A true CN105138706A (en) | 2015-12-09 |
Family
ID=54724053
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510641019.9A Pending CN105138706A (en) | 2015-09-30 | 2015-09-30 | Data diagnosis method, device and system for distributed type file system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105138706A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107301131A (en) * | 2017-06-30 | 2017-10-27 | 郑州云海信息技术有限公司 | A kind of distributed storage management software fault diagnosis method and system |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0811939A3 (en) * | 1996-06-03 | 1998-12-30 | Webtv Networks, Inc. | Method and apparatus for providing proxying and transcoding of documents in a distributed metwork |
| CN101187930A (en) * | 2007-12-04 | 2008-05-28 | 浙江大学 | Distribution type file system dummy directory and name space implementing method |
| CN104077328A (en) * | 2013-03-29 | 2014-10-01 | 百度在线网络技术（北京）有限公司 | Operation diagnosis method and device for MapReduce distributed system |
| CN104219250A (en) * | 2014-09-26 | 2014-12-17 | 北京国双科技有限公司 | Webpage data acquisition method and apparatus and webpage data transmission method and device |
-
2015
- 2015-09-30 CN CN201510641019.9A patent/CN105138706A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0811939A3 (en) * | 1996-06-03 | 1998-12-30 | Webtv Networks, Inc. | Method and apparatus for providing proxying and transcoding of documents in a distributed metwork |
| CN101187930A (en) * | 2007-12-04 | 2008-05-28 | 浙江大学 | Distribution type file system dummy directory and name space implementing method |
| CN104077328A (en) * | 2013-03-29 | 2014-10-01 | 百度在线网络技术（北京）有限公司 | Operation diagnosis method and device for MapReduce distributed system |
| CN104219250A (en) * | 2014-09-26 | 2014-12-17 | 北京国双科技有限公司 | Webpage data acquisition method and apparatus and webpage data transmission method and device |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107301131A (en) * | 2017-06-30 | 2017-10-27 | 郑州云海信息技术有限公司 | A kind of distributed storage management software fault diagnosis method and system |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108683562B (en) | Anomaly detection positioning method and device, computer equipment and storage medium | |
| US20080065928A1 (en) | Technique for supporting finding of location of cause of failure occurrence | |
| CN112486629B (en) | Micro-service state detection method, micro-service state detection device, electronic equipment and storage medium | |
| CN113434464A (en) | Distributed log processing system and method | |
| CN102279787B (en) | Method and device for testing average fault-free time | |
| CN110674034A (en) | Health examination method and device, electronic equipment and storage medium | |
| CN111737137A (en) | Interface test data generation method and device, host and storage medium | |
| CN108920337A (en) | A kind of device exception information methods of exhibiting and computer equipment | |
| TWI498844B (en) | Engineering tool | |
| CN114218072A (en) | Test script generation method and device, storage medium and computer equipment | |
| CN113868058A (en) | Peripheral component high-speed interconnection equipment fault detection method and device and server | |
| CN117891671A (en) | Medical service terminal supervision method, system, electronic equipment and storage medium | |
| CN105138706A (en) | Data diagnosis method, device and system for distributed type file system | |
| CN115292113B (en) | Method and device for fault detection of internal memory of server and electronic equipment | |
| CN106708705B (en) | Terminal background process monitoring method and system | |
| CN111200654A (en) | Client request error processing method and device | |
| CN111158995A (en) | Method and system for realizing cross-system log tracking query based on skywalk and ELK platform | |
| CN112416735A (en) | Application program detection method and device, terminal equipment and storage medium | |
| KR20130029250A (en) | Method and apparatus for requesting examination and fault detection | |
| CN115344490A (en) | Method and device for testing software product, storage medium and electronic equipment | |
| CN112787839B (en) | Port description modification method and device | |
| CN110362464B (en) | Software analysis method and equipment | |
| CN113626136B (en) | Virtual machine fault detection method and device | |
| CN116541442B (en) | New energy automobile log analysis method and device | |
| CN111708684B (en) | Recording method and device for page access and computer system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20151209 |