CN104361107A - Script tool implementation method for rapidly detecting consistency of files on multiple nodes - Google Patents
Script tool implementation method for rapidly detecting consistency of files on multiple nodes Download PDFInfo
- Publication number
- CN104361107A CN104361107A CN201410700532.6A CN201410700532A CN104361107A CN 104361107 A CN104361107 A CN 104361107A CN 201410700532 A CN201410700532 A CN 201410700532A CN 104361107 A CN104361107 A CN 104361107A
- Authority
- CN
- China
- Prior art keywords
- node
- script
- thread
- files
- total number
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 35
- 238000001514 detection method Methods 0.000 claims abstract description 19
- 238000004364 calculation method Methods 0.000 claims description 3
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/30—Arrangements for executing machine instructions, e.g. instruction decode
- G06F9/38—Concurrent instruction execution, e.g. pipeline or look ahead
- G06F9/3885—Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units
- G06F9/3889—Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units controlled by multiple instructions, e.g. MIMD, decoupled access or execute
- G06F9/3891—Concurrent instruction execution, e.g. pipeline or look ahead using a plurality of independent parallel functional units controlled by multiple instructions, e.g. MIMD, decoupled access or execute organised in groups of units sharing resources, e.g. clusters
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Stored Programmes (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Computer And Data Communications (AREA)
Abstract
The invention discloses a script tool implementation method for rapidly detecting the consistency of files on multiple nodes, which comprises the following specific implementation processes: the method comprises the steps that a script obtains a node name list set by a user during running, the node name list is specified by the user in advance, and the script obtains the list and then places the list into an array variable; the script automatically detects the number of processor cores of the node currently running the script, and sets the maximum bootable thread number of the script as the number of processor cores of the node where the script is currently located; counting the total number of the nodes, judging whether the total number of the nodes exceeds the maximum thread number which can be started by the script, and starting the threads; the thread of the start is used to detect whether the nodes in the node list are remotely loginable or not in parallel. Compared with the prior art, the script tool implementation method for rapidly detecting the consistency of the files on the multiple nodes greatly improves the speed of detecting the consistency of the files in batches of a large number of nodes and reduces the total detection execution time of the nodes.
Description
Technical field
The present invention relates to computer server technical field, specifically the conforming wscript.exe implementation method of a kind of practical, quick detection multinode files.
Background technology
Along with cluster is in the generally use of network service and high-performance computing sector, and the cluster scale that current each field uses also is expanding year by year, comprising the required equipment that the cluster to thousands of station server up to a hundred has become large-scale Internet company, supercomputing center.
And in the management of these large-scale clusters, inevitably each network-node server comprised in cluster is carried out to the operation of file consistence detection, general batch operation uses script to carry out, the general flow of script is by circulation, node server title in the long-range specified list of order, and perform same operation.This method is because be that order performs operated from a distance, so in the node server quantity of cluster when hundreds of, several thousand is even up to ten thousand, in this case, required time is the hundreds of, several thousand even up to ten thousand times of single server required time by the method that order performs, the speed of such detection will be lower, and practicality is not strong.
Based on this, now provide a kind of and detect the conforming wscript.exe implementation method of multinode files fast, the method can realize the consistance detecting multinode files fast.
Summary of the invention
Technical assignment of the present invention is for above weak point, provides a kind of practical, quick detection multinode files conforming wscript.exe implementation method.
The conforming wscript.exe implementation method of a kind of detection multinode files fast, its specific implementation process is:
1) script operationally obtains the node name list that user sets, and this node name list is that user specifies in advance, and script is placed in array variable after obtaining this list;
2) script detects the processor core quantity of the node of current Run Script automatically, and the bootable maximum thread arranging script is the processor core calculation of script current place node;
3) add up node total number amount, whether decision node total quantity exceedes the bootable maximum thread of script, and starts thread;
4) use node in the thread parallel detection node list started whether can Telnet;
5) when have in detecting node cannot Telnet time, exporting the corresponding node of prompting cannot Telnet, and prompting user revises node name list or checks corresponding node, and exits script;
6) when the detection in step 5) does not have node cannot Telnet, then use the thread parallel of startup to detect the conforming operation of different node files.
Described node name list is used to specify the node name used that will perform batch operation.
The detailed process of adding up number of nodes in described step 3) is: by the node listing obtained, and calculates node total number amount to be operated, then decision node total quantity with can start the size of maximum thread.
Described node total number amount and the judgement that can start maximum thread and the process starting thread are:
When node total number amount does not exceed the bootable maximum thread of script, start the thread of respective numbers by node total number amount; When node total number amount exceedes the bootable maximum thread of script, start the thread of respective numbers by the bootable maximum thread of script;
Corresponding, when node total number amount exceedes the bootable maximum thread of script, then each parallel detection carried out with start line number of passes in step 4), gradation is until last node in node name list has been detected.
Remote entry method in described step 4), step 5), step 6) comprises ssh login, rsh logs in.
One of the present invention detects the conforming wscript.exe implementation method of multinode files fast, has the following advantages:
The one of this invention detects the conforming wscript.exe implementation method of multinode files fast and replaces sequential operation by parallel work-flow, greatly improve the speed of the batch detection file consistence to great deal of nodes, reduce total detection execution time of great deal of nodes, practicality is stronger, applied widely, be easy to promote.
Embodiment
Below in conjunction with specific embodiment, the invention will be further described.
The invention provides the conforming wscript.exe implementation method of a kind of detection multinode files fast, can be used for detecting fast the conforming instrument of great deal of nodes files in cluster, method of the present invention can after user sets node name list, start multiple thread to perform the operation different node detecting file consistence, its specific implementation process is:
1) script operationally obtains the node name list that user sets, and this node name list is that user specifies in advance, and script is placed in array variable after obtaining this list;
2) script detects the processor core quantity of the node of current Run Script automatically, and the bootable maximum thread arranging script is the processor core calculation of script current place node;
3) add up node total number amount, whether decision node total quantity exceedes the bootable maximum thread of script, and starts thread;
4) use node in the thread parallel detection node list started whether can Telnet;
5) when have in detecting node cannot Telnet time, exporting the corresponding node of prompting cannot Telnet, and prompting user revises node name list or checks corresponding node, and exits script;
6) when the detection in step 5) does not have node cannot Telnet, then use the thread parallel of startup to detect the conforming operation of different node files.
Described node name list is used to specify the node name used that will perform batch operation.
The detailed process of adding up number of nodes in described step 3) is: by the node listing obtained, and calculates node total number amount to be operated, then decision node total quantity with can start the size of maximum thread.
Described node total number amount and the judgement that can start maximum thread and the process starting thread are:
When node total number amount does not exceed the bootable maximum thread of script, start the thread of respective numbers by node total number amount; When node total number amount exceedes the bootable maximum thread of script, start the thread of respective numbers by the bootable maximum thread of script;
Corresponding, when node total number amount exceedes the bootable maximum thread of script, then each batch operation carried out with start line number of passes on the different node of executed in parallel in step 4), gradation is until last node in node name list has been detected.
Remote entry method in described step 4), step 5), step 6) comprises ssh login, rsh logs in.
Above-mentioned embodiment is only concrete case of the present invention; scope of patent protection of the present invention includes but not limited to above-mentioned embodiment; claims of any a kind of quick detection multinode files according to the invention conforming wscript.exe implementation method and the those of ordinary skill of any described technical field to its suitable change done or replacement, all should fall into scope of patent protection of the present invention.
Claims (5)
1. detect the conforming wscript.exe implementation method of multinode files fast, it is characterized in that, its specific implementation process is:
1) script operationally obtains the node name list that user sets, and this node name list is that user specifies in advance, and script is placed in array variable after obtaining this list;
2) script detects the processor core quantity of the node of current Run Script automatically, and the bootable maximum thread arranging script is the processor core calculation of script current place node;
3) add up node total number amount, whether decision node total quantity exceedes the bootable maximum thread of script, and starts thread;
4) use node in the thread parallel detection node list started whether can Telnet;
5) when have in detecting node cannot Telnet time, exporting the corresponding node of prompting cannot Telnet, and prompting user revises node name list or checks corresponding node, and exits script;
6) when the detection in step 5) does not have node cannot Telnet, then use the thread parallel of startup to detect the conforming operation of different node files.
2. one according to claim 1 detects the conforming wscript.exe implementation method of multinode files fast, it is characterized in that, described node name list is used to specify the node name used that will perform batch operation.
3. one according to claim 1 detects the conforming wscript.exe implementation method of multinode files fast, it is characterized in that, the detailed process of adding up number of nodes in described step 3) is: by the node listing obtained, calculate node total number amount to be operated, then decision node total quantity with can start the size of maximum thread.
4. one according to claim 3 detects the conforming wscript.exe implementation method of multinode files fast, it is characterized in that, described node total number amount and the judgement that can start maximum thread and the process starting thread are:
When node total number amount does not exceed the bootable maximum thread of script, start the thread of respective numbers by node total number amount; When node total number amount exceedes the bootable maximum thread of script, start the thread of respective numbers by the bootable maximum thread of script;
Corresponding, when node total number amount exceedes the bootable maximum thread of script, then each parallel detection carried out with start line number of passes in step 4), gradation is until last node in node name list has been detected.
5. one according to claim 1 detects the conforming wscript.exe implementation method of multinode files fast, it is characterized in that, the remote entry method in described step 4), step 5), step 6) comprises ssh login, rsh logs in.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410700532.6A CN104361107A (en) | 2014-11-28 | 2014-11-28 | Script tool implementation method for rapidly detecting consistency of files on multiple nodes |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410700532.6A CN104361107A (en) | 2014-11-28 | 2014-11-28 | Script tool implementation method for rapidly detecting consistency of files on multiple nodes |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN104361107A true CN104361107A (en) | 2015-02-18 |
Family
ID=52528367
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410700532.6A Pending CN104361107A (en) | 2014-11-28 | 2014-11-28 | Script tool implementation method for rapidly detecting consistency of files on multiple nodes |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104361107A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090178044A1 (en) * | 2008-01-09 | 2009-07-09 | Microsoft Corporation | Fair stateless model checking |
| CN102171650A (en) * | 2008-11-24 | 2011-08-31 | 英特尔公司 | Systems, methods, and apparatuses to decompose a sequential program into multiple threads, execute said threads, and reconstruct the sequential execution |
| CN103019776A (en) * | 2012-11-30 | 2013-04-03 | 浪潮电子信息产业股份有限公司 | Method for concurrent installation of various softwares in server cluster |
| CN103106068A (en) * | 2013-02-28 | 2013-05-15 | 江苏物联网研究发展中心 | Internet of things big data fast calibration method |
-
2014
- 2014-11-28 CN CN201410700532.6A patent/CN104361107A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090178044A1 (en) * | 2008-01-09 | 2009-07-09 | Microsoft Corporation | Fair stateless model checking |
| CN102171650A (en) * | 2008-11-24 | 2011-08-31 | 英特尔公司 | Systems, methods, and apparatuses to decompose a sequential program into multiple threads, execute said threads, and reconstruct the sequential execution |
| CN103019776A (en) * | 2012-11-30 | 2013-04-03 | 浪潮电子信息产业股份有限公司 | Method for concurrent installation of various softwares in server cluster |
| CN103106068A (en) * | 2013-02-28 | 2013-05-15 | 江苏物联网研究发展中心 | Internet of things big data fast calibration method |
Non-Patent Citations (1)
| Title |
|---|
| TUOHUANG0303: "Shell脚本中并发线程以及并发数的控制", 《HTTP://BLOG.CHINAUNIX.NET/UID-8478094-ID-3995108.HTML》 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106294120B (en) | Method, apparatus and computer program product for testing code | |
| US10284577B2 (en) | Method and apparatus for file identification | |
| CN104834537A (en) | Data processing method, server and client | |
| CN103092650A (en) | Virtual machine mirror image generating method and device based on software preinstallation in cloud environment | |
| US20160098390A1 (en) | Command history analysis apparatus and command history analysis method | |
| WO2017000761A1 (en) | Method and apparatus for extracting feature information of terminal device | |
| US10067860B2 (en) | Defining test bed requirements | |
| CN113177732A (en) | Process flow management method, device, medium and terminal equipment | |
| WO2017007488A1 (en) | Staged application rollout | |
| CN103970655A (en) | Expect-based automatic server cluster testing method | |
| CN112000457A (en) | Method, apparatus and computer program product for managing tasks in a processing system | |
| JP6190539B2 (en) | Log analysis apparatus, log analysis system, log analysis method, and computer program | |
| CN110266598B (en) | Routing information processing method, device, equipment and readable storage medium | |
| CN104376086B (en) | Data processing method and device | |
| JP2015011413A (en) | Verification automation method | |
| CN105978939A (en) | Data downloading method and data downloading device | |
| CN110995489B (en) | Large data platform server management method, device, server and storage medium | |
| CN104361107A (en) | Script tool implementation method for rapidly detecting consistency of files on multiple nodes | |
| CN106156210B (en) | Method and device for determining application identifier matching list | |
| CN107632864B (en) | Method for establishing UEFI Boot Order of specific ordering | |
| CN104516970B (en) | A kind of method and apparatus for carrying out log analysis | |
| CN109814911A (en) | Method, apparatus, computer equipment and storage medium for Manage Scripts program | |
| US20130297283A1 (en) | Information processing device, information processing method, and program | |
| CN114297067A (en) | Script testing method and device | |
| CN116846799A (en) | Game server stress test method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20150218 |
|
| WD01 | Invention patent application deemed withdrawn after publication |