CN109254928A - A kind of method of log processing, system, equipment and computer readable storage medium - Google Patents
A kind of method of log processing, system, equipment and computer readable storage medium Download PDFInfo
- Publication number
- CN109254928A CN109254928A CN201811131894.2A CN201811131894A CN109254928A CN 109254928 A CN109254928 A CN 109254928A CN 201811131894 A CN201811131894 A CN 201811131894A CN 109254928 A CN109254928 A CN 109254928A
- Authority
- CN
- China
- Prior art keywords
- log
- server
- default
- fast disk
- stored
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 38
- 238000004590 computer program Methods 0.000 claims description 6
- 230000009286 beneficial effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 6
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000006872 improvement Effects 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F12/00—Accessing, addressing or allocating within memory systems or architectures
- G06F12/02—Addressing or allocation; Relocation
- G06F12/0223—User address space allocation, e.g. contiguous or non contiguous base addressing
- G06F12/023—Free address space management
- G06F12/0238—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory
- G06F12/0246—Memory management in non-volatile memory, e.g. resistive RAM or ferroelectric memory in block erasable memory, e.g. flash memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/06—Management of faults, events, alarms or notifications
- H04L41/069—Management of faults, events, alarms or notifications using logs of notifications; Post-processing of notifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Abstract
This application discloses a kind of methods of log processing, comprising: obtains the business throughput of server；Judge whether business throughput is more than first threshold；If so, the log of server is stored path carry to default SSD fast disk.Technical solution provided herein, by the business throughput for first obtaining server, judge whether the business throughput is more than first threshold again, if it exceeds, the log of the server is then stored into path carry to default SSD fast disk, it is preset in SSD fast disk so that log can directly be stored to this, since the read-write efficiency for presetting SSD fast disk is more much higher than the read and write rate of common SAS disk, evade performance bottleneck of the server in log rule, greatly reduces the influence of the traffic handing capacity of diary service server.The application additionally provides the system, equipment and computer readable storage medium of a kind of log processing simultaneously, has above-mentioned beneficial effect.
Description
Technical field
This application involves log processing field, in particular to a kind of method of log processing, system, equipment and computer can
Read storage medium.
Background technique
Log storage path/var/log/icfs of server is defaulted as system disk/dev/sda, and server is set at present
The standard configuration of standby system disk is SAS disk, and when portfolio is bigger, the pressure that each node log generates is bigger than normal, in log
When traffic pressure is big can block traffic execute, the strong influence traffic handing capacity of server.
Therefore, how to reduce influence of the log to server service processing capacity is that those skilled in the art need to solve at present
Certainly the technical issues of.
Summary of the invention
The purpose of the application is to provide method, system, equipment and the computer readable storage medium of a kind of log processing, uses
In influence of the reduction log to server service processing capacity.
In order to solve the above technical problems, the application provides a kind of method of log processing, this method comprises:
Obtain the business throughput of server；
Judge whether the business throughput is more than first threshold；
If so, the log of the server is stored path carry to default SSD fast disk.
Optionally, the business throughput for obtaining server, comprising:
The business throughput of the server is obtained in real time.
Optionally, after the log of the server to be stored to path carry to default SSD fast disk, further includes:
Obtain the log quantity in the default SSD fast disk；
When the log quantity is more than second threshold, the log in the default SSD fast disk is uploaded to cloud.
Optionally, after the log of the server to be stored to path carry to default SSD fast disk, further includes:
Prompt information of the output comprising log storage path.
The application also provides a kind of system of log processing, which includes:
First obtains module, for obtaining the business throughput of server；
First judgment module, for judging whether the business throughput is more than first threshold；
Carry module, for when the business throughput is more than the first threshold, the log of the server to be deposited
Path carry is put to default SSD fast disk.
Optionally, the first acquisition module includes:
Real-time acquisition submodule, for obtaining the business throughput of the server in real time.
Optionally, further includes:
Second obtains module, for obtaining after path carry to default SSD fast disk is stored in the log of the server
Take the log quantity in the default SSD fast disk；
Uploading module is used for when the log quantity is more than second threshold, will be in the log in the default SSD fast disk
Reach cloud.
Optionally, further includes:
Output module, for after path carry to default SSD fast disk is stored in the log of the server, output to be wrapped
The prompt information in the path containing log storage.
The application also provides a kind of log processing equipment, which includes:
Memory, for storing computer program；
Processor realizes the step of the method for log processing as described in any of the above-described when for executing the computer program
Suddenly.
The application also provides a kind of computer readable storage medium, and calculating is stored on the computer readable storage medium
Machine program is realized as described in any of the above-described when the computer program is executed by processor the step of the method for log processing.
The method of log processing provided herein, comprising: obtain the business throughput of server；Judge business throughput
It whether is more than first threshold；If so, the log of server is stored path carry to default SSD fast disk.
Technical solution provided herein by first obtaining the business throughput of server, then judges that the business is handled up
Whether amount is more than first threshold, if it does, then by the log storage path carry of the server to default SSD fast disk, so that
Log can directly be stored to this and be preset in SSD fast disk, since the read-write efficiency for presetting SSD fast disk is faster than the read-write of common SAS disk
Rate is much higher, has evaded performance bottleneck of the server in log rule, has greatly reduced the business of diary service server
The influence of processing capacity.The application additionally provides the system, equipment and computer readable storage medium of a kind of log processing simultaneously,
With above-mentioned beneficial effect, details are not described herein.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
The embodiment of application for those of ordinary skill in the art without creative efforts, can also basis
The attached drawing of offer obtains other attached drawings.
Fig. 1 is a kind of flow chart of the method for log processing provided by the embodiment of the present application；
Fig. 2 is the flow chart of the method for another kind log processing provided by the embodiment of the present application；
Fig. 3 is a kind of structure chart of the system of log processing provided by the embodiment of the present application；
Fig. 4 is the structure chart of the system of another kind log processing provided by the embodiment of the present application；
Fig. 5 is a kind of structure chart of log processing equipment provided by the embodiment of the present application.
Specific embodiment
The core of the application is to provide method, system, equipment and the computer readable storage medium of a kind of log processing, uses
In influence of the reduction log to server service processing capacity.
To keep the purposes, technical schemes and advantages of the embodiment of the present application clearer, below in conjunction with the embodiment of the present application
In attached drawing, the technical scheme in the embodiment of the application is clearly and completely described, it is clear that described embodiment is
Some embodiments of the present application, instead of all the embodiments.Based on the embodiment in the application, those of ordinary skill in the art
Every other embodiment obtained without making creative work, shall fall in the protection scope of this application.
Referring to FIG. 1, Fig. 1 is a kind of flow chart of the method for log processing provided by the embodiment of the present application.
It specifically comprises the following steps:
S101: the business throughput of server is obtained；
The standard configuration of device systems disk based on current server is SAS disk, when portfolio is bigger, each node
The pressure that log generates is bigger than normal, diary service pressure is big when can block traffic execute, strong influence server
Traffic handing capacity, this application provides a kind of methods of log processing, for solving the above problems；
Business throughput is the quantity that system handles request within the unit time, optionally, business throughput can between
It is obtained every a period of time primary；
Preferably, specific to may be to further decrease influence of the log rule to server service processing capacity
The business throughput of server is obtained in real time.
S102: judge whether the business throughput is more than first threshold；
If so, entering step S103；
Optionally, when the business throughput is less than first threshold, then prove that server current business is less, log is fallen
Influence of the disk to server service processing capacity is smaller, then can not do any operation at this time；
The first threshold is specifically as follows to be determined according to the value of user's input, or server networking obtains, this Shen
Please the setting means of first threshold is not specifically limited.
S103: the log of server is stored into path carry to default SSD fast disk；
When the business throughput is more than first threshold, then prove that server current business is more, log rule is to service
Device traffic handing capacity is affected, and the log of server is stored path carry to default SSD fast disk, so as to generate at this time
Log all store to this and preset in SSD fast disk, for example, by taking server is AS13000 as an example, by by log write path (/
Var/log/icfs) mode that carry presets on SSD fast disk subregion can greatly improve the traffic handing capacity of AS13000, rule
AS13000 is kept away in the performance bottleneck of this part of log rule, the read and write rate of common SAS disk is per second in more than 100 M, the reading of SSD
Efficiency is write in 1G or more per second, log rule performance improves 10 times or more, can greatly improve the operational efficiency of AS13000；
Preferably, it after path carry to default SSD fast disk is stored in the log of server, can also export comprising day
Will stores the prompt information in path, to avoid there is the case where can not find log.
Based on the above-mentioned technical proposal, the method for a kind of log processing provided herein, by first obtaining server
Business throughput, then judge whether the business throughput is more than first threshold, if it does, then the log of the server is stored
Path carry is preset in SSD fast disk, due to presetting the reading of SSD fast disk to default SSD fast disk so that log can directly be stored to this
It is more much higher than the read and write rate of common SAS disk to write efficiency, has evaded performance bottleneck of the server in log rule, greatly drops
The low influence of the traffic handing capacity of diary service server.
It is directed to the step S103 of an embodiment, the log of server is being stored into path carry to default SSD fast disk
Later, step as shown in Figure 2 can also be performed, referring to FIG. 2, Fig. 2 is another kind log provided by the embodiment of the present application
The flow chart of the method for processing.
Itself specifically includes the following steps:
S201: the log quantity in default SSD fast disk is obtained；
S202: when log quantity is more than second threshold, the log in default SSD fast disk is uploaded to cloud.
It is directed to the case where being filled with there may be the log in default SSD fast disk, the embodiment of the present application is pre- by obtaining
If the log quantity in SSD fast disk, and when the log quantity is more than second threshold, this is preset in the log in SSD fast disk
Cloud is reached, the log in default SSD fast disk can be deleted later, to avoid there is default SSD fast disk off-capacity
Situation.
Referring to FIG. 3, Fig. 3 is a kind of structure chart of the system of log processing provided by the embodiment of the present application.
The system may include:
First obtains module 100, for obtaining the business throughput of server；
First judgment module 200, for judging whether business throughput is more than first threshold；
Carry module 300, for when business throughput is more than first threshold, path carry to be stored in the log of server
To default SSD fast disk.
Referring to FIG. 4, Fig. 4 is the structure chart of the system of another kind log processing provided by the embodiment of the present application.
This first acquisition module 100 may include:
Real-time acquisition submodule, for obtaining the business throughput of server in real time.
The system can also include:
Second obtains module, pre- for obtaining after path carry to default SSD fast disk is stored in the log of server
If the log quantity in SSD fast disk；
Uploading module, for when log quantity is more than second threshold, the log in default SSD fast disk to be uploaded to cloud
End.
The system can also include:
Output module, for after path carry to default SSD fast disk is stored in the log of server, output to include day
The prompt information in will storage path.
Each component part in system above can be applied in embodiment below:
Real-time acquisition submodule obtains the business throughput of server in real time；First judgment module judges that business throughput is
No is more than first threshold；When business throughput is more than first threshold, the log of server is stored path carry by carry module
To default SSD fast disk；
After path carry to default SSD fast disk is stored in the log of server, second, which obtains module, obtains default SSD
Log quantity in fast disk；When log quantity is more than second threshold, the log in default SSD fast disk is uploaded to by uploading module
Cloud；
After path carry to default SSD fast disk is stored in the log of server, output module output is deposited comprising log
Put the prompt information in path.
Referring to FIG. 5, Fig. 5 is a kind of structure chart of log processing equipment provided by the embodiment of the present application.
The log processing equipment 400 can generate bigger difference because configuration or performance are different, may include one or
More than one processor (central processing units, CPU) 422 (for example, one or more processors) and
Storage medium 430 (such as one or one of memory 432, one or more storage application programs 442 or data 444
The above mass memory unit).Wherein, memory 432 and storage medium 430 can be of short duration storage or persistent storage.It is stored in
The program of storage medium 430 may include one or more modules (diagram does not mark), and each module may include to dress
Series of instructions operation in setting.Further, central processing unit 422 can be set to communicate with storage medium 430, in day
The series of instructions operation in storage medium 430 is executed in will processing equipment 400.
Log processing equipment 400 can also include one or more power supplys 424, one or more wired or nothings
Wired network interface 450, one or more input/output interfaces 458, and/or, one or more operating systems 441,
Such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..
Step in the method for log processing described in above-mentioned Fig. 1 to Fig. 2 is based on shown in the Fig. 5 as log processing equipment
Structure realize.
It is apparent to those skilled in the art that for convenience and simplicity of description, the system of foregoing description,
The specific work process of device and module, can refer to corresponding processes in the foregoing method embodiment, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed device, device and method, it can be with
It realizes by another way.For example, the apparatus embodiments described above are merely exemplary, for example, the division of module,
Only a kind of logical function partition, there may be another division manner in actual implementation, such as multiple module or components can be with
In conjunction with or be desirably integrated into another system, or some features can be ignored or not executed.Another point, it is shown or discussed
Mutual coupling, direct-coupling or communication connection can be through some interfaces, the INDIRECT COUPLING of device or module or
Communication connection can be electrical property, mechanical or other forms.
Module may or may not be physically separated as illustrated by the separation member, show as module
Component may or may not be physical module, it can and it is in one place, or may be distributed over multiple networks
In module.Some or all of the modules therein can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
It, can also be in addition, can integrate in a processing module in each functional module in each embodiment of the application
It is that modules physically exist alone, can also be integrated in two or more modules in a module.Above-mentioned integrated mould
Block both can take the form of hardware realization, can also be realized in the form of software function module.
If integrated module is realized and when sold or used as an independent product in the form of software function module, can
To be stored in a computer readable storage medium.Based on this understanding, the technical solution of the application substantially or
Say that all or part of the part that contributes to existing technology or the technical solution can embody in the form of software products
Out, which is stored in a storage medium, including some instructions are used so that a computer equipment
The whole of (can be personal computer, funcall device or the network equipment etc.) execution each embodiment method of the application
Or part steps.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (Read-Only Memory,
ROM), random access memory (Random Access Memory, RAM), magnetic or disk etc. are various can store program
The medium of code.
Above to method, system, equipment and the computer readable storage medium of a kind of log processing provided herein
It is described in detail.Specific examples are used herein to illustrate the principle and implementation manner of the present application, the above reality
The explanation for applying example is merely used to help understand the present processes and its core concept.It should be pointed out that for the art
For those of ordinary skill, under the premise of not departing from the application principle, can also to the application, some improvement and modification can also be carried out,
These improvement and modification are also fallen into the protection scope of the claim of this application.
It should also be noted that, in the present specification, relational terms such as first and second and the like be used merely to by
One entity or operation are distinguished with another entity or operation, without necessarily requiring or implying these entities or operation
Between there are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant meaning
Covering non-exclusive inclusion, so that the process, method, article or equipment for including a series of elements not only includes that
A little elements, but also including other elements that are not explicitly listed, or further include for this process, method, article or
The intrinsic element of equipment.In the absence of more restrictions, the element limited by sentence "including a ...", is not arranged
Except there is also other identical elements in the process, method, article or equipment for including element.
Claims (10)
1. a kind of method of log processing characterized by comprising
Obtain the business throughput of server；
Judge whether the business throughput is more than first threshold；
If so, the log of the server is stored path carry to default SSD fast disk.
2. the method according to claim 1, wherein the business throughput for obtaining server, comprising:
The business throughput of the server is obtained in real time.
3. the method according to claim 1, wherein the log of the server is stored path carry to pre-
If after SSD fast disk, further includes:
Obtain the log quantity in the default SSD fast disk；
When the log quantity is more than second threshold, the log in the default SSD fast disk is uploaded to cloud.
4. the method according to claim 1, wherein the log of the server is stored path carry to pre-
If after SSD fast disk, further includes:
Prompt information of the output comprising log storage path.
5. a kind of system of log processing characterized by comprising
First obtains module, for obtaining the business throughput of server；
First judgment module, for judging whether the business throughput is more than first threshold；
Carry module, for when the business throughput is more than the first threshold, road to be stored in the log of the server
Diameter carry is to default SSD fast disk.
6. system according to claim 5, which is characterized in that described first, which obtains module, includes:
Real-time acquisition submodule, for obtaining the business throughput of the server in real time.
7. system according to claim 5, which is characterized in that further include:
Second obtains module, for obtaining institute after path carry to default SSD fast disk is stored in the log of the server
State the log quantity in default SSD fast disk；
Uploading module, for when the log quantity is more than second threshold, the log in the default SSD fast disk to be uploaded to
Cloud.
8. system according to claim 5, which is characterized in that further include:
Output module, for after path carry to default SSD fast disk is stored in the log of the server, output to include institute
State the prompt information in log storage path.
9. a kind of log processing equipment characterized by comprising
Memory, for storing computer program；
Processor realizes the method for the log processing as described in any one of Claims 1-4 when for executing the computer program
The step of.
10. a kind of computer readable storage medium, which is characterized in that be stored with computer on the computer readable storage medium
Program, realizing the method for log processing as described in any one of Claims 1-4 when the computer program is executed by processor
Step.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811131894.2A CN109254928A (en) | 2018-09-27 | 2018-09-27 | A kind of method of log processing, system, equipment and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811131894.2A CN109254928A (en) | 2018-09-27 | 2018-09-27 | A kind of method of log processing, system, equipment and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109254928A true CN109254928A (en) | 2019-01-22 |
Family
ID=65048028
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811131894.2A Withdrawn CN109254928A (en) | 2018-09-27 | 2018-09-27 | A kind of method of log processing, system, equipment and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109254928A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110119431A (en) * | 2019-05-14 | 2019-08-13 | 深信服科技股份有限公司 | A kind of the operation regulation method and relevant device of data synchronous task |
| CN111897649A (en) * | 2020-07-15 | 2020-11-06 | 西安万像电子科技有限公司 | Method and device for scheduling number of servers |
-
2018
- 2018-09-27 CN CN201811131894.2A patent/CN109254928A/en not_active Withdrawn
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110119431A (en) * | 2019-05-14 | 2019-08-13 | 深信服科技股份有限公司 | A kind of the operation regulation method and relevant device of data synchronous task |
| CN111897649A (en) * | 2020-07-15 | 2020-11-06 | 西安万像电子科技有限公司 | Method and device for scheduling number of servers |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230344729A1 (en) | Dynamic scaling of storage volumes for storage client file systems | |
| US11573831B2 (en) | Optimizing resource usage in distributed computing environments by dynamically adjusting resource unit size | |
| CN107832126B (en) | Thread adjusting method and terminal thereof | |
| US20170255409A1 (en) | Dynamic configuration of data volumes | |
| US9432484B1 (en) | CIM-based data storage management system having a restful front-end | |
| JP2018518736A (en) | Receive buffer credits over multiple channels of one or more host computing devices to transmit data to the control unit | |
| US10645164B1 (en) | Consistent latency for solid state drives | |
| US9298373B2 (en) | Placement and movement of sub-units of a storage unit in a tiered storage environment | |
| US10616134B1 (en) | Prioritizing resource hosts for resource placement | |
| CN109257758B (en) | Network capacity expansion method and device | |
| CN105743808A (en) | Method and device of adapting QoS | |
| CN109388614A (en) | A kind of method, system and the equipment of catalogue file number quota | |
| CN112650575B (en) | Resource scheduling method, device and cloud service system | |
| CN104216835A (en) | Method and device for implementing memory fusion | |
| US11307900B2 (en) | Adjustment of the number of central processing units to meet performance requirements of an I/O resource | |
| US20220179585A1 (en) | Management of Idle Time Compute Tasks in Storage Systems | |
| CN109324874A (en) | A kind of virutal machine memory snapshot imports the method, system and device of block device | |
| CN104641355A (en) | Adaptive service timeouts | |
| CN109254928A (en) | A kind of method of log processing, system, equipment and computer readable storage medium | |
| CN104243531A (en) | Data processing method, device and system | |
| CN105242955A (en) | Virtual machine disk input and output scheduling method and system | |
| CN114070755B (en) | Virtual machine network flow determination method and device, electronic equipment and storage medium | |
| CN105045873A (en) | Data file pushing method, apparatus and system | |
| CN112615795A (en) | Flow control method and device, electronic equipment, storage medium and product | |
| CN111510479A (en) | Resource allocation method and device for heterogeneous cache system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20190122 |
|
| WW01 | Invention patent application withdrawn after publication |