CN117971618A - Database performance problem processing method, device, equipment, medium and product - Google Patents
Database performance problem processing method, device, equipment, medium and product Download PDFInfo
- Publication number
- CN117971618A CN117971618A CN202311696554.5A CN202311696554A CN117971618A CN 117971618 A CN117971618 A CN 117971618A CN 202311696554 A CN202311696554 A CN 202311696554A CN 117971618 A CN117971618 A CN 117971618A
- Authority
- CN
- China
- Prior art keywords
- performance problem
- target
- database
- analysis
- performance
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 34
- 238000004458 analytical method Methods 0.000 claims abstract description 216
- 238000000034 method Methods 0.000 claims abstract description 58
- 238000012545 processing Methods 0.000 claims abstract description 49
- 239000000243 solution Substances 0.000 claims description 74
- 230000008569 process Effects 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 19
- 238000003860 storage Methods 0.000 claims description 13
- 238000005192 partition Methods 0.000 claims description 11
- 239000012088 reference solution Substances 0.000 claims description 10
- 238000012549 training Methods 0.000 claims description 8
- 230000007246 mechanism Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000004891 communication Methods 0.000 description 7
- 230000003287 optical effect Effects 0.000 description 4
- 238000005457 optimization Methods 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012300 Sequence Analysis Methods 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application discloses a database performance problem processing method, device, equipment, medium and product, and relates to the technical field of big data. The method comprises the following steps: acquiring a description information text corresponding to a target database performance problem to be analyzed; matching performance problem classifications corresponding to the performance problems of the target database based on the descriptive information text to obtain target performance problem classification information; acquiring a target analysis rule set associated with target performance problem category information; based on the target analysis rule set, an analysis result report corresponding to the target database performance problem is generated, and the analysis result report is used for determining a performance problem solution corresponding to the target database performance problem. According to the embodiment of the application, the automatic analysis and processing of the database performance problem can be more efficiently and accurately realized, so that the overall database performance management and control efficiency can be effectively improved, and the working efficiency of developers can be improved.
Description
Technical Field
The application belongs to the technical field of big data, and particularly relates to a database performance problem processing method, a device, equipment, a medium and a product.
Background
At present, the performance problem of an IT (internet Technology ) system database is a key for influencing the stable operation of the system, and along with the rapid increase of the user quantity and the data quantity, the performance requirement of the application database is also higher and higher, and the performance problem becomes one of the reasons of the production events of each system. The ability to quickly analyze performance problems with databases is not available to most developers and requires reliance on database administrators for performance problem analysis.
Based on this, a new solution for processing database performance problems is still needed in the industry to realize efficient and accurate analysis of the database performance problems, so as to achieve the purpose of quickly solving the database performance problems.
Disclosure of Invention
The embodiment of the application provides a method, a device, equipment, a medium and a product for processing database performance problems, which can more efficiently and accurately realize the automatic analysis and processing of the database performance problems, thereby effectively improving the overall database performance management and control efficiency and the working efficiency of developers.
In a first aspect, an embodiment of the present application provides a method for processing a database performance problem, where the method for processing a database performance problem includes:
Acquiring a description information text corresponding to a target database performance problem to be analyzed;
matching performance problem classifications corresponding to the performance problems of the target database based on the descriptive information text to obtain target performance problem classification information;
Acquiring a target analysis rule set associated with target performance problem category information;
based on the target analysis rule set, an analysis result report corresponding to the target database performance problem is generated, and the analysis result report is used for determining a performance problem solution corresponding to the target database performance problem.
In some possible embodiments, after generating the analysis result report corresponding to the target database performance problem, the database performance problem processing method further includes:
inputting the analysis result report into a preset solution generating model to obtain a performance problem solution corresponding to the performance problem of the target database;
the preset solution generating model is obtained by training based on the historical database performance problem and the corresponding historical solution in advance.
In some possible embodiments, after the analysis result report is input into the preset solution generation model, the database performance problem processing method further includes:
if the performance problem solution corresponding to the performance problem of the target database cannot be obtained, outputting an analysis result report for manual analysis;
recording a reference solution obtained by manual analysis, and retraining a preset solution generating model based on the reference solution to obtain an updated preset solution generating model.
In some possible embodiments, generating an analysis result report corresponding to the target database performance problem based on the target analysis rule set includes:
acquiring script programs corresponding to each analysis rule in a target analysis rule set;
And executing script programs corresponding to each analysis rule in the target analysis rule set respectively, summarizing to obtain execution results of each script program, and generating an analysis result report.
In some possible embodiments, before acquiring the descriptive information text corresponding to the target database performance problem to be analyzed, the database performance problem processing method further includes:
responding to a starting instruction of the performance problem analysis task, and starting a scheduling task program of a sentinel mechanism;
After obtaining the target analysis rule set associated with the target performance problem category information, the database performance problem processing method further includes:
generating a target message of which the target database performance problem is matched with the target analysis rule set, and sending the target message to a scheduling task program;
And under the condition that the scheduling task program consumes the target message, starting a preset process to schedule and execute script programs corresponding to all analysis rules in the target analysis rule set.
In some possible embodiments, before matching the performance problem classification corresponding to the performance problem of the target database based on the descriptive information text to obtain the performance problem class information of the target database, the database performance problem processing method further includes:
Acquiring known database performance problems, and constructing a database performance problem classification table based on the acquired known database performance problems, wherein the database performance problem classification table comprises performance problem category information corresponding to at least one performance problem classification;
Respectively defining respectively associated analysis rule sets for the performance problem category information in the database performance problem classification table;
matching performance problem classification corresponding to the performance problem of the target database based on the description information text to obtain target performance problem category information, wherein the matching comprises the following steps:
and matching the performance problem classification corresponding to the performance problem of the target database from the database performance problem classification table based on the descriptive information text to obtain the target performance problem category information.
In some possible implementations, the database performance problem classification table includes at least one of an index class, a database table partition class, a structured query language SQL statement class, and a sequence class.
Based on the same inventive concept, in a second aspect, an embodiment of the present application provides a database performance problem processing apparatus, including:
The first acquisition module is used for acquiring descriptive information text corresponding to the performance problem of the target database to be analyzed;
The first matching module is used for matching the performance problem classification corresponding to the performance problem of the target database based on the descriptive information text to obtain target performance problem class information;
The second acquisition module is used for acquiring a target analysis rule set associated with the target performance problem category information;
the first generation module is used for generating an analysis result report corresponding to the performance problem of the target database based on the target analysis rule set, wherein the analysis result report is used for determining a performance problem solution corresponding to the performance problem of the target database.
In a third aspect, an embodiment of the present application provides a database performance problem processing apparatus, including:
a processor and a memory storing computer program instructions;
the processor executes the computer program instructions to implement the method for processing database performance problems provided in any one of the embodiments of the present application.
In a fourth aspect, embodiments of the present application provide a computer storage medium having stored thereon computer program instructions which, when executed by a processor, implement a method for processing a database performance problem as provided in any of the above embodiments of the present application.
In a fifth aspect, an embodiment of the present application provides a computer program product, where instructions in the computer program product, when executed by a processor of an electronic device, cause the electronic device to perform a method for processing a database performance problem according to any one of the embodiments of the present application.
According to the database performance problem processing method, device, equipment, medium and product, the description information text corresponding to the target database performance problem to be analyzed is obtained, and the performance problem classification corresponding to the target database performance problem is matched according to the description information text, so that the target performance problem category information is obtained. Thus, after the target analysis rule set associated with the target performance problem category information is obtained, an analysis result report corresponding to the performance problem of the target database can be generated based on the target analysis rule set, and the analysis result report can be used for determining a performance problem solution corresponding to the performance problem of the target database. As can be seen from the above description, according to the method, the device, the equipment, the medium and the product for processing the database performance problem in the embodiment of the application, the database performance problem is subjected to programmed matching classification and associated corresponding analysis rule sets, and then the database performance problem is automatically analyzed according to the corresponding analysis rule sets, so that an analysis result report can be finally obtained to determine a solution corresponding to the performance problem, and thus, the automatic analysis processing of the database performance problem can be more efficiently and accurately realized, and further, the overall database performance management and control efficiency and the working efficiency of developers can be effectively improved.
Drawings
In order to more clearly illustrate the technical solution of the embodiments of the present application, the drawings that are needed to be used in the embodiments of the present application will be briefly described, and it is possible for a person skilled in the art to obtain other drawings according to these drawings without inventive effort.
FIG. 1 is a flowchart of a database performance problem processing method according to an embodiment of the present application;
FIG. 2 is a schematic flow chart of a database performance problem processing method according to an embodiment of the present application;
FIG. 3 is a schematic diagram of a database performance problem processing apparatus according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a database performance problem processing apparatus according to an embodiment of the present application.
Detailed Description
Features and exemplary embodiments of various aspects of the present application will be described in detail below, and in order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described in further detail below with reference to the accompanying drawings and the detailed embodiments. It should be understood that the particular embodiments described herein are meant to be illustrative of the application only and not limiting. It will be apparent to one skilled in the art that the present application may be practiced without some of these specific details. The following description of the embodiments is merely intended to provide a better understanding of the application by showing examples of the application.
It is noted that relational terms such as first and second, and the like are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Moreover, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
It should be noted that, in the technical scheme of the application, the acquisition, storage, use, processing and the like of the data all meet the relevant regulations of national laws and regulations.
As described in the background section, there are generally two ways to analyze database performance at present.
The first way is: and (3) manually operating the query system by a database manager to analyze, and informing an application developer of the analysis result or the performance optimization suggestion, and making an optimization technical scheme and modifying the system by the application developer. The manual operation and point-to-point communication mode adopted by the mode has slower efficiency and hysteresis, and the performance analysis of a certain problem is performed in the historical problem analysis in many times, so that the repeated problem analysis process exists.
The second way is: with database performance scanning tools, and has gradually replaced the first approach, the approach to primary database performance analysis. Some large companies can construct own database performance scanning tools, the purpose of the scanning platform is to find performance problems, and then the problem flows are transferred to application developers for analysis and optimization, so that an optimization transformation scheme is formulated. In such a way, the scanning tool can scan out a plurality of SQL (Structured Query Language ) sentences with performance problems, and the problems are that because the scanning tool is not flexible enough, false alarm situations can occur, developers need to analyze one by one, in the analysis process, analysis works such as a database execution plan query and a system log query are repeated according to sql_id, the workload is large, a great deal of time is needed, and the working efficiency is low.
In view of the foregoing, in order to solve the problems in the prior art, embodiments of the present application provide a database performance problem processing method, apparatus, device, computer storage medium, and program product. It should be noted that the examples provided by the present application are not intended to limit the scope of the present disclosure.
The method for processing database performance problems provided by the embodiment of the application is first described below.
Fig. 1 is a flow chart illustrating a method for processing database performance problems according to an embodiment of the application. The database performance problem processing method is applied to electronic equipment, and the electronic equipment can comprise a server, a user terminal or the like. As shown in fig. 1, the database performance problem processing method includes the following steps:
S110, acquiring a description information text corresponding to a target database performance problem to be analyzed;
S120, matching performance problem classifications corresponding to the performance problems of the target database based on the descriptive information text to obtain target performance problem classification information;
s130, acquiring a target analysis rule set associated with target performance problem category information;
And S140, generating an analysis result report corresponding to the performance problem of the target database based on the target analysis rule set, wherein the analysis result report is used for determining a performance problem solution corresponding to the performance problem of the target database.
According to the database performance problem processing method provided by the embodiment of the application, the description information text corresponding to the target database performance problem to be analyzed is obtained, and the performance problem classification corresponding to the target database performance problem is matched according to the description information text, so that the target performance problem category information is obtained. Thus, after the target analysis rule set associated with the target performance problem category information is obtained, an analysis result report corresponding to the performance problem of the target database can be generated based on the target analysis rule set, and the analysis result report can be used for determining a performance problem solution corresponding to the performance problem of the target database.
According to the database performance problem processing method disclosed by the embodiment of the application, the database performance problems are subjected to programmed matching classification and associated corresponding analysis rule sets, and then the database performance problems are automatically analyzed according to the corresponding analysis rule sets, so that an analysis result report can be finally obtained to determine a solution corresponding to the performance problems, and thus, the automatic analysis processing of the database performance problems can be more efficiently and accurately realized, and further, the overall database performance management and control efficiency and the working efficiency of developers can be effectively improved.
Specific implementations of the steps 110 to 140 are described in detail below.
In S110, in a specific implementation, a description information text corresponding to the performance problem of the target database to be analyzed is obtained, for example, the description information text corresponding to the performance problem of the target database to be analyzed may be obtained through means such as external manual introduction or internal program generation.
In this embodiment, in order to facilitate the subsequent efficient analysis of the performance problem of the target database based on the descriptive information text, the descriptive information file may be further defined as a text file in a structured data format.
More specifically, the description information file may specifically include: one or more of database instance names, sql_id, sql statements, problem categories, problem descriptions, occurrence times, etc., which are not strictly limited in this embodiment, may be specifically determined according to the actual automation analysis requirements.
In the step S120, in a specific implementation, after the performance problem of the target database to be analyzed is obtained, the performance problem classification corresponding to the performance problem of the target database may be matched based on the information included in the description information text, so as to obtain the target performance problem category information corresponding to the performance problem of the target database according to the matching result.
In some possible embodiments, optionally, in order to facilitate more efficiently and reasonably implementing the performance problem classification matching operation corresponding to the performance problem of the target database, before matching the performance problem classification corresponding to the performance problem of the target database based on the descriptive information text to obtain the target performance problem category information, the database performance problem processing method may further include:
Acquiring known database performance problems, and constructing a database performance problem classification table based on the acquired known database performance problems, wherein the database performance problem classification table can comprise performance problem category information corresponding to at least one performance problem classification;
Respectively defining respectively associated analysis rule sets for the performance problem category information in the database performance problem classification table;
Matching the performance problem classification corresponding to the performance problem of the target database based on the description information text to obtain target performance problem class information, which may include:
and matching the performance problem classification corresponding to the performance problem of the target database from the database performance problem classification table based on the descriptive information text to obtain the target performance problem category information.
In particular, the performance problems encountered by the database in the history stage can be recorded, so that the collection of the performance problems of the known database is realized.
In this way, after the known database performance problems are collected, the known database performance problems may be classified by using actual processing experience or the like, to obtain the database performance problem classification table.
The database performance problem classification table may include different performance problem category information, and relevant feature information corresponding to each performance problem category information, etc. In this way, when matching is specifically performed, the characteristic information corresponding to different classifications may be compared with the information in the description information text, so as to determine the target performance problem category information corresponding to the target database performance problem, which is not strictly limited in this embodiment.
According to some embodiments of the application, optionally, the database performance problem classification table may include at least one of an index class, a database table partition class, a structured query language SQL statement class, and a sequence class.
More specifically, the data performance problem corresponding to the index class may be, for example: the number of indexes is excessive, more than sorting, the number of fields contained in a single index is more than 5, redundant indexes, the same field is used for a plurality of indexes, etc. The data performance problem corresponding to the database table partition class may be, for example: the large database table is not partitioned, the partition field does not use a single field as the partition field, the number of partitions is not the power of 2 when the hash partition is performed, and the total database partition number is super-set with a threshold value.
The data performance problem corresponding to the Sql statement class may be, for example: the sql statement logically reads high, the sql statement physically reads high, the sql statement performs full table scanning, the sql statement walks INDEX SKIP SCAN, the sql statement has a plurality of execution plans, the sql analysis fails, the sql text length is very long, binding variables are not used, the sql is not paged, and the like.
The data performance problem corresponding to the sequence class may be, for example: the cache setting for the sequence is below a threshold. Other classes of corresponding data performance issues may be flexibly designed according to other analysis requirements, and the present example is not strictly limited herein.
In the specific implementation in S130, after determining the target performance problem category information corresponding to the performance problem of the target database, the target analysis rule set associated with the target performance problem category information may be determined by querying the association relationship between the performance problem category information stored in the response storage platform and the analysis rule set.
The association relationship between the performance problem category information and the analysis rule set may be predefined, the target analysis rule set may include at least one analysis rule, and the analysis rule may be used to analyze and detect specific content in the descriptive text information corresponding to the performance problem of the target database, which is not limited in this embodiment.
In the specific implementation in S140, after the target analysis rule set corresponding to the target performance problem category information is acquired, an analysis result report corresponding to the target database performance problem is automatically generated according to the analysis rules included in the target analysis rule set. Wherein the analysis result report may be used to determine a performance problem solution corresponding to the performance problem of the target database.
Furthermore, in order to more reasonably implement the management and control processing of the performance problem of the target database, after the analysis result report corresponding to the performance problem of the target database is generated, the method for processing the performance problem of the database may further include:
inputting the analysis result report into a preset solution generating model to obtain a performance problem solution corresponding to the performance problem of the target database;
the preset solution generating model is obtained by training based on the historical database performance problem and the corresponding historical solution in advance.
In this embodiment, the preset solution generating model may be obtained by learning and training the historical database performance problem and the corresponding historical solution based on an API (Application Program Interface ) interface opened by AIGG big models, for example.
And an analysis result file corresponding to the historical database performance problem can be introduced in the training process, so that after the analysis result report corresponding to the target database performance problem is received, a performance problem solution corresponding to the target database performance problem is obtained through analysis and calculation, so that solution guidance can be provided for subsequent developers, and meanwhile, dependence on a professional database manager is reduced or even eliminated.
In some possible embodiments, in order to enable more flexibility in analyzing a database, flexible configuration implementation can be implemented so as to be capable of adapting to various database performance problem analyses, after the analysis result report is input into the preset solution generating model, the database performance problem processing method may further include:
if the performance problem solution corresponding to the performance problem of the target database cannot be obtained, outputting an analysis result report for manual analysis;
recording a reference solution obtained by manual analysis, and retraining a preset solution generating model based on the reference solution to obtain an updated preset solution generating model.
In particular, when the performance problem solution corresponding to the performance problem of the target database cannot be generated after the analysis result report corresponding to the performance problem of the target database is input into the preset solution generation model, it can be explained that the performance problem may be a new problem.
Under the condition, outputting the performance problem solution corresponding to the performance problem of the target database, wherein the output can be realized in the modes of short messages, mails or front-end display interface popup windows and the like, so that corresponding personnel can intervene in time in manual intervention analysis.
In this embodiment, when the same database performance problem occurs again later, the preset solution generating model may quickly and accurately generate a corresponding solution, and may further import and record a reference solution obtained by manual analysis, and retrain the preset solution generating model based on the reference solution, so as to obtain an updated preset solution generating model.
Therefore, after the target database performance problem appears again later, the updated preset solution generating model can be used for generating a corresponding solution, so that the database performance on the whole can be effectively controlled.
In some possible embodiments, in combination with consideration of an actual analysis scenario, in order to more effectively program and automate repeated tasks of analyzing performance problems, so as to improve working efficiency of a developer in working, the generating an analysis result report corresponding to a target database performance problem based on a target analysis rule set may specifically include:
acquiring script programs corresponding to each analysis rule in a target analysis rule set;
And executing script programs corresponding to each analysis rule in the target analysis rule set respectively, summarizing to obtain execution results of each script program, and generating an analysis result report.
In the specific implementation, the analysis processing operation for analyzing the database performance problem is integrated, so that the analysis processing operation is converted into program automation, and corresponding analysis script programs are written for analysis rules included in different analysis rule sets.
In this embodiment, after the target analysis rule set is obtained, script programs corresponding to the analysis rules in the target analysis rule set may be obtained, and the execution sequence of the script programs may be controlled to execute the script programs corresponding to the analysis rules in the target analysis rule set, respectively. Thus, after the execution of the script program is completed, the execution results of the script programs are obtained by summarizing, and the analysis result report can be generated.
In some possible embodiments, more specifically, in combination with the actual scenario scheduling scenario consideration, before the obtaining the description information text corresponding to the target database performance problem to be analyzed, the database performance problem processing method may further include:
responding to a starting instruction of the performance problem analysis task, and starting a scheduling task program of a sentinel mechanism;
After acquiring the target analysis rule set associated with the target performance problem category information, the database performance problem processing method may further include:
generating a target message of which the target database performance problem is matched with the target analysis rule set, and sending the target message to a scheduling task program;
And under the condition that the scheduling task program consumes the target message, starting a preset process to schedule and execute script programs corresponding to all analysis rules in the target analysis rule set.
Specifically, the performance problem analysis task is started after responding to a start instruction of the performance problem analysis task. In the event that the performance problem analysis task is initiated, a dispatch task program of a sentinel mechanism waiting to receive the message is initiated.
After the description information text corresponding to the performance problem of the target database is imported, the program performs description information text according to the imported data file, matches corresponding target performance problem category information from the database performance problem classification table according to the description information text, associates a pre-defined analysis rule set and a script library corresponding to the target performance problem category information, and generates a target message that the target database performance problem is matched with the target analysis rule set.
In this way, the target information matched with the association is sent to the scheduling task program, and after the scheduling task program consumes the target information, a preset process is started to schedule the script program corresponding to each analysis rule so as to finally obtain an analysis result report corresponding to the performance problem of the target database.
In order to facilitate understanding of the database performance problem processing method provided in the above embodiment, the method will be described in the following with a specific embodiment of a scenario. Fig. 2 is a schematic flow chart of a scenario of a database performance problem processing method according to an embodiment of the present application.
As shown in fig. 2, in the embodiment of the present scenario, the operations of analyzing the performance problem of the database are integrated first, and become program automation, and the repetitive work of the analysis problem is abstracted and programmed by setting flexible analysis rules and writing corresponding analysis script programs, so as to improve the working efficiency of the developer in the work.
In addition, the embodiment can be more flexible in the aspect of analyzing the database, can realize flexible configuration realization, can adapt to various database performance problem analysis, and can realize the performance problem analysis of different database systems by establishing analysis rules and writing corresponding script programs aiming at different database performance problem analysis. The database performance problem analysis result performance knowledge base is trained by using a large model algorithm to generate a solution generator (the preset solution generation model).
When the method is specifically implemented, a database performance problem classification table is firstly constructed; a predefined set of analysis rules: the analysis rules may include: database table basic condition analysis rules, sql execution plan analysis rules, partition number analysis rules, query sql analysis failure analysis rules, sql paging analysis rules, sql length analysis rules, sequence analysis rules, index analysis rules and the like, and then writing script programs for the analysis rules.
Secondly, creating an analysis problem task: in the process of creating the analysis task, firstly, the information such as a database and a service period required by the script program is required to be configured, then, the verification program reads the configuration information to verify, after the verification program is successful, the relevant settings (such as file format, whether some inquiry statement information is displayed or not in the analysis process and the like) of the performance analysis result file generated by the task are set, and finally, the performance problem of the database required to be analyzed is imported, so that the scanning task can be started. The database performance problem is a descriptive information text importing system in the form of a structured data format text file, and the descriptive information text mainly comprises: database instance name, sql_id, sql statement, problem category, problem description, time of occurrence, etc.
And after the performance task is started, starting a scheduling task program of a sentinel mechanism waiting for receiving the message, importing the description information text corresponding to the performance problem of the target database, carrying out the description information text according to the imported data file by the program, matching the corresponding target performance problem category information from the database performance problem classification table according to the description information text, associating a pre-defined analysis rule set and a script library corresponding to the target performance problem category information, and generating a target message of which the target database performance problem is matched with the target analysis rule set.
In this way, the target information matched with the association is sent to the scheduling task program, and after the scheduling task program consumes the target information, a preset process is started to schedule the script program corresponding to each analysis rule so as to finally obtain an analysis result report corresponding to the performance problem of the target database.
And finally, after the analysis result file is generated, inputting the data in the analysis result file into a solution generator, and generating a solution corresponding to the database performance problem by the solution generator according to the input information. The solution generator can be obtained by learning and training a historical analysis result file, a historical result file and the like based on an API interface opened by AIGC large models. Finally, after the solution is obtained, the analysis result report and the generated solution generation file can be reported, and the file can support downloading and previewing.
Furthermore, it is contemplated in this embodiment that if the database performance problem is a new problem, the solution generator cannot identify the database performance problem, and then an intervening manual intervention is required. In this case, the solution analyzed manually is imported for record storage, and the solution generator is subjected to relearning training, so that the solution can be generated after the same problem appears again later.
In summary, the embodiment of the present scenario can directly and automatically analyze the known database performance problem, and generate an analysis process report and a solution to the problem, which aims to automatically process the repeated problem analysis, avoid repeated idle work, and reduce repeated work. The unknown database performance problem can be automatically analyzed by the program in the first manual analysis process, the performance problem is added, and the program automatic analysis can be realized after the performance problem appears repeatedly.
Based on the database performance problem processing method provided by the above embodiment, the present application also provides a database performance problem processing device corresponding to the database performance problem processing method, and the database performance problem processing device is described in detail below through fig. 3.
Fig. 3 is a schematic structural diagram of a database performance problem processing apparatus according to an embodiment of the present application. The database performance problem processing apparatus 300 shown in fig. 3 includes:
A first obtaining module 310, configured to obtain a description information text corresponding to a performance problem of a target database to be analyzed;
The first matching module 320 is configured to match performance problem classifications corresponding to performance problems of the target database based on the descriptive information text, so as to obtain target performance problem classification information;
a second obtaining module 330, configured to obtain a target analysis rule set associated with the target performance problem category information;
The first generating module 340 is configured to generate, based on the target analysis rule set, an analysis result report corresponding to the performance problem of the target database, where the analysis result report is used to determine a performance problem solution corresponding to the performance problem of the target database.
According to the database performance problem processing device provided by the embodiment of the application, the corresponding functional modules are arranged to obtain the description information text corresponding to the performance problem of the target database to be analyzed, and the performance problem classification corresponding to the performance problem of the target database is matched according to the description information text, so that the target performance problem class information is obtained. Thus, after the target analysis rule set associated with the target performance problem category information is obtained, an analysis result report corresponding to the performance problem of the target database can be generated based on the target analysis rule set, and the analysis result report can be used for determining a performance problem solution corresponding to the performance problem of the target database.
According to the database performance problem processing device disclosed by the embodiment of the application, the database performance problems are subjected to programmed matching classification and associated corresponding analysis rule sets, and then the database performance problems are automatically analyzed according to the corresponding analysis rule sets, so that an analysis result report can be finally obtained to determine a solution corresponding to the performance problems, and thus, the automatic analysis processing of the database performance problems can be more efficiently and accurately realized, and further, the overall database performance management and control efficiency and the working efficiency of developers can be effectively improved.
In some possible embodiments, after generating the analysis result report corresponding to the target database performance problem, the database performance problem processing apparatus may further include:
the first input module can be used for inputting the analysis result report into a preset solution generating model to obtain a performance problem solution corresponding to the performance problem of the target database;
the preset solution generating model is obtained by training based on the historical database performance problem and the corresponding historical solution in advance.
In some possible embodiments, after the analysis result report is input into the preset solution generation model, the database performance problem processing apparatus may further include:
The first output module can be used for outputting an analysis result report for manual analysis if a performance problem solution corresponding to the performance problem of the target database cannot be obtained;
the model updating module can be used for recording a reference solution obtained by manual analysis and retraining a preset solution generating model based on the reference solution to obtain an updated preset solution generating model.
In some possible embodiments, the generating, by the first generating module 340, an analysis result report corresponding to the performance problem of the target database based on the target analysis rule set may include:
the first acquisition sub-module can be used for acquiring script programs corresponding to each analysis rule in the target analysis rule set;
The first generation sub-module can be used for respectively executing script programs corresponding to each analysis rule in the target analysis rule set, summarizing and obtaining execution results of each script program, and generating an analysis result report.
In some possible embodiments, before acquiring the descriptive information text corresponding to the target database performance problem to be analyzed, the database performance problem processing apparatus may further include:
The first starting module can be used for responding to a starting instruction of the performance problem analysis task and starting a scheduling task program of the sentinel mechanism;
after acquiring the target analysis rule set associated with the target performance problem category information, the database performance problem processing apparatus may further include:
the first sending module can be used for generating a target message of which the target database performance problem is matched with the target analysis rule set and sending the target message to the scheduling task program;
the second starting module can be used for starting a preset process to schedule and execute script programs corresponding to each analysis rule in the target analysis rule set under the condition that the task scheduling program consumes the target message.
In some possible embodiments, before matching the performance problem classification corresponding to the performance problem of the target database based on the descriptive information text to obtain the performance problem class information, the database performance problem processing apparatus may further include:
The construction module can be used for collecting the performance problems of the known database and constructing a database performance problem classification table based on the collected performance problems of the known database, wherein the database performance problem classification table can comprise performance problem category information corresponding to at least one performance problem classification;
the definition module can be used for defining respectively associated analysis rule sets for the performance problem category information in the database performance problem classification table;
The matching of the performance problem classification corresponding to the performance problem of the target database by the first matching module 320 based on the description information text to obtain the target performance problem classification information may specifically include:
and matching the performance problem classification corresponding to the performance problem of the target database from the database performance problem classification table based on the descriptive information text to obtain the target performance problem category information.
In some possible implementations, at least one of an index class, a database table partition class, a structured query language SQL statement class, and a sequence class may be included in the database performance problem classification table.
Based on the database performance problem processing method provided by the above embodiment, the present application also provides a database performance problem processing apparatus corresponding to the database performance problem processing method, and the database performance problem processing apparatus is described in detail below through fig. 4.
Referring to fig. 4, fig. 4 is a schematic structural diagram of a database performance problem processing apparatus according to an embodiment of the application.
The database performance problem processing apparatus may comprise a processor 401 and a memory 402 in which computer program instructions are stored.
In particular, the processor 401 may include a Central Processing Unit (CPU), or an Application SPECIFIC INTEGRATED Circuit (ASIC), or may be configured as one or more integrated circuits that implement embodiments of the present application.
Memory 402 may include mass storage for data or instructions. By way of example, and not limitation, memory 402 may comprise a hard disk drive (HARD DISK DRIVE, HDD), a floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or a universal serial bus (Universal Serial Bus, USB) drive, or a combination of two or more of the foregoing. Memory 402 may include removable or non-removable (or fixed) media, where appropriate. Memory 402 may be internal or external to the integrated gateway disaster recovery device, where appropriate. In a particular embodiment, the memory 402 is a non-volatile solid state memory.
The memory may include Read Only Memory (ROM), random Access Memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical, or other physical/tangible memory storage devices. Thus, in general, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software comprising computer-executable instructions and when the software is executed (e.g., by one or more processors) it is operable to perform the operations described with reference to methods in accordance with aspects of the present disclosure.
The processor 401 implements any of the database performance problem processing methods of the above embodiments by reading and executing computer program instructions stored in the memory 402.
In one example, the data database performance problem processing apparatus may further include a communication interface 403 and a bus 410. As shown in fig. 4, the processor 401, the memory 402, and the communication interface 403 are connected by a bus 410 and perform communication with each other.
The communication interface 403 is mainly used to implement communication between each module, device, unit and/or apparatus in the embodiment of the present application.
Bus 410 includes hardware, software, or both, coupling components of the database performance problem processing apparatus to each other. By way of example, and not limitation, the buses may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an infiniband interconnect, a Low Pin Count (LPC) bus, a memory bus, a micro channel architecture (MCa) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a video electronics standards association local (VLB) bus, or other suitable bus, or a combination of two or more of the above. Bus 410 may include one or more buses, where appropriate. Although embodiments of the application have been described and illustrated with respect to a particular bus, the application contemplates any suitable bus or interconnect.
The database performance problem processing device executes the database performance problem processing method in the embodiment of the application, thereby realizing the database performance problem processing method described in the embodiment of the application.
In addition, in combination with the database performance problem processing method in the above embodiment, the embodiment of the present application may be implemented by providing a computer storage medium. The computer storage medium has stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the database performance problem handling methods of the embodiments described above.
Based on the database performance problem processing method in the foregoing embodiments, an embodiment of the present application provides a computer program product, where instructions in the computer program product, when executed by a processor of an electronic device, cause the electronic device to execute the database performance problem processing method provided in any one of the foregoing embodiments of the present application.
It should be understood that the application is not limited to the particular arrangements and instrumentality described above and shown in the drawings. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and shown as examples. The method processes of the present application are not limited to the specific steps described and shown, but various changes, modifications and additions, or the order between steps may be made by those skilled in the art after appreciating the spirit of the present application.
The functional blocks shown in the above-described structural block diagrams may be implemented in hardware, software, firmware, or a combination thereof. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine readable medium or transmitted over transmission media or communication links by a data signal carried in a carrier wave. A "machine-readable medium" may include any medium that can store or transfer information. Examples of machine-readable media include electronic circuitry, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio Frequency (RF) links, and the like. The code segments may be downloaded via computer networks such as the internet, intranets, etc.
It should also be noted that the exemplary embodiments mentioned in this disclosure describe some methods or systems based on a series of steps or devices. The present application is not limited to the order of the above-described steps, that is, the steps may be performed in the order mentioned in the embodiments, or may be performed in a different order from the order in the embodiments, or several steps may be performed simultaneously.
Aspects of the present disclosure are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, enable the implementation of the functions/acts specified in the flowchart and/or block diagram block or blocks. Such a processor may be, but is not limited to being, a general purpose processor, a special purpose processor, an application specific processor, or a field programmable logic circuit. It will also be understood that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware which performs the specified functions or acts, or combinations of special purpose hardware and computer instructions.
In the foregoing, only the specific embodiments of the present application are described, and it will be clearly understood by those skilled in the art that, for convenience and brevity of description, the specific working processes of the systems, modules and units described above may refer to the corresponding processes in the foregoing method embodiments, which are not repeated herein. It should be understood that the scope of the present application is not limited thereto, and any equivalent modifications or substitutions can be easily made by those skilled in the art within the technical scope of the present application, and they should be included in the scope of the present application.
Claims (11)
1. A method for processing database performance problems, the method comprising:
Acquiring a description information text corresponding to a target database performance problem to be analyzed;
Matching the performance problem classification corresponding to the performance problem of the target database based on the description information text to obtain target performance problem class information;
Acquiring a target analysis rule set associated with the target performance problem category information;
And generating an analysis result report corresponding to the performance problem of the target database based on the target analysis rule set, wherein the analysis result report is used for determining a performance problem solution corresponding to the performance problem of the target database.
2. The method of claim 1, wherein after the generating the analysis result report corresponding to the target database performance issue, the method further comprises:
Inputting the analysis result report into a preset solution generating model to obtain a performance problem solution corresponding to the performance problem of the target database;
The preset solution generating model is obtained by training based on the historical database performance problem and the corresponding historical solution in advance.
3. The method of claim 2, wherein after the inputting the analysis result report into a preset solution generation model, the method further comprises:
If the performance problem solution corresponding to the performance problem of the target database cannot be obtained, outputting the analysis result report for manual analysis;
Recording a reference solution obtained by manual analysis, and retraining the preset solution generating model based on the reference solution to obtain an updated preset solution generating model.
4. The method of claim 1, wherein generating an analysis result report corresponding to the target database performance problem based on the target analysis rule set comprises:
Acquiring script programs corresponding to all analysis rules in the target analysis rule set;
And executing script programs corresponding to each analysis rule in the target analysis rule set respectively, summarizing to obtain execution results of each script program, and generating the analysis result report.
5. The method of claim 4, wherein prior to the obtaining the descriptive information text corresponding to the target database performance issue to be analyzed, the method further comprises:
responding to a starting instruction of the performance problem analysis task, and starting a scheduling task program of a sentinel mechanism;
after the obtaining the target analysis rule set associated with the target performance issue category information, the method further comprises:
generating a target message of which the target database performance problem is matched with the target analysis rule set, and sending the target message to the scheduling task program;
and under the condition that the scheduling task program consumes the target message, starting a preset process to schedule and execute script programs corresponding to all analysis rules in the target analysis rule set.
6. The method of claim 1, wherein before said matching the performance problem classification corresponding to the performance problem of the target database based on the descriptive text, obtaining target performance problem class information, the method further comprises:
Acquiring a known database performance problem, and constructing a database performance problem classification table based on the acquired known database performance problem, wherein the database performance problem classification table comprises performance problem category information corresponding to at least one performance problem classification;
Respectively defining respectively associated analysis rule sets for performance problem category information in the database performance problem classification table;
The matching of the performance problem classification corresponding to the performance problem of the target database based on the description information text to obtain target performance problem class information comprises the following steps:
And based on the descriptive information text, matching the performance problem classification corresponding to the target database performance problem from the database performance problem classification table to obtain the target performance problem category information.
7. The method of claim 6, wherein the database performance problem classification table includes at least one of an index class, a database table partition class, a structured query language SQL statement class, and a sequence class.
8. A database performance problem processing apparatus, the apparatus comprising:
The first acquisition module is used for acquiring descriptive information text corresponding to the performance problem of the target database to be analyzed;
The first matching module is used for matching the performance problem classification corresponding to the performance problem of the target database based on the description information text to obtain target performance problem class information;
the second acquisition module is used for acquiring a target analysis rule set associated with the target performance problem category information;
the first generation module is used for generating an analysis result report corresponding to the performance problem of the target database based on the target analysis rule set, and the analysis result report is used for determining a performance problem solution corresponding to the performance problem of the target database.
9. A database performance problem processing apparatus, the apparatus comprising: a processor and a memory storing computer program instructions;
The processor, when executing the computer program instructions, implements a database performance problem handling method as claimed in any one of claims 1 to 7.
10. A computer readable storage medium, wherein computer program instructions are stored on the computer readable storage medium, which when executed by a processor, implement the database performance problem processing method according to any one of claims 1-7.
11. A computer program product, characterized in that instructions in the computer program product, when executed by a processor of an electronic device, perform the database performance problem handling method according to any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311696554.5A CN117971618A (en) | 2023-12-11 | 2023-12-11 | Database performance problem processing method, device, equipment, medium and product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311696554.5A CN117971618A (en) | 2023-12-11 | 2023-12-11 | Database performance problem processing method, device, equipment, medium and product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117971618A true CN117971618A (en) | 2024-05-03 |
Family
ID=90850561
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311696554.5A Pending CN117971618A (en) | 2023-12-11 | 2023-12-11 | Database performance problem processing method, device, equipment, medium and product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117971618A (en) |
-
2023
- 2023-12-11 CN CN202311696554.5A patent/CN117971618A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107819627B (en) | System fault processing method and server | |
| CN111343161B (en) | Abnormal information processing node analysis method, abnormal information processing node analysis device, abnormal information processing node analysis medium and electronic equipment | |
| CN110659282B (en) | Data route construction method, device, computer equipment and storage medium | |
| CN114461644A (en) | Data acquisition method and device, electronic equipment and storage medium | |
| CN112181835A (en) | Automatic testing method and device, computer equipment and storage medium | |
| CN110990350B (en) | Log analysis method and device | |
| CN114398394A (en) | Data blood margin analysis method, device, equipment and storage medium | |
| CN110633318A (en) | Data extraction processing method, device, equipment and storage medium | |
| CN113609008A (en) | Test result analysis method and device and electronic equipment | |
| CN117436440A (en) | Log identification method, system, terminal equipment and storage medium | |
| CN116074183B (en) | C3 timeout analysis method, device and equipment based on rule engine | |
| CN117971618A (en) | Database performance problem processing method, device, equipment, medium and product | |
| CN115658072A (en) | Data blood margin analysis method, device, equipment and computer readable storage medium | |
| CN114841281A (en) | Data table identification method, device, equipment, medium and program product | |
| CN115470355A (en) | Rail transit information query method and device, electronic equipment and storage medium | |
| CN113095064A (en) | Code field identification method and device, electronic equipment and storage medium | |
| CN112214669A (en) | Home decoration material formaldehyde release data processing method and device and monitoring server | |
| CN115758135B (en) | Track traffic signal system function demand tracing method and device and electronic equipment | |
| CN113177157B (en) | Label separation method, device, equipment and storage medium | |
| CN112328595A (en) | Data searching method, device, equipment and storage medium | |
| CN114090014A (en) | Program splitting method, device, equipment and computer storage medium | |
| CN116306545A (en) | Form generation method, device, equipment, medium and program product | |
| CN115757314A (en) | File processing method and device, electronic equipment and readable storage medium | |
| CN115904964A (en) | Error reporting test script classification method and device | |
| CN115237917A (en) | Data computing method, device and equipment for data center station and readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |