CN115857938A - Method and device for resource audit of big data submission operation - Google Patents
Method and device for resource audit of big data submission operation Download PDFInfo
- Publication number
- CN115857938A CN115857938A CN202211462613.8A CN202211462613A CN115857938A CN 115857938 A CN115857938 A CN 115857938A CN 202211462613 A CN202211462613 A CN 202211462613A CN 115857938 A CN115857938 A CN 115857938A
- Authority
- CN
- China
- Prior art keywords
- job
- audit
- auditing
- big data
- service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The embodiment of the invention discloses a method and a device for resource audit of big data submission operation, wherein the method comprises the following steps: acquiring a job submitted by a service submitter; if the operation type of the operation is the SQL type, SQL analysis is carried out on the operation to extract operation key elements, and then the operation is audited by matching the operation key elements with a preset audit rule file to obtain an audit result; and if the job type of the job is the YARN type, determining an audit result by verifying whether the job is a job registered in a registration center, wherein each service submitter registers the respective job by submitting job information in the registration center in advance. The invention realizes the beneficial effect of accurately performing resource audit on big data submission operation.
Description
Technical Field
The invention relates to the technical field of big data processing, in particular to a method and a device for resource auditing of big data submission operation.
Background
The large data platform resource supervision mainly manages computing resources, solves the problem of resource contention, and enables operation and maintenance personnel to comprehensively plan the use condition and operation of the platform computing resources. At present, most of jobs on a platform are submitted to YARN to run, and the submission ways are various and can be mainly divided into two types: one is submission as YARN job and one is submission as SQL job. How to carry out resource audit on big data submission jobs of different types is a technical problem which needs to be solved urgently in the prior art.
Disclosure of Invention
The present invention provides a method and an apparatus for resource auditing of big data submission job, in order to solve at least one technical problem in the above background art.
To achieve the above object, according to one aspect of the present invention, there is provided a method of resource auditing for a big data submission job, the method comprising:
acquiring a job submitted by a service submitter;
if the operation type of the operation is the SQL type, SQL analysis is carried out on the operation to extract operation key elements, and then the operation is audited by matching the operation key elements with a preset audit rule file to obtain an audit result;
and if the job type of the job is the YARN type, determining an audit result by verifying whether the job is a job registered in a registration center, wherein each service submitter registers the respective job by submitting job information in the registration center in advance.
Optionally, the method for performing resource audit on big data submission job further includes:
and if the auditing result is that the auditing is passed, submitting the operation to YARN service.
Optionally, the acquiring the job submitted by the service submitter specifically includes:
and intercepting the operation submitted by the service submitter, and storing the operation information of the intercepted operation into a preset operation interception information table.
Optionally, the operation key elements include: a library table name, a field name, and an SQL keyword; the audit rule file comprises: audit items and audit rules.
Optionally, the audit rule file includes: processing the rules;
the method further comprises the following steps:
and if the operation type of the operation is the SQL type and the auditing result is that the auditing is not passed, executing the processing rule and returning processing information to the service submitter.
Optionally, the determining an audit result by verifying whether the job is a job registered in a registry specifically includes:
acquiring a registered job information table from the registry;
and if the data record corresponding to the job exists in the registered job information table and the job information of the job is consistent with the information recorded in the data record, determining that the job audit is passed, otherwise, determining that the job audit is not passed.
To achieve the above object, according to another aspect of the present invention, there is provided an apparatus for resource auditing of a big data submission job, the apparatus comprising:
the job acquiring unit is used for acquiring the job submitted by the service submitter;
the first auditing unit is used for extracting operation key elements by performing SQL analysis on the operation if the operation type of the operation is an SQL type, and then auditing the operation by matching the operation key elements with a preset auditing rule file to obtain an auditing result;
and a second auditing unit configured to determine an auditing result by verifying whether the job is a job that has been registered in a registry in which each service submitter previously registered the respective job by submitting job information, if the job type of the job is a YARN type.
Optionally, the apparatus for performing resource audit on big data submission job further includes:
and the job sending unit is used for submitting the job to the YARN service if the auditing result is that the auditing is passed.
Optionally, the job obtaining unit specifically includes:
the operation interception module is used for intercepting the operation submitted by the service submitter;
and the information table writing module is used for storing the operation information of the intercepted operation into a preset operation interception information table.
Optionally, the audit rule file includes: processing the rules;
the device, still include:
and the audit non-passing processing unit is used for executing the processing rule and returning processing information to the service submitter if the operation type of the operation is the SQL type and the audit result is that the audit does not pass.
Optionally, the second auditing unit specifically includes:
a registered job information table acquisition module for acquiring a registered job information table from the registry;
and the audit result determining module is used for determining that the job audit is passed if the data record corresponding to the job exists in the registered job information table and the job information of the job is consistent with the information recorded in the data record, or else, determining that the job audit is not passed.
To achieve the above object, according to another aspect of the present invention, there is also provided a computer device including a memory, a processor, and a computer program stored on the memory and executable on the processor, the processor implementing the steps of the above method for resource auditing of big data submission jobs when executing the computer program.
To achieve the above object, according to another aspect of the present invention, there is also provided a computer readable storage medium having stored thereon a computer program/instructions which, when executed by a processor, implement the above steps of the method of resource auditing for big data commit jobs.
To achieve the above object, according to another aspect of the present invention, there is also provided a computer program product comprising computer program/instructions which, when executed by a processor, implement the above steps of the method of resource auditing for big data submission jobs.
The invention has the beneficial effects that:
according to the embodiment of the invention, the operation submitted by a business submitter is obtained, if the operation type of the operation is the SQL type, the operation key element is extracted by SQL analysis on the operation, the operation is audited by matching the operation key element with the preset audit rule file to obtain the audit result, if the operation type of the operation is the YARN type, the audit result is determined by verifying whether the operation is the operation registered in the registration center, and the beneficial effect of accurate and efficient resource audit on the YARN operation and the SQL operation is realized.
Drawings
In order to more clearly illustrate the embodiments or technical solutions of the present invention, the drawings used in the embodiments or technical solutions in the prior art are briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to these drawings without creative efforts. In the drawings:
FIG. 1 is a first flow diagram of a method of resource auditing of big data submission jobs, in accordance with an embodiment of the present invention;
FIG. 2 is a second flowchart of a method of resource auditing of big data submission jobs, in accordance with an embodiment of the present invention;
FIG. 3 is a schematic view of a first process for job auditing according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a second process for job auditing according to an embodiment of the present invention;
FIG. 5 is a first block diagram of an apparatus for resource auditing of big data submission jobs, in accordance with an embodiment of the present invention;
FIG. 6 is a second block diagram of an apparatus for resource auditing of big data submission jobs in accordance with an embodiment of the present invention;
FIG. 7 is a third block diagram of an apparatus for resource auditing of big data submission jobs, in accordance with embodiments of the present invention;
FIG. 8 is a schematic diagram of a computer apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, in the description and claims of the present invention and the above-described drawings, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be noted that the embodiments and features of the embodiments of the present invention may be combined with each other without conflict. The present invention will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
It should be noted that, in the technical solution of the present application, the acquisition, storage, use, processing, etc. of data all conform to the relevant regulations of the national laws and regulations.
It should be noted that the method and apparatus for resource auditing of big data submission job of the present invention can be used in the financial field, and can also be used in any field except the financial field.
The method has the main functions of automatically auditing the resources of the big data submission operation, namely intercepting the operation submitted by a user, auditing the intercepted operation and refusing to execute the operation which fails to be audited.
Fig. 1 is a first flowchart of a method for resource auditing of a big data submission job according to an embodiment of the present invention, and as shown in fig. 1, in an embodiment of the present invention, the method for resource auditing of a big data submission job according to the present invention includes steps S101 to S103.
Step S101, acquiring the operation submitted by the service submitter.
In the invention, the operation types submitted by the service submitter are mainly divided into SQL types and YARN types; when a business submitter submits a job through a modified agent command (such as bdms-spark-submit), the background service of the big data comprehensive control platform intercepts the job, stores the job information into a job interception information table, and then judges the job type.
And step S102, if the operation type of the operation is the SQL type, SQL analysis is carried out on the operation to extract operation key elements, and then the operation is audited by matching the operation key elements with a preset audit rule file to obtain an audit result.
In one embodiment of the present invention, the job critical elements include: a library table name, a field name and an SQL keyword; the audit rule file comprises: audit items and audit rules.
The method specifically audits the operation key elements according to the preset audit items and the audit rules, if the operation key elements meet the audit rules corresponding to each audit item, the audit is determined to be passed, and otherwise, the audit is determined not to be passed.
The invention records the directly submitted SQL operation and provides an auditing function, such as auditing the deletion operation of some important data.
As shown in fig. 3 and 4, in a specific embodiment of the present invention, if the type of SQL is the SQL type, the execution SQL is parsed by a parser, an SQL syntax tree is generated, key elements such as a library table name, a field name, and SQL key words (e.g., select, delete, insert, drop, truncate, etc.) are extracted, the audit service forms a rule file according to predefined audit items, audit rules, and processing rules, matches the extracted key elements with the rule file (e.g., table1 does not allow deletion), if the audit does not pass, executes corresponding processing rules and returns processing information to the job submitter, and if the audit passes, submits the SQL to the YARN service.
Step S103, if the job type of the job is YARN type, determining an audit result by verifying whether the job is a job that has been registered in a registry, wherein each service submitter registers its own job by submitting job information in the registry in advance.
According to the invention, the cluster resource user needs to register the operation information in advance through the big data comprehensive control platform according to the respective operation conditions, so that a basis is provided for subsequent audit work. In the present invention, each service submitter needs to pre-register its own job in the registry. When the job pre-registration is performed, job information needs to be submitted, the job at the present stage is mainly a task running on YARN, and the job information mainly includes: task name, resource usage, executing user, and executing SQL. The registry processes the job registration of each service submitter and generates a registered job information table in which job information of each job for which registration is completed is recorded.
As shown in fig. 3 and 4, in an embodiment of the present invention, if the type is YARN, the resource application needs to be audited through the registration center, that is, a background audit service is called through a Rest request, whether the job information already exists is queried in a registered table, and the job submitted this time is compared with the registered job, and if the job does not exist or the comparison is inconsistent, an error message is returned to the job submitter due to the audit failure; if the comparison is consistent, the operation is submitted to YARN service after the audit is passed. And finally updating and warehousing the auditing result of the operation.
As shown in fig. 3 and fig. 4, the job audit service of the present invention mainly functions to intercept the job that the user wants to submit to YARN for execution, and the tasks can be divided into two categories: one for YARN jobs and one for SQL jobs. For YARN operation, auditing the resource application condition through a registration center, and returning error information to an operation submitter after audit failure; for SQL tasks, a background audit service analyzes SQL, and records of executed SQL information (such as SQL sentences, server information, execution time and the like) are firstly used for subsequent examination; and then, analyzing the SQL by a syntax analyzer, extracting key information, matching the key information by rule service, and realizing different access control and risk early warning for data with different security levels. The auditing process is mainly completed through the job registration center, and the execution of the job which is not audited is refused.
In an embodiment of the present invention, the method for resource auditing of big data submission job of the present invention further includes:
and if the auditing result is that the auditing is passed, submitting the operation to YARN service.
Apache Hadoop YARN (Yet other Resource coordinator) is a new Hadoop Resource manager, is a universal Resource management system, can provide uniform Resource management and scheduling for upper-layer application, and brings great benefits to the cluster in the aspects of utilization rate, uniform Resource management, data sharing and the like.
In an embodiment of the present invention, the acquiring the job submitted by the service submitter in step S101 specifically includes:
and intercepting the operation submitted by the service submitter, and storing the operation information of the intercepted operation into a preset operation interception information table.
In one embodiment of the present invention, the audit rule file includes: processing the rules;
the method for resource audit of big data submission operation of the invention also comprises the following steps:
and if the operation type of the operation is the SQL type and the auditing result is that the auditing is not passed, executing the processing rule and returning processing information to the service submitter.
In an embodiment of the present invention, if the job type of the job is YARN type and the audit result is that the audit does not pass, the audit not pass information is returned to the service submitter.
As shown in fig. 2, in an embodiment of the present invention, the step S103 of determining the audit result by verifying whether the job is a job registered in the registry specifically includes a step S201 and a step S202.
Step S201, a registered job information table is acquired from the registry.
Step S202, if a data record corresponding to the job exists in the registered job information table, and the job information of the job is consistent with the information recorded in the data record, determining that the job audit is passed, otherwise, determining that the job audit is not passed.
The application range of the invention comprises registration and audit functions of key SQL and YARN execution jobs, and the like, the jobs submitted by users are intercepted, the intercepted jobs are audited, the auditing process can be audited through a job registration center, and the execution of the jobs which do not pass the auditing is refused. In the future, various scenes of real-time monitoring and risk management and control can be realized.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than here.
Based on the same inventive concept, the embodiment of the present invention further provides a device for performing resource audit on big data submission jobs, which can be used to implement the method for performing resource audit on big data submission jobs described in the foregoing embodiment, as described in the following embodiment. Because the principle of the device for performing resource audit on big data submission job is similar to the method for performing resource audit on big data submission job, the embodiment of the device for performing resource audit on big data submission job can refer to the embodiment of the method for performing resource audit on big data submission job, and the repeated parts are not repeated. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 5 is a first structural block diagram of an apparatus for resource auditing of big data submission jobs according to an embodiment of the present invention, and as shown in fig. 5, in an embodiment of the present invention, the apparatus for resource auditing of big data submission jobs according to the present invention includes:
a job obtaining unit 1, configured to obtain a job submitted by a service submitter;
the first auditing unit 2 is configured to, if the job type of the job is an SQL type, extract job key elements by performing SQL analysis on the job, and further audit the job by matching the job key elements with a preset auditing rule file to obtain an auditing result;
a second auditing unit 3, configured to determine an auditing result by verifying whether the job is a job that has been registered in a registry where each service submitter registers the respective job by submitting job information in advance, if the job type of the job is a YARN type.
In an embodiment of the present invention, the apparatus for resource auditing of big data submission job of the present invention further includes:
and the job sending unit is used for submitting the job to the YARN service if the auditing result is that the auditing is passed.
As shown in fig. 6, in an embodiment of the present invention, the job obtaining unit 1 specifically includes:
the job intercepting module 101 is used for intercepting the job submitted by the service submitter;
the information table writing module 102 is configured to store the job information of the intercepted job into a preset job interception information table.
In one embodiment of the present invention, the audit rule file includes: processing the rules;
in an embodiment of the present invention, an apparatus for performing resource audit on big data submission job further includes:
and the audit non-passing processing unit is used for executing the processing rule and returning processing information to the service submitter if the operation type of the operation is the SQL type and the audit result is that the audit does not pass.
As shown in fig. 7, in an embodiment of the present invention, the second auditing unit 3 specifically includes:
a registered job information table acquisition module 301, configured to acquire a registered job information table from the registry;
an audit result determining module 302, configured to determine that the job audit is passed if a data record corresponding to the job exists in the registered job information table and the job information of the job is consistent with information recorded in the data record, or determine that the job audit is not passed if the job information of the job is consistent with the information recorded in the data record.
To achieve the above object, according to another aspect of the present application, there is also provided a computer apparatus. As shown in fig. 8, the computer device comprises a memory, a processor, a communication interface and a communication bus, wherein a computer program that can be run on the processor is stored in the memory, and the steps of the method of the above embodiment are realized when the processor executes the computer program.
The processor may be a Central Processing Unit (CPU). The Processor may also be other general purpose Processor, digital Signal Processor (DSP), application Specific Integrated Circuit (ASIC), field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic device, discrete hardware component, or a combination thereof.
The memory, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and units, such as the corresponding program units in the above-described method embodiments of the present invention. The processor executes various functional applications of the processor and the processing of the work data by executing the non-transitory software programs, instructions and modules stored in the memory, that is, the method in the above method embodiment is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor, and the like. Further, the memory may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory located remotely from the processor, and such remote memory may be coupled to the processor via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more units are stored in the memory and when executed by the processor perform the method of the above embodiments.
The specific details of the computer device may be understood by referring to the corresponding related description and effects in the foregoing embodiments, which are not described herein again.
To achieve the above object, according to another aspect of the present application, there is also provided a computer-readable storage medium storing a computer program which, when executed in a computer processor, implements the steps in the above method of resource auditing for big data submission jobs. It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD), a Solid State Drive (SSD), or the like; the storage medium may also comprise a combination of memories of the kind described above.
To achieve the above object, according to another aspect of the present application, there is also provided a computer program product including computer program/instructions which, when executed by a processor, implement the above steps of the method of resource auditing of a big data submission job.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and they may alternatively be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, or fabricated separately as individual integrated circuit modules, or fabricated as a single integrated circuit module from multiple modules or steps. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (14)
1. A method for resource auditing of big data submission jobs, comprising:
acquiring the operation submitted by a service submitter;
if the operation type of the operation is the SQL type, performing SQL analysis on the operation to extract operation key elements, and further matching the operation key elements with a preset audit rule file to audit the operation to obtain an audit result;
and if the job type of the job is the YARN type, determining an audit result by verifying whether the job is a job registered in a registration center, wherein each service submitter registers the respective job by submitting job information in the registration center in advance.
2. The method of resource auditing a big data submission job of claim 1, further comprising:
and if the auditing result is that the auditing is passed, submitting the operation to YARN service.
3. The method for resource auditing of big data submission jobs as claimed in claim 1, wherein the obtaining of the jobs submitted by the business submitters specifically includes:
and intercepting the operation submitted by the service submitter, and storing the operation information of the intercepted operation into a preset operation interception information table.
4. The method of resource auditing a big data submission job of claim 1, where the job critical elements include: a library table name, a field name, and an SQL keyword; the audit rule file comprises: audit items and audit rules.
5. The method of resource auditing a big data submission job of claim 1, where the audit rule file includes: processing the rules;
the method further comprises the following steps:
and if the operation type of the operation is the SQL type and the auditing result is that the auditing is not passed, executing the processing rule and returning processing information to the service submitter.
6. The method for resource auditing of big data submission jobs as claimed in claim 1, wherein the determining the auditing result by verifying whether the job is a job that has been registered in a registry specifically includes:
acquiring a registered job information table from the registry;
and if the data record corresponding to the job exists in the registered job information table and the job information of the job is consistent with the information recorded in the data record, determining that the job audit is passed, otherwise, determining that the job audit is not passed.
7. An apparatus for resource auditing of big data submission jobs, comprising:
the system comprises a job acquisition unit, a job processing unit and a job processing unit, wherein the job acquisition unit is used for acquiring jobs submitted by a service submitter;
the first auditing unit is used for extracting operation key elements by performing SQL analysis on the operation if the operation type of the operation is an SQL type, and then auditing the operation by matching the operation key elements with a preset auditing rule file to obtain an auditing result;
and a second auditing unit configured to determine an auditing result by verifying whether the job is a job that has been registered in a registry in which each service submitter previously registered the respective job by submitting job information, if the job type of the job is a YARN type.
8. The apparatus for resource auditing a big data submission job of claim 7, further comprising:
and the job sending unit is used for submitting the job to the YARN service if the auditing result is that the auditing is passed.
9. The apparatus for resource auditing of big data submission jobs as claimed in claim 7, wherein the job obtaining unit specifically includes:
the operation interception module is used for intercepting the operation submitted by the service submitter;
and the information table writing module is used for storing the operation information of the intercepted operation into a preset operation interception information table.
10. The apparatus for resource auditing a big data submission job of claim 7, where the audit rule file includes: processing the rules;
the device, still include:
and the audit non-passing processing unit is used for executing the processing rule and returning processing information to the service submitter if the operation type of the operation is the SQL type and the audit result is that the audit does not pass.
11. The apparatus for resource audit of big data submission job as claimed in claim 7, wherein the second auditing unit specifically includes:
a registered job information table acquisition module for acquiring a registered job information table from the registry;
and the audit result determining module is used for determining that the job audit is passed if the data record corresponding to the job exists in the registered job information table and the job information of the job is consistent with the information recorded in the data record, or else, determining that the job audit is not passed.
12. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the steps of the method of any of claims 1 to 6 are implemented when the computer program is executed by the processor.
13. A computer-readable storage medium, on which a computer program/instructions are stored, characterized in that the computer program/instructions, when executed by a processor, implement the steps of the method of any one of claims 1 to 6.
14. A computer program product comprising computer program/instructions, characterized in that the computer program/instructions, when executed by a processor, implement the steps of the method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211462613.8A CN115857938A (en) | 2022-11-22 | 2022-11-22 | Method and device for resource audit of big data submission operation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211462613.8A CN115857938A (en) | 2022-11-22 | 2022-11-22 | Method and device for resource audit of big data submission operation |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115857938A true CN115857938A (en) | 2023-03-28 |
Family
ID=85664700
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211462613.8A Pending CN115857938A (en) | 2022-11-22 | 2022-11-22 | Method and device for resource audit of big data submission operation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115857938A (en) |
-
2022
- 2022-11-22 CN CN202211462613.8A patent/CN115857938A/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11544623B2 (en) | Consistent filtering of machine learning data | |
| US20220188332A1 (en) | Distributed transaction database log with immediate reads and batched writes | |
| US11182691B1 (en) | Category-based sampling of machine learning data | |
| US11100420B2 (en) | Input processing for machine learning | |
| US20180253339A1 (en) | Operation efficiency management with respect to application compile-time | |
| US10387415B2 (en) | Data arrangement management in a distributed data cluster environment of a shared pool of configurable computing resources | |
| US9992269B1 (en) | Distributed complex event processing | |
| JP2014502762A (en) | Filtering query data in the data store | |
| US10929370B2 (en) | Index maintenance management of a relational database management system | |
| US11687512B2 (en) | Index suggestion engine for relational databases | |
| US20160342646A1 (en) | Database query cursor management | |
| AU2021244852B2 (en) | Offloading statistics collection | |
| US20180322154A1 (en) | Database performance tuning framework | |
| CN115758459A (en) | Data authority management method and device | |
| US11210352B2 (en) | Automatic check of search configuration changes | |
| CN116628023A (en) | Waiting event type query method and device, storage medium and electronic equipment | |
| CN112948467B (en) | Data processing method and device, computer equipment and storage medium | |
| CN115857938A (en) | Method and device for resource audit of big data submission operation | |
| CN114020446A (en) | Cross-multi-engine routing processing method, device, equipment and storage medium | |
| CN115168297A (en) | Bypassing log auditing method and device | |
| US20240152521A1 (en) | Database system observability data querying and access | |
| Goncalves | Benchmarking of Modern Data Analysis Tools for a 2nd generation Transient Data Analysis Framework | |
| Brimhall et al. | Chapter 22: Query Performance Tuning: by Jason Brimhall | |
| Antognini et al. | Performance Problems |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |