CN113553193B - Mirror image data auditing and distributing processing method and system - Google Patents
Mirror image data auditing and distributing processing method and system Download PDFInfo
- Publication number
- CN113553193B CN113553193B CN202111103776.2A CN202111103776A CN113553193B CN 113553193 B CN113553193 B CN 113553193B CN 202111103776 A CN202111103776 A CN 202111103776A CN 113553193 B CN113553193 B CN 113553193B
- Authority
- CN
- China
- Prior art keywords
- audit
- image data
- mirror image
- service
- services
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5061—Partitioning or combining of resources
- G06F9/5077—Logical partitioning of resources; Management or configuration of virtualized resources
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
- G06F9/505—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals considering the load
Abstract
The application discloses a mirror image data auditing and distributing processing method and a system, wherein the method comprises the following steps: receiving mirror image data, wherein the mirror image data comprises data for operating a database; acquiring the current load of each audit service, wherein the audit service is used for auditing, and the mirror image data stores data for operating the database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service; selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data are sent; and respectively sending the mirror image data of different target information to each audit service in the plurality of audit services for auditing. Through the application, the problem of the prior art in the process of auditing the mirror image data is solved, so that the auditing efficiency is improved, and auditing resources are fully utilized.
Description
Technical Field
The application relates to the field of data processing, in particular to a mirror image data auditing and distributing processing method and system.
Background
When database auditing is performed, operations on the database that occur may be audited to determine if a problem exists.
The data that operates on the database may exist in the form of mirrored data. These mirrored data include not only operations on one database but also operations on a plurality of databases.
When mirror image data is audited, one audit service is used for auditing the mirror image data, other audit services are idle at the moment, on one hand, audit efficiency is reduced, and on the other hand, existing audit service resources are not fully utilized.
Disclosure of Invention
The embodiment of the application provides an audit allocation processing method and system for mirror image data, which are used for at least solving the problems existing in the prior art when the mirror image data is audited.
According to one aspect of the application, a mirror image data audit allocation processing method is provided, and comprises the following steps: receiving mirror image data, wherein the mirror image data comprises data for operating a database; acquiring the current load of each audit service, wherein the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service; selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent; and respectively sending the mirror image data of different destination information to each audit service in the plurality of audit services for auditing.
Further, the sending the mirror image data of different destination information to each of the plurality of audit services for auditing includes: and sending the mirror image data of the same target information to the same audit service in the plurality of audit services for auditing, wherein different target information points to different databases, and the same target information points to the same database.
Further, sending the mirror image data of the same destination information to the same audit service of the plurality of audit services for auditing comprises: acquiring mirror image data of a preset destination address; determining whether the mirror image data of the preset destination address is audited by preset auditing service; and if the mirror image data of the preset destination address is audited by the preset auditing service, sending the mirror image data of the preset destination address to the preset auditing service.
Further, still include: and under the condition that the mirror image data of the preset destination address is not audited, selecting one audit service from the audit services as the preset audit service.
Further, still include: and recording the corresponding relation between the preset destination address and the preset auditing service, wherein the corresponding relation is used as a basis for selecting the auditing service according to the destination address.
According to another aspect of the present application, there is also provided a mirrored data audit allocation processing system, comprising: the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving mirror image data, and the mirror image data comprises data for operating a database; the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring the current load of each audit service, the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service; the selecting module is used for selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent; and the sending module is used for respectively sending the mirror image data of different target information to each audit service in the plurality of audit services for auditing.
Further, the sending module is configured to: and sending the mirror image data of the same target information to the same audit service in the plurality of audit services for auditing, wherein different target information points to different databases, and the same target information points to the same database.
Further, the sending module is configured to: acquiring mirror image data of a preset destination address; determining whether the mirror image data of the preset destination address is audited by preset auditing service; and if the mirror image data of the preset destination address is audited by the preset auditing service, sending the mirror image data of the preset destination address to the preset auditing service.
Further, the selection module is configured to: and under the condition that the mirror image data of the preset destination address is not audited, selecting one audit service from the audit services as the preset audit service.
Further, still include: and the recording module is used for recording the corresponding relation between the preset destination address and the preset auditing service, wherein the corresponding relation is used as a basis for selecting the auditing service according to the destination address.
In the embodiment of the application, the method comprises the steps of receiving mirror image data, wherein the mirror image data comprises data for operating a database; acquiring the current load of each audit service, wherein the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service; selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent; and respectively sending the mirror image data of different destination information to each audit service in the plurality of audit services for auditing. Through the application, the problem of the prior art in the process of auditing the mirror image data is solved, so that the auditing efficiency is improved, and auditing resources are fully utilized.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the application and, together with the description, serve to explain the application and are not intended to limit the application. In the drawings:
FIG. 1 is a flow chart of a mirrored data audit assignment processing method according to an embodiment of the application.
Detailed Description
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict. The present application will be described in detail below with reference to the embodiments with reference to the attached drawings.
It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.
In this embodiment, a method for processing mirror image data audit allocation is provided, and fig. 1 is a flowchart of a method for processing mirror image data audit allocation according to an embodiment of the present application, as shown in fig. 1, the flowchart includes the following steps:
step S102, receiving mirror image data, wherein the mirror image data comprises data for operating a database;
step S104, acquiring the current load of each audit service, wherein the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service;
step S106, selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent;
for example, in another optional embodiment, a plurality of audit services with a load lower than a second threshold are selected from the audit services, the number of the plurality of audit services is a first number, whether the second number of the destination information in the mirror image data is the same as the first number is determined, and if the second number of the destination information in the mirror image data is the same as the first number, step S102 is executed. And if the first quantity is different from the second quantity, sending the mirror image data of at least two different pieces of destination information to the same audit service according to the relation between the first quantity and the second quantity, or sending the mirror image data of the same destination information to different audit services.
If the first number is larger than the second number, sending the mirror image data of the same target information to the same audit service, then obtaining the load of the audit service receiving the mirror image data, and sending the mirror image data of the same target information to at least two different audit services under the condition that the load exceeds a second threshold value.
And if the first number is smaller than the second number, sending the mirror image data of two different pieces of destination information to the same audit service.
When the audit service is selected, the audit services can be arranged from low to high according to the load of the audit service, and the first number of audit services are sequentially selected according to the sequence of the load from low to high.
In addition, as another optional implementation manner, the mirror image data may be split according to the load of the audit service, and the flow rate of the mirror image data audited by each audit service after the split is inversely proportional to the load of the audit service.
And step S108, respectively sending the mirror image data of different destination information to each audit service in the plurality of audit services for auditing.
As an optional implementation, the mirror image data of the same database may be submitted to the same audit service for auditing, and in the optional implementation, the mirror image data of a predetermined destination address is obtained; determining whether the mirror image data of the preset destination address is audited by preset auditing service; and if the mirror image data of the preset destination address is audited by the preset auditing service, sending the mirror image data of the preset destination address to the preset auditing service.
And under the condition that the mirror image data of the preset destination address is not audited, selecting one audit service from the audit services as the preset audit service. For example, one with the lowest load can be selected, and the image data can be sent to the selected auditing service with the lowest load for auditing. The corresponding relation between the preset destination address and the preset auditing service can be recorded, wherein the corresponding relation is used as a basis for selecting the auditing service according to the destination address.
Through the application, the problem of the prior art in the process of auditing the mirror image data is solved, so that the auditing efficiency is improved, and auditing resources are fully utilized.
As an optional implementation manner, after being sent to the audit service, if the load of the audit service during auditing the image data exceeds a first threshold, the audit service splits the image data that is not audited yet, and sends a request message to other audit services, where the request message is used to inquire whether the other audit services can audit, and when receiving a response that the other audit services can audit, sends a part of split data to the other audit services. And after the other auditing services audit the received data, sending the auditing result to the auditing service for gathering.
The above steps can be executed by one of the auditing services, or by a distribution service specially distributing the auditing tasks, the distribution service is connected with all the auditing services, and the auditing services can also communicate with each other. If one of the audit services splits the mirror image data, the audit service is also used for summarizing the audit results of other audit services, and if the distribution service splits the mirror image data, the distribution service is used for summarizing the audit results of other audit services.
In this embodiment, an electronic device is provided, comprising a memory in which a computer program is stored and a processor configured to run the computer program to perform the method in the above embodiments.
The programs described above may be run on a processor or may also be stored in memory (or referred to as computer-readable media), which includes both non-transitory and non-transitory, removable and non-removable media, that implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
These computer programs may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks, and corresponding steps may be implemented by different modules.
Such an apparatus or system is provided in this embodiment. The system comprises: the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving mirror image data, and the mirror image data comprises data for operating a database; the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring the current load of each audit service, the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service; the selecting module is used for selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent; and the sending module is used for respectively sending the mirror image data of different target information to each audit service in the plurality of audit services for auditing.
The system or the apparatus is used for implementing the functions of the method in the foregoing embodiments, and each module in the system or the apparatus corresponds to each step in the method, which has been described in the method and is not described herein again.
For example, the sending module is configured to: and sending the mirror image data of the same target information to the same audit service in the plurality of audit services for auditing, wherein different target information points to different databases, and the same target information points to the same database. Optionally, the sending module is configured to: acquiring mirror image data of a preset destination address; determining whether the mirror image data of the preset destination address is audited by preset auditing service; and if the mirror image data of the preset destination address is audited by the preset auditing service, sending the mirror image data of the preset destination address to the preset auditing service.
For another example, the selection module is configured to: and under the condition that the mirror image data of the preset destination address is not audited, selecting one audit service from the audit services as the preset audit service. Optionally, the system may further include: and the recording module is used for recording the corresponding relation between the preset destination address and the preset auditing service, wherein the corresponding relation is used as a basis for selecting the auditing service according to the destination address.
The problem of carrying out the audit time to the mirror image data among the prior art and existing has been solved through this embodiment to improve audit efficiency, make full use of the audit resource.
The above are merely examples of the present application and are not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A mirror image data audit distribution processing method is characterized by comprising the following steps:
receiving mirror image data, wherein the mirror image data comprises data for operating a database;
acquiring the current load of each audit service, wherein the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service;
selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent; selecting a plurality of audit services with the load lower than a second threshold value from the audit services, wherein the number of the plurality of audit services is a first number, and judging whether a second number of target information in the mirror image data is the same as the first number; if the first quantity and the second quantity are different, sending the mirror image data of at least two different pieces of target information to the same audit service according to the relation between the first quantity and the second quantity, or sending the mirror image data of the same piece of target information to different audit services; if the first number is larger than the second number, sending the mirror image data of the same target information to the same audit service, then obtaining the load of the audit service receiving the mirror image data, and sending the mirror image data of the same target information to at least two different audit services under the condition that the load exceeds a second threshold value; if the first number is smaller than the second number, sending the mirror image data of two different pieces of destination information to the same audit service;
respectively sending the mirror image data of different target information to each audit service in the plurality of audit services for auditing; after the audit data is sent to an audit service, if the load of the audit service during the audit of the mirror image data exceeds a first threshold value, the audit service splits the mirror image data which is not audited yet, and sends a request message to other audit services, wherein the request message is used for inquiring whether the other audit services can audit or not, under the condition that the audit responses of the other audit services can be received, part of split data is sent to the other audit services, and the other audit services send the audit results to the audit service for summarizing after the received data is audited.
2. The method of claim 1, wherein sending the mirrored data of different destination information to each of the plurality of audit services for auditing comprises:
and sending the mirror image data of the same target information to the same audit service in the plurality of audit services for auditing, wherein different target information points to different databases, and the same target information points to the same database.
3. The method of claim 2, wherein sending mirrored data of the same destination information to the same one of the plurality of audit services for auditing comprises:
acquiring mirror image data of a preset destination address;
determining whether the mirror image data of the preset destination address is audited by preset auditing service;
and if the mirror image data of the preset destination address is audited by the preset auditing service, sending the mirror image data of the preset destination address to the preset auditing service.
4. The method of claim 3, further comprising:
and under the condition that the mirror image data of the preset destination address is not audited, selecting one audit service from the audit services as the preset audit service.
5. The method of claim 4, further comprising:
and recording the corresponding relation between the preset destination address and the preset auditing service, wherein the corresponding relation is used as a basis for selecting the auditing service according to the destination address.
6. A mirrored data audit distribution processing system, comprising:
the system comprises a receiving module, a processing module and a processing module, wherein the receiving module is used for receiving mirror image data, and the mirror image data comprises data for operating a database;
the system comprises an acquisition module, a processing module and a processing module, wherein the acquisition module is used for acquiring the current load of each audit service, the audit service is used for auditing, and the mirror image data stores data for operating a database; the load of the audit service is used for indicating the occupied rate of the computing resources of the audit service;
the selecting module is used for selecting a plurality of audit services from the audit services according to the target information of the mirror image data and the current load of each audit service, wherein the target information is used for indicating a database to which the mirror image data is sent; selecting a plurality of audit services with the load lower than a second threshold value from the audit services, wherein the number of the plurality of audit services is a first number, and judging whether a second number of target information in the mirror image data is the same as the first number; if the first quantity and the second quantity are different, sending the mirror image data of at least two different pieces of target information to the same audit service according to the relation between the first quantity and the second quantity, or sending the mirror image data of the same piece of target information to different audit services; if the first number is larger than the second number, sending the mirror image data of the same target information to the same audit service, then obtaining the load of the audit service receiving the mirror image data, and sending the mirror image data of the same target information to at least two different audit services under the condition that the load exceeds a second threshold value; if the first number is smaller than the second number, sending the mirror image data of two different pieces of destination information to the same audit service;
the sending module is used for respectively sending the mirror image data of different target information to each audit service in the plurality of audit services for auditing; after the audit data is sent to an audit service, if the load of the audit service during the audit of the mirror image data exceeds a first threshold value, the audit service splits the mirror image data which is not audited yet, and sends a request message to other audit services, wherein the request message is used for inquiring whether the other audit services can audit or not, under the condition that the audit responses of the other audit services can be received, part of split data is sent to the other audit services, and the other audit services send the audit results to the audit service for summarizing after the received data is audited.
7. The system of claim 6, wherein the sending module is configured to:
and sending the mirror image data of the same target information to the same audit service in the plurality of audit services for auditing, wherein different target information points to different databases, and the same target information points to the same database.
8. The system of claim 7, wherein the sending module is configured to:
acquiring mirror image data of a preset destination address;
determining whether the mirror image data of the preset destination address is audited by preset auditing service;
and if the mirror image data of the preset destination address is audited by the preset auditing service, sending the mirror image data of the preset destination address to the preset auditing service.
9. The system of claim 8, wherein the selection module is configured to:
and under the condition that the mirror image data of the preset destination address is not audited, selecting one audit service from the audit services as the preset audit service.
10. The system of claim 9, further comprising:
and the recording module is used for recording the corresponding relation between the preset destination address and the preset auditing service, wherein the corresponding relation is used as a basis for selecting the auditing service according to the destination address.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111103776.2A CN113553193B (en) | 2021-09-22 | 2021-09-22 | Mirror image data auditing and distributing processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111103776.2A CN113553193B (en) | 2021-09-22 | 2021-09-22 | Mirror image data auditing and distributing processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113553193A CN113553193A (en) | 2021-10-26 |
| CN113553193B true CN113553193B (en) | 2022-02-01 |
Family
ID=78106633
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111103776.2A Active CN113553193B (en) | 2021-09-22 | 2021-09-22 | Mirror image data auditing and distributing processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113553193B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104537308A (en) * | 2015-01-23 | 2015-04-22 | 北京奇虎科技有限公司 | System and method for providing application security auditing function |
| CN107547310A (en) * | 2017-08-24 | 2018-01-05 | 杭州安恒信息技术有限公司 | A kind of user behavior association analysis method and system based on bypass audit device |
-
2021
- 2021-09-22 CN CN202111103776.2A patent/CN113553193B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104537308A (en) * | 2015-01-23 | 2015-04-22 | 北京奇虎科技有限公司 | System and method for providing application security auditing function |
| CN107547310A (en) * | 2017-08-24 | 2018-01-05 | 杭州安恒信息技术有限公司 | A kind of user behavior association analysis method and system based on bypass audit device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113553193A (en) | 2021-10-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10439937B2 (en) | Service addressing in distributed environment | |
| CN112346829B (en) | Method and equipment for task scheduling | |
| CN109951494B (en) | Simulation data processing method and device, simulation equipment and storage medium | |
| CN109391512A (en) | A kind of service issuing method, device and electronic equipment | |
| CN111562884B (en) | Data storage method and device and electronic equipment | |
| CN113553193B (en) | Mirror image data auditing and distributing processing method and system | |
| CN110764930B (en) | Request or response processing method and device based on message mode | |
| CN116841645A (en) | Database flow processing method and system for database audit | |
| CN114020477A (en) | Desensitization cluster environment concurrent task scheduling method and device | |
| CN111600943B (en) | Method and equipment for acquiring target data | |
| CN108287793A (en) | The way to play for time and server of response message | |
| CN111369282B (en) | Resource processing method and device | |
| CN110874268B (en) | Data processing method, device and equipment | |
| CN113723991B (en) | Marketing article influence analysis processing method and device | |
| CN114827158A (en) | Configuration information loading method, system and server | |
| CN111143711A (en) | Object searching method and system | |
| CN112148740B (en) | Data transmission method and device, storage medium and electronic device | |
| CN111767330B (en) | Data interaction method and device, electronic equipment and storage medium | |
| CN114461614B (en) | Sensitive data identification processing method and system | |
| CN111404709B (en) | Method and device for operating policy rules under network function virtualization | |
| CN110971640B (en) | CDN acceleration service distribution method and device | |
| CN113630422A (en) | Network security data processing method and system based on edge node | |
| CN116055479A (en) | File transmission processing method and device, nonvolatile storage medium and electronic equipment | |
| CN112579314A (en) | Data information issuing method and device, storage medium and electronic equipment | |
| CN114676101A (en) | File processing method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |