CN114928574A - Information sending method, information sending device, electronic equipment and computer readable medium - Google Patents
Information sending method, information sending device, electronic equipment and computer readable medium Download PDFInfo
- Publication number
- CN114928574A CN114928574A CN202210526370.3A CN202210526370A CN114928574A CN 114928574 A CN114928574 A CN 114928574A CN 202210526370 A CN202210526370 A CN 202210526370A CN 114928574 A CN114928574 A CN 114928574A
- Authority
- CN
- China
- Prior art keywords
- information
- target
- data information
- candidate
- initial
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L47/00—Traffic control in data switching networks
- H04L47/50—Queue scheduling
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The embodiment of the disclosure discloses an information sending method, an information sending device, electronic equipment and a computer readable medium. One embodiment of the method comprises: and analyzing the initial log information to generate candidate data information to obtain a candidate data information set. And determining candidate data information meeting the screening condition in the candidate data information set as first target data information to obtain a first target data information set. And analyzing the event content information contained in each piece of first target data information in the first target data information set to generate target information, so as to obtain a target information set. And sending the target information in the target information set to target equipment through a target queue. The method and the device ensure the accuracy of the information in the sending process and improve the information sending efficiency.
Description
Technical Field
Embodiments of the present disclosure relate to the field of computer technologies, and in particular, to an information sending method, an information sending device, an electronic device, and a computer-readable medium.
Background
The information sending refers to a technology of sending the repaired data information to a user so that the user can modify the data which needs to be repaired locally. At present, when information is transmitted, the method generally adopted is as follows: and directly sending the repaired data information to the user, and after the user finishes modifying the local data, sending the modified data information to the user of the next layer so as to fulfill the aim of finishing data modification layer by layer.
However, when the above-described manner is adopted, there are often technical problems as follows:
firstly, due to the adoption of a mode of sending data layer by layer, when a current layer user has an error in data modification, the data with the error in modification can be transmitted to a lower layer user, so that the accuracy of the data in the process of sending the data layer by layer can not be ensured;
secondly, data information is sent layer by layer, which results in longer data information transmission path and long consumed time, and further results in lower information sending efficiency.
Disclosure of Invention
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
Some embodiments of the present disclosure propose an information transmitting method, apparatus, electronic device and computer readable medium to solve one or more of the technical problems set forth in the background section above.
In a first aspect, some embodiments of the present disclosure provide an information sending method, including: analyzing initial log information to generate candidate data information to obtain a candidate data information set, wherein the initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set comprises: event type information and event content information; determining candidate data information meeting a screening condition in the candidate data information set as first target data information to obtain a first target data information set, wherein the screening condition is that event type information included in the candidate data information is target event type information, and event content information included in the candidate data information includes a target identifier; analyzing event content information contained in each first target data information in the first target data information set to generate target information to obtain a target information set; and sending the target information in the target information set to the target equipment through the target queue.
In a second aspect, some embodiments of the present disclosure provide an information transmitting apparatus, including: a first analysis unit, configured to analyze initial log information to generate candidate data information, resulting in a candidate data information set, where the initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set includes: event type information and event content information; an information determining unit configured to determine candidate data information satisfying a screening condition in the candidate data information set as first target data information, and obtain a first target data information set, wherein the screening condition is that event type information included in the candidate data information is target event type information, and event content information included in the candidate data information includes a target identifier; the second analysis unit is configured to analyze the event content information contained in each first target data information in the first target data information set to generate target information, so as to obtain a target information set; and the information sending unit is configured to send the target information in the target information set to the target equipment through the target queue.
In a third aspect, some embodiments of the present disclosure provide an electronic device, comprising: one or more processors; a storage device, on which one or more programs are stored, which when executed by one or more processors cause the one or more processors to implement the method described in any implementation of the first aspect.
In a fourth aspect, some embodiments of the present disclosure provide a computer readable medium on which a computer program is stored, wherein the program, when executed by a processor, implements the method described in any of the implementations of the first aspect.
The above embodiments of the present disclosure have the following beneficial effects: by the information sending method of some embodiments of the disclosure, the accuracy of the information in the sending process can be ensured, and the information sending efficiency can be improved. Specifically, the accuracy in the information transmission process cannot be guaranteed, and the reason for the inefficiency is that: firstly, due to the adoption of a mode of sending data layer by layer, when a current layer user has errors in data modification, the data with the errors in modification can be transmitted to a lower layer user, so that the accuracy of the data in the layer-by-layer sending process cannot be ensured; secondly, data information is sent layer by layer, which results in longer data information transmission path and long consumed time, and further results in lower information sending efficiency. Based on this, the information sending method of some embodiments of the present disclosure includes: firstly, analyzing initial log information to generate candidate data information to obtain a candidate data information set, wherein the initial log information is log information for recording data changes in a target database, and the candidate data information in the candidate data information set comprises: event type information and event content information. Since the initial log information is in binary format, it is necessary to analyze the initial log information to obtain a candidate data information set that can be used directly. Then, the candidate data information meeting the screening condition in the candidate data information set is determined as first target data information, and a first target data information set is obtained, wherein the screening condition is that the event type information included in the candidate data information is target event type information, and the event content information included in the candidate data information includes a target identifier. Therefore, the screening of the candidate data information is completed, and the candidate data information containing the target event type information and the target representation is obtained. And then, analyzing the event content information contained in each first target data information in the first target data information set to generate target information, so as to obtain a target information set. Thus, target information capable of accurately representing the data repair content is obtained. And finally, sending the target information in the target information set to the target equipment through the target queue. Therefore, the target information is sent to the target equipment in a message queue mode. Then, each layer of users acquires target information through corresponding target equipment according to self requirements, and the situation that when a mode of sending data layer by layer is adopted, due to the fact that the current layer of users wrongly modify the data, the wrongly modified data is transmitted to the lower layer of users, and accuracy of the data in the layer-by-layer sending process cannot be guaranteed is avoided. Meanwhile, the target information is sent in a form of message queues instead of being sent layer by layer, so that the problems of low information sending efficiency caused by long data information transmission path and long consumed time are solved, and the information sending efficiency is improved.
Drawings
The above and other features, advantages, and aspects of embodiments of the present disclosure will become more apparent by referring to the following detailed description when taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.
Fig. 1 is a flow diagram of some embodiments of an information sending method according to the present disclosure;
fig. 2 is a schematic block diagram of some embodiments of an information transmitting apparatus according to the present disclosure;
FIG. 3 is a schematic block diagram of an electronic device suitable for use in implementing some embodiments of the present disclosure.
Detailed Description
Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is to be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. It should be understood that the drawings and the embodiments of the disclosure are for illustration purposes only and are not intended to limit the scope of the disclosure.
It should be noted that, for convenience of description, only the portions related to the related invention are shown in the drawings. The embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict.
It should be noted that the terms "first", "second", and the like in the present disclosure are only used for distinguishing different devices, modules or units, and are not used for limiting the order or interdependence of the functions performed by the devices, modules or units.
It is noted that references to "a", "an", and "the" modifications in this disclosure are intended to be illustrative rather than limiting, and that those skilled in the art will recognize that "one or more" may be used unless the context clearly dictates otherwise.
The names of messages or information exchanged between devices in the embodiments of the present disclosure are for illustrative purposes only, and are not intended to limit the scope of the messages or information.
The present disclosure will be described in detail below with reference to the accompanying drawings in conjunction with embodiments.
Fig. 1 is a flow 100 of some embodiments of an information sending method according to the present disclosure. The information sending method comprises the following steps:
In some embodiments, an executing agent (e.g., a computing device) of the information sending method may parse the initial log information to generate candidate data information, resulting in a set of candidate data information. The initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set may include: event type information and event content information. The event type information may represent a type of an event obtained by analyzing the log information. The event content information may represent the content of an event obtained by analyzing the log information. For example, the target database may be a MySQL database. The log information may be binlog log information. The EVENT type information may be WRITE _ row _ EVENT. Wherein, the WRITE _ row _ EVENT represents the EVENT type information as a data new EVENT. The above event content information may be [ insert table _1(field _1, field _2, remark) values (value _1, value _2, "@ data repair") ], representing that a value _1 is inserted in the field _1 field, a value _2 is inserted in the field _2 field, and a value "@ data repair" is inserted in the remark field in the table _ 1.
For example, the execution subject may analyze the initial log information by a mysql brinlog analysis tool to generate candidate data information, so as to obtain the candidate data information set.
The computing device may be hardware or software. When the computing device is hardware, it may be implemented as a distributed cluster composed of multiple servers or terminal devices, or may be implemented as a single server or a single terminal device. When the computing device is embodied as software, it may be installed in the hardware devices enumerated above. It may be implemented, for example, as multiple software or software modules to provide distributed services, or as a single software or software module. And is not particularly limited herein.
It should be understood that the number of computing devices described above is merely illustrative. There may be any number of computing devices, as implementation needs dictate.
And 102, determining candidate data information meeting the screening condition in the candidate data information set as first target data information to obtain a first target data information set.
In some embodiments, the executing entity may determine candidate data information satisfying the filtering condition in the candidate data information set as first target data information, to obtain a first target data information set. The filtering condition may be that the event type information included in the candidate data information is target event type information, and the event content information included in the candidate data information includes a target identifier. The target event type information may be preset event type information for filtering candidate data information. The target identifier may be a predetermined identifier for marking the modified data. For example, the target EVENT type information may be [ WRITE _ row _ EVENT ] or [ UPDATE _ row _ EVENT ]. Wherein, the WRITE _ row _ EVENT represents the EVENT type information as a data new EVENT. UPDATE _ row _ EVENT characterizes the EVENT type information as a data modification EVENT. The above target identification may be [ @ data repair ].
In some embodiments, the executing entity may parse the event content information included in each first target data information in the first target data information set to generate target information, so as to obtain a target information set. The target information may be digital information obtained by encrypting modified data in the target database. For example, the target information may be [ 2101120444 ].
Optionally, the event content information included in the candidate data information set may include: a target database statement. For example, the target database statement may be [ insert table _1(field _1, field _2, remark) values (value _1, value _2, "@ data repair") ].
Optionally, the analyzing, by the executing entity, event content information included in each piece of first target data information in the first target data information set to generate target information, so as to obtain a target information set, may include the following steps:
the first step is to run the target database statement in the event content information included in the first target data information to generate second target data information.
The second target data information may represent an operation result of the target database statement. For example, the second target data information may be
| field_1 | field_2 | remark |
| value_1 | value_2 | @ data repair |
Wherein, field _1, field _2 and remark are field names. The value in the field _1 field is value _1, the value in the field _2 field is value _2, and the value in the remark field is "@ data repair".
And secondly, carrying out format conversion on the second target data information to generate third target data information.
The third target data information may be data information in a JSON type format. For example, the third target data information may be { "field _ 1": "value _ 1", "field _ 2": "value _ 2", "remark": "@ data repair" }.
As an example, the execution subject may convert the second target data information into the third target data information by using a "for json auto" statement in a MySQL database.
And thirdly, carrying out format verification on the third target data information to generate a verification result.
The verification result may represent whether the third target data information passes through the JOSN format verification. For example, the check result may be [ whether the check is passed: is ].
As an example, the execution subject may perform format check on the third target data information using a JOSN format check tool to generate a check result.
And fourthly, determining the third target data information as candidate information corresponding to the first target data information in response to the fact that the verification result represents that the third target data information passes format verification.
For example, the candidate information may be { "field _ 1": "value _ 1", "field _ 2": "value _ 2", "remark": "@ data repair" }.
And fifthly, generating abnormal prompt information in response to the fact that the verification result represents that the third target data information does not pass format verification.
The abnormality indication information may indicate that the third target data is abnormal.
And sixthly, sending the abnormal prompt information to display equipment so that the target user can modify the third target data information.
The display device may be a device having a display function. The user may modify the third target data information according to the abnormality prompt information displayed on the display device.
And seventhly, performing format verification on the modified third target data information in response to the received modified third target data information to generate a secondary verification result.
And the secondary verification result can represent whether the modified third target data information passes format verification.
As an example, the execution subject may perform format verification on the modified third target data information by using a JOSN format verification tool to generate a verification result.
And eighthly, determining the modified third target data information as candidate information corresponding to the first target data information in response to the fact that the second verification result represents that the modified third target data information passes format verification.
And ninthly, performing type conversion on the candidate information to generate candidate digital information.
The candidate number information may be information in the format of binary byte array.
As an example, the execution body may perform type conversion on the candidate information using a Base64 encoder and a Base64 encoding table, resulting in the candidate digital information.
And step ten, encrypting the candidate digital information by using the first target parameter and the second target parameter to generate the target information.
The first target parameter and the second target parameter may be preset parameters for performing encryption processing on the candidate digital information.
As an example, the executing entity performs an encryption process on the candidate digital information by using a first target parameter and a second target parameter to generate the target information, and may be implemented by the following formula:
C＝M e mod n。
where C represents target information. M represents candidate number information. e denotes a first target parameter. n represents a second target parameter.
And 104, sending the target information in the target information set to the target equipment through the target queue.
In some embodiments, the execution agent may send the target information in the target information set to the target device through the target queue. The target queue may be a message queue for sending target information. And the users in each layer of users correspond to one target device. The target device may be a device for the user to obtain target information sent by the target queue and for the user to modify local data according to the target information.
Optionally, the target queue may be obtained through the following steps:
the method comprises the steps of firstly, obtaining an initial message queue and an initial configuration parameter set corresponding to the initial message queue.
The initial message queue may be a message queue whose parameters are not configured. The initial configuration parameters may be initial parameters of a message queue. For example, the message queue may be a Kafka message queue.
And secondly, determining the initial configuration parameters meeting the parameter screening conditions in the initial configuration parameter set as sample parameters to obtain a sample parameter set.
Wherein, the parameter screening condition is that a correlation coefficient between an initial configuration parameter and the throughput rate of the initial message queue is greater than a first target value.
The first target value may be a minimum value of a correlation coefficient between a preset initial configuration parameter and a throughput rate of the message queue.
And thirdly, carrying out transformation processing on each sample parameter in the sample parameter set to generate a first sample parameter, so as to obtain a first sample parameter set.
Wherein the first sample parameter may be a parameter satisfying a standard normal distribution.
As an example, the executing entity may perform transformation processing on each sample parameter in the sample parameter set to generate a first sample parameter by the following formula, so as to obtain a first sample parameter set:
wherein x' represents a first sample parameter. x denotes the sample parameter. u represents the average of the sample parameters in the sample parameter set. δ represents the variance of a sample parameter in the set of sample parameters.
And fourthly, sampling in a preset range corresponding to each first sample parameter in the first sample parameter set to generate an initial training parameter set, so as to obtain an initial training parameter set.
Wherein the initial training parameter may be a parameter for replacing a parameter in the initial message queue. The number of initial training parameters in the initial training parameter set is the same as the number of first sample parameters in the first sample parameter set. The preset range may be a predetermined range in which the first sample parameter is in a certain proportion. For example, the first sample parameter may be 0.5. The ratio may be ± 10%, and the above-mentioned preset range may be (0.45, 0.55).
For example, the execution subject may sample by using a latin hypercube sampling method to generate an initial training parameter set, and obtain the initial training parameter set.
And fifthly, determining a target value corresponding to each initial training parameter group in the initial training parameter group set.
And the target value corresponding to the initial training parameter group represents the throughput rate of the candidate queue.
Optionally, for each initial training parameter set in the initial training parameter set, the determining, by the execution subject, a target value corresponding to the initial training parameter set may include the following sub-steps:
the first substep, using the initial training parameters in the initial training parameter group to replace the corresponding parameters in the initial message queue, to obtain the candidate queue.
Wherein the candidate queue may be a message queue for which parameter replacement is completed.
And a second substep of operating the candidate queue to obtain the target value corresponding to the initial training parameter set.
As an example, the execution entity may run the candidate queue and monitor the performance of the candidate queue to obtain the target value corresponding to the initial training parameter set.
Sixthly, determining an initial training sample set, wherein the initial training samples in the initial training sample set comprise: the initial training parameter set and the target value corresponding to the initial training parameter set, wherein the target value included in the initial training sample set is larger than the second target value.
The second target value may be a preset rate value for screening the initial training sample. For example, the second target value may be 400 bars/second. The executing agent may determine the initial training parameter group and the target value corresponding to the initial training parameter group as an initial training sample, so as to obtain an initial training sample set.
And seventhly, generating the target queue based on the initial training sample set and the initial message queue.
The target queue may be a message queue with the highest throughput rate obtained by replacing the parameter.
Optionally, the generating, by the executing entity, the target queue based on the initial training sample set and the initial message queue may include the following sub-steps:
a first substep of performing the following training steps based on the initial training sample set:
and a first training step, training the initial model by using the initial training sample set to obtain a target model and a coefficient matrix.
Wherein the initial model may be an untrained linear regression model. The target model may be a trained linear regression model. The coefficient matrix includes a weight coefficient corresponding to each initial training parameter.
And a second training step, based on the coefficient matrix, sampling in a preset range corresponding to each first sample parameter in the first sample parameter set to generate a second sample parameter set, so as to obtain a second sample parameter set.
As an example, the execution subject samples within a preset range corresponding to each first sample parameter in the first sample parameter set to generate a second sample parameter set, so as to obtain the second sample parameter set.
And the preset ranges corresponding to the first sample parameters corresponding to the second sample parameters in different second sample parameter sets are different. The second sample parameter is obtained by the following formula:
where ζ represents a second sample parameter. w represents the weighting factor corresponding to the second sample parameter. e denotes a natural constant. c represents a preset density parameter. And m represents the lower limit of the preset range corresponding to the first sample parameter. n represents the upper limit of the preset range corresponding to the first sample parameter. u represents a random number between 0, 1.
And a third training step, namely replacing the corresponding parameters in the initial message queue by using the second sample parameter group for each second sample parameter group in the second sample parameter group set to obtain a candidate queue corresponding to the second sample parameter group.
As an example, the executing entity may replace the parameter in the initial message queue with a corresponding parameter in the second sample parameter group, so as to obtain a candidate queue corresponding to the second sample parameter group.
And a fourth training step, in which the candidate queue corresponding to each second sample parameter set in the second sample parameter set is run to generate a target value corresponding to the second sample parameter set, so as to obtain a target value set.
And a fifth training step, determining a training sample set.
Wherein the training samples in the training sample set comprise: and the second parameter group and the target value corresponding to the second parameter group, wherein the target value included in the training samples in the training sample set is larger than the second target value. The executing entity may determine the second parameter group and the target value corresponding to the second parameter group as a training sample.
And a sixth training step of increasing the number of times of training by 1.
The initial value of the number of times of training is set to 0.
And a seventh training step, in response to the fact that the training times are larger than the preset times, determining a second sample parameter group corresponding to the maximum target value in the target value set as a target parameter group, and replacing the parameter corresponding to the initial message queue according to the target parameter group to obtain the target queue.
As an example, the execution body may replace the parameter in the initial message queue with a parameter in a target parameter group to obtain the target queue.
The preset times may be preset times of model training iterations. The target parameter set may be a parameter set having a maximum corresponding target value.
And a second substep of taking the training sample set as an initial training sample set and the target model as an initial model in response to determining that the training times are less than or equal to a preset number, and executing the training steps again.
The seventh step is an inventive point of some embodiments of the present disclosure, and solves the technical problem mentioned in the background section, "sending data information layer by layer, where a data information transmission path is long and time consumption is long, thereby resulting in low information sending efficiency. Since the data information is sent layer by layer (for example, the user a sends the data information to the user B, and the user B sends the modified data information to the user C), the transmission path of the data information is longer, the consumed time is long, and the information sending efficiency is further reduced. Based on this, in order to improve the efficiency of information transmission, first, based on an initial training sample set, the following training steps are performed: firstly, training an initial model by using an initial training sample set to obtain a target model and a coefficient matrix. And secondly, sampling in a preset range corresponding to each first sample parameter in the first sample parameter set based on the coefficient matrix to generate a second sample parameter set, so as to obtain a second sample parameter set. And the preset ranges corresponding to the first sample parameters corresponding to the second sample parameters in different second sample parameter sets are different. Therefore, the first sample parameters are sampled by combining the weight parameters obtained by model training, and the second sample parameters corresponding to the same first sample parameters in different obtained second sample parameter groups are ensured to be uniformly distributed. And thirdly, replacing the corresponding parameters in the initial message queue by using the second sample parameter group for each second sample parameter group in the second sample parameter group set to obtain a candidate queue corresponding to the second sample parameter group. And fourthly, operating the candidate queue corresponding to each second sample parameter group in the second sample parameter group set to generate a target value corresponding to the second sample parameter group, so as to obtain a target value set. And fifthly, determining a training sample set. Therefore, the training of the model and the updating of the training samples are completed once, and the updated training sample set is obtained. And sixthly, increasing the training times by 1. And seventhly, determining a second sample parameter group corresponding to the maximum target value in the target value set as a target parameter group in response to the fact that the training times are larger than the preset times, and replacing the parameters corresponding to the initial message queue according to the target parameter group to obtain the target queue. Therefore, the message queue with the highest throughput rate is obtained through iterative training of the model. Then, in response to determining that the training times are less than or equal to the preset times, the training sample set is used as an initial training sample set, and the target model is used as an initial model, and the training steps are executed again. Due to the adoption of the message queue mode, users at each layer can acquire data information through corresponding target equipment according to self requirements, and the problems of long data information transmission path and long consumed time caused by sending the data information layer by layer are solved. Meanwhile, through iterative training of the model, optimization of the message queue is completed, the message queue with the highest throughput rate is obtained, the time for information transmission is further shortened, and the efficiency of information sending is improved.
By the information sending method of some embodiments of the disclosure, the accuracy of the information in the sending process can be ensured, and the information sending efficiency can be improved. Specifically, the accuracy in the information transmission process cannot be guaranteed, and the reason for the inefficiency is that: firstly, due to the adoption of a mode of sending data layer by layer, when a current layer user has an error in data modification, the data with the error in modification can be transmitted to a lower layer user, so that the accuracy of the data in the process of sending the data layer by layer can not be ensured; secondly, data information is sent layer by layer, which results in longer data information transmission path and long consumed time, and further results in lower information sending efficiency. Based on this, the information sending method of some embodiments of the present disclosure includes: firstly, analyzing initial log information to generate candidate data information to obtain a candidate data information set, wherein the initial log information is log information for recording data changes in a target database, and the candidate data information in the candidate data information set comprises: event type information and event content information. Since the initial log information is in binary format, it is necessary to analyze the initial log information to obtain a candidate data information set that can be used directly. Then, the candidate data information meeting the screening condition in the candidate data information set is determined as first target data information, and a first target data information set is obtained, wherein the screening condition is that the event type information included in the candidate data information is target event type information, and the event content information included in the candidate data information includes a target identifier. Therefore, the screening of the candidate data information is completed, and the candidate data information containing the target event type information and the target representation is obtained. And then, analyzing the event content information contained in each first target data information in the first target data information set to generate target information, so as to obtain a target information set. Thus, target information capable of accurately representing the data repair content is obtained. And finally, sending the target information in the target information set to the target equipment through the target queue. Therefore, the target information is sent to the target equipment in a message queue mode. Then, each layer of users acquires target information through corresponding target equipment according to self requirements, and the situation that when a mode of sending data layer by layer is adopted, due to the fact that the current layer of users wrongly modify the data, the wrongly modified data are transmitted to the lower layer of users, and accuracy of the data in the layer-by-layer sending process cannot be guaranteed is avoided. Meanwhile, the target information is sent in a message queue mode instead of being sent layer by layer, so that the problem of low information sending efficiency caused by long time consumption caused by a long data information transmission path (for example, the user A sends the data information to the user B, and the user B sends the data information to the user C) is solved, and the information sending efficiency is improved.
With further reference to fig. 2, as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of an information transmitting apparatus, which correspond to those of the method embodiments shown in fig. 1, and which may be applied in various electronic devices in particular.
As shown in fig. 2, the information transmitting apparatus 200 of some embodiments includes: a first parsing unit 201, an information determination unit 202, a second parsing unit 203, and an information transmission unit 204. The first parsing unit 201 is configured to parse initial log information to generate candidate data information, so as to obtain a candidate data information set, where the initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set includes: event type information and event content information. The information determining unit 202 is configured to determine candidate data information satisfying a filtering condition in the candidate data information set as first target data information, and obtain the first target data information set, wherein the filtering condition is that event type information included in the candidate data information is target event type information, and event content information included in the candidate data information includes a target identifier. The second parsing unit 203 is configured to parse the event content information included in each of the first target data information sets to generate target information, resulting in a target information set. The information sending unit 204 is configured to send the target information in the target information set to the target device through the target queue.
It will be appreciated that the units described in the apparatus 200 correspond to the various steps in the method described with reference to figure 1. Thus, the operations, features and resulting advantages described above with respect to the method are also applicable to the apparatus 200 and the units included therein, and are not described herein again.
Referring now to FIG. 3, shown is a schematic block diagram of an electronic device (e.g., computing device) 300 suitable for use in implementing some embodiments of the present disclosure. The electronic device shown in fig. 3 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 3, electronic device 300 may include a processing device (e.g., central processing unit, graphics processor, etc.) 301 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)302 or a program loaded from a storage device 308 into a Random Access Memory (RAM) 303. In the RAM 303, various programs and data necessary for the operation of the electronic apparatus 300 are also stored. The processing device 301, the ROM 302, and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.
Generally, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; an output device 307 including, for example, a Liquid Crystal Display (LCD), a speaker, a vibrator, and the like; storage devices 308 including, for example, magnetic tape, hard disk, etc.; and a communication device 309. The communication means 309 may allow the electronic device 300 to communicate with other devices, wireless or wired, to exchange data. While fig. 3 illustrates an electronic device 300 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may be alternatively implemented or provided. Each block shown in fig. 3 may represent one device or may represent multiple devices, as desired.
In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flow diagrams may be implemented as computer software programs. For example, some embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In some such embodiments, the computer program may be downloaded and installed from a network through the communication device 309, or installed from the storage device 308, or installed from the ROM 302. The computer program, when executed by the processing apparatus 301, performs the above-described functions defined in the methods of some embodiments of the present disclosure.
It should be noted that the computer readable medium described in some embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.
In some embodiments, the clients, servers may communicate using any currently known or future developed network Protocol, such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), the Internet (e.g., the Internet), and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any currently known or future developed network.
The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by the electronic device, cause the electronic device to: analyzing initial log information to generate candidate data information to obtain a candidate data information set, wherein the initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set comprises: event type information and event content information; determining candidate data information meeting a screening condition in the candidate data information set as first target data information to obtain a first target data information set, wherein the screening condition is that event type information included in the candidate data information is target event type information and event content information included in the candidate data information includes a target identifier; analyzing event content information contained in each first target data information in the first target data information set to generate target information to obtain a target information set; and sending the target information in the target information set to the target equipment through the target queue.
Computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + +, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The units described in some embodiments of the present disclosure may be implemented by software, and may also be implemented by hardware. The described units may also be provided in a processor, which may be described as: a processor includes a first parsing unit, an information determination unit, a second parsing unit, and an information transmission unit. The names of these units do not constitute a limitation to the unit itself in some cases, and for example, the information sending unit may also be described as "a unit that sends the target information in the target information set to the target device through the target queue".
The functions described herein above may be performed, at least in part, by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), systems on a chip (SOCs), Complex Programmable Logic Devices (CPLDs), and the like.
The foregoing description is only exemplary of the preferred embodiments of the disclosure and is illustrative of the principles of the technology employed. It will be appreciated by those skilled in the art that the scope of the invention in the embodiments of the present disclosure is not limited to the specific combination of the above-mentioned features, but also encompasses other embodiments in which any combination of the above-mentioned features or their equivalents is made without departing from the inventive concept as defined above. For example, the above features and (but not limited to) the features with similar functions disclosed in the embodiments of the present disclosure are mutually replaced to form the technical solution.
Claims (8)
1. An information sending method includes:
analyzing initial log information to generate candidate data information to obtain a candidate data information set, wherein the initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set comprises: event type information and event content information;
determining candidate data information meeting a screening condition in the candidate data information set as first target data information to obtain a first target data information set, wherein the screening condition is that event type information included in the candidate data information is target event type information and event content information included in the candidate data information includes a target identifier;
analyzing event content information contained in each first target data information in the first target data information set to generate target information to obtain a target information set;
and sending the target information in the target information set to target equipment through a target queue.
2. The method of claim 1, wherein the candidate data information in the set of candidate data information includes event content information comprising: a target database statement; and
the analyzing the event content information included in each first target data information in the first target data information set to generate target information includes:
executing a target database statement in the event content information included in the first target data information to generate second target data information;
carrying out format conversion on the second target data information to generate third target data information;
carrying out format verification on the third target data information to generate a verification result;
and determining the third target data information as candidate information corresponding to the first target data information in response to the fact that the verification result represents that the third target data information passes format verification.
3. The method of claim 2, wherein the parsing event content information contained in each first target data information of the first set of target data information to generate target information further comprises:
generating abnormal prompt information in response to the fact that the verification result represents that the third target data information does not pass format verification;
sending the abnormal prompt information to display equipment so that a target user can modify the third target data information;
performing format verification on the modified third target data information in response to receiving the modified third target data information to generate a secondary verification result;
and determining the modified third target data information as candidate information corresponding to the first target data information in response to determining that the secondary verification result represents that the modified third target data information passes format verification.
4. The method of claim 3, wherein the parsing event content information contained in each first target data information of the first set of target data information to generate target information further comprises:
performing type conversion on the candidate information to generate candidate digital information;
and encrypting the candidate digital information by using the first target parameter and the second target parameter to generate the target information.
5. The method of claim 1, wherein the target queue is derived by:
acquiring an initial message queue and an initial configuration parameter set corresponding to the initial message queue;
determining initial configuration parameters meeting parameter screening conditions in the initial configuration parameter set as sample parameters to obtain a sample parameter set, wherein the parameter screening conditions are that correlation coefficients of the initial configuration parameters and throughput rates of the initial message queues are larger than a first target value;
performing transformation processing on each sample parameter in the sample parameter set to generate a first sample parameter, so as to obtain a first sample parameter set;
sampling in a preset range corresponding to each first sample parameter in the first sample parameter set to generate an initial training parameter set to obtain an initial training parameter set;
for each initial training parameter set in the initial training parameter set, determining a target value corresponding to the initial training parameter set, wherein the target value corresponding to the initial training parameter set represents the throughput rate of the candidate queue;
determining an initial training sample set, wherein an initial training sample in the initial training sample set comprises: the initial training parameter set and a target value corresponding to the initial training parameter set, wherein the target value included in the initial training sample set is larger than a second target value;
generating the target queue based on the initial training sample set and the initial message queue.
6. An information transmission apparatus comprising:
the data analysis method comprises a first analysis unit and a second analysis unit, wherein the first analysis unit is configured to analyze initial log information to generate candidate data information to obtain a candidate data information set, the initial log information is log information used for recording data changes in a target database, and the candidate data information in the candidate data information set comprises: event type information and event content information;
an information determining unit configured to determine candidate data information satisfying a screening condition in the candidate data information set as first target data information, resulting in a first target data information set, wherein the screening condition is that event type information included in the candidate data information is target event type information, and event content information included in the candidate data information includes a target identifier;
the second analysis unit is configured to analyze the event content information contained in each first target data information in the first target data information set to generate target information, so as to obtain a target information set;
an information sending unit configured to send the target information in the target information set to a target device through a target queue.
7. An electronic device, comprising:
one or more processors;
a storage device having one or more programs stored thereon;
when executed by the one or more processors, cause the one or more processors to implement the method of any one of claims 1-5.
8. A computer-readable medium, on which a computer program is stored, wherein the program, when executed by a processor, implements the method of any one of claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210526370.3A CN114928574B (en) | 2022-05-16 | 2022-05-16 | Information transmission method, apparatus, electronic device, and computer-readable medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210526370.3A CN114928574B (en) | 2022-05-16 | 2022-05-16 | Information transmission method, apparatus, electronic device, and computer-readable medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114928574A true CN114928574A (en) | 2022-08-19 |
| CN114928574B CN114928574B (en) | 2023-06-13 |
Family
ID=82809092
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210526370.3A Active CN114928574B (en) | 2022-05-16 | 2022-05-16 | Information transmission method, apparatus, electronic device, and computer-readable medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114928574B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115361450A (en) * | 2022-10-19 | 2022-11-18 | 北京国电通网络技术有限公司 | Request information processing method, apparatus, electronic device, medium, and program product |
| CN116150249A (en) * | 2023-04-13 | 2023-05-23 | 新兴际华集团财务有限公司 | Table data export method, apparatus, electronic device and computer readable medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6889231B1 (en) * | 2002-08-01 | 2005-05-03 | Oracle International Corporation | Asynchronous information sharing system |
| CN103235754A (en) * | 2013-04-24 | 2013-08-07 | 曙光信息产业(北京)有限公司 | Method and device for processing requests in distributed file system |
| CN106709043A (en) * | 2016-12-30 | 2017-05-24 | 江苏瑞中数据股份有限公司 | Data synchronous loading method based on database log |
| US20210081432A1 (en) * | 2019-09-13 | 2021-03-18 | Pure Storage, Inc. | Configurable data replication |
| CN113535777A (en) * | 2021-06-24 | 2021-10-22 | 上海浦东发展银行股份有限公司 | Database query method, device and system |
| US11321006B1 (en) * | 2020-03-25 | 2022-05-03 | Pure Storage, Inc. | Data loss prevention during transitions from a replication source |
-
2022
- 2022-05-16 CN CN202210526370.3A patent/CN114928574B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6889231B1 (en) * | 2002-08-01 | 2005-05-03 | Oracle International Corporation | Asynchronous information sharing system |
| CN103235754A (en) * | 2013-04-24 | 2013-08-07 | 曙光信息产业(北京)有限公司 | Method and device for processing requests in distributed file system |
| CN106709043A (en) * | 2016-12-30 | 2017-05-24 | 江苏瑞中数据股份有限公司 | Data synchronous loading method based on database log |
| US20210081432A1 (en) * | 2019-09-13 | 2021-03-18 | Pure Storage, Inc. | Configurable data replication |
| US11321006B1 (en) * | 2020-03-25 | 2022-05-03 | Pure Storage, Inc. | Data loss prevention during transitions from a replication source |
| CN113535777A (en) * | 2021-06-24 | 2021-10-22 | 上海浦东发展银行股份有限公司 | Database query method, device and system |
Non-Patent Citations (2)
| Title |
|---|
| LIK WONG ET AL.: "Oracle Streams: A High Performance Implementation for Near Real Time Asynchronous Replication", IEEE * |
| 汪洋;李爱平;缪嘉嘉;邹鹏;: "一种基于发布/订阅机制的数据集成方法", 计算机工程与应用 * |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115361450A (en) * | 2022-10-19 | 2022-11-18 | 北京国电通网络技术有限公司 | Request information processing method, apparatus, electronic device, medium, and program product |
| CN115361450B (en) * | 2022-10-19 | 2023-01-17 | 北京国电通网络技术有限公司 | Request information processing method, apparatus, electronic device, medium, and program product |
| CN116150249A (en) * | 2023-04-13 | 2023-05-23 | 新兴际华集团财务有限公司 | Table data export method, apparatus, electronic device and computer readable medium |
| CN116150249B (en) * | 2023-04-13 | 2023-06-16 | 新兴际华集团财务有限公司 | Table data export method, apparatus, electronic device and computer readable medium |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114928574B (en) | 2023-06-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114928574B (en) | Information transmission method, apparatus, electronic device, and computer-readable medium | |
| CN115130065B (en) | Method, device and equipment for processing characteristic information of supply terminal and computer readable medium | |
| CN112684968A (en) | Page display method and device, electronic equipment and computer readable medium | |
| CN115293657B (en) | Carbon emission index information generation method, apparatus, electronic device, and medium | |
| CN113268761B (en) | Information encryption method and device, electronic equipment and computer readable medium | |
| CN114004425A (en) | Article circulation information prediction model generation method, information generation method and device | |
| CN115085196A (en) | Power load predicted value determination method, device, equipment and computer readable medium | |
| CN113190517B (en) | Data integration method and device, electronic equipment and computer readable medium | |
| CN113379335B (en) | Electric power material sampling method and device, electronic equipment and computer readable medium | |
| CN114780338A (en) | Host information processing method and device, electronic equipment and computer readable medium | |
| CN112507676B (en) | Method and device for generating energy report, electronic equipment and computer readable medium | |
| CN115277261A (en) | Abnormal machine intelligent identification method, device and equipment based on industrial control network virus | |
| CN111221424B (en) | Method, apparatus, electronic device, and computer-readable medium for generating information | |
| CN113779335A (en) | Information generation method and device, electronic equipment and computer readable medium | |
| CN111898061A (en) | Method, device, electronic equipment and computer readable medium for searching network | |
| CN116881097B (en) | User terminal alarm method, device, electronic equipment and computer readable medium | |
| CN115374320B (en) | Text matching method and device, electronic equipment and computer medium | |
| CN116862319B (en) | Power index information generation method, device, electronic equipment and medium | |
| CN115204150B (en) | Information verification method and device, electronic equipment and computer readable medium | |
| CN112073202B (en) | Information generation method and device, electronic equipment and computer readable medium | |
| CN115629982A (en) | Test task execution method, device, electronic equipment, medium and program product | |
| CN113839976B (en) | Data sampling method and device | |
| CN109189689B (en) | Method and apparatus for testing | |
| CN111930704A (en) | Service alarm equipment control method, device, equipment and computer readable medium | |
| CN112307032A (en) | Application index determination method and device, electronic equipment and computer readable medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |