CN111352984B - Data distribution method, device and storage medium - Google Patents

Data distribution method, device and storage medium Download PDF

Info

Publication number
CN111352984B
CN111352984B CN202010102263.9A CN202010102263A CN111352984B CN 111352984 B CN111352984 B CN 111352984B CN 202010102263 A CN202010102263 A CN 202010102263A CN 111352984 B CN111352984 B CN 111352984B
Authority
CN
China
Prior art keywords
data
time
routing rule
routing
rule
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010102263.9A
Other languages
Chinese (zh)
Other versions
CN111352984A (en
Inventor
刘晓彤
王鹏
裴宏祥
曹朦胧
刘乾
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China United Network Communications Group Co Ltd
Original Assignee
China United Network Communications Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China United Network Communications Group Co Ltd filed Critical China United Network Communications Group Co Ltd
Priority to CN202010102263.9A priority Critical patent/CN111352984B/en
Publication of CN111352984A publication Critical patent/CN111352984A/en
Application granted granted Critical
Publication of CN111352984B publication Critical patent/CN111352984B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/74Address processing for routing

Abstract

The embodiment of the invention provides a data distribution method, equipment and a storage medium, wherein the method comprises the following steps: acquiring data to be distributed; matching routing rules for the data to be distributed according to a pre-established routing table, wherein the routing table comprises at least one routing rule; determining a first time and a second time corresponding to the matched routing rule, wherein the first time is a system time when the matched routing rule is used last time, and the second time is a change time of the matched routing rule; and if the first time is later than the second time, triggering a data callback processing mechanism to redistribute the data to be distributed. According to the method and the device, the wrong data distributed due to the routing rule change time delay can be automatically identified, the wrong data can be timely redistributed, the timeliness of the data is guaranteed, and meanwhile, the labor cost and the time cost are reduced.

Description

Data distribution method, device and storage medium
Technical Field
The embodiment of the invention relates to the technical field of data processing, in particular to a data distribution method, data distribution equipment and a storage medium.
Background
With the increase of data traffic and service types, related technicians usually adopt a multi-channel parallel processing mode, that is, data is matched with different output channels through a data route, and the data is distributed to a plurality of computer nodes through the different output channels, so that the data can be processed by the plurality of computer nodes at the same time.
At present, the data routing is usually used to distribute data by using a routing table recorded with data distribution routing rules as the basis for data distribution. That is, the data label of the data to be distributed is matched with the routing rule in the routing table, and the output channel of the data is determined according to the matched routing rule.
However, this method has extremely high dependency on the routing table, when the output rule changes, the routing rule in the routing table also needs to be changed synchronously, the data is still distributed according to the wrong routing rule before the change due to the time delay caused by the change action, and the data with the wrong distribution needs to be periodically recovered manually, so that the data processing delay is caused, and the timeliness of the data is greatly reduced.
Disclosure of Invention
Embodiments of the present invention provide a data distribution method, device and storage medium, so as to solve the problem in the prior art that timeliness of data is reduced due to manual recovery and distribution of wrong data.
A first aspect of an embodiment of the present invention provides a data distribution method, including:
acquiring data to be distributed;
matching routing rules for the data to be distributed according to a pre-established routing table, wherein the routing table comprises at least one routing rule;
determining a first time and a second time corresponding to the matched routing rule, wherein the first time is a system time when the matched routing rule is used for the last time, and the second time is a change time of the matched routing rule;
and if the first time is after the second time, triggering a data callback processing mechanism to redistribute the data to be distributed.
Optionally, the routing table further includes output channel identifiers, where the output channel identifiers correspond to the routing rules one to one;
before the determining the first time and the second time corresponding to the matched routing rule, the method further includes:
according to the matched routing rule, determining an output channel identifier corresponding to the data to be distributed;
selecting a corresponding output channel according to the output channel identifier;
and distributing the data to be distributed according to the output channel.
Optionally, the method further comprises:
if the first time is after the second time, determining that the data to be distributed is data with distribution errors;
and storing the data with the distribution error into a data pool corresponding to the output channel.
Optionally, the triggering data recall processing mechanism redistributes the data to be distributed, including:
acquiring data with distribution errors in the data pool;
and re-matching a routing rule for the data with the distribution error according to the routing table.
Optionally, the routing table further includes time corresponding to each of the at least one routing rule, where the time is system time when the corresponding routing rule is used last time;
the determining the first time corresponding to the matched routing rule includes:
and determining the time corresponding to the matched routing rule in the routing table as a first time.
Optionally, before determining the first time and the second time corresponding to the matched routing rule, the method further includes:
acquiring a change instruction of a routing rule sent by a system, wherein the change instruction comprises change type information;
and changing the routing rule in the routing table according to the change instruction.
Optionally, the change type information includes: updating information, and/or deleting information, and/or adding information;
the changing the routing rule in the routing table according to the change instruction comprises:
updating the routing rule to be updated in the routing table according to the updating information; and/or the presence of a gas in the gas,
deleting the routing rule to be deleted in the routing table according to the deletion information; and/or the presence of a gas in the atmosphere,
and adding a routing rule in the routing table according to the newly added information.
Optionally, the change time is a system time when a change instruction corresponding to the matched routing rule is issued.
A second aspect of an embodiment of the present invention provides a data distribution apparatus, including: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executes computer-executable instructions stored in the memory, so that the at least one processor executes the data distribution method according to the first aspect of the embodiment of the present invention.
A third aspect of the present invention provides a computer-readable storage medium, where a computer-executable instruction is stored, and when a processor executes the computer-executable instruction, the data distribution method according to the first aspect of the present invention is implemented.
According to the data distribution method, the data distribution equipment and the storage medium, the data callback processing mechanism is activated by recording the latest use time of the routing rule matched with the data to be distributed and the change action initiation time of the matched routing rule, and the data with wrong books distributed due to the time delay of the change of the routing rule is automatically identified. That is, when the last usage time of the routing rule matched with the data to be distributed is after the initiation time of the routing rule change action, the data distribution is considered to be wrong, and the data callback processing mechanism is triggered to callback the wrong data and redistribute the wrong data. The process can identify the data with the errors in distribution in real time and automatically call back the data with the errors in redistribution, so that the data processing delay caused by the errors in distribution is reduced, the data timeliness is improved, and meanwhile, the labor and time costs are saved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is an application scenario diagram illustrating a data distribution method according to an exemplary embodiment of the present invention;
FIG. 2 is a flow diagram illustrating a data distribution method in accordance with an exemplary embodiment of the present invention;
FIG. 3 is a flowchart illustrating a data distribution method according to another exemplary embodiment of the present invention;
FIG. 4 is a block diagram of a data distribution system shown in an exemplary embodiment of the invention;
fig. 5 is a schematic structural diagram showing a data distribution apparatus according to an exemplary embodiment of the present invention;
fig. 6 is a schematic structural diagram of a data distribution apparatus shown in an exemplary embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are, for example, capable of operation in sequences other than those illustrated or otherwise described herein. Moreover, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
At present, the data routing is usually used to distribute data by using a routing table recorded with data distribution routing rules as the basis for data distribution. That is, the data label of the data to be distributed is matched with the routing rule in the routing table, and the output channel of the data is determined according to the matched routing rule.
However, the method has extremely high dependency on the routing table, when the output rule changes, the routing rule in the routing table also needs to be changed synchronously, the time delay caused by the change action can cause the data to be still distributed according to the wrong routing rule before the change, the wrongly distributed data needs to be periodically recovered manually, the data recovery time interval needs to be determined manually, the accuracy and the reasonableness are both low, and the timing data recovery compatibility is low; data with a time efficiency requirement needs to be frequently recycled, and at the moment, labor cost needs to be sacrificed to ensure the time efficiency of the system for processing the data; and for the scene with larger recovery time interval, the corresponding speed for processing the abnormal conditions such as the data synchronization delay of the routing table is low.
In order to overcome the defect, the invention provides a data distribution method, equipment and a storage medium, wherein the method activates a data callback processing mechanism by recording the latest use time of a routing rule matched with data to be distributed and the change action initiation time of the matched routing rule, and automatically identifies the data of wrong distribution caused by the change time delay of the routing rule. That is, when the last usage time of the routing rule matched with the data to be distributed is after the initiation time of the routing rule change action, the data distribution is considered to be wrong, and the data callback processing mechanism is triggered to callback the wrong data and redistribute the wrong data. The process can identify the data with the errors in distribution in real time and automatically call back the data with the errors in redistribution, so that the data processing delay caused by the errors in distribution is reduced, the data timeliness is improved, and meanwhile, the labor and time costs are saved.
Fig. 1 is an application scenario diagram illustrating a data distribution method according to an exemplary embodiment of the present invention.
As shown in fig. 1, in this embodiment, a data processing application system 102 obtains data to be distributed from a database 101, and then matches a routing rule for the data to be distributed according to a pre-established routing table, where the routing table includes at least one routing rule; then determining a first time and a second time corresponding to the matched routing rule, wherein the first time is a system time when the matched routing rule is used last time, and the second time is a change time of the matched routing rule; finally, the data processing application system 102 determines the sequence of the first time and the second time, and if the first time is after the second time, it indicates that the change of the matched routing rule has been delayed, and at this time, the data distributed according to the routing rule is the error distribution data, and then, the data callback processing mechanism is triggered to redistribute the data to be distributed.
Fig. 2 is a flowchart illustrating a data distribution method according to an exemplary embodiment of the present invention, and an execution subject of the present embodiment may be a data processing application system in the embodiment illustrated in fig. 1.
As shown in fig. 2, the method provided by this embodiment may include the following steps:
s201, acquiring data to be distributed;
the data to be distributed can be stored in the database, and when the data needs to be distributed, the data can be directly obtained from the database.
S202, matching routing rules for the data to be distributed according to a pre-established routing table, wherein the routing table comprises at least one routing rule;
specifically, the routing table includes at least one routing rule, and for different data, the corresponding routing rules are different. In some embodiments, the data to be distributed corresponds to a data label, and a routing rule corresponding to the data to be distributed is determined according to comparison between the data label and the routing rule in the routing table.
Further, the routing table further includes output channel identifiers, and the output channel identifiers and the routing rules are in a one-to-one correspondence relationship;
before the first time and the second time corresponding to the matched routing rule are determined, the method further includes:
determining an output channel identifier corresponding to the data to be distributed according to the matched routing rule;
selecting a corresponding output channel according to the output channel identifier;
and distributing the data to be distributed according to the output channel.
Specifically, after a routing rule corresponding to the data to be distributed is determined, an output channel identifier of the data to be distributed is determined according to a corresponding relationship between the routing rule and the output channel identifier, an output channel corresponding to the data to be distributed is determined according to the output channel identifier, and the data to be distributed is sent to a corresponding computer node through the output channel.
S203, determining a first time and a second time corresponding to the matched routing rule, wherein the first time is a system time when the matched routing rule is used for the last time, and the second time is a change time of the matched routing rule;
the system time may be a time system of the data processing application system, for example, the time system of the data processing application system is rounded up to a time starting point by 8 o' clock of 11 months, 1 day and 8 days in 2019, that is, 00 h, 00 min and 00 s in the time system, and the time is calculated from the time starting point.
Specifically, the first time is the system time when the matched routing rule is used for the last time, that is, after the routing rule corresponding to the data to be distributed is obtained through matching, the system time corresponding to the output channel identifier determined according to the matched routing rule is used as the first time, that is, the system time when the routing rule is used for the last time. And the second time is the change time of the matched routing rule, wherein the change time is the system time when the change instruction corresponding to the matched routing rule is sent out, namely, if the matched routing rule needs to be changed, the system needs to send the change instruction of the routing rule, and the system time when the instruction is sent out is taken as the second time.
Further, the routing table further includes respective corresponding time of the at least one routing rule, where the time is system time when the corresponding routing rule is used last time;
specifically, the system time corresponding to the output channel identifier determined according to the matched routing rule is used as the first time, and the time corresponding to the routing rule in the routing table is updated to the first time, so that the time corresponding to each routing rule in the routing table is guaranteed to be the system time when the corresponding routing rule is used for the last time. In specific implementation, the time corresponding to the routing rule to which the data to be distributed is matched in the routing table may be directly determined as the first time.
And S204, if the first time is after the second time, triggering a data recall processing mechanism to redistribute the data to be distributed.
Specifically, if the first time is after the second time, it indicates that the change action of the matched routing rule has been delayed, and the data to be distributed is still distributed by using the routing rule, thereby causing the erroneous distribution of the data to be distributed; and then, storing the data with the distribution error into a data pool corresponding to the output channel corresponding to the routing rule. Meanwhile, triggering a data recall processing mechanism to redistribute the data to be distributed, namely acquiring data with distribution errors in the data pool from a corresponding output channel; and then re-matching a routing rule for the data with the distribution error according to the routing table.
In one embodiment, before the first time and the second time corresponding to the matching routing rule are determined, the method further includes:
acquiring a change instruction of a routing rule sent by a system, wherein the change instruction comprises change type information;
and changing the routing rule in the routing table according to the change instruction.
Optionally, the change type information includes: updating information, and/or deleting information, and/or adding information;
the changing the routing rule in the routing table according to the change instruction comprises:
updating the routing rule to be updated in the routing table according to the updating information; and/or the presence of a gas in the gas,
deleting the routing rule to be deleted in the routing table according to the deletion information; and/or the presence of a gas in the gas,
and adding a routing rule in the routing table according to the newly added information.
Specifically, in the data distribution process, the distribution policy needs to be adjusted in real time according to the type and content change of the data to be distributed input to the source, and therefore, the routing rule in the routing table needs to be changed in real time, for example, if a certain type of data to be distributed does not appear for a long time, the routing rule corresponding to the type of data in the routing table needs to be deleted in order to reduce the memory usage; and for newly added type data to be distributed, a routing rule corresponding to the type of data needs to be added in a routing table.
In the embodiment, the data callback processing mechanism is activated by recording the last use time of the routing rule matched with the data to be distributed and the change action initiation time of the matched routing rule, so that the data of wrong books distributed due to the time delay of the change of the routing rule is automatically identified. That is, when the last usage time of the routing rule matched with the data to be distributed is after the initiation time of the routing rule change action, the data distribution is considered to be wrong, and the data callback processing mechanism is triggered to callback the wrong data and redistribute the wrong data. The process can identify the data with the errors in distribution in real time and automatically call back the data with the errors in redistribution, so that the data processing delay caused by the errors in distribution is reduced, the data timeliness is improved, and meanwhile, the labor and time costs are saved.
Fig. 3 is a flowchart illustrating a data distribution method according to another exemplary embodiment of the present invention, and this embodiment fully describes a specific implementation process of this embodiment on the basis of the embodiment of fig. 2.
As shown in fig. 3, the data distribution method provided in this embodiment may include the following steps:
s301, acquiring data to be distributed;
s302, matching a routing rule for the data to be distributed according to a pre-established routing table, wherein the routing table comprises at least one routing rule, an output channel identifier and time corresponding to the at least one routing rule, the output channel identifier and the routing rule are in one-to-one correspondence, and the time is system time when the corresponding routing rule is used for the last time;
s303, determining an output channel identifier corresponding to the data to be distributed according to the matched routing rule;
s304, selecting a corresponding output channel according to the output channel identifier;
s305, transmitting the data to be distributed through the output channel;
s306, determining a first time and a second time corresponding to the matched routing rule, wherein the first time is a system time when the matched routing rule is used last time, and the second time is a change time of the matched routing rule;
s307, if the first time is not later than the second time, determining the data to be distributed as data with distribution errors, and storing the data with the distribution errors into a data pool corresponding to the output channel;
s308, acquiring data with distribution errors in the data pool;
s309, re-matching the routing rule for the data with the distribution error according to the routing table so as to redistribute the data with the error.
For parts not described in detail in this embodiment, reference may be made to the description of the relevant steps in the above method embodiments, and further description is omitted here.
Fig. 4 is a schematic structural diagram of a data distribution system according to an exemplary embodiment of the present invention, and this embodiment describes in detail specific functions of each part of the system in this embodiment based on the embodiment of fig. 3.
As shown in fig. 4, the data distribution system provided in the present embodiment includes:
a data source module 401 for providing data to be distributed.
A routing table 402, which includes n routing rules, an output channel identifier corresponding to each routing rule, and a time corresponding to each routing rule, where the time is a system time when a corresponding routing rule is used last time. The n routing rules are Rule _0 and Rule _1 \8230, the output channel identification is represented by numbers 0 and 1 \8230, the n is represented by numbers 0 and 1 \8230, and the time corresponding to each of the n routing rules is represented by T _0 and T _1 \8230, and the T is represented by T _ n.
And a data routing module 403, configured to match a routing rule from a routing table according to the data to be distributed input by the data source, determine an output channel identifier corresponding to the data to be distributed according to the matched routing rule, and determine an output channel of the data to be distributed according to the output channel identifier.
And the data routing module is also used for updating the time corresponding to the routing rule to the current system time when the output channel is determined according to the routing rule matched with the data to be distributed. For example, the routing Rule to which the data to be distributed is matched is Rule _0, an output channel-0 corresponding to the data to be distributed is determined according to an output channel identifier 0 corresponding to the Rule _0, and meanwhile, the time T _0 corresponding to the Rule _0 is updated to be the current system time, that is, the time when the Rule _0 is used last time.
The output channels 404, the output channels and the output channel identifiers in the routing table are in a one-to-one correspondence relationship, so that after the data routing module determines the output channel identifiers corresponding to the data to be distributed, the output channels corresponding to the output channel identifiers can be directly selected to distribute the data.
For example, the data routing module, according to the data to be distributed, matches the routing Rule in the routing table to be Rule _1, and then the output channel identifier corresponding to Rule _1 is 1, and according to the identifier 1, can determine that the output channel-1 is the transmission channel corresponding to the data to be distributed, and distributes the data to be distributed to the corresponding computer node through the output channel-1.
A data pool 405 for storing data of distribution errors.
It should be noted that each output channel may correspond to a data pool, and the output channel has a function of automatically identifying data with a distribution error, and when data with a distribution error is identified, the error data is stored in the corresponding data pool.
For example, the output channel-0 and the output channel-1 \8230, the output channel-n respectively identifies error data as error data-0 and error data-1 \8230, and the output channel-n respectively stores the error data in the data pool-0, the data pool-1 \8230andthe data pool-n.
And a routing rule synchronous change module 406, configured to change a corresponding routing rule in the routing table according to a routing rule change instruction issued by the data processing application system. Comparing the system time when the change instruction is issued with the time corresponding to the corresponding routing rule, namely comparing the system time when the change instruction of the routing rule is issued with the time of using the routing rule for the last time, and if the time of using the routing rule for the last time is after the system time when the change instruction of the routing rule is issued, the change of the routing rule is delayed, so that the wrong distribution of data is caused; at this time, the error data recall module 407 is triggered to recall the data with the distribution error from the corresponding data pool and redistribute the data.
For example, the routing Rule matched with the data to be distributed is Rule _1, then the output channel identifier corresponding to Rule _1 is 1, the output channel-1 can be determined to be the transmission channel corresponding to the data to be distributed according to the identifier 1, and the data to be distributed is transmitted through the output channel-1. Meanwhile, the system time when the change instruction corresponding to Rule _1 is issued is obtained and recorded as T _1, T _1 is compared with T _1 corresponding to Rule _1, when the change action is actually executed according to the table update instruction, if T _1 is greater than T _1, it indicates that the change action executed by Rule _1 according to the change instruction has been delayed, and therefore the data to be distributed is wrongly distributed, the data with the distribution error is stored in a data pool-1 by an output channel-1, and the data error callback module 407 automatically recalls the data with the distribution error from the data pool-1 to a data source for redistribution.
It can be understood that, since T _1 and T _1 are both system time, a time T _1 is greater than T _1, which indicates that the time of using Rule _1 last time is after the system time when the change instruction of Rule _1 is issued.
And an error data retrieving module 407, configured to retrieve data with an error in distribution from the data pool 405 for redistribution when the time of using the routing rule last is after the issuing time of the change instruction of the routing rule.
It should be noted that, according to the change instruction of the route change rule, the route rule in the change routing table includes three change types: deleting the corresponding routing rule in the routing table, updating the corresponding routing rule in the routing table, and adding the routing rule in the routing table. In the following, assuming that the system time when the change instruction of Rule _3 is issued is T _3, and the system time when Rule _3 is used last time is T _3, the trigger conditions of the error data callback module are respectively described for different change types:
for delete routing rules: if T _3 is larger than T _3, the execution of the change action of Rule _3 is delayed, and the wrong distribution of the data is caused, and a data callback module is triggered to callback the wrong data in the data pool-3;
for the update routing Rule, if T _3 is greater than T _3, it indicates that the execution of the change action of Rule _3 is delayed, and causes the wrong distribution of data, and triggers the data callback module to callback the wrong data in the data pool-3;
for the newly added routing rule, because no use record of the newly added routing rule exists, the system time (marked as T _ sys) when the change action is executed is compared with the change instruction issuing time T _3, if the T _ sys is greater than the T _3, the execution of the change action is delayed, and the data is wrongly distributed, and then the data recall module is triggered to recall the wrong data in the corresponding data pool.
Fig. 5 is a schematic structural diagram showing a data distribution apparatus according to an exemplary embodiment of the present invention;
as shown in fig. 5, the apparatus provided in this embodiment includes:
a data obtaining module 501, configured to obtain data to be distributed;
a rule matching module 502, configured to match a routing rule for the data to be distributed according to a pre-established routing table, where the routing table includes at least one routing rule;
a time determining module 503, configured to determine a first time and a second time corresponding to the matched routing rule, where the first time is a system time when the matched routing rule is used last time, and the second time is a change time of the matched routing rule;
a data distribution module 504, configured to trigger a data recall processing mechanism to redistribute the data to be distributed when the first time is after the second time.
For detailed functional description of each module in this embodiment, reference is made to the description of the embodiment of the method, and the detailed description is not provided herein.
Fig. 6 is a schematic hardware structure diagram of a data distribution device according to an exemplary embodiment of the present invention. As shown in fig. 6, the present embodiment provides a data distribution apparatus 600 including: at least one processor 601 and memory 602. The processor 601 and the memory 602 are connected by a bus 603.
In a specific implementation process, the at least one processor 601 executes the computer-executable instructions stored in the memory 602, so that the at least one processor 601 executes the data distribution method in the foregoing method embodiment.
For the specific implementation process of the processor 601, reference may be made to the above method embodiments, which implement principles and technical effects similar to each other, and details are not described herein again.
In the embodiment shown in fig. 6, it should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose processors, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.
The memory may comprise high speed RAM memory and may also include non-volatile storage NVM, such as at least one disk memory.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
Another embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the data distribution method in the foregoing method embodiment is implemented.
The computer-readable storage medium may be implemented by any type of volatile or non-volatile storage device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk. A readable storage medium may be any available medium that can be accessed by a general purpose or special purpose computer.
An exemplary readable storage medium is coupled to the processor such the processor can read information from, and write information to, the readable storage medium. Of course, the readable storage medium may also be an integral part of the processor. The processor and the readable storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the readable storage medium may also reside as discrete components in the apparatus.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The foregoing program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; and the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present invention.

Claims (8)

1. A method for data distribution, comprising:
acquiring data to be distributed;
matching routing rules for the data to be distributed according to a pre-established routing table, wherein the routing table comprises at least one routing rule; the routing table also comprises output channel identifiers, and the output channel identifiers are in one-to-one correspondence with the routing rules;
determining a first time and a second time corresponding to the matched routing rule, wherein the first time is a system time when the matched routing rule is used for the last time, and the second time is a change time of the matched routing rule;
if the first time is after the second time, determining that the data to be distributed is data with distribution errors;
storing the data with the distribution errors into a data pool corresponding to the output channel;
acquiring data with distribution errors in the data pool;
and re-matching a routing rule for the data with the distribution error according to the routing table so as to re-distribute the data with the error.
2. The method of claim 1,
before the first time and the second time corresponding to the matched routing rule are determined, the method further includes:
according to the matched routing rule, determining an output channel identifier corresponding to the data to be distributed;
selecting a corresponding output channel according to the output channel identifier;
and distributing the data to be distributed according to the output channel.
3. The method according to claim 1, wherein the routing table further includes a time corresponding to each of the at least one routing rule, and the time is a system time when the corresponding routing rule was last used;
the determining the first time corresponding to the matched routing rule includes:
and determining the time corresponding to the matched routing rule in the routing table as a first time.
4. The method of claim 1, wherein the determining that the first time and the second time correspond to the matched routing rule are prior, the method further comprising:
acquiring a change instruction of a routing rule sent by a system, wherein the change instruction comprises change type information;
and changing the routing rule in the routing table according to the change instruction.
5. The method of claim 4, wherein the change type information comprises: updating information, and/or deleting information, and/or adding information;
the changing the routing rule in the routing table according to the change instruction comprises:
updating the routing rule to be updated in the routing table according to the updating information; and/or the presence of a gas in the gas,
deleting the routing rule to be deleted in the routing table according to the deletion information; and/or the presence of a gas in the gas,
and adding a routing rule in the routing table according to the newly added information.
6. The method according to claim 4, wherein the change time is a system time when a change instruction corresponding to the matched routing rule is issued.
7. A data distribution apparatus, characterized by comprising: at least one processor and memory;
the memory stores computer-executable instructions;
the at least one processor executing the computer-executable instructions stored by the memory causes the at least one processor to perform the data distribution method of any of claims 1 to 6.
8. A computer-readable storage medium having stored thereon computer-executable instructions which, when executed by a processor, implement the data distribution method of any one of claims 1 to 6.
CN202010102263.9A 2020-02-19 2020-02-19 Data distribution method, device and storage medium Active CN111352984B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010102263.9A CN111352984B (en) 2020-02-19 2020-02-19 Data distribution method, device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010102263.9A CN111352984B (en) 2020-02-19 2020-02-19 Data distribution method, device and storage medium

Publications (2)

Publication Number Publication Date
CN111352984A CN111352984A (en) 2020-06-30
CN111352984B true CN111352984B (en) 2023-04-18

Family

ID=71197999

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010102263.9A Active CN111352984B (en) 2020-02-19 2020-02-19 Data distribution method, device and storage medium

Country Status (1)

Country Link
CN (1) CN111352984B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113395213B (en) * 2021-06-10 2022-11-18 哲库科技(北京)有限公司 Configuration method of routing table item, storage medium, electronic equipment and mobile terminal

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106131204A (en) * 2016-07-22 2016-11-16 无锡华云数据技术服务有限公司 It is applied to message rapid distribution method and the system thereof of SiteServer LBS
CN107526808A (en) * 2017-08-22 2017-12-29 中国联合网络通信集团有限公司 Real-time data processing method and device

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1177436C (en) * 2002-02-09 2004-11-24 华为技术有限公司 Management method of multicast users in mobile network
US10033693B2 (en) * 2013-10-01 2018-07-24 Nicira, Inc. Distributed identity-based firewalls
US9473398B2 (en) * 2013-10-23 2016-10-18 International Business Machines Corporation Devolved routing in software-defined networks
CN104811740B (en) * 2015-04-29 2019-01-08 北京奇艺世纪科技有限公司 A kind of distribution method of video file, system and device
CN105721314A (en) * 2016-02-05 2016-06-29 华为技术有限公司 Method and equipment for sending data packet
CN109981467B (en) * 2019-03-29 2022-02-11 中国人民银行清算总中心 Static route updating method and route centralized management distribution method
CN110581804B (en) * 2019-08-09 2021-05-11 睿魔智能科技(深圳)有限公司 Heterogeneous link data translation and distribution method, system, device and storage medium
CN110677348B (en) * 2019-09-17 2021-07-27 创新先进技术有限公司 Data distribution method, access method and respective devices based on cache cluster routing

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106131204A (en) * 2016-07-22 2016-11-16 无锡华云数据技术服务有限公司 It is applied to message rapid distribution method and the system thereof of SiteServer LBS
CN107526808A (en) * 2017-08-22 2017-12-29 中国联合网络通信集团有限公司 Real-time data processing method and device

Also Published As

Publication number Publication date
CN111352984A (en) 2020-06-30

Similar Documents

Publication Publication Date Title
US8108365B2 (en) Consistency of a database management system
CN110659256B (en) Multi-computer room synchronization method, computing device and computer storage medium
CN110502563B (en) Data processing method and device of multiple data sources and storage medium
CN109508912B (en) Service scheduling method, device, equipment and storage medium
CN111352984B (en) Data distribution method, device and storage medium
CN112182010A (en) Dirty page refreshing method and device, storage medium and electronic equipment
CN111158593B (en) Multi-snapshot dependency relationship processing method and device and related components
CN104052626A (en) Method, device and system for configuring network element data
CN112256672B (en) Database change approval method and device
CN110647463B (en) Method and device for restoring test breakpoint and electronic equipment
CN111488483A (en) Method, device, terminal and non-transitory computer-readable storage medium for updating song library
CN106649756A (en) Log synchronization method and device
JP2908442B1 (en) Trace information collection method
CN110633321B (en) Data synchronization method, device and equipment
CN114911750A (en) Data conversion method and device
US20030163804A1 (en) Method for assuring compatibility and method for securing data within a distributed computer system
CN106788917B (en) Method for uploading service data based on parking lot
JPS58103052A (en) Automatic data gathering system
CN112558975B (en) Method and device for switching codes of components, electronic equipment and readable storage medium
US20210383073A1 (en) Comment management method, server and readable storage medium
CN111078714B (en) Data processing method and device
CN110597763B (en) Method and device for generating function index table
CN112328327B (en) Configuration partition arrangement method and device
CN111726373B (en) Communication link construction method, device and equipment
JPH0546378A (en) Correction processing method for program

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant