CN113204535A - Routing method and device, electronic equipment and computer readable storage medium - Google Patents

Routing method and device, electronic equipment and computer readable storage medium Download PDF

Info

Publication number
CN113204535A
CN113204535A CN202110555211.1A CN202110555211A CN113204535A CN 113204535 A CN113204535 A CN 113204535A CN 202110555211 A CN202110555211 A CN 202110555211A CN 113204535 A CN113204535 A CN 113204535A
Authority
CN
China
Prior art keywords
target
processed
file
field
routing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110555211.1A
Other languages
Chinese (zh)
Other versions
CN113204535B (en
Inventor
刘霞
蔡予萌
马彦
胡凯乐
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202110555211.1A priority Critical patent/CN113204535B/en
Publication of CN113204535A publication Critical patent/CN113204535A/en
Application granted granted Critical
Publication of CN113204535B publication Critical patent/CN113204535B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00—Routing or path finding of packets in data switching networks
    • H04L45/14—Routing performance; Theoretical aspects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers

Abstract

The disclosure provides a routing method and device, electronic equipment and a computer-readable storage medium, and can be used in the technical field of big data and also in the technical field of finance. The routing method disclosed by the invention comprises the following steps: sequentially reading a plurality of files to be processed, wherein the files to be processed comprise first type routing fields; judging whether the current file to be processed is a target file to be processed; under the condition that the current file to be processed is a target file to be processed, generating a target second type routing field corresponding to the target file to be processed according to a target first type routing field corresponding to the target file to be processed, so that the target file to be processed is routed to a target database in a second file system according to the target second type routing field and a routing algorithm; and under the condition that the current file to be processed is not the target file to be processed, discarding the current file to be processed.

Description

Routing method and device, electronic equipment and computer readable storage medium
Technical Field
The present disclosure relates to the field of big data technologies, and in particular, to a routing method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product.
Background
With the advent of the information age, distributed systems are widely applied to various service processing scenes, the distributed platform system adopts a form of database division and table division for data processing and storage, and in the database falling process, the data falling process is usually determined according to routing fields.
In the process of implementing the concept of the present disclosure, the inventor finds that in the related art, at least the following problem exists, because the types of routing fields according to which different service systems perform data routing may be different, in the process of performing data interaction between different services, there may be a case where a data file does not carry a routing field used by the system in the data routing process, and how to perform data routing in this case is an urgent problem to be solved.
Disclosure of Invention
In view of the above, the present disclosure provides a routing method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product.
One aspect of the present disclosure provides a routing method, including:
sequentially reading a plurality of files to be processed, wherein the files to be processed comprise a first type routing field, and the first type routing field is a routing field type according to which the files to be processed are subjected to data routing in a first file system;
Judging whether the current file to be processed is a target file to be processed;
under the condition that the current file to be processed is a target file to be processed, generating a target second type routing field corresponding to the target file to be processed according to a target first type routing field corresponding to the target file to be processed, so that the target file to be processed is routed to a target database in a second file system according to the target second type routing field and a routing algorithm, wherein the second type routing field is a routing field type according to which the data of the file to be processed is routed in the second file system; and
and under the condition that the current file to be processed is not the target file to be processed, discarding the current file to be processed.
According to the embodiment of the disclosure, the plurality of files to be processed are files obtained by numbering each file in the original batch of files in sequence in the preprocessing server, each file to be processed comprises a sequence number, and the current file to be processed comprises the current sequence number.
Judging whether the current file to be processed is the target file to be processed comprises the following steps: and judging whether the current file to be processed is the target file to be processed or not according to the current sequence number and a preset judgment rule.
According to the embodiment of the disclosure, the preset judgment rule adopts a modulus judgment rule;
judging whether the current file to be processed is the target file to be processed according to the current sequence number and the judgment rule comprises the following steps: the current sequence number is subjected to modulus taking to obtain a current modulus value, wherein the number of the nodes is the number of processing servers in the second file system, and each processing server is identified through a node serial number; and determining the current file to be processed with the current module value matched with the node sequence number as a target file to be processed.
According to an embodiment of the present disclosure, generating a target second type routing field corresponding to a target file to be processed according to a target first type routing field corresponding to the target file to be processed includes: and generating a target second type routing field according to the target first type routing field and a preset generation rule, wherein the preset generation rule is used for representing the corresponding relation between the first type routing field and the second type routing field.
According to the embodiment of the present disclosure, the correspondence between the first type routing field and the second type routing field is: the second type routing field is the first type routing field + the supplementary field, wherein the supplementary field includes a time information field and a nonce field.
Generating a target second type routing field according to the target first type routing field and a preset generation rule comprises: acquiring a target auxiliary field corresponding to a target first type routing field; and adding the destination auxiliary field to the destination first-type routing field to generate a destination second-type routing field.
According to an embodiment of the present disclosure, the obtaining of the target auxiliary field corresponding to the target first type routing field includes: obtaining target raw information data, wherein the target raw information data includes target auxiliary field information data corresponding to the target first-type routing field, the target raw information data is pre-generated and pre-stored in an information database of the second file system, and parsing the target raw information data to obtain the target auxiliary field corresponding to the target first-type routing field.
According to the embodiment of the disclosure, the routing algorithm adopts a hash algorithm;
routing the target pending file to a target database in a second file system according to the target second type routing field and the routing algorithm comprises: determining a fragment serial number corresponding to the target file to be processed based on the target second type routing field and the total fragment number by utilizing a Hash algorithm, wherein the fragment serial number is used for identifying the target database; and storing the target file to be processed to a target database corresponding to the fragment sequence number.
According to an embodiment of the present disclosure, further comprising: and after the fragment serial number corresponding to the target file to be processed is determined, storing the fragment serial number corresponding to the target file to be processed into an information database of the second file system.
A routing device comprises a reading module, a judging module, a first execution module and a second execution module.
The reading module is used for sequentially reading a plurality of files to be processed, wherein the files to be processed comprise a first type routing field, and the first type routing field is a routing field type according to which the files to be processed are subjected to data routing in a first file system.
And the judging module is used for judging whether the current file to be processed is the target file to be processed.
The first execution module is used for generating a target second type routing field corresponding to the target file to be processed according to a target first type routing field corresponding to the target file to be processed under the condition that the current file to be processed is the target file to be processed, so that the target file to be processed is routed to a target database in a second file system according to the target second type routing field and a routing algorithm, wherein the second type routing field is a routing field type according to which the data routing of the file to be processed is carried out in the second file system.
And the second execution module is used for discarding the current file to be processed under the condition that the current file to be processed is not the target file to be processed.
According to an embodiment of the disclosure, in the reading module, the plurality of files to be processed are files obtained by numbering each file in the original batch of files in the preprocessing server in sequence, each file to be processed includes a sequence number, and the current file to be processed includes the current sequence number.
The judging module is used for judging whether the current file to be processed is the target file to be processed according to the current sequence number and a preset judging rule.
According to an embodiment of the present disclosure, the preset determination rule adopts a modulo determination rule. The above-mentioned judging module includes: a modulus taking unit and a judging unit.
The module taking unit is used for taking a module of the number of the nodes according to the current sequence number to obtain a current module value, wherein the number of the nodes is the number of the processing servers in the second file system, and each processing server is identified through the node serial number.
And the judging unit is used for determining the current file to be processed, matched with the node serial number, of the current modulus value as the target file to be processed.
According to an embodiment of the present disclosure, the first execution module is configured to generate a target second-type routing field according to a target first-type routing field and a preset generation rule, where the preset generation rule is used to characterize a correspondence relationship between the first-type routing field and the second-type routing field.
According to the embodiment of the present disclosure, the correspondence between the first type routing field and the second type routing field is: the second type routing field is the first type routing field + the supplementary field, wherein the supplementary field includes a time information field and a nonce field.
The first execution module comprises an acquisition unit and an adding unit.
The acquiring unit is used for acquiring a target auxiliary field corresponding to the target first type routing field. And the adding unit is used for adding the target auxiliary field into the target first type routing field so as to generate a target second type routing field.
According to an embodiment of the present disclosure, the obtaining unit includes an obtaining subunit and an analyzing subunit.
The acquiring subunit is configured to acquire target original information data, where the target original information data includes target auxiliary field information data corresponding to the target first-type routing field, and the target original information data is generated in advance and stored in an information database of the second file system in advance. And the analysis subunit is used for analyzing the target original information data to acquire a target auxiliary field corresponding to the target first type routing field.
According to an embodiment of the present disclosure, wherein the routing algorithm adopts a hash algorithm, and the first execution module further includes: a calculation unit and a storage unit.
The computing unit is used for determining a fragment sequence number corresponding to the target file to be processed based on the target second type routing field and the total fragment number by utilizing a Hash algorithm, wherein the fragment sequence number is used for identifying the target database. And the storage unit is used for storing the target file to be processed to a target database corresponding to the fragment sequence number.
According to the embodiment of the disclosure, the device further includes a storage module, configured to store the fragment sequence number corresponding to the target file to be processed into the information database of the second file system after determining the fragment sequence number corresponding to the target file to be processed.
Another aspect of the present disclosure provides an electronic device including: one or more processors, and a memory; wherein the memory is for storing one or more programs; wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the routing method as described above.
Another aspect of the present disclosure provides a computer-readable storage medium storing computer-executable instructions for implementing the routing method as described above when executed.
Another aspect of the present disclosure provides a computer program product comprising computer executable instructions for implementing the routing method as described above when executed.
According to the embodiment of the disclosure, in a data interaction scene between the file system and an external file system, a target second type routing field corresponding to a target file to be processed is generated according to a target first type routing field corresponding to the target file to be processed, so that the target file to be processed can be routed to a target database in a second file system according to the target second type routing field and a routing algorithm, and the problem that routing cannot be completed due to the fact that data files do not carry the routing field used by the system in the data interaction scene of different file systems is solved. Meanwhile, after each processing server of the system receives the file, the file can be processed through pre-judgment processing under the condition that the received file belongs to the target file to be processed, the routing field required by the system is further calculated, and data routing is carried out according to the routing field.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent from the following description of embodiments of the present disclosure with reference to the accompanying drawings, in which:
fig. 1 schematically illustrates an exemplary system architecture to which the routing methods and apparatus of the present disclosure may be applied;
FIG. 2 schematically illustrates a flow chart of a routing method according to an embodiment of the present disclosure;
FIG. 3 schematically shows a flowchart for determining whether a current file to be processed is a target file to be processed according to an embodiment of the present disclosure;
FIG. 4 schematically illustrates a schematic diagram of a routing method according to an embodiment of the disclosure;
FIG. 5 schematically illustrates a block diagram of a routing device according to an embodiment of the present disclosure;
fig. 6 schematically shows a block diagram of an electronic device for implementing a routing method according to an embodiment of the present disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that the description is illustrative only and is not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It is noted that the terms used herein should be interpreted as having a meaning that is consistent with the context of this specification and should not be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B and C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.). Where a convention analogous to "A, B or at least one of C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B or C" would include but not be limited to systems that have a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).
Before the embodiments of the present disclosure are explained in detail, the system structure and the application scenario related to the method provided by the embodiments of the present disclosure are described as follows.
Fig. 1 schematically illustrates an exemplary system architecture 100 to which the routing methods and apparatus of the present disclosure may be applied. It should be noted that fig. 1 is only an example of a system architecture to which the embodiments of the present disclosure may be applied to help those skilled in the art understand the technical content of the present disclosure, and does not mean that the embodiments of the present disclosure may not be applied to other devices, systems, environments or scenarios.
As shown in fig. 1, the system architecture 100 according to this embodiment may include a preprocessing server 101, a processing server cluster 102, and a database server 103.
The preprocessing server 101, the processing server cluster 102 and the database server 103 realize data transmission interaction through a network. The network may include various connection types, such as wired and/or wireless communication links, and so forth.
The preprocessing server 101 may be configured to preprocess a batch of files to be processed from an external file system and send the preprocessed files to the processing server cluster 102. The preprocessing may be to add a judgment identifier to the batch to-be-processed files, where the batch to-be-processed files include multiple files, such as file 1, file 2, file 3 … …, and file n, and the judgment identifier may be added to the batch to-be-processed files, and different judgment identifiers may be added to each of the to-be-processed files, so that the processing server cluster 102 may judge whether the current to-be-processed file is the target to-be-processed file according to the judgment identifier after receiving the batch to-be-processed files.
In the scene of data interaction between the file system and the external file system, the to-be-processed file comprises a first type routing field, and the first type routing field is a routing field type according to which the to-be-processed file is subjected to data routing in the external file system. In the system, when the data routing is carried out on the file to be processed, the type of the routing field is a second type routing field different from the first type routing field. The first type routing field and the second type routing field have one-to-one correspondence. Accordingly, the second-type routing field may be generated based on the first-type routing field and the correspondence.
The processing server cluster 102 includes a plurality of processing servers, each processing server sequentially reads a plurality of files to be processed after receiving a batch of files to be processed, and determines whether a current file to be processed is a target file to be processed according to a determination identifier of each file to be processed.
And under the condition that the current file to be processed is the target file to be processed, the processing server is further used for generating a second type routing field and a data fragment sequence number corresponding to the target file to be processed according to the first type routing field and the corresponding relation, carrying out data routing according to the second type routing field and storing the file to be processed into the corresponding data fragment. And under the condition that the current file to be processed is not the target file to be processed, the processing server discards the current file to be processed.
The database server 103 stores information data for representing the corresponding relationship between the first type routing field and the second type routing field, and the processing server can acquire the information data from the database server 103 in the process of generating the second type routing field according to the first type routing field and the corresponding relationship, so as to facilitate further analysis and processing. The database server 103 is further configured to store a data processing result, and may store, in the database server 103, the corresponding second-type routing field generated by the processing server and the data fragment sequence number corresponding to the target file to be processed calculated by the processing server, so as to facilitate data maintenance and management.
It should be understood that the number of preprocessing servers 101, the number of servers in processing server cluster 102, and the number of database servers 103 in fig. 1 are merely illustrative. There may be any number of servers, as desired for implementation.
It should be noted that the routing method and apparatus of the present disclosure may be used in the field of big data technology, financial technology, or any field except the field of big data technology and financial field, and the application field of the routing method and apparatus is not limited by the present disclosure.
In the distributed platform system, a database-based and table-based fragmentation mode is adopted for data processing and storage, and in the database falling process, the data falling to which database the data should fall is usually determined according to a routing field. Because the types of routing fields according to which different service systems perform data routing may be different, in the process of performing data interaction between different services, there may be a case where a data file does not carry a routing field used by the system in the data routing process, and therefore, a routing field required by the system needs to be calculated.
The actual processing method is a situation that a receiver applies all fragments to be processed, and in the situation, all fragments need to be judged and processed, and the processing efficiency is low due to the fact that all data needs to be processed. Another way is to pre-route the received files at the common layer, which is not very efficient because the number of actuators at the common layer is limited and only one actuator can process them. In order to improve efficiency and make full use of the usage of the fragments.
In the process of implementing the present disclosure, it is found that, after receiving a file, the system can process the received file by pre-judging processing under the condition that the received file belongs to a target file to be processed, further calculate a routing field required by the system, and perform data routing according to the routing field, thereby completing the data routing and improving the efficiency of the data routing.
Accordingly, based on the above concept, the present disclosure provides a routing method.
Fig. 2 schematically shows a flow chart of a routing method according to an embodiment of the present disclosure.
As shown in fig. 2, the method includes operations S201 to S204.
In operation S201, a plurality of files to be processed are sequentially read, where the files to be processed include a first type routing field, and the first type routing field is a routing field type according to which the files to be processed are subjected to data routing in a first file system.
In operation S202, it is determined whether the current file to be processed is a target file to be processed.
In operation S203, when the current file to be processed is the target file to be processed, a target second type routing field corresponding to the target file to be processed is generated according to the target first type routing field corresponding to the target file to be processed, so that the target file to be processed is routed to a target database in a second file system according to the target second type routing field and a routing algorithm, where the second type routing field is a routing field type according to which the file to be processed is data routed in the second file system.
In operation S204, in the case that the current file to be processed is not the target file to be processed, the current file to be processed is discarded.
According to the embodiment of the disclosure, the first file system is an external file system, the second file system is a file system, and in a scenario where the file system and the external file system perform data interaction, the to-be-processed file includes a first type routing field, and the first type routing field is a routing field type according to which the to-be-processed file is subjected to data routing in the external file system. In the system, when the data routing is carried out on the file to be processed, the type of the routing field is a second type routing field different from the first type routing field. The first type routing field and the second type routing field have one-to-one correspondence. Accordingly, the second-type routing field may be generated based on the first-type routing field and the correspondence.
According to the embodiment of the disclosure, the file system, that is, the second file system, includes a plurality of processing servers, each processing server sequentially reads a plurality of files to be processed after receiving a batch of files to be processed from the external file system, and judges in advance whether a current file to be processed is a target file to be processed. And if the current file to be processed is the target file to be processed, performing subsequent processing, otherwise, discarding the current file to be processed.
According to the embodiment of the disclosure, whether the current file to be processed is the target file to be processed is judged in advance, whether the current file to be processed is the target file to be processed is judged according to the judgment identifier of each file to be processed, wherein the judgment identifier can be added to each file to be processed in advance through preprocessing, the preprocessing process can be a process of preprocessing the batch files to be processed in batches by the preprocessing server, or each processing server can perform an operation of adding the judgment identifier to the current file to be processed after receiving the current file to be processed. The preprocessing can be to add different judgment marks to each file to be processed, or can be to add partially same judgment marks, and the processing server can judge the current file to be processed according to a self-defined algorithm and the judgment marks, so that the plurality of files to be processed are distributed to each processing service in a balanced manner, and the data processing efficiency is improved.
And under the condition that the current file to be processed is the target file to be processed, the processing server is also used for generating a target second type routing field corresponding to the target file to be processed according to the target first type routing field corresponding to the target file to be processed and the corresponding relation, so that data routing is performed according to the target second type routing field and a routing algorithm, and the target file to be processed is routed to a target database in a second file system, namely the corresponding data fragment.
According to the embodiment of the disclosure, in a data interaction scene between the file system and an external file system, a target second type routing field corresponding to a target file to be processed is generated according to a target first type routing field corresponding to the target file to be processed, so that the target file to be processed can be routed to a target database in a second file system according to the target second type routing field and a routing algorithm, and the problem that routing cannot be completed due to the fact that data files do not carry the routing field used by the system in the data interaction scene of different file systems is solved. Meanwhile, after each processing server of the system receives the file, the file can be processed through pre-judgment processing under the condition that the received file belongs to the target file to be processed, the routing field required by the system is further calculated, and data routing is carried out according to the routing field.
Fig. 3 schematically shows a flowchart for determining whether a current file to be processed is a target file to be processed according to an embodiment of the present disclosure.
As shown in fig. 3, the method includes operations S321 to S323.
In operation S321, after numbering each file in the original batch of files in sequence in the preprocessing server, a plurality of files to be processed are obtained, where each file to be processed includes a sequence number, and the current file to be processed includes the current sequence number.
According to the embodiment of the disclosure, whether the current file to be processed is the target file to be processed is judged in advance, and whether the current file to be processed is the target file to be processed can be judged according to the judgment identifier of each file to be processed. The judgment identifier may be added by performing batch preprocessing on the batch files to be processed in the preprocessing server. According to an embodiment of the present disclosure, the determination flag added in operation S321 is a sequence number, each to-be-processed file includes one sequence number, and each sequence number is different from each other.
According to an embodiment of the present disclosure, determining whether the current file to be processed is the target file to be processed includes: and judging whether the current file to be processed is the target file to be processed or not according to the current sequence number and a preset judgment rule.
According to an embodiment of the present disclosure, the preset determination rule may adopt a modulo determination rule. And numbering according to the current sequence and judging rules.
In the process of performing determination according to the current sequence number and the determination rule, in operation S322, the current sequence number is modulo the number of nodes to obtain a current modulo value, where the number of nodes is the number of processing servers in the second file system, and each processing server is identified by a node number.
In operation S323, it is determined whether the current modulus value matches the node sequence number. And under the condition that the current module value is matched with the node serial number, determining the current file to be processed, matched with the current module value and the node serial number, as a target file to be processed, otherwise, discarding the file. For example, if the sequence number of the current file to be processed is 1 and the number of the nodes is 16, performing modulo operation to obtain a current modulo value of 1, and processing the current file to be processed by the server No. 1; for another example, if the sequence number of the current file to be processed is 2 and the number of the nodes is 16, then the module is taken to obtain the current module value is 2, and then the current file to be processed is processed by the server No. 2, so that a plurality of files can be classified into a plurality of servers in a balanced manner to be processed in parallel.
According to the embodiment of the disclosure, whether the current file to be processed is the target file to be processed is judged by adding the sequence number to each file in advance and combining the modular algorithm, so that the files can be evenly classified to multiple servers for parallel processing, all the servers can be fully utilized for processing at the same time, the data processed by each server are uniform and not repeated, the data processing efficiency is improved, meanwhile, the method is wide in application range, and the method is applicable to one file or multiple files provided by the upstream application of an external system.
According to an embodiment of the present disclosure, generating a target second type routing field corresponding to a target file to be processed according to a target first type routing field corresponding to the target file to be processed includes: and generating a target second type routing field according to the target first type routing field and a preset generation rule, wherein the preset generation rule is used for representing the corresponding relation between the first type routing field and the second type routing field.
According to the embodiment of the present disclosure, the correspondence between the first type routing field and the second type routing field is: the second type routing field is the first type routing field + the supplementary field, wherein the supplementary field includes a time information field and a nonce field.
Generating a target second type routing field according to the target first type routing field and a preset generation rule comprises:
acquiring a target auxiliary field corresponding to a target first type routing field; and adding the destination auxiliary field to the destination first-type routing field to generate a destination second-type routing field.
According to an embodiment of the present disclosure, the obtaining of the target auxiliary field corresponding to the target first type routing field includes: obtaining target raw information data, wherein the target raw information data includes target auxiliary field information data corresponding to the target first-type routing field, the target raw information data is pre-generated and pre-stored in an information database of the second file system, and parsing the target raw information data to obtain the target auxiliary field corresponding to the target first-type routing field.
According to the embodiment of the present disclosure, the first routing field adopts, for example, a client number (remainder conference number generated by the system when the client transacts business), the second type routing field adopts, for example, a medium number, and the medium number is generated according to the correspondence between the first type routing field and the second type routing field, for example, the pre-stored original information data may be obtained from the database. The database stores original information data used for representing the corresponding relation between the first type routing field and the second type routing field, and the original information data can be obtained from the database, so that further analysis and processing are facilitated.
According to the embodiment of the disclosure, the original information data may be service log data stored by the system when the client transacts the service, and may include, for example, service transaction time, service type, protocol number, protocol generation time, and a protocol random number for identifying each different service generation, etc. And then, analyzing the original information data to obtain protocol generation time and a protocol random number (namely a target auxiliary field), and adding the protocol generation time and the protocol random number into the protocol number, wherein the generated medium number is the protocol number + the protocol generation time + the protocol random number.
According to an embodiment of the present disclosure, wherein the routing algorithm employs a hash algorithm. Routing the target pending file to a target database in a second file system according to the target second type routing field and the routing algorithm comprises: determining a fragment serial number corresponding to the target file to be processed based on the target second type routing field and the total fragment number by utilizing a Hash algorithm, wherein the fragment serial number is used for identifying the target database; and storing the target file to be processed to a target database corresponding to the fragment sequence number.
According to the embodiment of the disclosure, when data routing is performed, a field with uniqueness is used as a routing field of a sub-database sub-table, a fragmentation serial number of the data is determined by performing a hash algorithm on the routing field according to the total fragmentation number, and the fragmentation serial number determines which database the data should land in, so that a target file to be processed can be stored in a target database corresponding to the fragmentation serial number according to the fragmentation serial number.
Fig. 4 schematically shows a schematic diagram of a routing method according to an embodiment of the present disclosure. Hereinafter, a routing method according to an embodiment of the present disclosure is exemplarily described with reference to fig. 4.
According to the embodiment of the disclosure, firstly, a plurality of files to be processed are obtained after sequence numbers are added to each file in an original batch of files in a preprocessing server in sequence, and each file to be processed comprises one sequence number.
The sequence numbers increase sequentially from 1 onwards (example: 1, 2, 3, 4 … … n).
Before adding the sequence number, the files received by the processing server are as follows:
field 1, field 2, field 3 … …
……
Field 1, field 2, field 3 … …
After adding the sequence number, the processing server receives the following files:
sequence number 1, field 2, field 3 … …
Sequence number 2, field 1, field 2, field 3 … …
Sequence number 3, field 1, field 2, field 3 … …
Sequence number 4, field 1, field 2, field 3 … …
……
Sequence number n, field 1, field 2, field 3 … …
The fields of each file include a first routing field, for example, a client number (a protocol number generated by the system when the client transacts business) is used as the first routing field, and a medium number is used as the second type routing field.
And then, the plurality of files to be processed are respectively sent to each processing server, and a plurality of database servers for executing data fragment storage can be used as the processing servers. After each database server receives the files to be processed, each database server sequentially judges each file and judges whether the current module value is matched with the node serial number. And under the condition that the current module value is matched with the node serial number, determining the current file to be processed, matched with the current module value and the node serial number, as a target file to be processed, otherwise, discarding the file, skipping the data, and continuously reading and processing the next file. For example, if the sequence number of the current file to be processed is n and the number of nodes is m, then performing modulo operation to obtain the current modulus value is n, and then processing the current file to be processed by the n servers, so that the files are evenly classified into a plurality of servers for parallel processing.
And under the condition that the current file to be processed is the target file to be processed, each database server generates a second type routing field according to the corresponding relation between the first type routing field and the second type routing field. I.e. the media number. Specifically, the method includes the steps of firstly obtaining pre-stored original information data from a database, namely service log data stored by a system when a client transacts services, obtaining protocol generation time and a protocol random number by analyzing the original information data, and then adding the protocol generation time and the protocol random number to the protocol number to generate a medium number. In addition, each database server is further configured to calculate a routing relationship, that is, a hash algorithm is used to calculate a fragment sequence number according to which the target file to be processed falls down when executing the library falling, based on the target second-type routing field and the total fragment number, so as to facilitate subsequent data processing, for example, storing the target file to be processed in a target database corresponding to the fragment sequence number.
According to the embodiment of the disclosure, after the fragment sequence number corresponding to the target file to be processed is determined, the fragment sequence number corresponding to the target file to be processed is stored in the information database of the second file system.
According to an embodiment of the present disclosure, the information database may employ a non-relational database hbase. The information database can be used for storing original information data, such as service system log data, and storing a data processing result, for example, a corresponding second type routing field generated by the processing server and a data fragment sequence number corresponding to a target file to be processed calculated by the processing server can be stored in the database, so that data maintenance and management can be performed at a later stage.
Fig. 5 schematically shows a block diagram of a routing device 500 according to an embodiment of the present disclosure.
The routing apparatus 500 may be used to implement the method described with reference to fig. 2.
As shown in fig. 5, the routing apparatus 500 includes a reading module 510, a determining module 520, a first executing module 530, and a second executing module 540.
The reading module 510 is configured to sequentially read a plurality of files to be processed, where the files to be processed include a first type routing field, and the first type routing field is a routing field type according to which the files to be processed are routed in a first file system.
The determining module 520 is configured to determine whether the current file to be processed is a target file to be processed.
The first executing module 530 is configured to, when the current file to be processed is a target file to be processed, generate a target second type routing field corresponding to the target file to be processed according to a target first type routing field corresponding to the target file to be processed, so as to route the target file to be processed to a target database in a second file system according to the target second type routing field and a routing algorithm, where the second type routing field is a routing field type according to which the file to be processed is subjected to data routing in the second file system.
The second executing module 540 is configured to discard the current file to be processed if the current file to be processed is not the target file to be processed.
According to the embodiment of the disclosure, in a scenario of data interaction between a file system and an external file system, a first execution module 530 generates a target second type routing field corresponding to a target file to be processed according to a target first type routing field corresponding to the target file to be processed, so that the target file to be processed can be subsequently routed to a target database in a second file system according to the target second type routing field and a routing algorithm, and the problem that routing cannot be completed due to the fact that the data files do not carry the routing fields used by the system in the data interaction scenario of different file systems is solved. Meanwhile, through the judgment module 520, after each processing server of the system receives the file, the file can be processed through pre-judgment, and the received file is processed under the condition that the received file belongs to the target file to be processed, so that the routing field required by the system is further calculated, and data routing is performed according to the routing field.
According to an embodiment of the present disclosure, in the reading module 510, the multiple files to be processed are obtained by numbering each file in the original batch of files in the preprocessing server according to a sequence, each file to be processed includes a sequence number, and the current file to be processed includes the current sequence number.
The determining module 520 is configured to determine whether the current file to be processed is the target file to be processed according to the current sequence number and a preset determining rule.
According to an embodiment of the present disclosure, the preset determination rule adopts a modulo determination rule. The determining module 520 includes: a modulus taking unit and a judging unit.
The module taking unit is used for taking a module of the number of the nodes according to the current sequence number to obtain a current module value, wherein the number of the nodes is the number of the processing servers in the second file system, and each processing server is identified through the node serial number.
And the judging unit is used for determining the current file to be processed, matched with the node serial number, of the current modulus value as the target file to be processed.
According to an embodiment of the present disclosure, the first executing module 530 is configured to generate the target second-type routing field according to the target first-type routing field and a preset generating rule, where the preset generating rule is used to represent a corresponding relationship between the first-type routing field and the second-type routing field.
According to the embodiment of the present disclosure, the correspondence between the first type routing field and the second type routing field is: the second type routing field is the first type routing field + the supplementary field, wherein the supplementary field includes a time information field and a nonce field.
The first executing module 530 includes an acquiring unit and an adding unit.
The acquiring unit is used for acquiring a target auxiliary field corresponding to the target first type routing field. And the adding unit is used for adding the target auxiliary field into the target first type routing field so as to generate a target second type routing field.
According to an embodiment of the present disclosure, the obtaining unit includes an obtaining subunit and an analyzing subunit.
The acquiring subunit is configured to acquire target original information data, where the target original information data includes target auxiliary field information data corresponding to the target first-type routing field, and the target original information data is generated in advance and stored in an information database of the second file system in advance. And the analysis subunit is used for analyzing the target original information data to acquire a target auxiliary field corresponding to the target first type routing field.
According to an embodiment of the present disclosure, wherein the routing algorithm adopts a hash algorithm, the first executing module 530 further includes: a calculation unit and a storage unit.
The computing unit is used for determining a fragment sequence number corresponding to the target file to be processed based on the target second type routing field and the total fragment number by utilizing a Hash algorithm, wherein the fragment sequence number is used for identifying the target database. And the storage unit is used for storing the target file to be processed to a target database corresponding to the fragment sequence number.
According to the embodiment of the disclosure, the device further includes a storage module, configured to store the fragment sequence number corresponding to the target file to be processed into the information database of the second file system after determining the fragment sequence number corresponding to the target file to be processed.
Any number of modules, sub-modules, units, sub-units, or at least part of the functionality of any number thereof according to embodiments of the present disclosure may be implemented in one module. Any one or more of the modules, sub-modules, units, and sub-units according to the embodiments of the present disclosure may be implemented by being split into a plurality of modules. Any one or more of the modules, sub-modules, units, sub-units according to embodiments of the present disclosure may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in any other reasonable manner of hardware or firmware by integrating or packaging a circuit, or in any one of or a suitable combination of software, hardware, and firmware implementations. Alternatively, one or more of the modules, sub-modules, units, sub-units according to embodiments of the disclosure may be at least partially implemented as a computer program module, which when executed may perform the corresponding functions.
For example, any plurality of the reading module 510, the determining module 520, the first executing module 530 and the second executing module 540 may be combined and implemented in one module/unit/sub-unit, or any one of the modules/units/sub-units may be split into a plurality of modules/units/sub-units. Alternatively, at least part of the functionality of one or more of these modules/units/sub-units may be combined with at least part of the functionality of other modules/units/sub-units and implemented in one module/unit/sub-unit. According to an embodiment of the present disclosure, at least one of the reading module 510, the determining module 520, the first executing module 530 and the second executing module 540 may be at least partially implemented as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by hardware or firmware in any other reasonable manner of integrating or packaging a circuit, or implemented by any one of three implementations of software, hardware and firmware, or implemented by a suitable combination of any several of them. Alternatively, at least one of the reading module 510, the determining module 520, the first executing module 530 and the second executing module 540 may be at least partially implemented as a computer program module, which when executed, may perform a corresponding function.
Another aspect of the present disclosure provides an electronic device including: one or more processors, and a memory; wherein the memory is for storing one or more programs; wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the routing method as described above.
Fig. 6 schematically shows a block diagram of an electronic device for implementing a routing method according to an embodiment of the present disclosure. The electronic device shown in fig. 6 is only an example, and should not bring any limitation to the functions and the scope of use of the embodiments of the present disclosure.
As shown in fig. 6, an electronic device 600 according to an embodiment of the present disclosure includes a processor 601, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM)602 or a program loaded from a storage section 608 into a Random Access Memory (RAM) 603. Processor 601 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 601 may also include onboard memory for caching purposes. Processor 601 may include a single processing unit or multiple processing units for performing different actions of a method flow according to embodiments of the disclosure.
In the RAM 603, various programs and data necessary for the operation of the electronic apparatus 600 are stored. The processor 601, the ROM602, and the RAM 603 are connected to each other via a bus 604. The processor 601 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM602 and/or RAM 603. It is to be noted that the programs may also be stored in one or more memories other than the ROM602 and RAM 603. The processor 601 may also perform various operations of the method flows according to embodiments of the present disclosure by executing programs stored in the one or more memories.
Electronic device 600 may also include input/output (I/O) interface 605, input/output (I/O) interface 605 also connected to bus 604, according to an embodiment of the disclosure. The system 600 may also include one or more of the following components connected to the I/O interface 605: an input portion 606 including a keyboard, a mouse, and the like; an output portion 607 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 608 including a hard disk and the like; and a communication section 609 including a network interface card such as a LAN card, a modem, or the like. The communication section 609 performs communication processing via a network such as the internet. The driver 610 is also connected to the I/O interface 605 as needed. A removable medium 611 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 610 as necessary, so that a computer program read out therefrom is mounted in the storage section 608 as necessary.
According to embodiments of the present disclosure, method flows according to embodiments of the present disclosure may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable storage medium, the computer program containing program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network through the communication section 609, and/or installed from the removable medium 611. The computer program, when executed by the processor 601, performs the above-described functions defined in the system of the embodiments of the present disclosure. The systems, devices, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer-readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to an embodiment of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium. Examples may include, but are not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 602 and/or RAM 603 described above and/or one or more memories other than the ROM 602 and RAM 603.
Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method provided by the embodiments of the present disclosure, when the computer program product is run on an electronic device, the program code being adapted to cause the electronic device to carry out the routing method provided by the embodiments of the present disclosure.
The computer program, when executed by the processor 601, performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure. The systems, apparatuses, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the present disclosure.
In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed in the form of a signal on a network medium, downloaded and installed through the communication section 609, and/or installed from the removable medium 611. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user computing device, partly on the user device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions. Those skilled in the art will appreciate that various combinations and/or combinations of features recited in the various embodiments and/or claims of the present disclosure can be made, even if such combinations or combinations are not expressly recited in the present disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.

Claims (12)

1. A routing method, comprising:
sequentially reading a plurality of files to be processed, wherein the files to be processed comprise a first type routing field, and the first type routing field is a routing field type according to which the files to be processed are subjected to data routing in a first file system;
judging whether the current file to be processed is a target file to be processed;
under the condition that the current file to be processed is the target file to be processed, generating a target second type routing field corresponding to the target file to be processed according to a target first type routing field corresponding to the target file to be processed, so as to route the target file to be processed to a target database in a second file system according to the target second type routing field and a routing algorithm, wherein the second type routing field is a routing field type according to which the data routing of the file to be processed is carried out in the second file system; and
And under the condition that the current file to be processed is not the target file to be processed, discarding the current file to be processed.
2. The method according to claim 1, wherein the plurality of files to be processed are files obtained by numbering each file in an original batch of files in sequence in a preprocessing server, each file to be processed comprises a sequence number, and the current file to be processed comprises a current sequence number;
the judging whether the current file to be processed is the target file to be processed comprises the following steps:
and judging whether the current file to be processed is the target file to be processed or not according to the current sequence number and a preset judgment rule.
3. The method according to claim 2, wherein the preset judgment rule adopts a modulus judgment rule;
judging whether the current file to be processed is the target file to be processed according to the current sequence number and a judgment rule comprises the following steps:
taking a module of the number of the nodes by the current sequence number to obtain a current module value, wherein the number of the nodes is the number of processing servers in the second file system, and each processing server is identified by a node serial number;
And determining the current file to be processed, matched with the node sequence number, of the current modulus value as the target file to be processed.
4. The method of claim 1, wherein generating a target second type routing field corresponding to the target pending file from a target first type routing field corresponding to the target pending file comprises:
and generating the target second type routing field according to the target first type routing field and a preset generation rule, wherein the preset generation rule is used for representing the corresponding relation between the first type routing field and the second type routing field.
5. The method of claim 4, wherein,
the corresponding relation between the first type routing field and the second type routing field is as follows: the second type routing field + an auxiliary field, wherein the auxiliary field comprises a time information field and a nonce field;
generating the target second type routing field according to the target first type routing field and a preset generation rule comprises:
acquiring the target auxiliary field corresponding to the target first type routing field;
Adding the target auxiliary field to the target first type routing field to generate the target second type routing field.
6. The method of claim 5, wherein obtaining the target auxiliary field corresponding to the target first type routing field comprises:
acquiring target original information data, wherein the target original information data comprises target auxiliary field information data corresponding to the target first-type routing field, and the target original information data is generated in advance and stored in an information database of the second file system in advance;
and analyzing the target original information data to obtain the target auxiliary field corresponding to the target first type routing field.
7. The method of claim 1, wherein the routing algorithm employs a hash algorithm;
routing the target pending file to a target database in a second file system according to the target second type routing field and a routing algorithm comprises:
determining a fragment sequence number corresponding to the target file to be processed based on the target second type routing field and the total fragment number by using the hash algorithm, wherein the fragment sequence number is used for identifying the target database;
And storing the target file to be processed to a target database corresponding to the fragment sequence number.
8. The method of claim 7, further comprising:
and after the fragment serial number corresponding to the target file to be processed is determined, storing the fragment serial number corresponding to the target file to be processed into an information database of a second file system.
9. A routing device, comprising:
the device comprises a reading module, a processing module and a processing module, wherein the reading module is used for sequentially reading a plurality of files to be processed, the files to be processed comprise a first type routing field, and the first type routing field is a routing field type according to which the files to be processed are subjected to data routing in a first file system;
the judging module is used for judging whether the current file to be processed is the target file to be processed;
a first execution module, configured to, when the current file to be processed is the target file to be processed, generate a target second type routing field corresponding to the target file to be processed according to a target first type routing field corresponding to the target file to be processed, so as to route the target file to be processed to a target database in a second file system according to the target second type routing field and a routing algorithm, where the second type routing field is a routing field type according to which the data routing is performed on the file to be processed in the second file system; and
And the second execution module is used for discarding the current file to be processed under the condition that the current file to be processed is not the target file to be processed.
10. An electronic device, comprising:
one or more processors;
a memory for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of any of claims 1-8.
11. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 1 to 8.
12. A computer program product comprising computer executable instructions for implementing the method of any one of claims 1 to 8 when executed.
CN202110555211.1A 2021-05-20 2021-05-20 Routing method and device, electronic equipment and computer readable storage medium Active CN113204535B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110555211.1A CN113204535B (en) 2021-05-20 2021-05-20 Routing method and device, electronic equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110555211.1A CN113204535B (en) 2021-05-20 2021-05-20 Routing method and device, electronic equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN113204535A true CN113204535A (en) 2021-08-03
CN113204535B CN113204535B (en) 2024-02-02

Family

ID=77032074

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110555211.1A Active CN113204535B (en) 2021-05-20 2021-05-20 Routing method and device, electronic equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113204535B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107276912A (en) * 2016-04-07 2017-10-20 华为技术有限公司 Memory, message processing method and distributed memory system
WO2017201970A1 (en) * 2016-05-21 2017-11-30 乐视控股（北京）有限公司 Branch base database system and routing method therefor
CN110659298A (en) * 2019-08-14 2020-01-07 金蝶软件（中国）有限公司 Financial data processing method and device, computer equipment and storage medium
CN111258990A (en) * 2020-02-17 2020-06-09 同盾控股有限公司 Index database data migration method, device, equipment and storage medium
CN112231400A (en) * 2020-09-27 2021-01-15 北京金山云网络技术有限公司 Distributed database access method, device, equipment and storage medium
CN112579606A (en) * 2020-12-24 2021-03-30 平安普惠企业管理有限公司 Workflow data processing method and device, computer equipment and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107276912A (en) * 2016-04-07 2017-10-20 华为技术有限公司 Memory, message processing method and distributed memory system
WO2017201970A1 (en) * 2016-05-21 2017-11-30 乐视控股（北京）有限公司 Branch base database system and routing method therefor
CN110659298A (en) * 2019-08-14 2020-01-07 金蝶软件（中国）有限公司 Financial data processing method and device, computer equipment and storage medium
CN111258990A (en) * 2020-02-17 2020-06-09 同盾控股有限公司 Index database data migration method, device, equipment and storage medium
CN112231400A (en) * 2020-09-27 2021-01-15 北京金山云网络技术有限公司 Distributed database access method, device, equipment and storage medium
CN112579606A (en) * 2020-12-24 2021-03-30 平安普惠企业管理有限公司 Workflow data processing method and device, computer equipment and storage medium

Also Published As

Publication number Publication date
CN113204535B (en) 2024-02-02

Similar Documents

Publication Publication Date Title
CN109951547B (en) Transaction request parallel processing method, device, equipment and medium
CN108933695B (en) Method and apparatus for processing information
CN110719215B (en) Flow information acquisition method and device of virtual network
CN111275438B (en) Consensus method, device, equipment and storage medium of block chain network
CN109376534B (en) Method and apparatus for detecting applications
CN112163412B (en) Data verification method and device, electronic equipment and storage medium
CN113268761B (en) Information encryption method and device, electronic equipment and computer readable medium
CN111597120A (en) Interface test apparatus, method, electronic device, and computer-readable storage medium
US10042876B2 (en) Sort-merge-join on a large architected register file
CN112507265B (en) Method and device for abnormality detection based on tree structure and related products
US11113287B1 (en) Data stream management system
CN113204535B (en) Routing method and device, electronic equipment and computer readable storage medium
CN113132400B (en) Business processing method, device, computer system and storage medium
CN115374207A (en) Service processing method and device, electronic equipment and computer readable storage medium
CN112988738B (en) Data slicing method and device for block chain
CN115203178A (en) Data quality inspection method and device, electronic equipment and storage medium
CN113094415B (en) Data extraction method, data extraction device, computer readable medium and electronic equipment
CN113824689A (en) Edge computing network, data transmission method, device, equipment and storage medium
CN113014650A (en) Processing method and device for data request, computing equipment and medium
CN113177212B (en) Joint prediction method and device
CN116846564B (en) Signature verification method, system, terminal and storage medium supporting multiple algorithms
CN110909191A (en) Graph data processing method and device, storage medium and electronic equipment
CN112364284B (en) Method and device for detecting abnormality based on context and related product
CN116401319A (en) Data synchronization method and device, electronic equipment and computer readable storage medium
CN117478517A (en) DNS traffic analysis method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant