CN116846546B - Information loss-proof and repetition-proof cross-network data exchange system - Google Patents
Information loss-proof and repetition-proof cross-network data exchange system Download PDFInfo
- Publication number
- CN116846546B CN116846546B CN202310450765.4A CN202310450765A CN116846546B CN 116846546 B CN116846546 B CN 116846546B CN 202310450765 A CN202310450765 A CN 202310450765A CN 116846546 B CN116846546 B CN 116846546B
- Authority
- CN
- China
- Prior art keywords
- information
- module
- data
- signal
- transmitted
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000010365 information processing Effects 0.000 claims abstract description 16
- 230000011218 segmentation Effects 0.000 claims description 59
- 238000012790 confirmation Methods 0.000 claims description 18
- 238000000034 method Methods 0.000 claims description 17
- 230000007274 generation of a signal involved in cell-cell signaling Effects 0.000 claims description 7
- 238000012217 deletion Methods 0.000 claims description 6
- 230000037430 deletion Effects 0.000 claims description 6
- 230000008707 rearrangement Effects 0.000 claims description 6
- 238000011084 recovery Methods 0.000 claims description 5
- 230000001502 supplementing effect Effects 0.000 claims description 3
- 230000005540 biological transmission Effects 0.000 abstract description 6
- 230000002265 prevention Effects 0.000 abstract description 6
- 238000012545 processing Methods 0.000 abstract description 3
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
- H04L9/0861—Generation of secret information including derivation or calculation of cryptographic keys or passwords
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/90—Buffering arrangements
- H04L49/9057—Arrangements for supporting packet reassembly or resequencing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/50—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols using hash chains, e.g. blockchains or hash trees
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Computer Security & Cryptography (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to the field of data exchange systems, in particular to an information loss prevention and repetition prevention cross-network data exchange system, which comprises a distributed information processing server, a data processing server and a data processing server, wherein the distributed information processing server is used for acquiring the character length of data to be transmitted and the generation times of segmented signals; the external prepositive data exchanger is used for acquiring an information chain segment according to the segmented signal and the information to be transmitted; the key network switch is used for generating key information according to the information chain segment and obtaining cache information according to the information to be transmitted and the corresponding key information; the internal preposed data exchanger is used for acquiring a data loss signal and acquiring a data set to be transmitted of the data set to be transmitted according to the data loss signal, the key information and the cache information; and the data receiving server acquires the non-repeated information chain segments and acquires the receiving information according to the non-repeated information chain segments and the data set to be transmitted. The invention ensures that the information is not lost or repeated in the transmission process.
Description
Technical Field
The invention relates to the field of data exchange systems, in particular to a cross-network data exchange system for preventing information from losing and repeating.
Background
The data exchange system is an information exchange platform constructed by integrating the application information systems which are constructed in a scattered way and through a computer network, so that a plurality of application subsystems can transmit and share information/data, the utilization rate of information resources is improved, the data exchange system becomes a basic target for informatization construction, interconnection and intercommunication among distributed heterogeneous systems are ensured, and unified data processing and exchange are constructed.
Chinese patent publication No. CN101459517B discloses an inter-network data exchange system, however, no solution is disclosed how to prevent data loss and prevent data duplication.
Most of the prior art relies on the switching system to directly ensure the reliability and the integrity of the transmission of the cross-network messages, and how to ensure that the transmitted messages are not lost and not repeated becomes a technical problem that each data switching system needs to break through.
Disclosure of Invention
Therefore, the invention provides a cross-network data exchange system for preventing information from losing and repeating, which solves the problem of how to ensure that transmitted information is not lost and not repeated.
To achieve the above object, the present invention provides a cross-network data exchange system for preventing information loss and duplication, including:
the distributed information processing server is used for acquiring the character length of the data to be transmitted, outputting corresponding segmented signals according to the character length, and acquiring the generation times of the segmented signals;
the external prepositive data exchanger is connected with the distributed information processing server and used for acquiring an information chain segment according to the segmented signal and the information to be transmitted;
the key network switch is connected with the external prepositive data switch and is used for generating key information according to the information chain segments and obtaining cache information according to the information to be transmitted and the corresponding key information;
the internal preposed data switch is connected with the network switch and used for respectively acquiring the receiving times of two specific character lengths, generating a data loss signal according to the receiving times and the generation times of the segmented signals, and acquiring a data set to be transmitted according to the data loss signal, the key information and the cache information;
and the data receiving server is connected with the internal preposed data exchange and is used for generating a pre-repeated signal according to the key information, reconfirming the pre-repeated signal, deleting repeated information segments according to the confirmation result, acquiring non-repeated information segments and acquiring receiving information according to the non-repeated information segments and the data set to be transmitted.
Further, the distributed information processing server comprises an information receiving module, an information quantity acquisition module, a judgment module, a segmentation number acquisition module and a first information sending module, wherein the information receiving module is connected with the information classification module, the information acquisition module is connected with the judgment module, and the first information sending module is connected with the judgment module;
the information receiving module is used for receiving a plurality of data to be transmitted;
the information quantity acquisition module is used for respectively acquiring character lengths Qi and i of the plurality of data to be transmitted, wherein the character lengths i and i are numbers of the plurality of data to be transmitted according to time sequence generated by information, and the values are 1,2 and 3;
the judging module is used for outputting a corresponding segmentation signal according to the character length, outputting a first segmentation signal when the Qi is more than or equal to 32, and outputting a second segmentation signal when the Qi is less than 32;
the segmentation frequency acquisition module is used for acquiring the segmentation signal generation frequency C in the judgment module;
the first information sending module is configured to send the character length Qi and the corresponding segment signal, where the number of times of segment signal generation C is sent to the external preamble exchange.
Further, the external prepositive data exchanger comprises an information segmentation module and a second information sending module, and the information segmentation module is connected with the second information sending module;
the information segmentation module is used for acquiring an information chain segment according to the segmentation signal and the corresponding information to be transmitted;
the second information sending module is configured to send the information segment and the number of times of generating the segmented signal to the key network switch.
Further, the information segmentation module comprises an information filling submodule and an information cutting submodule, and the information cutting submodule is connected with the information filling submodule;
the information filling sub-module is used for receiving the second segmentation signal, acquiring a corresponding lowest-order character of data to be transmitted when the second segmentation signal is received, filling 10 cycle characters if the lowest-order character is 0, filling 01 cycle characters if the lowest-order character is 1 until the character length is more than 32 bits, and sending the filled data to be transmitted to the information segmentation sub-module;
when the information segmentation sub-module receives the first segmentation signal or receives data to be transmitted sent by the information filling sub-module, the information segmentation sub-module segments corresponding characters of the data to be transmitted into a first information segment, a second information segment and a third information segment in sequence from high order according to the time sequence generated by the information, wherein the character length of the first information segment is Qx, the character length of the second information segment is Qy, the character length of the third information segment is Qzi, and qx=14, qyi=qi-32 and qz=18 are specified.
Further, the key network switch comprises a key information generating module, a cache information module and a third information sending module, wherein the cache information module is connected with the key information generating module, and the key information generating module is connected with the third information sending module:
the key information generation module is used for generating the key information according to the first information chain segment, the second information chain segment and the third information chain segment;
the buffer information module is used for copying the information to be transmitted and binding the information with the corresponding key information to obtain buffer information;
the third information sending module is configured to send the information segment, the key information, the cache information, and the number of generation times of the segmented signal to the internal pre-network switch.
Further, the key information generation module comprises a hash address generation sub-module and a hash address assembly sub-module, and the hash address generation sub-module is connected with the hash address assembly sub-module;
the hash address generation submodule converts binary characters in the first information chain segment, the second information chain segment and the third information chain segment into decimal characters serving as keywords, and sets divisors as D by using a remainder dividing method to respectively acquire hash addresses X1i, X2i and X3i of the first information chain segment, the second information chain segment and the third information chain segment;
the hash address assembling sub-module is configured to obtain the key information ki= (X1 i, X2i, X3 i) according to the hash addresses X1i, X2i and X3i for obtaining the first information segment, the second information segment and the third information segment.
Further, the internal pre-network switch comprises an information checking module and a fourth information sending module, and the information checking module is connected with the information supplementing module;
the information checking module is used for acquiring the receiving times of two specific character lengths, generating a data loss signal according to the receiving times and the segmented signal generating times, and acquiring a data set to be transmitted according to the data loss signal, the key information and the cache information;
the fourth information sending module is configured to send the key information, the information segment and the data set to be transmitted to a data receiving server.
Further, the information checking module comprises a character length checking sub-module and an anti-loss sub-module, and the character length checking sub-module is connected with the anti-repetition sub-module:
the character length checking submodule is used for recording the receiving times N1 and N2 of the information chain segments with the character lengths of 14 and 18 respectively;
when N1 > N2, generating a first data loss signal;
generating a second data loss signal when N1 < N2;
when n1=n2, if C > N1, generating a third data loss signal;
the anti-loss submodule is used for acquiring a data set to be transmitted according to the received data loss signal;
when a first data loss signal is received, taking characters of all information chain segments with the character length of 18 as keywords, setting a divisor as D by using a remainder dividing method, obtaining a hash address X3i, matching with key information Ki= (X1 i, X2i, X3 i), searching a missing X3i set, obtaining a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and obtaining the data set to be transmitted;
when a second data loss signal is received, taking characters of all information chain segments with the character length of 14 as keywords, setting divisor D by using a remainder dividing method, obtaining a hash address X1i, matching with key information Ki= (X1 i, X2i, X3 i), searching a missing X1i set, obtaining a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and obtaining the data set to be transmitted;
when a third data loss signal is received, characters with all character lengths of 14 and 18 are used as keywords, a divisor D is set by using a remainder dividing method, hash addresses X1i and X3i are obtained and matched with key information Ki= (X1 i, X2i and X3 i), a missing X2i set is searched, so that a key information set of lost data is obtained, the cache information is queried according to the key information set of the lost data, and the data set to be transmitted is obtained.
Further, the data receiving server comprises a data anti-repetition module and a data recovery module;
the data anti-repetition module is used for generating a pre-repetition signal according to the key information, reconfirming the pre-repetition signal, deleting repeated information chain segments according to a confirmation result and obtaining a non-repeated information chain segment;
the data recovery module is used for carrying out character rearrangement according to the sequence that the first information chain segment is connected with the second information chain segment and the second information chain segment is connected with the third information chain segment according to the non-repeated information chain segment, deleting the continuous 0 or 1 of the lowest position after the character rearrangement, sequentially inserting the data set to be transmitted according to the sequence of the data generation time, and obtaining the receiving information.
Further, the data anti-repetition module comprises a key information comparison sub-module, a repeated confirmation sub-module and a deletion sub-module, wherein the key information comparison sub-module is connected with the repeated confirmation sub-module, and the deletion sub-module is connected with the repeated confirmation sub-module;
the key information comparison sub-module is used for generating a pre-repeated signal according to the key information, and outputting the pre-repeated signal if at least one Ky in any Kx in the Ki is equal to the at least one Ky;
when the repeated confirmation sub-module acquires the pre-repeated signal, acquiring cache information corresponding to the repeated key information and a corresponding information chain segment, comparing characters of the corresponding information chain segment with characters of the corresponding cache information, and outputting a deleting signal if the characters are completely consistent;
the deleting sub-module is used for deleting the information chain segment corresponding to the key information for generating the pre-repeated signal according to the received deleting signal, and acquiring the non-repeated information chain segment.
Compared with the prior art, the method has the advantages that the character length of data to be transmitted is obtained through the distributed information processing server, corresponding segmented signals are output according to the character length, the generation times of the segmented signals are obtained, the information chain segments are obtained through the external front-end data exchanger, key information is generated through the key network exchanger, cache information is obtained according to the information to be transmitted and the corresponding key information, the receiving times of two specific character lengths are respectively obtained through the internal front-end data exchanger, the data loss signals are generated according to the receiving times and the generation times of the segmented signals, and the data set to be transmitted is obtained according to the data loss signals, the key information and the cache information, so that the loss and the repetition in information transmission are avoided.
In particular, an information quantity acquisition module in the distributed information processing server acquires the character length of data to be transmitted, a judgment module outputs a corresponding segmentation signal according to the character length, and a segmentation frequency acquisition module acquires the generation frequency of the segmentation signal in the judgment module, so that the subsequent data reference is made to the prevention of data loss;
in particular, the information segmentation module in the external prepositive data exchange divides the data to be transmitted into three data segments with fixed character lengths at the head and the tail, and the data segments not only ensure the transmission speed, but also ensure the data not to be lost easily.
In particular, the key generation module in the key network switch utilizes the hash algorithm thought through the three information segments, and utilizes the remainder removal method to acquire the key information, so that the collision possibility of the key information is reduced to the greatest extent, the subsequent difficulty of judging repeated key information is ensured, and the working efficiency of the switching system is improved.
In particular, the hash address assembling sub-module in the key information generating module determines key information containing three hash addresses according to the information to be transmitted, and provides data support for subsequent checking information loss, information complementation and checking information repetition.
In particular, the information checking module in the internal front-end network switch of the invention compares the number of times of receiving the character length with the number of times of generating the segmented signal through the preset two characteristics, thereby checking the received data and avoiding the loss of the data.
In particular, the anti-loss sub-module in the information checking module of the invention inquires the cache information through the key information set of the lost data to acquire the lost data set to be transmitted, thereby ensuring that the data cannot be lost.
In particular, the data anti-repetition module in the data receiving server deletes the generated corresponding information chain segment by reconfirming the repeated key information, thereby ensuring that the data cannot be repeated.
Drawings
Fig. 1 is a schematic structural diagram of a cross-network data exchange system for preventing information loss and repetition according to an embodiment of the present invention;
fig. 2 is another schematic structural diagram of a cross-network data exchange system with information loss prevention and repetition prevention according to an embodiment of the present invention.
Detailed Description
In order that the objects and advantages of the invention will become more apparent, the invention will be further described with reference to the following examples; it should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are merely for explaining the technical principles of the present invention, and are not intended to limit the scope of the present invention.
It should be noted that, in the description of the present invention, terms such as "upper," "lower," "left," "right," "inner," "outer," and the like indicate directions or positional relationships based on the directions or positional relationships shown in the drawings, which are merely for convenience of description, and do not indicate or imply that the apparatus or elements must have a specific orientation, be constructed and operated in a specific orientation, and thus should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, for example; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention can be understood by those skilled in the art according to the specific circumstances.
Referring to fig. 1, a cross-network data exchange system for preventing information loss and duplication provided by an embodiment of the present invention includes:
the distributed information processing server 10 is configured to obtain a character length of data to be transmitted, and output a corresponding segment signal according to the character length to be transmitted, so as to obtain a number of times of generating the segment signal;
an external pre-data switch 20 connected to the distributed information processing server for obtaining an information segment according to the segment signal and the information to be transmitted;
a key network switch 30, connected to the external pre-data switch, for generating key information according to the information segment, and obtaining cache information according to the information to be transmitted and the corresponding key information;
an internal pre-data switch 40, connected to the network switch, for respectively obtaining the receiving times of two specific character lengths, generating a data loss signal according to the receiving times and the generating times of the segmented signal, and obtaining a data set to be transmitted according to the data loss signal, the key information and the buffer information;
the data receiving server 50 is connected to the internal pre-data exchange, and is configured to generate a pre-duplication signal according to the key information, reconfirm the pre-duplication signal, delete the duplicated information segments according to the confirmation result, obtain a non-duplication information segment, and obtain the receiving information according to the non-duplication information segment and the data set to be transmitted.
According to the invention, the character length of the data to be transmitted is obtained through the distributed information processing server, and if the character of the data to be transmitted is 01001, the obtained character length is 5; acquiring an information chain segment through an external prepositive data exchanger; the key network switch generates key information and obtains cache information according to the information to be transmitted and the corresponding key information; the internal preposed data exchanger is used for acquiring a data loss signal and acquiring a data set to be transmitted of the data set to be transmitted according to the data loss signal, the key information and the cache information; and the data receiving server acquires the non-repeated information chain segments and acquires the receiving information according to the non-repeated information chain segments and the data set to be transmitted.
Specifically, the invention obtains the character length of the data to be transmitted through the distributed information processing server, outputs the corresponding segmented signal according to the character length, obtains the generation times of the segmented signal, obtains the information chain segment through the external preposed data exchange, generates the key information through the key network exchange, obtains the buffer information according to the information to be transmitted and the corresponding key information, respectively obtains the receiving times of two specific character lengths through the internal preposed data exchange, generates the data loss signal according to the receiving times and the generation times of the segmented signal, and obtains the data set to be transmitted according to the data loss signal, the key information and the buffer information, thereby ensuring that the data set is not lost and repeated in the information transmission.
Specifically, the distributed information processing server comprises an information receiving module, an information quantity acquisition module, a judgment module, a segmentation number acquisition module and a first information sending module, wherein the information receiving module is connected with the information classification module, the information acquisition module is connected with the judgment module, and the first information sending module is connected with the judgment module;
the information receiving module is used for receiving a plurality of data to be transmitted;
the information quantity acquisition module is used for respectively acquiring character lengths Qi and i of the plurality of data to be transmitted, wherein the character lengths i and i are numbers of the plurality of data to be transmitted according to time sequence generated by information, and the values are 1,2 and 3;
the judging module is used for outputting a corresponding segmentation signal according to the character length, outputting a first segmentation signal when the Qi is more than or equal to 32, and outputting a second segmentation signal when the Qi is less than 32;
the segmentation frequency acquisition module is used for acquiring the segmentation signal generation frequency C in the judgment module;
the first information sending module is configured to send the character length Qi and the corresponding segment signal, where the number of times of segment signal generation C is sent to the external preamble exchange.
The invention obtains the character lengths Qi of the data to be transmitted, for example, when the character to be transmitted generated at the first time is 100010, then Q1=6, and when the character generated at the second time is 00001, then Q5=5, then the two Qi are smaller than 32, and two second segmentation signals are output, and C=2.
Specifically, the character length of data to be transmitted is acquired through the information quantity acquisition module in the distributed information processing server, the judgment module outputs the corresponding segmentation signals according to the character length, and the segmentation frequency acquisition module acquires the segmentation signal generation frequency in the judgment module, so that the subsequent data reference is made to the prevention of data loss.
Specifically, the external front-end data switch comprises an information segmentation module and a second information sending module, and the information segmentation module is connected with the second information sending module;
the information segmentation module is used for acquiring an information chain segment according to the segmentation signal and the corresponding information to be transmitted;
the second information sending module is configured to send the information segment and the number of times of generating the segmented signal to the key network switch.
Specifically, the information segmentation module comprises an information filling submodule and an information cutting submodule, and the information cutting submodule is connected with the information filling submodule;
the information filling sub-module is used for receiving the second segmentation signal, acquiring a corresponding lowest-order character of data to be transmitted when the second segmentation signal is received, filling 10 cycle characters if the lowest-order character is 0, filling 01 cycle characters if the lowest-order character is 1 until the character length is more than 32 bits, and sending the filled data to be transmitted to the information segmentation sub-module;
when the information segmentation sub-module receives the first segmentation signal or receives data to be transmitted sent by the information filling sub-module, the information segmentation sub-module segments corresponding characters of the data to be transmitted into a first information segment, a second information segment and a third information segment in sequence from high order according to the time sequence generated by the information, wherein the character length of the first information segment is Qx, the character length of the second information segment is Qy, the character length of the third information segment is Qzi, and qx=14, qyi=qi-32 and qz=18 are specified.
According to the invention, characters of data to be transmitted, which are equal to or greater than Qi, are divided into three information segments with two fixed byte lengths from beginning to end, for example, 0100001000001000100010000001, qi=35, the fixed character length of the first information segment is 14 when the fixed character length of the first information segment is 01000010000100 when the fixed character length of the third information segment is 18, the third information segment is 001000100010000001 when the character length of the second information segment is 3, and the third information segment is 010 when the fixed character length of the first information segment is intercepted from high order.
Specifically, the key network switch includes a key information generating module, a cache information module and a third information sending module, the cache information module is connected with the key information generating module, and the key information generating module is connected with the third information sending module:
the key information generation module is used for generating the key information according to the first information chain segment, the second information chain segment and the third information chain segment;
the buffer information module is used for copying the information to be transmitted and binding the information with the corresponding key information to obtain buffer information;
the third information sending module is configured to send the information segment, the key information, the cache information, and the number of generation times of the segmented signal to the internal pre-network switch.
Specifically, the data to be transmitted is segmented into three data segments with fixed character lengths at the head and the tail through the information segmentation module in the external front-end data exchanger, and the data segments not only ensure the transmission speed, but also ensure the data to be difficult to lose.
Specifically, the key information generation module comprises a hash address generation sub-module and a hash address assembly sub-module, wherein the hash address generation sub-module is connected with the hash address assembly sub-module;
the hash address generation submodule converts binary characters in the first information chain segment, the second information chain segment and the third information chain segment into decimal characters serving as keywords, and sets divisors as D by using a remainder dividing method to respectively acquire hash addresses X1i, X2i and X3i of the first information chain segment, the second information chain segment and the third information chain segment;
the hash address assembling sub-module is configured to obtain the key information ki= (X1 i, X2i, X3 i) according to the hash addresses X1i, X2i and X3i for obtaining the first information segment, the second information segment and the third information segment.
According to the invention, binary characters in the second information segment and the third information segment are converted into decimal numbers to serve as keywords, a divisor is set to be D by a remainder dividing method, hash addresses X1i, X2i and X3i of the first information segment, the second information segment and the third information segment are respectively obtained, and are specifically exemplified below, for example, when data information generated at first time is 01000010000100010001000100010000001, the first information segment is 01000010000100, the third information segment is 001000100010000001, the character length of the second information segment is 3, the third information segment is 010, a divisor is set to be 10 by the remainder dividing method, the binary characters of the first information segment are converted into decimal numbers 4228, x1i=8, the binary characters of the third information segment are converted into decimal numbers 34945, x3i=5, the binary characters of the second information segment are converted into decimal numbers 2, and x2i=2.
Specifically, the key information is acquired by the key generation module in the key network switch through the three information chain segments by utilizing a hash algorithm thought and a remainder removing method, so that the possibility of collision of the key information is reduced to the greatest extent, the difficulty of subsequent judgment of repeated key information is ensured, and the working efficiency of the switching system is improved.
Specifically, as shown in fig. 2, the internal pre-network switch includes an information checking module 41 and a fourth information transmitting module 42, and the information checking module is connected to the information supplementing module;
the information checking module is used for acquiring the receiving times of two specific character lengths, generating a data loss signal according to the receiving times and the segmented signal generating times, and acquiring a data set to be transmitted according to the data loss signal, the key information and the cache information;
the fourth information sending module is configured to send the key information, the information segment and the data set to be transmitted to a data receiving server.
Specifically, the invention compares the number of times of receiving the character length with the number of times of generating the segmented signal through the information checking module in the internal prepositive network switch, thereby checking the received data and avoiding the loss of the data.
Specifically, the information checking module comprises a character length checking sub-module and an anti-loss sub-module, wherein the character length checking sub-module is connected with the anti-repetition sub-module:
the character length checking submodule is used for recording the receiving times N1 and N2 of the information chain segments with the character lengths of 14 and 18 respectively;
when N1 > N2, generating a first data loss signal;
generating a second data loss signal when N1 < N2;
when n1=n2, if C > N1, generating a third data loss signal;
the anti-loss submodule is used for acquiring a data set to be transmitted according to the received data loss signal;
when a first data loss signal is received, taking characters of all information chain segments with the character length of 18 as keywords, setting a divisor as D by using a remainder dividing method, obtaining a hash address X3i, matching with key information Ki= (X1 i, X2i, X3 i), searching a missing X3i set, obtaining a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and obtaining the data set to be transmitted;
when a second data loss signal is received, taking characters of all information chain segments with the character length of 14 as keywords, setting divisor D by using a remainder dividing method, obtaining a hash address X1i, matching with key information Ki= (X1 i, X2i, X3 i), searching a missing X1i set, obtaining a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and obtaining the data set to be transmitted;
when a third data loss signal is received, characters with all character lengths of 14 and 18 are used as keywords, a divisor D is set by using a remainder dividing method, hash addresses X1i and X3i are obtained and matched with key information Ki= (X1 i, X2i and X3 i), a missing X2i set is searched, so that a key information set of lost data is obtained, the cache information is queried according to the key information set of the lost data, and the data set to be transmitted is obtained.
Specifically, the invention obtains the lost data set to be transmitted by inquiring the cache information through the anti-lost sub-module in the information checking module and the key information set of the lost data, thereby ensuring that the data cannot be lost.
Specifically, the data receiving server comprises a data anti-repetition module and a data recovery module;
the data anti-repetition module is used for generating a pre-repetition signal according to the key information, reconfirming the pre-repetition signal, deleting repeated information chain segments according to a confirmation result and obtaining a non-repeated information chain segment;
the data recovery module is used for carrying out character rearrangement according to the sequence that the first information chain segment is connected with the second information chain segment and the second information chain segment is connected with the third information chain segment according to the non-repeated information chain segment, deleting the continuous 0 or 1 of the lowest position after the character rearrangement, sequentially inserting the data set to be transmitted according to the sequence of the data generation time, and obtaining the receiving information.
Specifically, the data anti-repetition module comprises a key information comparison sub-module, a repeated confirmation sub-module and a deletion sub-module, wherein the key information comparison sub-module is connected with the repeated confirmation sub-module, and the deletion sub-module is connected with the repeated confirmation sub-module;
the key information comparison sub-module is used for generating a pre-repeated signal according to the key information, and outputting the pre-repeated signal if at least one Ky in any Kx in the Ki is equal to the at least one Ky;
when the repeated confirmation sub-module acquires the pre-repeated signal, acquiring cache information corresponding to the repeated key information and a corresponding information chain segment, comparing characters of the corresponding information chain segment with characters of the corresponding cache information, and outputting a deleting signal if the characters are completely consistent;
the deleting sub-module is used for deleting the information chain segment corresponding to the key information for generating the pre-repeated signal according to the received deleting signal, and acquiring the non-repeated information chain segment.
Specifically, the invention deletes the corresponding information chain segment through the data anti-repetition module in the data receiving server and reconfirms the repeated key information, thereby ensuring that the data cannot be repeated.
Thus far, the technical solution of the present invention has been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of protection of the present invention is not limited to these specific embodiments. Equivalent modifications and substitutions for related technical features may be made by those skilled in the art without departing from the principles of the present invention, and such modifications and substitutions will be within the scope of the present invention.
The foregoing description is only of the preferred embodiments of the invention and is not intended to limit the invention; various modifications and variations of the present invention will be apparent to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (1)
1. A cross-network data exchange system for preventing information loss and repetition, comprising:
the distributed information processing server is used for acquiring the character length of the data to be transmitted, outputting corresponding segmented signals according to the character length, and acquiring the generation times of the segmented signals;
the external prepositive data exchanger is connected with the distributed information processing server and used for acquiring an information chain segment according to the segmented signal and the data to be transmitted;
the key network switch is connected with the external prepositive data switch and used for generating key information according to the information chain segments and obtaining cache information according to the data to be transmitted and the corresponding key information;
the internal preposed data switch is connected with the network switch and used for respectively acquiring the receiving times of two specific character lengths, generating a data loss signal according to the receiving times and the generation times of the segmented signals, and acquiring a data set to be transmitted according to the data loss signal, the key information and the cache information;
the data receiving server is connected with the internal preposed data exchange and is used for generating a pre-repeated signal according to the key information, reconfirming the pre-repeated signal, deleting repeated information chain segments according to a confirmation result, acquiring non-repeated information chain segments and acquiring receiving information according to the non-repeated information chain segments and the data set to be transmitted;
the distributed information processing server comprises an information receiving module, an information quantity acquisition module, a judgment module, a segmentation number acquisition module and a first information sending module, wherein the information receiving module is connected with the information classification module, the information acquisition module is connected with the judgment module, and the first information sending module is connected with the judgment module;
the information receiving module is used for receiving a plurality of data to be transmitted;
the information quantity acquisition module is used for respectively acquiring character lengths Qi and i of the plurality of data to be transmitted, wherein the character lengths i and i are numbers of the plurality of data to be transmitted according to time sequence generated by information, and the values are 1,2 and 3;
the judging module is used for outputting a corresponding segmentation signal according to the character length, outputting a first segmentation signal when the Qi is more than or equal to 32, and outputting a second segmentation signal when the Qi is less than 32;
the segmentation frequency acquisition module is used for acquiring the segmentation signal generation frequency C in the judgment module;
the first information sending module is used for sending the character length Qi and the corresponding segmented signals, and the segmented signal generation times C are sent to the external prepositive data switch;
the external prepositive data exchanger comprises an information segmentation module and a second information sending module, and the information segmentation module is connected with the second information sending module;
the information segmentation module is used for acquiring an information segment according to the segmentation signal and the corresponding data to be transmitted;
the second information sending module is used for sending the information chain segments and the generation times of the segmented signals to the key network switch;
the information segmentation module comprises an information filling submodule and an information cutting submodule, and the information cutting submodule is connected with the information filling submodule;
the information filling sub-module is used for receiving the second segmentation signal, acquiring a corresponding lowest-order character of data to be transmitted when the second segmentation signal is received, filling 10 cycle characters if the lowest-order character is 0, filling 01 cycle characters if the lowest-order character is 1 until the character length is more than 32 bits, and sending the filled data to be transmitted to the information segmentation sub-module;
when the first segmentation signal is received or data to be transmitted sent by the information filling sub-module is received, the information segmentation sub-module sequentially segments corresponding characters of the data to be transmitted into a first information segment, a second information segment and a third information segment from high positions according to the time sequence of information generation, wherein the character length of the first information segment is Qx, the character length of the second information segment is Qy, the character length of the third information segment is Qz, and qx=14, qy=qi-32 and qz=18 are specified;
the key network switch comprises a key information generating module, a cache information module and a third information sending module, wherein the cache information module is connected with the key information generating module, and the key information generating module is connected with the third information sending module:
the key information generation module is used for generating the key information according to the first information chain segment, the second information chain segment and the third information chain segment;
the buffer information module is used for copying the data to be transmitted and binding the data with the corresponding key information to obtain buffer information;
the third information sending module is configured to send the information segment, the key information, the cache information and the number of generation times of the segmented signal to the internal pre-data switch;
the internal preposed data exchanger comprises an information checking module and a fourth information sending module, and the information checking module is connected with the information supplementing module;
the information checking module is used for acquiring the receiving times of two specific character lengths, generating a data loss signal according to the receiving times and the segmented signal generating times, and acquiring a data set to be transmitted according to the data loss signal, the key information and the cache information;
the fourth information sending module is used for sending the key information, the information chain segments and the data set to be transmitted to a data receiving server;
the information checking module comprises a character length checking sub-module and an anti-loss sub-module, wherein the character length checking sub-module is connected with the anti-repetition sub-module:
the character length checking submodule is used for recording the receiving times N1 and N2 of the information chain segments with the character lengths of 14 and 18 respectively;
when N1 > N2, generating a first data loss signal;
generating a second data loss signal when N1 < N2;
when n1=n2, if C > N1, generating a third data loss signal;
the anti-loss submodule is used for acquiring a data set to be transmitted according to the received data loss signal;
when a first data loss signal is received, taking characters of all information chain segments with the character length of 18 as keywords, setting a divisor as D by using a remainder dividing method, obtaining a hash address X3i, matching with key information Ki= (X1 i, X2i, X3 i), searching a missing X3i set, obtaining a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and obtaining the data set to be transmitted;
when a second data loss signal is received, taking characters of all information chain segments with the character length of 14 as keywords, setting divisor D by using a remainder dividing method, obtaining a hash address X1i, matching with key information Ki= (X1 i, X2i, X3 i), searching a missing X1i set, obtaining a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and obtaining the data set to be transmitted;
when a third data loss signal is received, respectively taking characters with all character lengths of 14 and 18 as keywords, setting a divisor as D by using a remainder dividing method, acquiring hash addresses X1i and X3i, matching the hash addresses with key information Ki= (X1 i, X2i and X3 i), searching a missing X2i set, acquiring a key information set of lost data, inquiring the cache information according to the key information set of the lost data, and acquiring the data set to be transmitted;
the data receiving server comprises a data repetition preventing module and a data recovering module;
the data anti-repetition module is used for generating a pre-repetition signal according to the key information, reconfirming the pre-repetition signal, deleting repeated information chain segments according to a confirmation result and obtaining a non-repeated information chain segment;
the data recovery module is used for carrying out character rearrangement according to the sequence that the first information chain segment is connected with the second information chain segment and the second information chain segment is connected with the third information chain segment, deleting the continuous 0 or 1 of the lowest bit after the character rearrangement, sequentially inserting the data set to be transmitted according to the sequence of the data generation time, and obtaining the receiving information;
the data anti-repetition module comprises a key information comparison sub-module, a repeated confirmation sub-module and a deletion sub-module, wherein the key information comparison sub-module is connected with the repeated confirmation sub-module, and the deletion sub-module is connected with the repeated confirmation sub-module;
the key information comparison sub-module is used for generating a pre-repeated signal according to the key information, and outputting the pre-repeated signal if at least one Ky in any Kx in the Ki is equal to the at least one Ky;
when the repeated confirmation sub-module acquires the pre-repeated signal, acquiring cache information corresponding to the repeated key information and a corresponding information chain segment, comparing characters of the corresponding information chain segment with characters of the corresponding cache information, and outputting a deleting signal if the characters are completely consistent;
the deleting sub-module is used for deleting the information chain segment corresponding to the key information for generating the pre-repeated signal according to the received deleting signal, and acquiring the non-repeated information chain segment;
the key information generation module comprises a hash address generation sub-module and a hash address assembly sub-module, and the hash address generation sub-module is connected with the hash address assembly sub-module;
the hash address generation submodule converts binary characters in the first information chain segment, the second information chain segment and the third information chain segment into decimal characters serving as keywords, and sets divisors as D by using a remainder dividing method to respectively acquire hash addresses X1i, X2i and X3i of the first information chain segment, the second information chain segment and the third information chain segment;
the hash address assembling submodule is used for obtaining the key information Ki= (X1 i, X2i, X3 i) according to the hash addresses X1i, X2i and X3i of the first information segment, the second information segment and the third information segment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310450765.4A CN116846546B (en) | 2023-04-24 | 2023-04-24 | Information loss-proof and repetition-proof cross-network data exchange system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310450765.4A CN116846546B (en) | 2023-04-24 | 2023-04-24 | Information loss-proof and repetition-proof cross-network data exchange system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116846546A CN116846546A (en) | 2023-10-03 |
| CN116846546B true CN116846546B (en) | 2024-03-22 |
Family
ID=88164152
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310450765.4A Active CN116846546B (en) | 2023-04-24 | 2023-04-24 | Information loss-proof and repetition-proof cross-network data exchange system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116846546B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101364932A (en) * | 2007-08-07 | 2009-02-11 | 普然通讯技术(上海)有限公司 | Data segment transmission method for packet-switching network |
| CN103595504A (en) * | 2013-11-04 | 2014-02-19 | 上海数字电视国家工程研究中心有限公司 | Encapsulation method and calibration method for data package |
| CN104158770A (en) * | 2014-08-20 | 2014-11-19 | 电子科技大学 | A method and device for dividing and recombining switch packet |
| CN108881158A (en) * | 2018-05-04 | 2018-11-23 | 北京明朝万达科技股份有限公司 | Data interaction system and method |
| CN108933774A (en) * | 2018-05-04 | 2018-12-04 | 北京明朝万达科技股份有限公司 | Data interaction system and method |
| US10924548B1 (en) * | 2018-03-15 | 2021-02-16 | Pure Storage, Inc. | Symmetric storage using a cloud-based storage system |
| CN112543920A (en) * | 2019-07-22 | 2021-03-23 | 华为技术有限公司 | Data reconstruction method, device, computer equipment, storage medium and system |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10921801B2 (en) * | 2017-08-02 | 2021-02-16 | Strong Force loT Portfolio 2016, LLC | Data collection systems and methods for updating sensed parameter groups based on pattern recognition |
-
2023
- 2023-04-24 CN CN202310450765.4A patent/CN116846546B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101364932A (en) * | 2007-08-07 | 2009-02-11 | 普然通讯技术(上海)有限公司 | Data segment transmission method for packet-switching network |
| CN103595504A (en) * | 2013-11-04 | 2014-02-19 | 上海数字电视国家工程研究中心有限公司 | Encapsulation method and calibration method for data package |
| CN104158770A (en) * | 2014-08-20 | 2014-11-19 | 电子科技大学 | A method and device for dividing and recombining switch packet |
| US10924548B1 (en) * | 2018-03-15 | 2021-02-16 | Pure Storage, Inc. | Symmetric storage using a cloud-based storage system |
| CN108881158A (en) * | 2018-05-04 | 2018-11-23 | 北京明朝万达科技股份有限公司 | Data interaction system and method |
| CN108933774A (en) * | 2018-05-04 | 2018-12-04 | 北京明朝万达科技股份有限公司 | Data interaction system and method |
| CN112543920A (en) * | 2019-07-22 | 2021-03-23 | 华为技术有限公司 | Data reconstruction method, device, computer equipment, storage medium and system |
Non-Patent Citations (1)
| Title |
|---|
| 综合数据传输平台的安全与可靠性研究;徐家慧;何蕾;李勃;刘军;;电网技术(S2);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116846546A (en) | 2023-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5414650A (en) | Parsing information onto packets using context-insensitive parsing rules based on packet characteristics | |
| CN108134775B (en) | Data processing method and equipment | |
| WO2014060033A1 (en) | Event management in telecommunications networks | |
| US8532331B2 (en) | Method for monitoring a picture or multimedia video pictures in a communication system | |
| CN110278202A (en) | A kind of file uploading system | |
| CN116846546B (en) | Information loss-proof and repetition-proof cross-network data exchange system | |
| US6819671B1 (en) | Relay control circuit using hashing function algorithm | |
| CN117240812A (en) | Double-backup digital simultaneous interpretation system | |
| US5742611A (en) | Client server network and method of operation | |
| CN114157716B (en) | Block chain-based data processing method and device and electronic equipment | |
| CN108737246B (en) | Message issuing method, device, storage medium and server | |
| CN107590380B (en) | High-speed space-time computing platform | |
| CN109657118A (en) | A kind of the URL De-weight method and its system of distributed network crawler | |
| CN110838924B (en) | Block transmission method and device | |
| CN113094397B (en) | Data storage and query response method and block execution method | |
| CN107977381B (en) | Data configuration method, index management method, related device and computing equipment | |
| CN105450331A (en) | Frame synchronization method and frame synchronization device | |
| CN110933619B (en) | Message processing method based on distributed network | |
| EP3591907B1 (en) | Mail transmission method and server | |
| US20170085625A1 (en) | Technologies for handling message passing interface operations | |
| US20150365365A1 (en) | Method and apparatus for modifying message | |
| CN113282662B (en) | Block information processing method, device, equipment and medium | |
| CN104468318A (en) | Method and server for recovering reverse relationship chain in network communication | |
| Ghazizadeh et al. | A new protocol for asymmetric communication channels: Reaching the lower bounds | |
| CN116233247B (en) | Data transmission processing system with preprocessing performance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |