CN117997479A - Data transmission system, method, equipment and storage medium - Google Patents
Data transmission system, method, equipment and storage medium Download PDFInfo
- Publication number
- CN117997479A CN117997479A CN202410369787.2A CN202410369787A CN117997479A CN 117997479 A CN117997479 A CN 117997479A CN 202410369787 A CN202410369787 A CN 202410369787A CN 117997479 A CN117997479 A CN 117997479A
- Authority
- CN
- China
- Prior art keywords
- data
- transmission
- unit
- backup
- serial number
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 145
- 238000000034 method Methods 0.000 title claims abstract description 21
- 238000012545 processing Methods 0.000 claims abstract description 17
- 239000003795 chemical substances by application Substances 0.000 claims description 27
- 238000007726 management method Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 9
- 238000013500 data storage Methods 0.000 claims description 9
- 230000003287 optical effect Effects 0.000 claims description 7
- 125000004122 cyclic group Chemical group 0.000 claims description 4
- 230000008569 process Effects 0.000 claims description 4
- 230000000977 initiatory effect Effects 0.000 claims description 3
- 238000012163 sequencing technique Methods 0.000 claims description 2
- 238000004891 communication Methods 0.000 abstract description 6
- 238000005259 measurement Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000006872 improvement Effects 0.000 description 4
- 238000012546 transfer Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 2
- 230000004888 barrier function Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005538 encapsulation Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention provides a data transmission system, a method, equipment and a storage medium, which belong to the field of data communication and storage, wherein a data generation module of the system is used for generating a data packet with link service information; the data processing module is used for encrypting the data in the data packet, and then distributing agent ID, agent serial number, session ID, message serial number and time stamp to the encrypted data for backup; the data transmission management module is used for extracting the corresponding backup data according to the retransmission request and retransmitting the extracted data. The invention retransmits the data according to the determined data transmission error type, thereby not only reducing the data loss and improving the data reliability, but also determining the corresponding data needing to be retransmitted without retransmitting the data entirely and improving the transmission efficiency.
Description
Technical Field
The invention belongs to the field of data communication and storage, and particularly relates to a data transmission system, a data transmission method, data transmission equipment and a data storage medium.
Background
Data communication and storage have become important requirements for various industries in modern information society. However, with the development of technology, security threats have increased. Therefore, in order to ensure the security of data, various security protection measures such as communication encryption technology, fire wall, gas barrier and the like are often used in the prior art. In conventional information security practices, unidirectional flow of data is typically accomplished through optical shutters to ensure unidirectional transmission of sensitive information from a non-secure network to a secure network. The data transmission mode can be divided into two mechanisms of real-time transmission and timing synchronization so as to meet the data convergence requirement of the secret-related network. However, the real-time transmission mode often causes excessive resource consumption on the data packet, and meanwhile, frequent data transmission operation is difficult to ensure the integrity of the data, thereby increasing the operation and maintenance cost. On the other hand, the timing synchronization mode cannot ensure the instantaneity of the data, which may cause the loss of the value of the key data. With the exponential growth of data volumes and the continued evolution of traffic environments, conventional shutter transmission systems have not been adequate to cope with increasingly complex traffic demands.
In summary, how to reduce the high consumption of resources by data transfer and reduce the loss of data transfer during the data transmission process, so as to ensure the high reliability of data transmission is a problem to be solved at present.
Disclosure of Invention
In order to overcome the problem of data transfer loss, the present invention provides a data transmission system comprising:
the data generation module is used for generating a data packet with link service information;
The data processing module is used for carrying out encryption processing on the data in the data packet, and then distributing an agent ID, an agent serial number, a session ID, a message serial number and a time stamp to the encrypted data for data backup;
The data transmission management module is used for extracting the corresponding backup data according to the retransmission request and retransmitting the extracted data, and specifically comprises the following steps: if the retransmission request is that the data is lost or has errors, extracting the corresponding backup data according to the proxy ID and the proxy serial number and retransmitting the data; if the retransmission request is that the data is transmitted to the receiver, but the transmission fails, or only one specific session is a transmission error, extracting the corresponding data backed up according to the session ID and the message sequence number and retransmitting the data; if the receiving side receives the transmission error caused by the network error, the time stamp of the error is extracted, and the corresponding data after the time stamp is extracted from the backup data according to the time stamp is retransmitted.
Preferably, the data generating module comprises a data source and a front-end transmitting unit; the data source is used for generating a data packet with link service information and initiating data transmission, and the data in the data packet has the same structure, the same length and the same number of modifiable service parameters; the pre-sending unit is used for sending an acknowledgement packet to the data source and starting data transmission when the data transmission is ready.
Preferably, the content of the data packet includes an information type, a destination IP, a file name, and a file length.
Preferably, the data processing module comprises an encryption unit and a data reading unit; the encryption unit is used for encrypting the data packet sent by the front-end sending unit by using the message digest algorithm MD5 and marking a data source at the same time; the data reading unit is used for reading the encrypted data and starting transmission.
Preferably, the data transmission management module comprises an optical gate, a remote memory management unit, a transmission control unit and a data retransmission unit; the optical gate is used for scanning, acquiring and uploading the data distributed with the agent ID, the agent serial number, the session ID, the message serial number and the time stamp and ensuring unidirectional transmission of the data in a physical layer and a software layer; the remote memory management unit is used for being responsible for data writing limitation and cyclic use of buffer space, judges whether batch writing is performed according to the size of each data packet, and designates a writing address of each sending message in the sending process; the transmission control unit is used for reporting the consumption speed of the received data as feedback data, inputting the feedback data of the receiver into the pre-sending unit, and adjusting the transmission speed by the pre-sending unit according to the feedback data; the data retransmission unit is used for extracting corresponding data in the backup according to the retransmission request and retransmitting the extracted data.
Preferably, the system further comprises a data storage module, wherein the data storage module comprises a rear receiving unit and a secure storage unit; the rear receiving unit is used for randomly storing data packets from different sources in the buffer area under the request of a user, sequencing the data packets in the receiving buffer area, calculating MD5 check codes, comparing with MD5 of the front sending unit, sending the data packets to the client after the check passes, and writing the data packets into the local disk; the secure storage unit is used for carrying out distributed secure storage on the data written into the local disk and copying one data into multiple copies.
The invention also provides a data transmission method, which comprises the following steps:
generating a data packet with link service information;
Encrypting the data in the data packet, and then distributing an agent ID, an agent serial number, a session ID, a message serial number and a time stamp to the encrypted data for data backup;
Extracting the corresponding data of the backup according to the retransmission request and retransmitting the extracted data, specifically: if the retransmission request is that the data is lost or has errors, extracting the corresponding backup data according to the proxy ID and the proxy serial number and retransmitting the data; if the retransmission request is that the data is transmitted to the receiver, but the transmission fails, or only one specific session is a transmission error, extracting the corresponding data backed up according to the session ID and the message sequence number and retransmitting the data; if the receiving party receives the transmission error caused by the network error, extracting the timestamp of the error occurrence, and retransmitting the corresponding data after extracting the timestamp from the backed-up data according to the timestamp;
the invention also provides a computer device comprising a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform the data transmission method.
The present invention also provides a computer readable storage medium storing a computer program adapted to be loaded by a processor for performing the data transmission method.
The data transmission system, the method, the device and the storage medium provided by the invention have the following beneficial effects:
The invention can judge the type of data transmission errors by distributing agent ID, agent serial number, session ID, message serial number and time stamp to each data in the data packet and carrying out data backup, and transmits the data according to the type of the data transmission errors, if the retransmission request is data loss or error, the data is extracted from the backup according to the agent ID and the agent serial number and the data is retransmitted; if the retransmission request is that the data is transmitted to the receiving party, but the transmission fails, or only one specific session is a transmission error, extracting the data from the backup according to the session ID and the message sequence number and retransmitting the data; if the receiving side receives the transmission error caused by the network error, extracting the time stamp of the error occurrence, and retransmitting the data after the time stamp is extracted from the backup according to the time stamp; the packet loss rate of data transmission can be reduced by retransmitting different types of data, and the reliability of the data transmission is ensured; in addition, the invention can determine the corresponding data to be retransmitted by judging the type of the data transmission error, and the data is not required to be completely retransmitted, thereby improving the transmission efficiency.
Drawings
In order to more clearly illustrate the embodiments of the present invention and the design thereof, the drawings required for the embodiments will be briefly described below. The drawings in the following description are only some of the embodiments of the present invention and other drawings may be made by those skilled in the art without the exercise of inventive faculty.
Fig. 1 is a flow chart of a data transmission system according to an embodiment of the present invention;
fig. 2 is a data retransmission flow chart.
Detailed Description
The present invention will be described in detail below with reference to the drawings and the embodiments, so that those skilled in the art can better understand the technical scheme of the present invention and can implement the same. The following examples are only for more clearly illustrating the technical aspects of the present invention, and are not intended to limit the scope of the present invention.
In the description of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "axial", "radial", "circumferential", etc. indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings are merely for convenience in describing the technical solutions of the present invention and to simplify the description, and do not indicate or imply that the devices or elements referred to must have a specific orientation, be configured and operated in a specific orientation, and therefore should not be construed as limiting the present invention.
Furthermore, the terms "first," "second," and the like are used for descriptive purposes only and are not to be construed as indicating or implying relative importance. In the description of the present invention, it should be noted that, unless explicitly specified or limited otherwise, the terms "connected," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; may be directly connected or indirectly connected through an intermediate medium. The specific meaning of the above terms in the present invention can be understood by those of ordinary skill in the art according to the specific circumstances. In the description of the present invention, unless otherwise indicated, the meaning of "a plurality" is two or more, and will not be described in detail herein.
Examples
The invention provides a data transmission system, which is shown in fig. 1 in detail, and comprises a data generation module, a data processing module, a data transmission management module and a data storage module. The data generation module is positioned in the measurement and control network and is used for generating a data packet and starting data transmission; the data processing module is positioned in the measurement and control network and used for encrypting the data in the data packet, and then distributing the agency ID, the agency serial number, the session ID, the message serial number and the time stamp to the encrypted data for data backup. The data transmission management module is used for transmitting and controlling the data distributed with the agent ID, the agent serial number, the session ID, the message serial number and the time stamp; the data transmission management module is further configured to extract corresponding backup data according to the retransmission request and retransmit the extracted data, specifically: if the retransmission request is that the data is lost or has errors, extracting the corresponding backup data according to the proxy ID and the proxy serial number and retransmitting the data; if the retransmission request is that the data is transmitted to the receiver, but the transmission fails, or only one specific session is a transmission error, extracting the corresponding data backed up according to the session ID and the message sequence number and retransmitting the data; if the receiving side receives the transmission error caused by the network error, the time stamp of the error is extracted, and the corresponding data after the time stamp is extracted from the backup data according to the time stamp is retransmitted. The data storage module is used for storing the received data. The measurement and control network is a network for measuring and controlling actual use scenes, namely a local area network where experimental data are collected and processed; the target network is a local area network at the application end.
In this embodiment, the data generating module includes a data source and a preamble transmitting unit; the data source is used for initiating data transmission and generating a data packet with link service information, wherein the content of the data packet comprises information type, destination IP, file name, file length and the like. All data packets have the same structure and length and include modifiable service parameters. The pre-sending unit sends an acknowledgement packet to the data source end when the data transmission is ready, and starts the data transmission.
The data processing module is also arranged in the measurement and control network and is responsible for encryption processing and reliable transmission of data. The module includes an encryption unit and a data reading unit. The encryption unit encrypts the data packet sent by the pre-sending unit by using the message digest algorithm MD5, and marks the data source at the same time. The data reading unit is used for reading the encrypted data and starting transmission.
The data transmission management module comprises an optical gate, a remote memory management unit, a transmission control unit and a data retransmission unit. The shutter is used to scan, acquire, upload, and guarantee unidirectional transmission of data at the physical and software layers for data assigned the proxy ID, proxy serial number, session ID, message serial number, and time stamp. The remote memory management unit is responsible for data writing limitation and cyclic use of buffer space, judges whether to write in batches according to the size of each data packet, and designates the writing address of each sending message in the sending process so as to prevent out-of-range errors. Meanwhile, the transmission control unit updates the current buffer space use condition according to the writing position, reports the consumption speed of the received data as feedback data, inputs the feedback data of the receiving party into the front-end sending unit, and the front-end sending unit correspondingly adjusts the transmission speed according to the feedback data. The data retransmission unit extracts corresponding data in the backup according to the retransmission request and retransmits the extracted data, the data retransmission unit can check the serial number while sending the data, if the data is lost or has errors, the serial number is extracted from the message and retransmission is requested, and meanwhile, the data retransmission unit reads and retransmits the backup data when receiving the retransmission request.
In order to distinguish the data that needs to be retransmitted, the present invention adds the following information in each metadata (i.e., message header) that includes information about the message itself: each agent is assigned a unique ID and the header records the ID of the agent being processed (agent ID). Further, a sequence number is sequentially assigned to each message processed by the agent (agent sequence number). At the same time, the time the proxy processed the message is also written.
In each proxy there may be multiple sessions identifying the source and destination, each session being provided with a unique ID (session ID). In addition, a sequence number is assigned to the message passing through each session. Thus, an agent ID, an agent sequence number, a session ID, a message sequence number, and a timestamp are added in each message header.
During the system initialization phase, the data processing module sends several test files with increasing file sizes to the shutter. After the data is received, the post-receiving unit displays the data processing time. The user manually inputs feedback data into the preamble transmission unit. The data processing module fits a transmission interval curve according to the feedback data to determine transmission intervals corresponding to different file sizes.
After each transmission task is completed, the user manually inputs the data receiving result and the corresponding processing time into the front-end transmitting unit. The preamble transmission unit corrects the transmission interval of the size file transmitted at this time according to the feedback information. And provides an opportunity for a post-receiving unit to receive acknowledgements without requiring a direct connection between the measurement and control network and the receiving party. In order to increase the effective capacity of the communication channel, the transmission control unit implements data slicing and encapsulation during data transmission. After completion of each transmission task, the user manually inputs the data reception result and the corresponding processing time to the preamble transmission unit, and the transmission interval generated by the transmission test is used as a default transmission interval, and it is necessary to recalculate the transmission interval after each transmission. Calculating a new transmission interval by the current transmission interval and a new transmission interval sample, wherein the new transmission interval= (1-current load) is the current transmission interval+current load is the new transmission interval sample; the current load is the cpu occupancy (as a percentage) of the post-receiving unit, the current transmission interval=the generation time of the data packet+the time consumed in the data transmission process, and the new transmission interval, the current transmission interval, and the new transmission interval sample are all time units.
Since the pre-sending unit knows the receiving buffer address and the buffer size of the receiving unit before use, the sender needs to obtain the registration information of the receiving space of the receiver and the write permission of the receiver. Meanwhile, the unidirectional data transmission environment cannot exchange registration information through a link. Therefore, it is necessary to reuse the receiving space using the static registration mode.
The data storage module is positioned in the target network and is responsible for storage and application of the received data. The data storage module comprises a rear receiving unit and a secure storage unit. After receiving the data, the rear receiving unit transmits the data from the receiving buffer area to the application program through the interface, and when a user sends a request, the rear receiving unit decrypts the data in the receiving buffer area and writes the decrypted data into the local disk. The safe storage unit performs distributed safe storage on the data written into the local disk, and in a distributed file storage system, the data are stored on a plurality of nodes in a scattered manner, so that the backup and redundancy of the data can be realized, and the reliability and usability of the data are improved. Meanwhile, the invention also adopts a storage mounting technology to expand the storage capacity, and storage equipment can be added and removed at any time so as to meet the requirement of a system on high-capacity data storage. In addition, the module provides automatic failover and data redundancy, ensuring data integrity.
The invention adopts the encryptor and the firewall to ensure the safe transmission and storage of the data. The encryption machine is used for encrypting and decrypting data, and the firewall is used for monitoring network traffic and preventing malicious attacks. In practical applications, multiple encryption techniques and multi-layer firewall techniques may be employed to enhance security. In order to ensure the reliability and stability of the system, the invention adopts the UPS power-off protection of the storage battery and the diesel generator as a standby power supply. When power failure and the like occur, the UPS power-off protection can realize seamless switching of the system, and the diesel generator can provide continuous power supply for the whole system for a long time.
The invention also provides a data transmission method, which comprises the following steps:
step 1: a data packet with the link service information is generated.
The data transmission is initiated by a data source which generates a data packet with a unique number, i.e. information type (file or stream), destination IP, file name, file length, etc. All transmitted messages have the same structure and length, and the number of service parameters can be modified. The preamble unit transmits an acknowledgement packet to the data source and starts data transmission.
Step 2: and encrypting the data in the data packet, and then distributing an agent ID, an agent serial number, a session ID, a message serial number and a time stamp to the encrypted data for data backup.
After the data starts to be transmitted, the data processing module starts to encrypt and mark the data packet and writes the data packet into the file public buffer.
Step 3: and extracting the corresponding data of the backup according to the retransmission request and retransmitting the extracted data, and distinguishing whether the retransmission request is a retransmission request of the proxy unit, the session unit or the time unit when the retransmission request is received. If the retransmission request is that the data is lost or has errors, extracting the corresponding backup data according to the proxy ID and the proxy serial number and retransmitting the data; if the retransmission request is that the data is transmitted to the receiver, but the transmission fails, or only one specific session is a transmission error, extracting the corresponding data backed up according to the session ID and the message sequence number and retransmitting the data; if the receiving side receives the transmission error caused by the network error, the time stamp of the error is extracted, and the corresponding data after the time stamp is extracted from the backup data according to the time stamp is retransmitted.
The specific process of data retransmission is as follows (see fig. 2):
fig. 2 is a flow chart for checking data integrity and requesting retransmission at a receiving unit. The data integrity of the receiving unit is checked with a sequence number and a cyclic redundancy check code CRC. When data is received, judging that the packet is lost by detecting whether the sequence of the proxy serial numbers is correct or not, and if the data is lost or has errors, extracting the proxy ID or the proxy serial numbers from the previously received message and requesting retransmission; if yes, checking whether CRC is wrong, if yes, judging that packet is lost, extracting proxy ID or proxy serial number and requesting retransmission, if not, receiving correct information, transmitting the information to a target host, judging whether transmission is successful, if yes, ending transmission, if not, if the received data is transmitted to a receiving end and fails to be transmitted, or if only one specific session is transmission error, requesting retransmission by using session ID or message serial number information, if the receiving unit transmits error due to network error, extracting a timestamp of error occurrence, and extracting corresponding data request retransmission after the timestamp from backup data according to the timestamp.
The invention also provides a computer device comprising a memory and a processor; the memory stores a computer program and the processor is configured to execute the computer program in the memory to perform the data transmission method.
The invention also provides a computer readable storage medium storing a computer program adapted to be loaded by a processor for performing a data transmission method.
The invention has the following advantages:
1) In the invention, the optical gate is used for realizing the safety isolation of data transmission and solving the problems of transmission speed and capacity.
For the technical means of distributed file storage and storage mounting of a receiving end, the performance improvement of continuous real-time transmission and mass file transmission is realized, and the safety interconnection between a source network and a receiving network is ensured.
2) The invention adopts a method for backing up the message at the transmitting end and retransmitting when generating the retransmission request. The key values to be separated, the way in which the message header is added, and the modules for backup and retransmission are defined. Therefore, the packet loss rate of data transmission can be reduced, and the reliability of the data transmission can be guaranteed.
3) Compared with the traditional unidirectional data transmission system based on the user datagram protocol UDP, the unidirectional data transmission system has the advantages of optimizing memory management in the unidirectional transmission process, improving the throughput of data transmission, reducing the resource consumption of the CPU by file transmission and reducing the transmission delay.
The invention is used as a high-performance transmission technology with high bandwidth, low time delay and low CPU overhead, can be effectively applied to the field of unidirectional data transmission, and can fully improve the performance of the existing system.
By implementing the invention, the improvement of the performance of the optical gate can be realized on the premise of ensuring high reliability of data, including reduction of delay, improvement of transmission speed, improvement of the number of transmission files in unit time and the like, thereby meeting the requirements of high-speed, high-efficiency and stable data transmission. The invention has wide application fields including but not limited to the fields of network communication, data centers, cloud computing and the like. The embodiment of the invention can be properly adjusted and changed according to actual demands without departing from the technical scheme and spirit of the invention. Accordingly, this invention is to be protected by the broadest permissible range of law.
The above embodiments are merely preferred embodiments of the present invention, the protection scope of the present invention is not limited thereto, and any simple changes or equivalent substitutions of technical solutions that can be obviously obtained by those skilled in the art within the technical scope of the present invention disclosed herein are all within the protection scope of the present invention.
Claims (9)
1. A data transmission system, comprising:
the data generation module is used for generating a data packet with link service information;
The data processing module is used for carrying out encryption processing on the data in the data packet, and then distributing an agent ID, an agent serial number, a session ID, a message serial number and a time stamp to the encrypted data for data backup;
The data transmission management module is used for extracting the corresponding backup data according to the retransmission request and retransmitting the extracted data, and specifically comprises the following steps: if the retransmission request is that the data is lost or has errors, extracting the corresponding backup data according to the proxy ID and the proxy serial number and retransmitting the data; if the retransmission request is that the data is transmitted to the receiver, but the transmission fails, or only one specific session is a transmission error, extracting the corresponding data backed up according to the session ID and the message sequence number and retransmitting the data; if the receiving side receives the transmission error caused by the network error, the time stamp of the error is extracted, and the corresponding data after the time stamp is extracted from the backup data according to the time stamp is retransmitted.
2. The data transmission system of claim 1, wherein the data generation module comprises a data source and a preamble unit; the data source is used for generating a data packet with link service information and initiating data transmission, and the data in the data packet has the same structure, the same length and the same number of modifiable service parameters; the pre-sending unit is used for sending an acknowledgement packet to the data source and starting data transmission when the data transmission is ready.
3. The data transmission system of claim 1, wherein the content of the data packet includes information type, destination IP, file name, and file length.
4. The data transmission system according to claim 2, wherein the data processing module includes an encryption unit and a data reading unit; the encryption unit is used for encrypting the data packet sent by the front-end sending unit by using the message digest algorithm MD5 and marking a data source at the same time; the data reading unit is used for reading the encrypted data and starting transmission.
5. The data transmission system according to claim 4, wherein the data transmission management module comprises a shutter, a remote memory management unit, a transmission control unit, and a data retransmission unit; the optical gate is used for scanning, acquiring and uploading the data distributed with the agent ID, the agent serial number, the session ID, the message serial number and the time stamp and ensuring unidirectional transmission of the data in a physical layer and a software layer; the remote memory management unit is used for being responsible for data writing limitation and cyclic use of buffer space, judges whether batch writing is performed according to the size of each data packet, and designates a writing address of each sending message in the sending process; the transmission control unit is used for reporting the consumption speed of the received data as feedback data, inputting the feedback data of the receiver into the pre-sending unit, and adjusting the transmission speed by the pre-sending unit according to the feedback data; the data retransmission unit is used for extracting corresponding data in the backup according to the retransmission request and retransmitting the extracted data.
6. The data transmission system of claim 1, further comprising a data storage module comprising a post-receive unit and a secure storage unit; the rear receiving unit is used for randomly storing data packets from different sources in the buffer area under the request of a user, sequencing the data packets in the receiving buffer area, calculating MD5 check codes, comparing with MD5 of the front sending unit, sending the data packets to the client after the check passes, and writing the data packets into the local disk; the secure storage unit is used for carrying out distributed secure storage on the data written into the local disk and copying one data into multiple copies.
7. A data transmission method, comprising the steps of:
generating a data packet with link service information;
Encrypting the data in the data packet, and then distributing an agent ID, an agent serial number, a session ID, a message serial number and a time stamp to the encrypted data for data backup;
Extracting the corresponding data of the backup according to the retransmission request and retransmitting the extracted data, specifically: if the retransmission request is that the data is lost or has errors, extracting the corresponding backup data according to the proxy ID and the proxy serial number and retransmitting the data; if the retransmission request is that the data is transmitted to the receiver, but the transmission fails, or only one specific session is a transmission error, extracting the corresponding data backed up according to the session ID and the message sequence number and retransmitting the data; if the receiving side receives the transmission error caused by the network error, the time stamp of the error is extracted, and the corresponding data after the time stamp is extracted from the backup data according to the time stamp is retransmitted.
8. A computer device comprising a memory and a processor; the memory stores a computer program, and the processor is configured to execute the computer program in the memory to perform the method of claim 7.
9. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program adapted to be loaded by a processor for performing the method of claim 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410369787.2A CN117997479A (en) | 2024-03-29 | 2024-03-29 | Data transmission system, method, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410369787.2A CN117997479A (en) | 2024-03-29 | 2024-03-29 | Data transmission system, method, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117997479A true CN117997479A (en) | 2024-05-07 |
Family
ID=90901449
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410369787.2A Pending CN117997479A (en) | 2024-03-29 | 2024-03-29 | Data transmission system, method, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117997479A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092673A (en) * | 2014-06-27 | 2014-10-08 | 中国人民解放军第二军医大学 | System and method for achieving safe one-way data transmission between networks |
| US20160338120A1 (en) * | 2015-05-14 | 2016-11-17 | Smart Technologies, Ulc | System And Method Of Communicating Between Interactive Systems |
| WO2019067002A1 (en) * | 2017-09-26 | 2019-04-04 | Olympus Sky Technologies, S.A. | Secure communications using organically derived synchronized processes |
| KR102177411B1 (en) * | 2019-08-27 | 2020-11-11 | 진테크이엔지(주) | Method for managing industrial control systems via physical one-way encryption remote monitoring |
| CN112788030A (en) * | 2021-01-11 | 2021-05-11 | 北京鼎轩科技有限责任公司 | Data exchange method and system between high-density network and low-density network |
| CN116070241A (en) * | 2023-02-09 | 2023-05-05 | 深圳市结客盟科技有限公司 | Mobile hard disk encryption control method |
| CN116743350A (en) * | 2023-08-14 | 2023-09-12 | 杭州合众数据技术有限公司 | Data stream fusion transmission method and system based on unidirectional optical gate and electronic equipment |
| CN117459286A (en) * | 2023-11-02 | 2024-01-26 | 广州启宁信息科技有限公司 | SD-WAN-based data communication security early warning method and device |
| CN117676501A (en) * | 2023-12-12 | 2024-03-08 | 南京海容同和智能科技有限公司 | Remote wireless communication method for one-stop type Internet of things fire control cabinet mechanical protection device |
| CN117768131A (en) * | 2022-09-19 | 2024-03-26 | 上海申通地铁集团有限公司 | Unidirectional isolation method for network boundary of industrial control system |
-
2024
- 2024-03-29 CN CN202410369787.2A patent/CN117997479A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104092673A (en) * | 2014-06-27 | 2014-10-08 | 中国人民解放军第二军医大学 | System and method for achieving safe one-way data transmission between networks |
| US20160338120A1 (en) * | 2015-05-14 | 2016-11-17 | Smart Technologies, Ulc | System And Method Of Communicating Between Interactive Systems |
| WO2019067002A1 (en) * | 2017-09-26 | 2019-04-04 | Olympus Sky Technologies, S.A. | Secure communications using organically derived synchronized processes |
| KR102177411B1 (en) * | 2019-08-27 | 2020-11-11 | 진테크이엔지(주) | Method for managing industrial control systems via physical one-way encryption remote monitoring |
| CN112788030A (en) * | 2021-01-11 | 2021-05-11 | 北京鼎轩科技有限责任公司 | Data exchange method and system between high-density network and low-density network |
| CN117768131A (en) * | 2022-09-19 | 2024-03-26 | 上海申通地铁集团有限公司 | Unidirectional isolation method for network boundary of industrial control system |
| CN116070241A (en) * | 2023-02-09 | 2023-05-05 | 深圳市结客盟科技有限公司 | Mobile hard disk encryption control method |
| CN116743350A (en) * | 2023-08-14 | 2023-09-12 | 杭州合众数据技术有限公司 | Data stream fusion transmission method and system based on unidirectional optical gate and electronic equipment |
| CN117459286A (en) * | 2023-11-02 | 2024-01-26 | 广州启宁信息科技有限公司 | SD-WAN-based data communication security early warning method and device |
| CN117676501A (en) * | 2023-12-12 | 2024-03-08 | 南京海容同和智能科技有限公司 | Remote wireless communication method for one-stop type Internet of things fire control cabinet mechanical protection device |
Non-Patent Citations (4)
| Title |
|---|
| 李兆;: "适用于有线机房的数据备份恢复方案", 中国有线电视, no. 03, 15 March 2010 (2010-03-15) * |
| 耿玉波;夏鲁宁;杜皎;荆继武;尚铭;: "一种Web服务器安全机制的研究与实现", 计算机工程, no. 11, 5 June 2006 (2006-06-05) * |
| 黄国良;张锐;罗朝辉;: "多线程异地备份发动机数据软件设计与应用", 火箭推进, no. 04, 15 August 2016 (2016-08-15) * |
| 黎妹红;齐小晨;吴倩倩;: "基于动态密钥的智能电网无线通信数据加密传输方案", 信息网络安全, no. 12, 10 December 2019 (2019-12-10) * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10243928B2 (en) | Detection of stale encryption policy by group members | |
| Paxson et al. | Known TCP implementation problems | |
| CN102571635A (en) | Message transmission method and equipment | |
| CN111447276B (en) | Encryption continuous transmission method with key agreement function | |
| US8984619B2 (en) | Methods, systems, and computer readable media for adaptive assignment of an active security association instance in a redundant gateway configuration | |
| CN101453479A (en) | Fast document transmission system | |
| WO2022099683A1 (en) | Data transmission method and apparatus, device, system, and storage medium | |
| CN106021028A (en) | Hot backup method and system for data | |
| Galvin et al. | SNMP Security Protocols | |
| KR101953552B1 (en) | Apparatus for one-way transmission, apparatus for one-way reception, and one-way retransmission method for using same | |
| US11716367B2 (en) | Apparatus for monitoring multicast group | |
| CN115118526B (en) | VR device data migration method | |
| CN117997479A (en) | Data transmission system, method, equipment and storage medium | |
| US8086908B2 (en) | Apparatus and a method for reporting the error of each level of the tunnel data packet in a communication network | |
| CN108881447A (en) | Illegal external connection data reporting method and device | |
| CN113778759B (en) | Failure detection and recovery method in data distribution process | |
| CN111221764B (en) | Cross-link data transmission method and system | |
| CN111490971B (en) | General hospital information infrastructure safety operation and maintenance and auditing method | |
| KR20100026721A (en) | Apparatus and method for providing network interface information in stream control transmission protocol | |
| JP2008245158A (en) | Communication equipment, communicating method, and communication program | |
| Mittal et al. | Detecting and Recovering the Failure Path During Data Transmission Through Bridge Node in WSN | |
| Lung et al. | A simple intrusion-tolerant reliable multicast protocol using the TTCB | |
| CN117240474A (en) | Data relay method, device, equipment and medium | |
| CN111030984A (en) | Data safety transmission system and method | |
| CN117997620A (en) | Unidirectional data transmission method and device, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination |