CN113391951B - Multipoint centralized remote backup disaster recovery method and system based on Ethernet simplified transmission - Google Patents
Multipoint centralized remote backup disaster recovery method and system based on Ethernet simplified transmission Download PDFInfo
- Publication number
- CN113391951B CN113391951B CN202110550906.0A CN202110550906A CN113391951B CN 113391951 B CN113391951 B CN 113391951B CN 202110550906 A CN202110550906 A CN 202110550906A CN 113391951 B CN113391951 B CN 113391951B
- Authority
- CN
- China
- Prior art keywords
- data
- unit
- user
- compression
- compression ratio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005540 biological transmission Effects 0.000 title claims abstract description 64
- 238000011084 recovery Methods 0.000 title claims abstract description 41
- 238000000034 method Methods 0.000 title claims description 34
- 238000007906 compression Methods 0.000 claims abstract description 217
- 230000006835 compression Effects 0.000 claims abstract description 217
- 230000000903 blocking effect Effects 0.000 claims abstract description 111
- 238000004458 analytical method Methods 0.000 claims abstract description 11
- 238000005516 engineering process Methods 0.000 claims abstract description 7
- 238000007405 data analysis Methods 0.000 claims description 56
- 238000000638 solvent extraction Methods 0.000 claims description 10
- 238000013500 data storage Methods 0.000 claims description 7
- 238000013144 data compression Methods 0.000 claims description 3
- 230000001105 regulatory effect Effects 0.000 claims description 2
- 230000008569 process Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1458—Management of the backup or restore process
- G06F11/1464—Management of the backup or restore process for networked environments
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/04—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
- H04L63/0428—Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Computer Security & Cryptography (AREA)
- General Physics & Mathematics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Quality & Reliability (AREA)
- Evolutionary Computation (AREA)
- Computer Hardware Design (AREA)
- Computing Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a multipoint centralized remote backup disaster recovery technology and a multipoint centralized remote backup disaster recovery system based on Ethernet simplified transmission, and relates to the technical field of data disaster recovery. On one hand, the multipoint centralized remote backup disaster recovery technology based on Ethernet simplified transmission is provided, and comprises the steps of obtaining user data, analyzing the user data, judging the size of data volume according to an analysis result, selecting priority transmission or selecting priority classification blocking according to the size of the data volume, compressing and encrypting the blocked data, backing up the encrypted data once and storing the data in other arbitrary end servers; on the other hand, the multipoint centralized remote backup disaster recovery system based on the Ethernet simplified transmission comprises a terminal server, a node server and a data processing system, wherein the terminal server comprises a data acquisition unit, an analysis unit, a second classification unit, a second block division unit, a transmission unit and a storage unit, and the node server comprises a receiving unit, a first classification unit, a first block division unit, a compression unit, an encryption unit, a correlation unit and a backup unit, so that the protection capability of user data is improved.
Description
Technical Field
The invention relates to the technical field of data disaster tolerance, in particular to a multipoint centralized remote backup disaster tolerance method and system based on Ethernet simplified transmission.
Background
At present, the security of data has become a key indicator in the operation process of enterprises, and it has been found through investigation that more than ninety percent of enterprises in the country are particularly concerned about the data security problem, but because a set of data security system is configured, the manpower, material resources and financial resources required to be spent are relatively large, and therefore, only less than four enterprises are equipped with data security systems for themselves nowadays.
Although many data security systems for large-scale enterprises and medium and small-scale enterprises are already available on the market, the data security of many medium and small-scale enterprises is not very important, and thus the applications of the data security systems are not very wide.
Chinese patent publication No.: CN 104407944A. A disaster recovery backup method and system are disclosed. Caching disaster-tolerant data into a local data cache space when the input/output IO data volume of an upper application reaches or exceeds a preset threshold value; when the IO data volume is lower than the preset threshold value, transmitting the disaster recovery data stored in the local data cache space to a remote backup data end; therefore, the disaster recovery backup method and the disaster recovery backup system have the following problems: because the local specific storage space is used, disaster recovery data transmission is carried out when the to-be-operated pressure is low, when the system has continuous high service volume, the data can only be backed up through the local storage space, if catastrophic time occurs in the process, the safety of the data is difficult to ensure, the data is difficult to recover, and the irretrievable loss is inevitably caused to enterprises.
Therefore, for data security, data can be remotely backed up under the condition that the data is kept locally stored in both the condition that the data volume is high and the condition that the data volume is low, the validity and the transmission speed of the data are ensured in the backup process, the transmission efficiency of the data is ensured, and the protection capability of the data is ensured.
Disclosure of Invention
Therefore, the invention provides a multipoint centralized remote backup disaster recovery method based on Ethernet simplified transmission on one hand, and a multipoint centralized remote backup disaster recovery system based on Ethernet simplified transmission on the other hand. The method and the device are used for solving the problem that the data protection capability is low because the data cannot be transmitted in real time when the data volume is large in the prior art.
In order to achieve the above object, an aspect of the present invention provides a method for multipoint centralized remote backup disaster recovery based on ethernet reduced transmission, including:
step s1, acquiring the user data in real time through the data acquisition unit, analyzing the user data through the data analysis unit, determining the data size of the user data according to the analysis result, and selecting priority transmission or selecting priority classification and blocking according to the data size;
step s2, classifying the user data according to data types through a data classification unit, and partitioning the data according to word length when the classification is completed;
step s3, transmitting the user data to the data receiving unit through the data transmitting unit;
step s4, after receiving the user data, the data receiving unit compresses the user data by the compression unit, and encrypts the user data when compression is completed;
step s5, the encrypted user data is backed up once by the data backup unit and stored in any other end server;
the data analysis unit is provided with a preset data volume D0, when the data acquisition unit finishes acquiring the user data, the data analysis unit analyzes the user data to calculate the data volume D of the user data, compares the data volume D of the user with the preset data volume D0, if the data volume D is larger than or equal to D0, the data analysis unit judges that the data volume of the user data is larger, the user data are classified through the second data classification unit, when the classification is finished, the data in each data type are partitioned through the data partitioning unit, when the partitioning is finished, the data blocks are compressed through the second compression unit and then transmitted to the node server through the transmission unit, if the data analysis unit judges that the data volume of the user is not large, if the data analysis unit judges that the data volume of the user is smaller than D0, the data are transmitted to the node server through the data transmission unit, and the user data are classified through the first data classification unit, when the classification is finished, the user data is blocked by the first data blocking unit, and when the blocking is finished, the user data is compressed by the first compression unit;
when the data receiving unit of the node server receives the compressed user data, the data receiving unit transmits the user data to the encryption unit for encryption, and when the encryption is completed, the user data is backed up to the corresponding end server in a snapshot and/or mirror image mode through the data backup unit. .
Further, the data analysis unit is provided with a first data amount difference Δ D1, a second data amount difference Δ D2, a third data amount difference Δ D3, a first data type P1, a second data type P2, a third data type P3, a fourth data type P4 and a fifth data type P5, wherein Δ D1 < Δ D2 < Δ D3,
when the data obtaining unit obtains the user data and the user data is analyzed and completed by the data analyzing unit, the data analyzing unit obtains the actual data amount and calculates the difference value delta D between the actual data amount and the preset data amount, sets delta D to be | D-D0|, and selects the corresponding data type according to the difference value to classify the user data through the first data classifying unit or the second data classifying unit,
when the delta D is less than or equal to the delta D1, the first data classification unit selects a first data type P1 to classify the user data, and the second data classification unit selects a third data type P3 to classify the user data;
when the delta D1 is larger than the delta D5634 and is smaller than or equal to the delta D2, the first data classification unit selects a second data type P2 to classify the user data, and the second data classification unit selects a fourth data type P4 to classify the user data;
when Δ D2 is greater than Δ D and less than or equal to Δ D3, the first data classification unit selects a third data type P3 to classify the user data, and the second data classification unit selects a fifth data type P5 to classify the user data.
Further, the first data block unit and the second data block unit are further provided with a first data block character length H1, a second data block character length H2 and a third data block character length H3, wherein H1 < H2 < H2,
when the first data classification unit or the second data classification unit finishes classifying the data, the first data blocking unit and the second data blocking unit select the character length of the corresponding data block according to the data type to block the data in a single data type,
when the data types are a first data type P1 and a second data type P2, the first data blocking unit sets a character length of a data block to a first data block character length H1,
when the data types are the third data type P3 and the fourth data type P4, the first data blocking unit or the second data blocking unit sets a character length of a data block to a second data block character length H2,
when the data type is the fifth data type P5, the second data blocking unit sets a character length of a data block to a third data block character length H3.
Further, the first data block partitioning unit is further provided with a preset data block number Da, a first node server operation speed V1, a second node server operation speed V2, a third node server operation speed V3, a first data block word length adjustment coefficient k1, a second data block word length adjustment coefficient k2, and a third data block word length adjustment coefficient V3, wherein V1 < V2 < V3, 1 < k1 < k2 < k3 < 2 are set,
when the first data blocking unit selects the ith data block word length Hi to block the user data, setting i to be 2, 3, the data analysis unit analyzes the data which is blocked, calculates the actual data block quantity D of the user data, compares the actual data block quantity D with the first quantity Da of the preset data block, if D is larger than Da, the data analysis unit judges that the data block data is larger, the data analysis unit sends the analysis result to the first data blocking unit, the first data blocking unit receives the result, acquires the maximum operation speed Va of the node server, and selects a corresponding data block word length adjusting coefficient according to the maximum operation speed to adjust the word length of the data block,
when V1 is not more than V and is less than V2, the first data blocking unit selects a first data block word length adjusting coefficient k1 to adjust the data block word length;
when V2 is not more than V and is less than V3, the first data blocking unit selects a second data block word length adjusting coefficient k2 to adjust the data block word length;
when V is larger than or equal to V3, the first data blocking unit selects a third data block word length adjusting coefficient k3 to adjust the data block word length;
when the first data blocking unit selects the j-th data block word length adjusting coefficient kj to adjust the data block word length, j is set to be 1, 2 and 3, and the first data blocking unit sets the adjusted data block word length to be H 'and sets H' to be Hi multiplied by ki.
Further, the second data blocking unit is further provided with a preset data block number Db, a first end server running speed Vb1, a second end server running speed Vb2 and a third end server running speed Vb3, wherein Vb1 is less than Vb2 is less than Vb3,
when the second data blocking unit selects the ith data block word length Hi 'to block the user data, setting i' as 1, 2, the data analysis unit analyzes the blocked data, calculates the actual data block quantity D of the user data, compares the actual data block quantity D with the preset data block second quantity Db, if D is more than Db, the data analysis unit judges that the data block data is larger, the data analysis unit sends the analysis result to the second data blocking unit, the second data blocking unit receives the result, acquires the maximum operation speed Vb of the end server, and selects the hostile data block word length adjusting coefficient according to the maximum operation speed to adjust the data block word length,
when Vb1 is not more than Vb and is less than Vb2, the second data blocking unit selects a first data block word length adjusting coefficient k1 to adjust the word length of the data block;
when Vb2 is not more than Vb and is less than Vb3, the second data blocking unit selects a second data block word length adjusting coefficient k2 to adjust the data block word length;
when Vb is larger than or equal to Vb3, the second data blocking unit selects a third data block word length adjusting coefficient k3 to adjust the data block word length;
when the second data blocking unit selects the j ' th data block word length adjusting coefficient Kj ' to adjust the data block word length, j ' is set to be 1, 2, and 3, and the second data blocking unit sets the adjusted data block word length to be H ″, which is set to be Hi ' × Kj '.
Further, the first compression unit and the second compression unit are each provided with a first data volume D1, a second data volume D2, a third data volume D3, a first compression ratio S1, a second compression ratio S2 and a third compression ratio S3, wherein S1 < S2 < S3,
when the first data blocking unit or the second data blocking unit blocks the user data according to the character length of the selected data block, the first compression unit or the second compression unit obtains the actual data volume D of the user data, selects the corresponding compression ratio according to the actual data volume and compresses the user data,
when D1 < D ≦ D2, the first compression unit compresses the user data and sets a compression ratio of the compressed data to a first compression ratio S1;
when D2 < D ≦ D3, the first compression unit or the second compression unit compresses the user data and sets the compression ratio of the compressed data to the second compression ratio S2;
when D > D3, the second compression unit compresses the user data and sets the compression ratio of the compressed data to the third compression ratio S3.
Further, the first compression unit is further provided with a first difference value Δ Da1 of the number of first data blocks, a first difference value Δ Da2 of the number of second data blocks, a first difference value Δ Da3 of the number of third data blocks, a first compression ratio adjustment coefficient x1, a second compression ratio adjustment coefficient x2 and a third compression ratio adjustment coefficient x3, wherein Δ Da1 < Δ Da2 < Δ Da3, 1 < x1 < x2 < x3 < 2 is set,
when the first compression unit selects the ith compression ratio Si to compress the blocked data and D is larger than Da, setting i to be 1, 2, the data analysis unit calculates the difference value Delta Da between the actual data block quantity D and the first quantity Da of the preset data block and selects a corresponding compression ratio adjustment coefficient according to the difference value to adjust the compression ratio,
when the delta Da1 is not more than delta Da and is less than delta Da2, the first compression unit selects a first compression ratio adjusting coefficient x1 to adjust the compression ratio;
when the delta Da2 is not more than delta Da and is less than delta Da3, the first compression unit selects a second compression ratio adjustment coefficient x2 to adjust the compression ratio;
when the delta Da is larger than or equal to the delta Da3, the first compression unit selects a third compression ratio adjustment coefficient x3 to adjust the compression ratio;
when the first compression unit selects the j-th compression ratio adjustment coefficient xj to adjust the compression ratio, j is set to 1, 2, 3, and the first compression unit sets the adjusted compression ratio to S ', and S' is set to Si × xj.
Further, the second compression unit is further provided with a second difference Δ Db1 of the number of first data blocks, a second difference Δ Db2 of the number of second data blocks, a second difference Δ Db3 of the number of third data blocks, wherein Δ Db1 < Δ Db2 < Δ Db3,
when the second compression unit selects the j-th compression ratio Sj to compress the blocked data and D is more than Db, setting j to be 2, 3, the data analysis unit calculates the difference value delta Db between the actual data block quantity D and the preset data block second quantity Db and selects the corresponding compression ratio adjustment coefficient according to the difference value to adjust the compression ratio,
when the delta Db1 is not more than delta Db and is less than delta Db2, the second compression unit selects a first compression ratio adjustment coefficient x1 to adjust the compression ratio;
when the delta Db2 is not more than delta Db and is less than delta Db3, the second compression unit selects a second compression ratio adjustment coefficient x2 to adjust the compression ratio;
when the delta Db is larger than or equal to the delta Db3, the second compression unit selects a third compression ratio adjustment coefficient x3 to adjust the compression ratio;
when the first compression unit selects the j 'th compression ratio adjustment coefficient xj' to adjust the compression ratio, j 'is set to 1, 2, 3, and the first compression unit sets the adjusted compression ratio to S ″, and sets S ″ -Sj × xj'.
Further, the encryption unit is provided with a first security level E1, a second security level E2, a third security level E3, a first encryption algorithm R1, a second encryption algorithm R2 and a third encryption algorithm R3, wherein E1 < E2 < E3,
when the first compression unit or the second compression unit finishes the compression of the user data, the encryption unit acquires the security level E of the user enterprise and selects a corresponding encryption algorithm according to the security level of the user enterprise to carry out security on the user data,
when E1 is less than or equal to E, the encryption unit selects a first encryption algorithm R1 to encrypt the user data;
when E1 is more than E and less than or equal to E2, the encryption unit selects a second encryption algorithm R2 to encrypt the user data; and when E2 is more than E and less than or equal to E3, the encryption unit selects a third encryption algorithm R3 to encrypt the user data.
Further, another aspect of the present invention provides a multipoint centralized remote backup disaster recovery system based on ethernet reduced transmission, comprising at least one node server and at least three end servers,
the end server comprises a data acquisition unit, a data analysis unit, a second data classification unit, a second data blocking unit, a data transmission unit and a data storage unit, is used for acquiring data of a user and transmitting the data of the user to the node server through the data transmission unit, and when the data volume is large, firstly classifies the data through the second data classification unit and blocks the data through the second data blocking unit, and is also used for compressing the data through the second data compression unit and transmitting the data of the user to the node server through the data transmission unit; the node server is also used for storing the data sent by the node server;
the node server comprises a data receiving unit, a first data classifying unit, a first data blocking unit, a compressing unit, an encrypting unit, an associating unit and a data backup unit, is used for receiving the data transmitted by the endpoint server, classifies the data through the first data classifying unit when the data amount is small, blocks the data through the first data blocking unit, compresses the classified and blocked data through the first compressing unit, encrypts the data through the encrypting unit, establishes association for the data blocks through the associating unit when the encryption is completed, backups the encrypted and/or associated data through the backup unit, and establishes a second backup for the user data through snapshot and/or mirror image technology at the other end server when the backup is completed.
Compared with the prior art, the method has the advantages that the method can be quoted in large enterprises with large data volume and can also be applied in small and medium enterprises with medium or small data volume, whether the data volume of the user data needs to be compressed firstly and then transmitted to the node server for encryption and backup or needs to be transmitted firstly and then compressed is judged according to the comparison result by presetting the data volume in the data analysis unit and comparing the actual data volume of the user data with the preset data volume, and when the data volume is low, the data volume is compressed firstly and then transmitted, so that the operation speed of the user when the user selects the small node server can be ensured, the backup speed of the user data is further improved on the premise of ensuring the effective transmission of the user data, and the data protection capability of the node server is further improved.
Furthermore, the data analysis unit is used for setting a data quantity difference value and a plurality of data types for classifying data, and the data analysis unit is used for selecting the corresponding data types according to the difference value between the actual data quantity and the preset data quantity to classify the user data according to the data quantity difference value, so that the transmission speed from the end server to the node server is increased, the data processing efficiency of the node server is further increased, and the data protection capability of the node server is further improved.
Furthermore, the character length of the data block when the user data is blocked is set in the first data blocking unit and the second data blocking unit, so that the user data is divided into a plurality of data blocks with equal length by the first data blocking unit or the second data blocking unit according to the corresponding data types and is transmitted when the blocking is completed, the transmission speed of the end server to the node server is further improved, the processing efficiency of the node server on the data is further improved, and the protection capability of the node server on the data is further improved.
Furthermore, the data volume is set in the first compression unit and the second compression unit, and the corresponding compression ratio is selected according to the actual data volume of the user data to compress the user data, so that the processing and transmission speed of the user data by the end service and the node server is ensured, the processing efficiency of the end server and the node server on the data is further improved, and the data protection capability of the node server is further improved.
Furthermore, the security level and the encryption algorithm are set in the encryption unit, and the corresponding encryption algorithm is selected according to the obtained security level of the user enterprise to encrypt the user data, so that the user data is protected in a targeted manner, and the data protection capability of the node server is further improved.
Furthermore, the number of preset data blocks, the operation speed of the node server and the word length adjusting coefficient of the data blocks are set in the first data blocking unit, whether the data is large or not is judged according to the comparison result of the actual number of the data blocks and the number of the preset data blocks, and when the data is large, the word length of the data blocks of the node server is adjusted by selecting the corresponding word length adjusting coefficient of the data blocks according to the operation speed of the node server, so that the processing capacity of the node server on the user data is further improved, and the protection capacity of the node server on the data is further improved.
Furthermore, the number of preset data blocks, the running speed of the end server and the word length adjusting coefficient of the data blocks are set in the second data blocking unit, whether the data is large or not is judged according to the comparison result of the actual number of the data blocks and the number of the preset data blocks, and when the data is large, the word length of the data blocks of the node server is adjusted by selecting the corresponding word length adjusting coefficient of the data blocks according to the running speed of the end server, so that the processing capacity of the end server on the user data is further improved, and the protection capacity of the node server on the data is further improved.
Furthermore, the first difference value of the number of the data blocks and the compression ratio adjusting coefficient are set in the first compression unit, and when the number of the data blocks is large, the compression ratio of the node server is adjusted, so that the processing capacity of the node server on the user data is further improved, and the data protection capacity of the node server is further improved.
Furthermore, a second difference value of the number of the data blocks is set in the second compression unit, and when the number of the data blocks is large, a corresponding compression ratio adjusting coefficient is selected for adjusting the compression ratio of the node server, so that the processing capacity of the end server on the user data is further improved, and the data protection capacity of the node server is further improved.
Further, by arranging a plurality of end servers and at least one node server, and arranging a data acquisition unit, a data analysis unit, a second data classification unit, a second data blocking unit, a data transmission unit and a data storage unit at the end servers, when the user data volume is large, the user data is processed by each unit in the end server, and sends the node server when the processing is completed, the user data is encrypted and backed up by the node server, or when the user data volume is small, the data is directly encrypted and backed up after being processed by the node server, because the user data is compressed and then backed up, when a disaster occurs, the user data can be quickly found through backup, and a plurality of processing units for processing the user data in different processing modes are arranged in the node server, so that the protection of the user data is further improved.
Particularly, the end server is also provided with a data storage unit, and after a user data is backed up by the node server, the user data is stored in the corresponding other end server through a snapshot and/or mirror image technology, so that the protection of the user data is further improved.
Drawings
Fig. 1 is a flowchart of a method for disaster recovery by multipoint centralized remote backup based on ethernet reduced transmission according to the present invention;
fig. 2 is a block diagram of a structure of a multipoint centralized remote backup disaster recovery system based on ethernet reduced transmission according to the present invention.
Detailed Description
In order that the objects and advantages of the invention will be more clearly understood, the invention is further described below with reference to examples; it should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
Preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only for explaining the technical principle of the present invention, and do not limit the scope of the present invention.
It should be noted that in the description of the present invention, the terms of direction or positional relationship indicated by the terms "upper", "lower", "left", "right", "inner", "outer", etc. are based on the directions or positional relationships shown in the drawings, which are only for convenience of description, and do not indicate or imply that the device or element must have a specific orientation, be constructed in a specific orientation, and be operated, and thus, should not be construed as limiting the present invention.
Furthermore, it should be noted that, in the description of the present invention, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood by those skilled in the art according to specific situations.
Referring to fig. 1 and fig. 2, fig. 1 is a flowchart of a multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, and fig. 2 is a block diagram of a multipoint centralized remote backup disaster recovery system based on ethernet reduced transmission according to the present invention.
One aspect of the present invention provides a method for multipoint centralized remote backup disaster recovery based on ethernet reduced transmission, comprising:
step s1, acquiring the user data in real time through the data acquisition unit, analyzing the user data through the data analysis unit, determining the data size of the user data according to the analysis result, and selecting priority transmission or selecting priority classification and blocking according to the data size;
step s2, classifying the user data according to data types through a data classification unit, and partitioning the data according to word length when the classification is completed;
step s3, transmitting the user data to the data receiving unit through the data transmitting unit;
step s4, after receiving the user data, the data receiving unit compresses the user data by the compression unit, and encrypts the user data when compression is completed;
step s5, the encrypted user data is backed up once by the data backup unit and stored in any other end server;
the data analysis unit is provided with a preset data volume D0, when the data acquisition unit finishes acquiring the user data, the data analysis unit analyzes the user data to calculate the data volume D of the user data, compares the data volume D of the user with the preset data volume D0, if the data volume D is larger than or equal to D0, the data analysis unit judges that the data volume of the user data is larger, the user data are classified through the second data classification unit, when the classification is finished, the data in each data type are partitioned through the data partitioning unit, when the partitioning is finished, the data blocks are compressed through the second compression unit and then transmitted to the node server through the transmission unit, if the data analysis unit judges that the data volume of the user is not large, if the data analysis unit judges that the data volume of the user is smaller than D0, the data are transmitted to the node server through the data transmission unit, and the user data are classified through the first data classification unit, when the classification is finished, the user data is blocked by the first data blocking unit, and when the blocking is finished, the user data is compressed by the first compression unit;
when the data receiving unit of the node server receives the compressed user data, the data receiving unit transmits the user data to the encryption unit for encryption, and when the encryption is completed, the user data is backed up to the corresponding end server in a snapshot and/or mirror image mode through the data backup unit.
Specifically, the data volume is preset in the data analysis unit, the actual data volume of the user data is compared with the preset data volume, whether the data volume of the user data needs to be compressed firstly and then transmitted to the node server for encryption and backup or needs to be compressed after being transmitted firstly is judged according to the comparison result, when the data volume is low, the data volume is compressed and then transmitted, the operation speed of a user when the user selects a small node server can be guaranteed, and the backup speed of the user data is further improved on the premise that the user data is effectively transmitted.
As shown in fig. 1, in the multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, the data analysis unit has a first data amount difference Δ D1, a second data amount difference Δ D2, a third data amount difference Δ D3, a first data type P1, a second data type P2, a third data type P3, a fourth data type P4, and a fifth data type P5, where Δ D1 < Δ D2 < Δ D3,
when the data obtaining unit obtains the user data and the user data is analyzed and completed by the data analyzing unit, the data analyzing unit obtains the actual data amount and calculates the difference value delta D between the actual data amount and the preset data amount, sets delta D to be | D-D0|, and selects the corresponding data type according to the difference value to classify the user data through the first data classifying unit or the second data classifying unit,
when the delta D is less than or equal to the delta D1, the first data classification unit selects a first data type P1 to classify the user data, and the second data classification unit selects a third data type P3 to classify the user data;
when the delta D1 is larger than the delta D5634 and is smaller than or equal to the delta D2, the first data classification unit selects a second data type P2 to classify the user data, and the second data classification unit selects a fourth data type P4 to classify the user data;
when Δ D2 is greater than Δ D and less than or equal to Δ D3, the first data classification unit selects a third data type P3 to classify the user data, and the second data classification unit selects a fifth data type P5 to classify the user data.
Specifically, the data analysis unit sets a data quantity difference value and multiple data types for classifying data, and the data analysis unit classifies user data by selecting corresponding data types according to the data quantity difference value by the first data classification unit and the second data classification unit according to the difference value between the actual data quantity and the preset data quantity, so that the transmission speed from the end server to the node server is increased, and the data processing efficiency of the node server is further improved.
As shown in fig. 1 and fig. 2, in the method for disaster recovery of multipoint centralized remote backup based on ethernet reduced transmission according to the present invention, the first data block unit and the second data block unit further have a first data block character length H1, a second data block character length H2, and a third data block character length H3, wherein H1 < H2 < H2,
when the first data classification unit or the second data classification unit finishes classifying the data, the first data blocking unit and the second data blocking unit select the character length of the corresponding data block according to the data type to block the data in a single data type,
when the data types are a first data type P1 and a second data type P2, the first data blocking unit sets a character length of a data block to a first data block character length H1,
when the data types are the third data type P3 and the fourth data type P4, the first data blocking unit or the second data blocking unit sets a character length of a data block to a second data block character length H2,
when the data type is the fifth data type P5, the second data blocking unit sets a character length of a data block to a third data block character length H3.
Specifically, the character length of the data block when the user data is blocked is set in the first data blocking unit and the second data blocking unit, so that the user data is divided into a plurality of data blocks with equal length by the first data blocking unit or the second data blocking unit according to the corresponding data type, and the data blocks are transmitted when the blocking is completed, thereby further improving the transmission speed from the end server to the node server, and further improving the processing efficiency of the node server on the data.
As shown in fig. 1 and fig. 2, in the multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, the first compression unit and the second compression unit are respectively provided with a first data volume D1, a second data volume D2, a third data volume D3, a first compression ratio S1, a second compression ratio S2, and a third compression ratio S3, wherein S1 < S2 < S3,
when the first data blocking unit or the second data blocking unit blocks the user data according to the character length of the selected data block, the first compression unit or the second compression unit obtains the actual data volume D of the user data, selects the corresponding compression ratio according to the actual data volume and compresses the user data,
when D1 < D ≦ D2, the first compression unit compresses the user data and sets a compression ratio of the compressed data to a first compression ratio S1;
when D2 < D ≦ D3, the first compression unit or the second compression unit compresses the user data and sets the compression ratio of the compressed data to the second compression ratio S2;
when D > D3, the second compression unit compresses the user data and sets the compression ratio of the compressed data to the third compression ratio S3.
Specifically, the data volume is set in the first compression unit and the second compression unit, and the corresponding compression ratio is selected according to the actual data volume of the user data to compress the user data, so that the speed of processing and transmitting the user data by the end service and the node server is ensured, and the processing efficiency of the end server and the node server on the data is further improved.
Referring to fig. 1 and fig. 2, in the multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, the encryption unit has a first security level E1, a second security level E2, a third security level E3, a first encryption algorithm R1, a second encryption algorithm R2, and a third encryption algorithm R3, wherein E1 < E2 < E3,
when the first compression unit or the second compression unit finishes the compression of the user data, the encryption unit acquires the security level E of the user enterprise and selects a corresponding encryption algorithm according to the security level of the user enterprise to carry out security on the user data,
when E1 is less than or equal to E, the encryption unit selects a first encryption algorithm R1 to encrypt the user data;
when E1 is more than E and less than or equal to E2, the encryption unit selects a second encryption algorithm R2 to encrypt the user data;
and when E2 is more than E and less than or equal to E3, the encryption unit selects a third encryption algorithm R3 to encrypt the user data.
Specifically, the security level and the encryption algorithm are set in the encryption unit, and the corresponding encryption algorithm is selected according to the obtained security level of the user enterprise to encrypt the user data, so that the user data is protected in a targeted manner, and the data protection capability of the node server is further improved.
Continuing to refer to fig. 1 and fig. 2, in the multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, the first data block unit further includes a preset data block number Ya, a first node server operating speed V1, a second node server operating speed V2, a third node server operating speed V3, a first data block word length adjusting coefficient k1, a second data block word length adjusting coefficient k2, and a third data block word length adjusting coefficient V3, where V1 < V2 < V3, 1 < k1 < k2 < k3 < 2,
when the first data blocking unit selects the ith data block word length Hi to block the user data, setting i to be 2, 3, the data analysis unit analyzes the data which is blocked, calculates the actual data block quantity Y of the user data, compares the actual data block quantity Y with the preset data block first quantity Ya, if Y is more than Ya, the data analysis unit judges that the data block data is larger, the data analysis unit sends the analysis result to the first data blocking unit, the first data blocking unit receives the result, acquires the maximum operation speed Va of the node server, and selects a corresponding data block word length adjusting coefficient according to the maximum operation speed to adjust the data block word length,
when V1 is not more than V and is less than V2, the first data blocking unit selects a first data block word length adjusting coefficient k1 to adjust the data block word length;
when V2 is not more than V and is less than V3, the first data blocking unit selects a second data block word length adjusting coefficient k2 to adjust the data block word length;
when V is larger than or equal to V3, the first data blocking unit selects a third data block word length adjusting coefficient k3 to adjust the data block word length;
when the first data blocking unit selects the j-th data block word length adjusting coefficient kj to adjust the data block word length, j is set to be 1, 2 and 3, and the first data blocking unit sets the adjusted data block word length to be H 'and sets H' to be Hi multiplied by ki.
Specifically, the number of preset data blocks, the operation speed of the node server and the word length adjustment coefficient of the data blocks are set in the first data blocking unit, whether the data is large or not is judged according to the comparison result of the actual number of the data blocks and the number of the preset data blocks, and when the data is large, the word length of the data blocks of the node server is adjusted by selecting the corresponding word length adjustment coefficient of the data blocks according to the operation speed of the node server, so that the processing capacity of the node server on user data is further improved, and the protection capacity of the node server on the data is further improved.
Referring to fig. 1 and fig. 2, in the multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, the second data block unit further has a preset data block number Yb, a first end server operation speed Vb1, a second end server operation speed Vb2, and a third end server operation speed Vb3, where Vb1 < Vb2 < Vb3,
when the second data blocking unit selects the ith ' data block word length Hi ' to block the user data, setting i ' as 1, 2, the data analysis unit analyzes the blocked data, calculates the actual data block quantity Y of the user data, compares the actual data block quantity Y with the second quantity Yb of the preset data block, if Y is more than Yb, the data analysis unit judges that the data block data is larger, the data analysis unit sends the analysis result to the second data blocking unit, the second data blocking unit receives the result, acquires the maximum operation Vb speed of the end server, and selects the hostile data block word length adjusting coefficient according to the maximum operation speed to adjust the data block word length,
when Vb1 is not more than Vb and is less than Vb2, the second data blocking unit selects a first data block word length adjusting coefficient k1 to adjust the word length of the data block;
when Vb2 is not more than Vb and is less than Vb3, the second data blocking unit selects a second data block word length adjusting coefficient k2 to adjust the data block word length;
when Vb is larger than or equal to Vb3, the second data blocking unit selects a third data block word length adjusting coefficient k3 to adjust the data block word length;
when the second data blocking unit selects the j ' th data block word length adjusting coefficient Kj ' to adjust the data block word length, j ' is set to be 1, 2, and 3, and the second data blocking unit sets the adjusted data block word length to be H ″, which is set to be Hi ' × Kj '.
Specifically, the number of preset data blocks, the running speed of the end server and the word length adjusting coefficient of the data blocks are set in the second data blocking unit, whether the data is large or not is judged according to the comparison result of the actual number of the data blocks and the number of the preset data blocks, and when the data is large, the word length of the data blocks of the node server is adjusted by selecting the corresponding word length adjusting coefficient of the data blocks according to the running speed of the end server, so that the processing capacity of the end server on user data is further improved, and the protection capacity of the node server on the data is further improved.
Referring to fig. 1 and fig. 2, in the multipoint centralized remote backup disaster recovery method based on ethernet reduced transmission according to the present invention, the first compression unit further has a first difference Δ Ya1 in the number of first data blocks, a first difference Δ Ya2 in the number of second data blocks, a first difference Δ Ya3 in the number of third data blocks, a first compression ratio adjustment coefficient x1, a second compression ratio adjustment coefficient x2, and a third compression ratio adjustment coefficient x3, where Δ Ya1 < Δ Ya2 < Δ Ya3, 1 < x1 < x2 < x3 < 2 are set,
when the first compression unit selects the ith compression ratio Si to compress the blocked data and Y is more than Ya, setting i as 1 and 2, the data analysis unit calculates the difference delta Ya between the number Y of the actual data blocks and the first number Ya of the preset data blocks, setting delta Ya as Y-Ya, and selecting the corresponding compression ratio adjustment coefficient according to the difference to adjust the compression ratio,
when the delta Ya1 is not more than or equal to the delta Ya and is less than the delta Ya2, the first compression unit selects a first compression ratio adjustment coefficient x1 to adjust the compression ratio;
when the delta Ya2 is not more than or equal to the delta Ya and is less than the delta Ya3, the first compression unit selects a second compression ratio adjustment coefficient x2 to adjust the compression ratio;
when the delta Ya is larger than or equal to the delta Ya3, the first compression unit selects a third compression ratio adjustment coefficient x3 to adjust the compression ratio;
when the first compression unit selects the j-th compression ratio adjustment coefficient xj to adjust the compression ratio, j is set to 1, 2, 3, and the first compression unit sets the adjusted compression ratio to S ', and S' is set to Si × xj.
Specifically, the first difference of the number of data blocks and the compression ratio adjusting coefficient are set in the first compression unit, and when the number of the data blocks is large, the compression ratio of the node server is adjusted, so that the processing capacity of the node server on the user data is further improved, and the data protection capacity of the node server is further improved.
With continued reference to fig. 1 and fig. 2, in the method for disaster recovery based on multipoint centralized remote backup of ethernet streamlined transmission according to the present invention, the second compression unit further has a second difference Δ Yb1 between the first number of data blocks, a second difference Δ Yb2 between the second number of data blocks, and a second difference Δ Yb3 between the third number of data blocks, where Δ Yb1 < Δ Yb2 < Δ Yb3,
when the second compression unit selects the jth compression ratio Sj to compress the partitioned data and Y is larger than Yb, setting j to be 2 and 3, the data analysis unit calculates the difference value delta Yb between the actual data block quantity Y and the preset data block second quantity Yb, setting delta Yb to be Y-Yb, and selects a corresponding compression ratio regulating coefficient according to the difference value to regulate the compression ratio,
when the delta Yb1 is not more than the delta Yb and is less than the delta Yb2, the second compression unit selects a first compression ratio adjustment coefficient x1 to adjust the compression ratio;
when the delta Yb2 is not more than the delta Yb and is less than the delta Yb3, the second compression unit selects a second compression ratio adjusting coefficient x2 to adjust the compression ratio;
when the delta Yb is larger than or equal to the delta Yb3, the second compression unit selects a third compression ratio adjustment coefficient x3 to adjust the compression ratio;
when the first compression unit selects the j 'th compression ratio adjustment coefficient xj' to adjust the compression ratio, j 'is set to 1, 2, 3, and the first compression unit sets the adjusted compression ratio to S ″, and sets S ″ -Sj × xj'.
Specifically, the second difference of the number of the data blocks is set in the second compression unit, and when the number of the data blocks is large, the compression ratio of the node server is adjusted by selecting the corresponding compression ratio adjustment coefficient, so that the processing capacity of the end server on the user data is further improved, and the data protection capacity of the node server is further improved.
Another aspect of the present invention provides a multipoint centralized remote backup disaster recovery system based on ethernet reduced transmission, comprising at least one node server and at least three end servers,
the end server comprises a data acquisition unit, a data analysis unit, a second data classification unit, a second data blocking unit, a data transmission unit and a data storage unit, is used for acquiring data of a user and transmitting the data of the user to the node server through the data transmission unit, and when the data volume is large, firstly classifies the data through the second data classification unit and blocks the data through the second data blocking unit, and is also used for compressing the data through the second data compression unit and transmitting the data of the user to the node server through the data transmission unit; and the data sent by the node server is stored.
The node server comprises a data receiving unit, a first data classifying unit, a first data blocking unit, a compressing unit, an encrypting unit, an associating unit and a data backup unit, is used for receiving the data transmitted by the endpoint server, classifies the data through the first data classifying unit when the data amount is small, blocks the data through the first data blocking unit, compresses the classified and blocked data through the first compressing unit, encrypts the data through the encrypting unit, establishes association for the data blocks through the associating unit when the encryption is completed, backups the encrypted and/or associated data through the backup unit, and establishes a second backup for the user data through snapshot and/or mirror image technology at the other end server when the backup is completed.
Specifically, by arranging a plurality of end servers and at least one node server, and arranging a data acquisition unit, a data analysis unit, a second data classification unit, a second data blocking unit, a data transmission unit and a data storage unit at the end servers, when the user data volume is large, the user data is processed by each unit in the end server, and sends the node server when the processing is completed, the user data is encrypted and backed up by the node server, or when the user data volume is small, the data is directly encrypted and backed up after being processed by the node server, because the user data is compressed and then backed up, when a disaster occurs, the user data can be quickly found through backup, and a plurality of processing units for processing the user data in different processing modes are arranged in the node server, so that the protection of the user data is further improved.
Particularly, the end server is also provided with a data storage unit, and after a user data is backed up by the node server, the user data is stored in the corresponding other end server through a snapshot and/or mirror image technology, so that the protection capability of the user data is further improved.
The node servers are also used for creating independent volumes for each end server, so that when a user inputs data subsequently, all data of the user are stored in the same volume, and the user can call the volume conveniently when a catastrophic event occurs.
So far, the technical solutions of the present invention have been described in connection with the preferred embodiments shown in the drawings, but it is easily understood by those skilled in the art that the scope of the present invention is obviously not limited to these specific embodiments. Equivalent changes or substitutions of related technical features can be made by those skilled in the art without departing from the principle of the invention, and the technical scheme after the changes or substitutions can fall into the protection scope of the invention.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention; various modifications and alterations to this invention will become apparent to those skilled in the art. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A multipoint centralized remote backup disaster recovery method based on Ethernet simplified transmission is characterized by comprising the following steps:
step s1, acquiring the user data in real time through the data acquisition unit, analyzing the user data through the data analysis unit, determining the data size of the user data according to the analysis result, and selecting priority transmission or selecting priority classification and blocking according to the data size;
step s2, classifying the user data according to data types through a data classification unit, and partitioning the data according to word length when the classification is completed;
step s3, transmitting the user data to the data receiving unit through the data transmitting unit;
step s4, after receiving the user data, the data receiving unit compresses the user data by the compression unit, and encrypts the user data when compression is completed;
step s5, the encrypted user data is backed up once by the data backup unit and stored in any other end server;
the data analysis unit is provided with a preset data volume D0, when the data acquisition unit finishes acquiring the user data, the data analysis unit analyzes the user data to calculate the data volume D of the user data, compares the data volume D of the user with the preset data volume D0, if the data volume D is larger than or equal to D0, the data analysis unit judges that the data volume of the user data is larger, the user data are classified through the second data classification unit, when the classification is finished, the data in each data type are partitioned through the data partitioning unit, when the partitioning is finished, the data blocks are compressed through the second compression unit and then transmitted to the node server through the transmission unit, if the data analysis unit judges that the data volume of the user is not large, if the data analysis unit judges that the data volume of the user is smaller than D0, the data are transmitted to the node server through the data transmission unit, and the user data are classified through the first data classification unit, when the classification is finished, the user data is blocked by the first data blocking unit, and when the blocking is finished, the user data is compressed by the first compression unit;
when the data receiving unit of the node server receives the compressed user data, the data receiving unit transmits the user data to the encryption unit for encryption, and when the encryption is completed, the user data is backed up to the corresponding end server in a snapshot and/or mirror image mode through the data backup unit.
2. The multipoint centralized remote backup disaster recovery method based on Ethernet reduced transmission as claimed in claim 1, wherein the data analysis unit is provided with a first data amount difference Δ D1, a second data amount difference Δ D2, a third data amount difference Δ D3, a first data type P1, a second data type P2, a third data type P3, a fourth data type P4 and a fifth data type P5, where Δ D1 < Δ D2 < Δ D3,
when the data obtaining unit obtains the user data and the user data is analyzed and completed by the data analyzing unit, the data analyzing unit obtains the actual data amount and calculates the difference value delta D between the actual data amount and the preset data amount, sets delta D to be | D-D0|, and selects the corresponding data type according to the difference value to classify the user data through the first data classifying unit or the second data classifying unit,
when the delta D is less than or equal to the delta D1, the first data classification unit selects a first data type P1 to classify the user data, and the second data classification unit selects a third data type P3 to classify the user data;
when the delta D1 is larger than the delta D5634 and is smaller than or equal to the delta D2, the first data classification unit selects a second data type P2 to classify the user data, and the second data classification unit selects a fourth data type P4 to classify the user data;
when Δ D2 is greater than Δ D and less than or equal to Δ D3, the first data classification unit selects a third data type P3 to classify the user data, and the second data classification unit selects a fifth data type P5 to classify the user data.
3. The Ethernet reduced transport based multipoint centralized remote backup disaster recovery method according to claim 2, wherein said first data block unit and said second data block unit further have a first data block character length H1, a second data block character length H2 and a third data block character length H3, wherein H1 < H2 < H3,
when the first data classification unit or the second data classification unit finishes classifying the data, the first data blocking unit and the second data blocking unit select the character length of the corresponding data block according to the data type to block the data in a single data type,
when the data types are a first data type P1 and a second data type P2, the first data blocking unit sets a character length of a data block to a first data block character length H1,
when the data types are the third data type P3 and the fourth data type P4, the first data blocking unit or the second data blocking unit sets a character length of a data block to a second data block character length H2,
when the data type is the fifth data type P5, the second data blocking unit sets a character length of a data block to a third data block character length H3.
4. The multipoint centralized remote backup disaster recovery method based on Ethernet reduced transmission as claimed in claim 3, wherein the first data block unit further has a preset data block number Ya, a first node server running speed V1, a second node server running speed V2, a third node server running speed V3, a first data block word length adjustment coefficient k1, a second data block word length adjustment coefficient k2 and a third data block word length adjustment coefficient V3, wherein V1 < V2 < V3, 1 < k1 < k2 < k3 < 2 are set,
when the first data blocking unit selects the ith data block word length Hi to block the user data, setting i to be 2, 3, the data analysis unit analyzes the data which is blocked, calculates the actual data block quantity Y of the user data, compares the actual data block quantity Y with the preset data block first quantity Ya, if Y is more than Ya, the data analysis unit judges that the data block data is larger, the data analysis unit sends the analysis result to the first data blocking unit, the first data blocking unit receives the result, acquires the maximum operation speed Va of the node server, and selects a corresponding data block word length adjusting coefficient according to the maximum operation speed to adjust the data block word length,
when V1 is not more than V and is less than V2, the first data blocking unit selects a first data block word length adjusting coefficient k1 to adjust the data block word length;
when V2 is not more than V and is less than V3, the first data blocking unit selects a second data block word length adjusting coefficient k2 to adjust the data block word length;
when V is larger than or equal to V3, the first data blocking unit selects a third data block word length adjusting coefficient k3 to adjust the data block word length;
when the first data blocking unit selects the j-th data block word length adjusting coefficient kj to adjust the data block word length, j is set to be 1, 2 and 3, and the first data blocking unit sets the adjusted data block word length to be H ', and sets H' to be Hi multiplied by kj.
5. The multipoint centralized remote backup disaster recovery method based on Ethernet reduced transmission as claimed in claim 3, wherein said second data block unit further comprises a preset data block number Yb, a first end server operation speed Vb1, a second end server operation speed Vb2 and a third end server operation speed Vb3, wherein Vb1 < Vb2 < Vb3,
when the second data blocking unit selects the ith ' data block word length Hi ' to block the user data, setting i ' as 1, 2, the data analysis unit analyzes the blocked data, calculates the actual data block quantity Y of the user data, compares the actual data block quantity Y with the second quantity Yb of the preset data block, if Y is more than Yb, the data analysis unit judges that the data block data is larger, the data analysis unit sends the analysis result to the second data blocking unit, the second data blocking unit receives the result, acquires the maximum operation Vb speed of the end server, and selects the hostile data block word length adjusting coefficient according to the maximum operation speed to adjust the data block word length,
when Vb1 is not more than Vb and is less than Vb2, the second data blocking unit selects a first data block word length adjusting coefficient k1 to adjust the word length of the data block;
when Vb2 is not more than Vb and is less than Vb3, the second data blocking unit selects a second data block word length adjusting coefficient k2 to adjust the data block word length;
when Vb is larger than or equal to Vb3, the second data blocking unit selects a third data block word length adjusting coefficient k3 to adjust the data block word length;
when the second data blocking unit selects the j ' th data block word length adjusting coefficient Kj ' to adjust the data block word length, j ' is set to be 1, 2, and 3, and the second data blocking unit sets the adjusted data block word length to be H ″, which is set to be Hi ' × Kj '.
6. The Ethernet reduced transmission based multipoint centralized remote backup disaster recovery method according to claim 4 or 5, wherein the first compression unit and the second compression unit are respectively provided with a first data volume D1, a second data volume D2, a third data volume D3, a first compression ratio S1, a second compression ratio S2 and a third compression ratio S3, wherein S1 < S2 < S3,
when the first data blocking unit or the second data blocking unit blocks the user data according to the character length of the selected data block, the first compression unit or the second compression unit obtains the actual data volume D of the user data, selects the corresponding compression ratio according to the actual data volume and compresses the user data,
when D1 < D ≦ D2, the first compression unit compresses the user data and sets a compression ratio of the compressed data to a first compression ratio S1;
when D2 < D ≦ D3, the first compression unit or the second compression unit compresses the user data and sets the compression ratio of the compressed data to the second compression ratio S2;
when D > D3, the second compression unit compresses the user data and sets the compression ratio of the compressed data to the third compression ratio S3.
7. The multipoint centralized remote backup disaster recovery method based on ethernet streamlined transmission according to claim 6, wherein said first compression unit further comprises a first difference Δ Ya1 in the number of first data blocks, a first difference Δ Ya2 in the number of second data blocks, a first difference Δ Ya3 in the number of third data blocks, a first compression ratio adjustment coefficient x1, a second compression ratio adjustment coefficient x2, and a third compression ratio adjustment coefficient x3, wherein Δ Ya1 < Δ Ya2 < Δ Ya3, 1 < x1 < x2 < x3 < 2 are set,
when the first compression unit selects the ith compression ratio Si to compress the blocked data and Y is more than Ya, setting i as 1 and 2, the data analysis unit calculates the difference delta Ya between the number Y of the actual data blocks and the first number Ya of the preset data blocks, setting delta Ya as Y-Ya, and selecting the corresponding compression ratio adjustment coefficient according to the difference to adjust the compression ratio,
when the delta Ya1 is not more than or equal to the delta Ya and is less than the delta Ya2, the first compression unit selects a first compression ratio adjustment coefficient x1 to adjust the compression ratio;
when the delta Ya2 is not more than or equal to the delta Ya and is less than the delta Ya3, the first compression unit selects a second compression ratio adjustment coefficient x2 to adjust the compression ratio;
when the delta Ya is larger than or equal to the delta Ya3, the first compression unit selects a third compression ratio adjustment coefficient x3 to adjust the compression ratio;
when the first compression unit selects the j-th compression ratio adjustment coefficient xj to adjust the compression ratio, j is set to 1, 2, 3, and the first compression unit sets the adjusted compression ratio to S ', and S' is set to Si × xj.
8. The Ethernet reduced transport based multipoint centralized remote backup disaster recovery method according to claim 6, wherein said second compression unit further comprises a second difference Δ Yb1 of the first data block number, a second difference Δ Yb2 of the second data block number, and a second difference Δ Yb3 of the third data block number, wherein Δ Yb1 < Δ Yb2 < Δ Yb3,
when the second compression unit selects the jth compression ratio Sj to compress the partitioned data and Y is larger than Yb, setting j to be 2 and 3, the data analysis unit calculates the difference value delta Yb between the actual data block quantity Y and the preset data block second quantity Yb, setting delta Yb to be Y-Yb, and selects a corresponding compression ratio regulating coefficient according to the difference value to regulate the compression ratio,
when the delta Yb1 is not more than the delta Yb and is less than the delta Yb2, the second compression unit selects a first compression ratio adjustment coefficient x1 to adjust the compression ratio;
when the delta Yb2 is not more than the delta Yb and is less than the delta Yb3, the second compression unit selects a second compression ratio adjusting coefficient x2 to adjust the compression ratio;
when the delta Yb is larger than or equal to the delta Yb3, the second compression unit selects a third compression ratio adjustment coefficient x3 to adjust the compression ratio;
when the first compression unit selects the j 'th compression ratio adjustment coefficient xj' to adjust the compression ratio, j 'is set to 1, 2, 3, and the first compression unit sets the adjusted compression ratio to S ″, and sets S ″ -Sj × xj'.
9. The Ethernet reduced transmission based multipoint centralized remote backup disaster recovery method according to claim 7 or 8, wherein said encryption unit has a first security level E1, a second security level E2, a third security level E3, a first encryption algorithm R1, a second encryption algorithm R2 and a third encryption algorithm R3, wherein E1 < E2 < E3,
when the first compression unit or the second compression unit finishes the compression of the user data, the encryption unit acquires the security level E of the user enterprise and selects a corresponding encryption algorithm according to the security level of the user enterprise to carry out security on the user data,
when E1 is less than or equal to E, the encryption unit selects a first encryption algorithm R1 to encrypt the user data;
when E1 is more than E and less than or equal to E2, the encryption unit selects a second encryption algorithm R2 to encrypt the user data;
and when E2 is more than E and less than or equal to E3, the encryption unit selects a third encryption algorithm R3 to encrypt the user data.
10. A multipoint centralized remote backup disaster recovery system based on Ethernet reduced transmission, comprising the multipoint centralized remote backup disaster recovery method based on Ethernet reduced transmission according to any one of claims 1 to 9, characterized by further comprising at least one node server and at least three end servers,
the end server comprises a data acquisition unit, a data analysis unit, a second data classification unit, a second data blocking unit, a data transmission unit and a data storage unit, is used for acquiring data of a user and transmitting the data of the user to the node server through the data transmission unit, and when the data volume is large, firstly classifies the data through the second data classification unit and blocks the data through the second data blocking unit, and is also used for compressing the data through the second data compression unit and transmitting the data of the user to the node server through the data transmission unit; the node server is also used for storing the data sent by the node server;
the node server comprises a data receiving unit, a first data classifying unit, a first data blocking unit, a compressing unit, an encrypting unit, an associating unit and a data backup unit, is used for receiving data transmitted by the end server, classifies the data through the first data classifying unit when the data amount is small, blocks the data through the first data blocking unit, compresses the classified and blocked data through the first compressing unit, encrypts the data through the encrypting unit, establishes association for the data blocks through the associating unit when the encryption is completed, backups the encrypted and/or associated data through the backup unit, and establishes a second backup for the user data through a snapshot and/or mirror image technology at the other end server when the backup is completed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110550906.0A CN113391951B (en) | 2021-05-20 | 2021-05-20 | Multipoint centralized remote backup disaster recovery method and system based on Ethernet simplified transmission |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110550906.0A CN113391951B (en) | 2021-05-20 | 2021-05-20 | Multipoint centralized remote backup disaster recovery method and system based on Ethernet simplified transmission |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113391951A CN113391951A (en) | 2021-09-14 |
| CN113391951B true CN113391951B (en) | 2021-12-24 |
Family
ID=77618132
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110550906.0A Active CN113391951B (en) | 2021-05-20 | 2021-05-20 | Multipoint centralized remote backup disaster recovery method and system based on Ethernet simplified transmission |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113391951B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113923235B (en) * | 2021-10-21 | 2023-01-24 | 上海威固信息技术股份有限公司 | Data distributed storage system based on cloud computing platform |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102647590A (en) * | 2012-04-17 | 2012-08-22 | 华为终端有限公司 | Image compression method and device |
| CN104407944A (en) * | 2014-12-24 | 2015-03-11 | 浪潮(北京)电子信息产业有限公司 | Disaster recovery backup method and disaster recovery backup system |
| CN105791245A (en) * | 2014-12-26 | 2016-07-20 | 北京航天测控技术有限公司 | Data sending and receiving method and device |
| CN107526655A (en) * | 2017-08-25 | 2017-12-29 | 郑州云海信息技术有限公司 | The data transmission method and system of bandwidth and data volume in a kind of saving transmission link |
| CN110535890A (en) * | 2018-05-23 | 2019-12-03 | 杭州海康威视系统技术有限公司 | The method and apparatus that file uploads |
| CN112395136A (en) * | 2021-01-20 | 2021-02-23 | 深圳市中科鼎创科技股份有限公司 | Continuous data protection system combined with snapshot technology |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9652384B2 (en) * | 2014-12-16 | 2017-05-16 | Intel Corporation | Apparatus, system and method for caching compressed data |
-
2021
- 2021-05-20 CN CN202110550906.0A patent/CN113391951B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102647590A (en) * | 2012-04-17 | 2012-08-22 | 华为终端有限公司 | Image compression method and device |
| CN104407944A (en) * | 2014-12-24 | 2015-03-11 | 浪潮(北京)电子信息产业有限公司 | Disaster recovery backup method and disaster recovery backup system |
| CN105791245A (en) * | 2014-12-26 | 2016-07-20 | 北京航天测控技术有限公司 | Data sending and receiving method and device |
| CN107526655A (en) * | 2017-08-25 | 2017-12-29 | 郑州云海信息技术有限公司 | The data transmission method and system of bandwidth and data volume in a kind of saving transmission link |
| CN110535890A (en) * | 2018-05-23 | 2019-12-03 | 杭州海康威视系统技术有限公司 | The method and apparatus that file uploads |
| CN112395136A (en) * | 2021-01-20 | 2021-02-23 | 深圳市中科鼎创科技股份有限公司 | Continuous data protection system combined with snapshot technology |
Non-Patent Citations (2)
| Title |
|---|
| Hybrid Efficient Genetic Algorithm for Big Data Feature Selection Problems;Tareq Abed Mohammed 等;《Foundations of Science》;20190301;第1-17页 * |
| 网络传输中关键大数据加密存储系统设计;李东琦 等;《现代电子技术》;20190815;第42卷(第16期);第79-82页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113391951A (en) | 2021-09-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100357901C (en) | Method for verifying data between main device and back-up device | |
| CN113391951B (en) | Multipoint centralized remote backup disaster recovery method and system based on Ethernet simplified transmission | |
| CN114090638A (en) | Combined data query method and device based on privacy protection | |
| CN108243256A (en) | A kind of date storage method, encoding device and decoding device | |
| CN101286837B (en) | Message encryption device and method oriented to storage area network | |
| CN116896445A (en) | Satellite network information encryption system and method | |
| CN116847335A (en) | Communication message encryption compression system based on Beidou third generation | |
| CN110209994A (en) | Matrix decomposition recommendation method based on homomorphic cryptography | |
| CN111144455B (en) | Data processing method, device, equipment and readable storage medium | |
| CN113378214B (en) | Continuous data protection method and device based on block chain technology | |
| CN115118529A (en) | Data transmission method based on block chain | |
| He et al. | Byzantine-robust and communication-efficient distributed non-convex learning over non-IID data | |
| Zhao et al. | Minmax sampling: A near-optimal global summary for aggregation in the wide area | |
| CN109753009A (en) | A kind of level monitoring online data management system | |
| CN116319088B (en) | Method for monitoring route node state and collecting information of Internet of things | |
| CN113225180A (en) | Method and system for protecting communication key | |
| EP3008855B1 (en) | System and method for remote maintenance of user units | |
| CN114666053B (en) | Cloud video conference key distribution method and system based on quantum key encryption | |
| CN114650156B (en) | Real-time data transmission method and system for Internet of things | |
| WO2023064804A1 (en) | Encoding/decoding system and method | |
| CN115883679A (en) | Block chain-based data secure transmission method and system | |
| US20200007505A1 (en) | Data processing device and method | |
| CN111970519A (en) | Airborne video return method | |
| CN113595781B (en) | Internet of things communication protocol configuration method and device | |
| Bahjat et al. | Quality of information functions for networked applications |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 530025, Shop 215, 2nd Floor, Building 13, Ronghe and Yuelanshan, No. 5 Changhong Road, Qingxiu District, Nanning City, Guangxi Zhuang Autonomous Region Patentee after: Feichuang Information Technology Co.,Ltd. Country or region after: China Address before: 530022 shop 215, floor 2, building 13, Ronghe yuelanshan, No. 5, Changhong Road, Qingxiu District, Nanning City, Guangxi Zhuang Autonomous Region Patentee before: Guangxi feichuang Information Technology Co.,Ltd. Country or region before: China |
|
| CP03 | Change of name, title or address |