CN114584397B - Distributed cloud data centralized processing method and system - Google Patents

Distributed cloud data centralized processing method and system Download PDF

Info

Publication number
CN114584397B
CN114584397B CN202210456494.9A CN202210456494A CN114584397B CN 114584397 B CN114584397 B CN 114584397B CN 202210456494 A CN202210456494 A CN 202210456494A CN 114584397 B CN114584397 B CN 114584397B
Authority
CN
China
Prior art keywords
cloud data
target cloud
data
network
uncertain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210456494.9A
Other languages
Chinese (zh)
Other versions
CN114584397A (en
Inventor
毛玉姣
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ruizhi Technology Group Co ltd
Original Assignee
Ruizhi Technology Group Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ruizhi Technology Group Co ltd filed Critical Ruizhi Technology Group Co ltd
Priority to CN202210456494.9A priority Critical patent/CN114584397B/en
Publication of CN114584397A publication Critical patent/CN114584397A/en
Application granted granted Critical
Publication of CN114584397B publication Critical patent/CN114584397B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00Network architectures or network communication protocols for network security
    • H04L63/04Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks
    • H04L63/0428Network architectures or network communication protocols for network security for providing a confidential data exchange among entities communicating through data packet networks wherein the data content is protected, e.g. by encrypting or encapsulating the payload
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • G06F16/2458Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2471Distributed queries
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Hardware Design (AREA)
  • Fuzzy Systems (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

The application discloses a distributed cloud data centralized processing method and a distributed cloud data centralized processing system, wherein the distributed cloud data centralized processing method specifically comprises the following steps: acquiring initial cloud data; processing the initial cloud data to obtain target cloud data, and transmitting the target cloud data; in response to the completion of the transmission processing of the target cloud data, inquiring whether uncertain data exist in the target cloud data; if the target cloud data has uncertain data, carrying out uncertain processing on the target cloud data; and responding to the uncertain processing of the target cloud data, and performing centralized processing on the target cloud data. The data transmission method and device can be used for carrying out centralized processing on the data, specifically centralized receiving, centralized fusion and centralized transmission, and safety during data transmission is improved.

Description

Distributed cloud data centralized processing method and system
Technical Field
The present application relates to the field of data processing, and in particular, to a distributed cloud data centralized processing method and system.
Background
With the continuous development of science and technology, data is used more and more frequently, and people have more and more means for processing data, and in the process of processing data, people usually consider the security of a data transmission environment, usually carry out multiple encryption on the transmission process, but neglect the processing of the data, so that no matter how safe the data transmission environment is, hidden danger exists in the data transmission.
Therefore, how to provide a method capable of improving security when processing data is a problem that needs to be solved urgently by those skilled in the art.
Disclosure of Invention
The application provides a distributed cloud data centralized processing method, which specifically comprises the following steps: acquiring initial cloud data; processing the initial cloud data to obtain target cloud data, and transmitting the target cloud data; in response to the completion of the transmission processing of the target cloud data, inquiring whether uncertain data exist in the target cloud data; if the target cloud data has uncertain data, carrying out uncertain processing on the target cloud data; and responding to the uncertain processing of the target cloud data, and performing centralized processing on the target cloud data.
As described above, if there is no uncertain data in the target cloud data, the target cloud data is directly subjected to centralized processing.
As above, a plurality of network receiving nodes are set to perform the acquisition of the initial cloud data at a plurality of times.
As above, the processing the initial cloud data to obtain the target cloud data includes performing fusion of the initial cloud data to obtain the target cloud data.
The above, wherein the target cloud data is defined as
Figure 41744DEST_PATH_IMAGE001
Wherein
Figure 224464DEST_PATH_IMAGE002
The initial cloud data received by the network convergence node i at the time t.
The method as above, wherein the target cloud data
Figure 269780DEST_PATH_IMAGE003
The concrete expression is as follows:
Figure 179837DEST_PATH_IMAGE004
Figure 259788DEST_PATH_IMAGE005
the initial cloud data received by the network fusion node i at the time t, and N represents the number of the network fusion nodes.
As above, the transmitting the target data includes transmitting the target cloud data to the network head node through the plurality of network transmission nodes in response to acquiring the target cloud data.
As described above, the target cloud data fused in the network master node is respectively compared with the initial cloud data of the plurality of network receiving nodes, so as to determine whether uncertain data exist in the target cloud data.
As above, the centralized processing of the target cloud data specifically includes the following sub-steps: setting the slicing time of target cloud data; carrying out fragmentation operation on the target cloud data according to the fragmentation time; and responding to the completion of the fragmentation operation of the target cloud data, and storing the target cloud data subjected to the fragmentation operation.
A distributed cloud data centralized processing system specifically comprises: the system comprises an acquisition unit, a transmission unit, a query unit, an uncertain processing unit and a centralized processing unit; an acquisition unit configured to acquire initial cloud data; the transmission unit is used for processing the initial cloud data to obtain target cloud data and transmitting the target cloud data; the query unit is used for responding to the completion of the transmission processing of the target cloud data and querying whether uncertain data exist in the target cloud data; the uncertain processing unit is used for carrying out uncertain processing on the target cloud data if the target cloud data has uncertain data; and the centralized unit is used for responding to the uncertain processing of the target cloud data and performing centralized processing on the target cloud data.
The application has the following beneficial effects:
the data transmission system can be used for carrying out centralized processing on the data, specifically centralized receiving, centralized fusion and centralized transmission, and can be used for carrying out safe storage after transmission, so that the safety during data transmission and the safety during storage are improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art according to the drawings.
Fig. 1 is a flowchart of a distributed cloud data centralized processing method provided according to an embodiment of the present application;
fig. 2 is an internal structure diagram of a distributed cloud data centralized processing system provided according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application are clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The application relates to a distributed cloud data centralized processing method and system, which can be used for performing centralized processing on data and improving the security during data transmission and storage.
Example one
As shown in fig. 1, a distributed cloud data centralized processing method provided by the present application specifically includes the following steps:
step S110: initial cloud data is obtained.
The initial cloud data is data that can be acquired by a network, and may be a plurality of initial cloud data acquired at different times.
Specifically, a plurality of network receiving nodes are set to acquire initial cloud data at a plurality of moments.
Step S120: and processing the initial cloud data to obtain target cloud data, and transmitting the target cloud data.
Specifically, a plurality of network nodes are arranged to perform centralized transmission processing of target cloud data, wherein the network nodes include a plurality of network transmission nodes, network convergence nodes, network aggregation nodes and the like, and are network nodes as well as network receiving nodes. Wherein step S120 specifically includes the following substeps:
step S1201: and fusing the initial cloud data to obtain target cloud data.
The single initial cloud data is not complete data, and the initial cloud data acquired at multiple moments need to be fused to form target cloud data.
Specifically, one or more network convergence nodes receive initial cloud data from the network receiving node and perform convergence of the initial cloud data, and each network convergence node may receive one type of initial cloud data, or one network convergence node may receive multiple types of initial cloud data.
Since the obtained initial cloud data is of a plurality of types, the target cloud data after fusion may also be of one or more types.
For example, when the network fusion node receives initial cloud data of A, B, C, D, E, etc., where the initial cloud data is A, B, C capable of being fused, and the initial cloud data D, E does not need to be fused, the target cloud data is 3 types, which are respectively target cloud data formed after the initial cloud data A, B, C is fused, and the target cloud data D, E.
The summation function is used for carrying out initial cloud data fusion, and target cloud data formed after the initial cloud data fusion can be defined as
Figure 347830DEST_PATH_IMAGE006
Figure 880442DEST_PATH_IMAGE007
The initial cloud data received by the network convergence node i at the time t.
Wherein the fused target cloud data
Figure 79342DEST_PATH_IMAGE008
The concrete expression is as follows:
Figure 13800DEST_PATH_IMAGE009
wherein
Figure 272743DEST_PATH_IMAGE010
The initial cloud data received by the network fusion node i at the time t, and N represents the number of the network fusion nodes.
Step S1202: and responding to the obtained target cloud data, and transmitting the target data.
Specifically, one or more target cloud data are obtained through response fusion, and the one or more network fusion nodes transmit the fused one or more target cloud data to the network master node through the network transmission node.
The number of the network transmission nodes is one or more, and each target cloud data is transmitted to one or more network general nodes through a corresponding network transmission node. One kind of target cloud data can be transmitted to only one network master node.
In the transmission process, collision and collision are generated when a plurality of network transmission nodes in the communication range simultaneously transmit target cloud data, so the embodiment allocates a specific random time slice according to the number of nodes which may have collision and collision around each network transmission node
Figure 292652DEST_PATH_IMAGE011
I.e. the network transport node i is
Figure 295243DEST_PATH_IMAGE012
Sending the fused target cloud data to a network master node within a time range,
Figure 834940DEST_PATH_IMAGE013
and transmitting the time when the node i initially receives the target cloud data for the network.
In the network transmission node, the node which first sends data is the network transmission node, the node which receives the data and transmits the data to the following node, and the node which sends the data to the network main node passes through is the sub-network transmission node.
A plurality of network transmission nodes which simultaneously transmit data are defined as first-layer nodes, and sub-network transmission nodes which need to pass when the network transmission nodes transmit data to a network main node are defined as second-layer nodes. In one layer of nodes, a plurality of network transmission nodes which simultaneously transmit data may be within communication range of each other. In the nodes of one layer and two layers, the sub-network transmission nodes in the communication coverage range of the network transmission node can be positioned in the same layer or the next layer.
In which random time slices
Figure 530363DEST_PATH_IMAGE014
The concrete expression is as follows:
Figure 37568DEST_PATH_IMAGE015
wherein the content of the first and second substances,
Figure 578271DEST_PATH_IMAGE016
when the communication range of the network transmission node is 50m and the data transmission rate is 1Mbps, the sum of time delays for transmitting data to the network total node by two network transmission nodes with the distance of 0-50m under the condition of no collision and collision is shown.
Figure 487321DEST_PATH_IMAGE017
Specifically, if the network transmission node transmits data to the network master node after 3 sub-network transmission nodes are needed to transmit the data to the network master node, the number of the sub-network transmission nodes is expressed
Figure 822487DEST_PATH_IMAGE018
. Wherein
Figure 816988DEST_PATH_IMAGE019
Indicating the number of nodes that are likely to collide with the network transmission node i.
Figure 161382DEST_PATH_IMAGE020
Indicating the probability that a network transmission node is in the same layer as the nodes in its communication coverage area.
Suppose that M network transmission nodes are randomly distributed, and the number of nodes in the same layer and in the communication range as the network transmission node i is
Figure 924939DEST_PATH_IMAGE021
Then, then
Figure 214362DEST_PATH_IMAGE022
Wherein this applicationPlease calculate the random time slice
Figure 430580DEST_PATH_IMAGE023
The problem that collision and collision are generated when a plurality of network transmission nodes in a communication range send data at the same time is solved. Different from the conventional technology in which a time is randomly defined, in the process of calculating the random time slice, the present embodiment considers parameters such as time delay, the number of network transmission nodes that may collide, and the number of total network transmission nodes, so that the random time slice is calculated
Figure 578664DEST_PATH_IMAGE024
The process is more comprehensive, so that the problem of collision of multiple network transmission nodes can be better solved.
In the data transmission process, the embodiment adopts the mode of node acquisition when initially acquiring data, and the transmission between nodes is used as the transmission path of the data, so that the security of the data during transmission is improved.
Step S130: and responding to the completion of the transmission of the target cloud data, and inquiring whether uncertain data exist in the target cloud data.
Specifically, query of uncertain data in target cloud data is carried out in the network master node.
The data is lost due to network transmission or other reasons, and if part of the data is not normally transmitted due to the loss in the data transmission, the lost data and the data which is not normally transmitted are uncertain data. The uncertain data are specifically one or more initial cloud data before fusion.
In the query process of the uncertain data, the plurality of network receiving nodes acquire the initial cloud data at a plurality of moments, so that the target cloud data fused in the network master node is respectively compared with the initial cloud data of the plurality of network receiving nodes.
Specifically, if the fused target cloud data is compared with the initial cloud data of the network receiving node, and if the target cloud data includes all elements of the initial cloud data, it is determined that the target cloud data does not have uncertain data, and step S150 is executed according to the target cloud data. If only part of the initial cloud data is included, it is determined that the uncertain data exists, and which initial cloud data the uncertain data is according to the comparison, step S140 is performed.
In the embodiment, the initial cloud data is compared with the target cloud data in the network master node, rather than the initial cloud data in the network transmission node, so that the possibility of fundamental abnormality of the initial cloud data is eliminated, and if the target cloud data contains all the elements of the initial cloud data, at least the target cloud data is considered to be free of data elements, so that the problem of data abnormality caused by data element loss is solved.
Step S140: and carrying out uncertain processing on the target cloud data.
Specifically, uncertain processing of uncertain data in target cloud data is performed in a network master node.
Step S140 specifically includes the following substeps:
step S1401: and judging whether the uncertain data can be replaced.
Specifically, the target cloud data with uncertain data is replaced by the new target cloud data generated by re-fusing the same initial cloud data.
Judging whether the uncertain data can be replaced, judging whether the time for generating the new target cloud data exceeds a specified threshold, if so, executing the step S1402, otherwise, directly executing the step S150 on the generated new target cloud data.
Step S1402: and selecting temporary data to form new target cloud data.
The temporary data is obtained by selecting a data element with a part similar to the missing data from the target cloud data to copy the data element as "temporary data", forming new target cloud data by the data element in the temporary data and the original target cloud data, and executing step S150 according to the target cloud data after the uncertain processing.
In step S130, since the uncertain data is specifically determined according to the initial cloud data, the similarity between other data in the target cloud data and the uncertain data is determined at this time, and the data with the similarity greater than the specified threshold is used as the temporary data.
The similarity between the data elements can be determined by Euclidean distance, minimum hash algorithm and locality sensitive hash algorithm.
The data transmission safety is improved, meanwhile, the data are detected, and the data transmission safety is enhanced through a plurality of angles.
Step S150: and carrying out centralized processing on the target cloud data.
The centralized processing of the target cloud data comprises the slicing operation of the target cloud data and the storage processing of the sliced cloud data.
Specifically, after the transmission processing of the target cloud data is performed, the plurality of network master nodes may respectively and sequentially receive the target cloud data, and in order to ensure that the data is not stolen or leaked, the network master nodes perform a fragmentation operation on the original target cloud data or the generated new target cloud data, where the following target cloud data represents the original target cloud data in step S130 or the new target cloud data generated in step S140.
The network master node receiving the target cloud data is a first network master node, and the network master node not receiving the target cloud data is a second network master node.
Specifically, the slicing operation refers to the step of slicing target cloud data (or new target cloud data) received in the network master node
Figure 196727DEST_PATH_IMAGE025
) Randomly slicing into k slices, the sum of the k data slices being equal to
Figure 404855DEST_PATH_IMAGE025
The step S150 specifically includes the following sub-steps:
step S1501: and setting target cloud data slicing time.
Wherein the time of the target cloud data fragmentation stage is assumed to be
Figure 108369DEST_PATH_IMAGE026
To
Figure 794565DEST_PATH_IMAGE027
That is, the total time period of the target cloud data fragmentation stage is
Figure 532714DEST_PATH_IMAGE028
Then the intermediate time of the target cloud data fragmentation stage
Figure 646163DEST_PATH_IMAGE029
Step S1502: and carrying out fragmentation operation on the target cloud data according to the fragmentation time.
Specifically, in
Figure 587706DEST_PATH_IMAGE030
At the moment, the first network master node transmits target cloud data
Figure 77593DEST_PATH_IMAGE031
Randomly dividing into k pieces, wherein the sum of the k target cloud data pieces is equal to
Figure 404669DEST_PATH_IMAGE032
At the middle moment of the target cloud data fragmentation stage
Figure 954599DEST_PATH_IMAGE033
And reserving one target cloud data fragment per se. To be cut to
Figure 632705DEST_PATH_IMAGE034
At the moment, the first network master node encrypts the rest k-1 pieces of target cloud data and then randomly sends the encrypted target cloud data to a second network master node h hops away from the first network master node.
Due to the fact that data fragmentation operation is conducted, even if a network attacker eavesdrops the fragment data sent by the network attacker, the fragment data is not the original target cloud data, and the safety of data transmission is enhanced.
Step S1503: and responding to the completion of the fragmentation operation of the target cloud data, and storing the fragmented target cloud data.
Specifically, the fragmented target cloud data is obtained from the second network master node and stored.
Specifically, a network storage node is arranged, and the network storage node acquires fragmented target cloud data in a second network master node and fuses the fragmented target cloud data into integral target data in the network storage node for storage.
According to the storage method provided by the embodiment, even if a network attacker eavesdrops the sent fragment data, the fragment data is not the original target cloud data, and the security of the stored data is enhanced.
As shown in fig. 2, the present application provides a distributed cloud data centralized processing system, which specifically includes: an obtaining unit 210, a transmitting unit 220, a querying unit 230, an uncertain processing unit 240, and a centralized processing unit 250.
The obtaining unit 210 is configured to obtain initial cloud data.
The transmission unit 220 is connected to the obtaining unit 210, and is configured to process the initial cloud data to obtain target cloud data, and transmit the target cloud data.
The query unit 230 is connected to the transmission unit 220, and configured to query whether uncertain data exists in the target cloud data in response to completion of the transmission processing of the target cloud data.
The uncertain processing unit 240 is connected to the querying unit 230, and is configured to perform uncertain processing on the target cloud data if the target cloud data has uncertain data.
The centralized unit 250 is connected to the query unit 230 and the uncertain processing unit 240, respectively, and is configured to perform centralized processing on the target cloud data in response to completing uncertain processing on the target cloud data or the target cloud data does not have uncertain data.
The application has the following beneficial effects:
the data transmission system can be used for carrying out centralized processing on the data, specifically centralized receiving, centralized fusion and centralized transmission, and can be used for carrying out safe storage after transmission, so that the safety during data transmission and the safety during storage are improved.
Although the present application has been described with reference to examples, which are intended to be illustrative only and not to be limiting of the application, changes, additions and/or deletions may be made to the embodiments without departing from the scope of the application.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present application, and shall be covered by the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (4)

1. A distributed cloud data centralized processing method is characterized by specifically comprising the following steps:
acquiring initial cloud data;
processing the initial cloud data to obtain target cloud data, and transmitting the target cloud data;
in response to the completion of the transmission of the target cloud data, inquiring whether uncertain data exist in the target cloud data;
if the target cloud data has uncertain data, carrying out uncertain processing on the target cloud data;
in response to the completion of the uncertain processing of the target cloud data, performing centralized processing on the target cloud data;
the processing of the initial cloud data to obtain target cloud data, and the transmission of the target cloud data comprises the following substeps:
fusing the initial cloud data to obtain target cloud data; the target cloud data is defined as
Figure 643172DEST_PATH_IMAGE001
Wherein
Figure 553359DEST_PATH_IMAGE002
The initial cloud data is received by the network fusion node i at the moment t; target cloud data
Figure 478590DEST_PATH_IMAGE003
The concrete expression is as follows:
Figure 437319DEST_PATH_IMAGE004
Figure 498816DEST_PATH_IMAGE002
the method comprises the steps that initial cloud data received by a network fusion node i at the moment t, and N represents the number of network fusion nodes;
responding to the obtained target cloud data, and transmitting the target data; one or more network fusion nodes transmit the fused one or more target cloud data to a network master node through a network transmission node in response to the obtained one or more target cloud data; wherein a specific random time slice is determined during transmission
Figure 579904DEST_PATH_IMAGE005
Network transmission node i in
Figure 726852DEST_PATH_IMAGE006
Sending the fused target cloud data to a network master node within a time range,
Figure 754851DEST_PATH_IMAGE007
the time when the network transmission node i initially receives the target cloud data;
random time slice
Figure 733171DEST_PATH_IMAGE005
The concrete expression is as follows:
Figure 657265DEST_PATH_IMAGE008
wherein the content of the first and second substances,
Figure 557087DEST_PATH_IMAGE009
the sum of time delays for sending data to a network total node by two network transmission nodes with the distance of 0-50m under the condition of no collision and collision when the communication range of the network transmission nodes is 50m and the data transmission rate is 1 Mbps;
Figure 919936DEST_PATH_IMAGE010
indicates the number of sub-network transmission nodes communicating with the network transmission node i,
Figure 956025DEST_PATH_IMAGE011
indicating the number of nodes in the collision range with the network transmission node i,
Figure 316599DEST_PATH_IMAGE012
representing the probability that a certain network transmission node is in the same layer with the node in the communication coverage range;
the uncertain processing of the target cloud data specifically comprises the following substeps of uncertain processing of the uncertain data:
judging whether the uncertain data can be replaced or not; the method comprises the steps of generating new target cloud data by re-fusing the same initial cloud data, and replacing the target cloud data with uncertain data with the new target cloud data;
if the time for generating the new target cloud data exceeds a specified threshold, selecting temporary data to form new target cloud data; if the time for generating the new target cloud data does not exceed a specified threshold, performing centralized processing on the target cloud data;
the centralized processing of the target cloud data specifically comprises the following substeps:
setting the slicing time of target cloud data; wherein the time of the target cloud data fragmentation stage is assumed to be
Figure 500456DEST_PATH_IMAGE013
To
Figure 604678DEST_PATH_IMAGE014
That is, the total time period of the target cloud data fragmentation stage is
Figure 495274DEST_PATH_IMAGE015
Then the intermediate time of the target cloud data fragmentation stage
Figure 89066DEST_PATH_IMAGE016
Carrying out fragmentation operation on the target cloud data according to the fragmentation time; firstly, defining a network total node which receives target cloud data as a first network total node, and defining a network total node which does not receive the target cloud data as a second network total node; in that
Figure 697902DEST_PATH_IMAGE013
At the moment, the first network master node transmits target cloud data
Figure 605815DEST_PATH_IMAGE017
Randomly dividing into k pieces, wherein the sum of the k target cloud data pieces is equal to
Figure 413234DEST_PATH_IMAGE017
At the middle moment of the target cloud data fragmentation stage
Figure 381190DEST_PATH_IMAGE018
One target cloud data fragment is reserved; to be cut to
Figure 211743DEST_PATH_IMAGE014
At the moment, the first network master node encrypts the rest k-1 pieces of target cloud data and then randomly sends the encrypted target cloud data to a second network master node h hops away from the first network master node;
and responding to the completion of the fragmentation operation of the target cloud data, and storing the target cloud data subjected to the fragmentation operation.
2. The distributed cloud data centralized processing method of claim 1, wherein the transmitting the target data includes transmitting the target cloud data to a network head node through a plurality of network transmission nodes in response to obtaining the target cloud data.
3. The distributed cloud data centralized processing method of claim 2, wherein the fused target cloud data in the network master node is compared with the initial cloud data of the plurality of network receiving nodes, respectively, to determine whether uncertain data exist in the target cloud data.
4. A distributed cloud data centralized processing system, configured to perform the method according to any one of claims 1 to 3, specifically comprising: the system comprises an acquisition unit, a transmission unit, a query unit, an uncertain processing unit and a centralized processing unit;
an acquisition unit configured to acquire initial cloud data;
the transmission unit is used for processing the initial cloud data to obtain target cloud data and transmitting the target cloud data;
the query unit is used for responding to the completion of the transmission processing of the target cloud data and querying whether uncertain data exist in the target cloud data;
the uncertain processing unit is used for carrying out uncertain processing on the target cloud data if the target cloud data has uncertain data;
and the centralized unit is used for responding to the uncertain processing of the target cloud data and performing centralized processing on the target cloud data.
CN202210456494.9A 2022-04-28 2022-04-28 Distributed cloud data centralized processing method and system Active CN114584397B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210456494.9A CN114584397B (en) 2022-04-28 2022-04-28 Distributed cloud data centralized processing method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210456494.9A CN114584397B (en) 2022-04-28 2022-04-28 Distributed cloud data centralized processing method and system

Publications (2)

Publication Number Publication Date
CN114584397A CN114584397A (en) 2022-06-03
CN114584397B true CN114584397B (en) 2022-07-29

Family

ID=81784722

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210456494.9A Active CN114584397B (en) 2022-04-28 2022-04-28 Distributed cloud data centralized processing method and system

Country Status (1)

Country Link
CN (1) CN114584397B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012086919A2 (en) * 2010-12-24 2012-06-28 (주)케이티 Distributed storage system including plurality of proxy servers, method for managing object thereof, and storage medium readable by computer
CN102883274A (en) * 2012-08-31 2013-01-16 北京邮电大学 Traffic safety management (TSM) information multihop broadcasting method
CN108574729A (en) * 2018-03-20 2018-09-25 深圳众厉电力科技有限公司 A kind of intelligent transformer substation cloud system
CN111065169A (en) * 2019-12-31 2020-04-24 北京中宸泓昌科技有限公司 Method for time division multiplexing of autonomous network system channel
CN111339192A (en) * 2020-02-21 2020-06-26 深圳供电局有限公司 Distributed edge computing data storage system
CN112188553A (en) * 2019-07-01 2021-01-05 大唐移动通信设备有限公司 Data transmission method and device of 5G system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200065149A1 (en) * 2018-08-24 2020-02-27 Embotics Corporation Method and system for selection of cloud-computing services

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012086919A2 (en) * 2010-12-24 2012-06-28 (주)케이티 Distributed storage system including plurality of proxy servers, method for managing object thereof, and storage medium readable by computer
CN102883274A (en) * 2012-08-31 2013-01-16 北京邮电大学 Traffic safety management (TSM) information multihop broadcasting method
CN108574729A (en) * 2018-03-20 2018-09-25 深圳众厉电力科技有限公司 A kind of intelligent transformer substation cloud system
CN112188553A (en) * 2019-07-01 2021-01-05 大唐移动通信设备有限公司 Data transmission method and device of 5G system
CN111065169A (en) * 2019-12-31 2020-04-24 北京中宸泓昌科技有限公司 Method for time division multiplexing of autonomous network system channel
CN111339192A (en) * 2020-02-21 2020-06-26 深圳供电局有限公司 Distributed edge computing data storage system

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于压缩感知的传感器网络数据采集技术研究;李丹;《中国优秀硕士学位论文全文数据库(电子期刊)》;20160715;全文 *

Also Published As

Publication number Publication date
CN114584397A (en) 2022-06-03

Similar Documents

Publication Publication Date Title
US11240301B2 (en) Decentralized ledger system and method for enterprises
KR102406020B1 (en) Apparatus and method for processing distributed consensus on decentralized byzantene fault tolerance
US11411721B2 (en) Systems and methods for selecting and utilizing a committee of validator nodes in a distributed system
CN112235379B (en) Block chain bottom layer shared storage method
CN111052091B (en) Method for forming consensus in network and node constituting the network
US20200007558A1 (en) Information verification system, information verification device, method and program
CN111506656B (en) Consensus processing method and device for block chain system, intelligent device and storage medium
CN110166249B (en) Information transmission method, device, verification end and computer readable storage medium
CN113708929B (en) Method for regularly pushing quantum key by edge gateway of Internet of things
CN106559166A (en) For condition detection method and equipment in distributed processing system(DPS) based on fingerprint
WO2018112869A1 (en) Alarm synchronization method and system
CN111930599B (en) Operation and maintenance data processing method and device of cloud service system and storage medium
CN114584397B (en) Distributed cloud data centralized processing method and system
Bonomi et al. Practical Byzantine reliable broadcast on partially connected networks
CN107743097B (en) Multicast method and device based on SDN network
Perumalla et al. Block chain-based access control and intrusion detection system in iod
CN112667928A (en) Prefix and identification data secure subscription method and system based on Handle system
CN115314228B (en) Unmanned aerial vehicle identity authentication method, device and system
CN111651171A (en) Interface version deployment method and device, electronic equipment and storage medium
CN111629022A (en) Practical Byzantine fault-tolerant node setting method
CN110944052A (en) File transmission method, device, system, electronic equipment and storage medium
CN106027649A (en) Data collection method of distributed data system and the distributed data system
CN115174561A (en) File segmented transmission method and system
Hasegawa et al. Quick notification of block generation using bloom filter in a blockchain
CN108881285B (en) Big data implementation control system based on internet network security

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant