CN114650178B - Big data exchange method and system - Google Patents
Big data exchange method and system Download PDFInfo
- Publication number
- CN114650178B CN114650178B CN202210308064.2A CN202210308064A CN114650178B CN 114650178 B CN114650178 B CN 114650178B CN 202210308064 A CN202210308064 A CN 202210308064A CN 114650178 B CN114650178 B CN 114650178B
- Authority
- CN
- China
- Prior art keywords
- data exchange
- data
- request
- exchange
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L43/00—Arrangements for monitoring or testing data switching networks
- H04L43/04—Processing captured monitoring data, e.g. for logfile generation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1095—Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Data Mining & Analysis (AREA)
- Computer Hardware Design (AREA)
- Computer Security & Cryptography (AREA)
- Computing Systems (AREA)
- General Engineering & Computer Science (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
The invention relates to a big data exchange method and a system, wherein the method comprises the following steps: when a client sends a data exchange request to a data server, the data server verifies the client after receiving the data exchange request, the data exchange request and verification information are synchronized to a switching network system after the verification is passed, the switching network system identifies exchange contents contained in the data exchange request, verification characteristics are extracted according to the verification information, a data exchange monitoring unit matches data exchange channels of the data server and the client according to the exchange contents and the verification characteristics, a time controller using the data exchange channels is constructed in the matched data exchange channels, the time controller is used for setting a shutdown period when the client and the data server use the data exchange channels for data exchange, and the matched data exchange channels are closed after the set shutdown period is ended; and if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel.
Description
Technical Field
The invention relates to the technical field of Internet big data, in particular to a big data exchange method and a big data exchange system.
Background
With the increasingly updated internet of things and the continuously mined big data of electronic commerce, data exchange and fusion between electronic commerce data islands are started, and the big data are often required to be shared or exchanged after fusion. In general, when large data exchange is performed, the large data exchange is formed in a local area network, data content to be exchanged is imported through a data exchange unit and sent to an exchange end, and when exchange is required to be requested again, the exchange request is required to be identified again to obtain the content. In addition, during data exchange, the request command of the client is easy to hijack, so that the client can be disguised to send the request command to the server, and a large amount of data is leaked.
Disclosure of Invention
Accordingly, an objective of the present invention is to provide a method and a system for exchanging big data, so as to solve the above-mentioned problems in the prior art.
In order to achieve the above purpose, the present invention provides the following technical solutions:
the big data exchange method is characterized by comprising the following steps:
when a client sends a data exchange request to a data server, the data server verifies the client after receiving the data exchange request, the data exchange request and verification information are synchronized to a switching network system after the verification is passed, the switching network system identifies exchange contents contained in the data exchange request, verification characteristics are extracted according to the verification information, a data exchange monitoring unit matches data exchange channels of the data server and the client according to the exchange contents and the verification characteristics, a time controller using the data exchange channels is constructed in the matched data exchange channels, the time controller is used for setting a turn-off period when the client and the data server use the data exchange channels for data exchange, and the matched data exchange channels are turned off after the set turn-off period is ended; and if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel.
Further, the switching network system records the data switching request and the verification feature extracted from the switching content and the verification information contained in the data switching request, correspondingly stores the data switching request, the switching content and the verification feature in the storage unit, and simultaneously records and stores the data switching channels matched with the data switching monitoring unit in the same storage unit as the data switching request together through the tracking unit to form a matching sub-table;
in response, when the same data exchange request is sent again by the same client, the exchange network system loads the extracted exchange content, the verification feature and the data exchange channel corresponding to the matching sub-table to finish data exchange between the client and the data server, and after the set shutdown period is ended, the matched data exchange channel is closed.
The invention also provides a big data exchange system, which comprises:
at least one data server is provided and,
providing at least one client, and providing at least one switching network system;
the switching network system includes:
a plurality of data exchange channels;
at least one data exchange monitoring unit;
the device comprises an identification unit, a recording unit, a storage unit, a tracking unit, a synthesis unit and a loading unit;
when the client sends a data exchange request to the data server, the data server verifies the client after receiving the data exchange request, and synchronizes the data exchange request and verification information to the exchange network system after the verification is passed;
the identification unit is used for identifying exchange content contained in the data exchange request and extracting verification features according to the verification information;
the recording unit is used for recording the data exchange request and the verification characteristics extracted from the exchange content and the verification information contained in the data exchange request, and correspondingly storing the data exchange request, the exchange content and the verification characteristics in the storage unit;
the tracking unit records and stores the data exchange channels matched with the data exchange monitoring unit in the same storage unit as the data exchange request together to form a matching sub-table;
the synthesis unit is used for merging a plurality of matching sub-tables to form a matching table.
Further, the data exchange monitoring unit has:
a data exchange time limit control module for generating a time controller according to exchange content contained in the data exchange request; the system also comprises a request command monitoring module and a freezing module;
the time controller is used for matching the turn-off period based on the size of the exchange content contained in the data exchange request;
if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel;
the request command monitoring module is used for monitoring the request times of the same client in a set period, and if the request times are larger than a set threshold in the set period, the freezing module freezes the connection between the client and the data server.
Further, the time controller is used for constructing a time controller using the data exchange channel in the matched data exchange channel after the data exchange monitoring unit matches the data exchange channels of the data server and the client according to the exchange content and the verification characteristic, the time controller is used for setting a shutdown period when the client and the data server use the data exchange channel to exchange data, and the matched data exchange channel is closed after the set shutdown period is stopped.
Further, the off period is set by the exchange content contained in the data exchange request.
Further, when the same client sends the same data exchange request again, the loading unit loads the matching table, acquires a matching sub-table corresponding to the data exchange request from the matching table, extracts the exchange content, the verification feature and the data exchange channel corresponding to the matching sub-table to complete data exchange between the client and the data server, and closes the matched data exchange channel after a set shutdown period is ended.
In order to prevent data from being attacked, a data exchange monitoring unit is utilized to verify a client, a time controller using a data exchange channel is also constructed in a matched data exchange channel, the time controller is used for setting a turn-off period when the client and the data server use the data exchange channel to exchange data, and the matched data exchange channel is turned off after the set turn-off period is cut off; if the turn-off period exceeds the set fusing threshold, the matched data exchange channel is automatically closed, so that a large amount of data exchange is prevented at one time, meanwhile, the request command monitoring module is used for monitoring the request times of the same client in the set period, and if the request times in the set period are greater than the set threshold, the freezing module freezes the connection between the client and the data server.
Meanwhile, by forming a matching table, when the same data exchange request is sent again by the same client, the exchange network system loads the extracted exchange content, the verification feature and the data exchange channel corresponding to the matching table to finish data exchange between the client and the data server, and after the set shutdown period is ended, the matched data exchange channel is closed. In this way, the same data exchange request sent again by the same client does not need to be identified and processed from the new, and the corresponding data exchange channel can be directly matched to complete the data exchange between the client and the data server.
Drawings
FIG. 1 is a flow chart of the method of the present invention;
fig. 2 is a schematic diagram of the framework of the present invention.
Detailed Description
The present invention will be described in detail below with reference to fig. 1 to 2 in conjunction with the accompanying drawings.
Referring to fig. 1, the present invention provides a big data exchange method, comprising the steps of:
when a client sends a data exchange request to a data server, the data server verifies the client after receiving the data exchange request, the data exchange request and verification information are synchronized to a switching network system after the verification is passed, the switching network system identifies exchange contents contained in the data exchange request, verification characteristics are extracted according to the verification information, a data exchange monitoring unit matches data exchange channels of the data server and the client according to the exchange contents and the verification characteristics, a time controller using the data exchange channels is constructed in the matched data exchange channels, the time controller is used for setting a turn-off period when the client and the data server use the data exchange channels for data exchange, and the matched data exchange channels are turned off after the set turn-off period is ended; and if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel.
In the above, the switching network system records the data switching request and the verification feature extracted from the switching content and the verification information included in the data switching request, stores the data switching request, the switching content and the verification feature in the storage unit correspondingly, and records and stores the data switching channels matched with the data switching monitoring unit in the same storage unit as the data switching request together through the tracking unit to form a matching sub-table; in response, when the same data exchange request is sent again by the same client, the exchange network system loads the extracted exchange content, the verification feature and the data exchange channel corresponding to the matching sub-table to finish data exchange between the client and the data server, and after the set shutdown period is ended, the matched data exchange channel is closed. In this way, the same data exchange request sent again by the same client does not need to be identified and processed from the new, and the corresponding data exchange channel can be directly matched to complete the data exchange between the client and the data server.
In the above, in order to prevent data from being attacked, in addition to the data server verifying the client, a time controller using the data exchange channel is also constructed in the matched data exchange channel by using the data exchange monitoring unit, where the time controller is used for setting a shutdown period when the client and the data server use the data exchange channel to exchange data, and after the set shutdown period is stopped, the matched data exchange channel is closed; if the turn-off period exceeds the set fusing threshold, the matched data exchange channel is automatically closed, so that a large amount of data exchange is prevented at one time, meanwhile, the request command monitoring module is used for monitoring the request times of the same client in the set period, and if the request times in the set period are greater than the set threshold, the freezing module freezes the connection between the client and the data server.
In the above, the off period set by the time controller is set according to the size of the exchange content included in the data exchange request, so when the off period corresponding to the data exchange content exceeding the set size exceeds the set fusing threshold, the matched data exchange channel is automatically closed and cannot transmit data, so that even if the data exchange request is hijacked and tampered, the data exchange request can only be obtained to disguise, the request command monitoring module is used for monitoring the request times of the same client in the set period, and if the request times in the set period are greater than the set threshold, the freezing module freezes the connection between the client and the data server.
Referring to fig. 2, the present invention also provides a big data exchange system, including:
providing at least one data server, said data server being a store of big data,
providing at least one client, and sending a data exchange request to a data server by the client;
and providing at least one switching network system;
the switching network system includes:
a plurality of data exchange channels;
at least one data exchange monitoring unit;
the device comprises an identification unit, a recording unit, a storage unit, a tracking unit, a synthesis unit and a loading unit;
when the client sends a data exchange request to the data server, the data server verifies the client after receiving the data exchange request, and synchronizes the data exchange request and verification information to the exchange network system after the verification is passed;
the identification unit is used for identifying exchange content contained in the data exchange request and extracting verification features according to the verification information;
the recording unit is used for recording the data exchange request and the verification characteristics extracted from the exchange content and the verification information contained in the data exchange request, and correspondingly storing the data exchange request, the exchange content and the verification characteristics in the storage unit;
the tracking unit records and stores the data exchange channels matched with the data exchange monitoring unit in the same storage unit as the data exchange request together to form a matching sub-table;
the synthesis unit is used for merging a plurality of matching sub-tables to form a matching table.
In the above, the data exchange monitoring unit has:
a data exchange time limit control module for generating a time controller according to exchange content contained in the data exchange request; the system also comprises a request command monitoring module and a freezing module;
the time controller is used for matching the turn-off period based on the size of the exchange content contained in the data exchange request;
if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel;
the request command monitoring module is used for monitoring the request times of the same client in a set period, and if the request times are greater than a set threshold value in the set period, the freezing module freezes the connection between the client and the data server;
the time controller is used for constructing a time controller using the data exchange channel in the matched data exchange channel after the data exchange monitoring unit matches the data exchange channels of the data server and the client according to the exchange content and the verification characteristic, the time controller is used for setting a turn-off period when the client and the data server use the data exchange channel for data exchange, and the matched data exchange channel is turned off after the set turn-off period is cut off;
when a client sends a data exchange request to a data server, the data server verifies the client after receiving the data exchange request, after the data exchange request passes the verification, the data exchange request and verification information are synchronized to a switching network system, the switching network system identifies exchange content contained in the data exchange request, and extracts verification features according to the verification information, the switching network system records the data exchange request and the verification features extracted by the exchange content and the verification information contained in the data exchange request, correspondingly stores the data exchange request, the exchange content and the verification features in a storage unit, the data exchange monitoring unit matches data exchange channels of the data server and the client according to the exchange content and the verification features, and the data exchange channels matched by the data exchange monitoring unit are recorded and stored in the same storage unit as the data exchange request together through a tracking unit to form a matching sub-table; a time controller using the data exchange channel is constructed in the matched data exchange channel, and the time controller is used for setting a turn-off period when the client and the data server use the data exchange channel to exchange data, and the matched data exchange channel is closed after the set turn-off period is cut off; if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel; in response, when the same data exchange request is sent again by the same client, the exchange network system loads the extracted exchange content, the verification feature and the data exchange channel corresponding to the matching sub-table to finish data exchange between the client and the data server, and after the set shutdown period is ended, the matched data exchange channel is closed. In this way, the same data exchange request sent again by the same client does not need to be identified and processed from the new, and the corresponding data exchange channel can be directly matched to complete the data exchange between the client and the data server. In order to prevent data from being attacked, a data exchange monitoring unit is utilized to verify a client, a time controller using a data exchange channel is also constructed in a matched data exchange channel, the time controller is used for setting a turn-off period when the client and the data server use the data exchange channel to exchange data, and the matched data exchange channel is turned off after the set turn-off period is cut off; if the turn-off period exceeds the set fusing threshold, the matched data exchange channel is automatically closed, so that a large amount of data exchange is prevented at one time, meanwhile, the request command monitoring module is used for monitoring the request times of the same client in the set period, and if the request times in the set period are greater than the set threshold, the freezing module freezes the connection between the client and the data server.
In the above, the off period is set by the exchange content included in the data exchange request.
In the above, when the same client sends the same data exchange request again, the loading unit loads the matching table, obtains a matching sub-table corresponding to the data exchange request from the matching table, and completes data exchange between the client and the data server according to the extraction exchange content, the verification feature and the data exchange channel corresponding to the matching sub-table, and after the set shutdown period expires, the matched data exchange channel is closed.
Meanwhile, by forming a matching table, when the same data exchange request is sent again by the same client, the exchange network system loads the extracted exchange content, the verification feature and the data exchange channel corresponding to the matching table to finish data exchange between the client and the data server, and after the set shutdown period is ended, the matched data exchange channel is closed. In this way, the same data exchange request sent again by the same client does not need to be identified and processed from the new, and the corresponding data exchange channel can be directly matched to complete the data exchange between the client and the data server.
The principles and embodiments of the present invention have been described herein with reference to specific examples, the description of which is intended only to facilitate an understanding of the method of the present invention and its core ideas. The foregoing is merely illustrative of the preferred embodiments of this invention, and it is noted that there is objectively no limit to the specific structure disclosed herein, since numerous modifications, adaptations and variations can be made by those skilled in the art without departing from the principles of the invention, and the above-described features can be combined in any suitable manner; such modifications, variations and combinations, or the direct application of the inventive concepts and aspects to other applications without modification, are contemplated as falling within the scope of the present invention.
Claims (1)
1. A big data exchange system, comprising:
at least one data server is provided and,
providing at least one client, and providing at least one switching network system;
the switching network system includes:
a plurality of data exchange channels;
at least one data exchange monitoring unit; the device comprises an identification unit, a recording unit, a storage unit, a tracking unit, a synthesis unit and a loading unit;
when the client sends a data exchange request to the data server, the data server verifies the client after receiving the data exchange request, and synchronizes the data exchange request and verification information to the exchange network system after the verification is passed; the identification unit is used for identifying exchange content contained in the data exchange request and extracting verification features according to the verification information; the recording unit is used for recording the data exchange request and the verification characteristics extracted from the exchange content and the verification information contained in the data exchange request, and correspondingly storing the data exchange request, the exchange content and the verification characteristics in the storage unit; the tracking unit records and stores the data exchange channels matched with the data exchange monitoring unit in the same storage unit as the data exchange request together to form a matching sub-table; the synthesis unit is used for merging a plurality of matching sub-tables to form a matching table;
the data exchange monitoring unit has: a data exchange time limit control module for generating a time controller according to exchange content contained in the data exchange request; the system also comprises a request command monitoring module and a freezing module; the time controller is used for matching the turn-off period based on the size of the exchange content contained in the data exchange request, and is used for matching the data exchange channels of the data server and the client according to the exchange content and the verification characteristic in the data exchange monitoring unit; if the turn-off period exceeds the set fusing threshold, automatically closing the matched data exchange channel; the request command monitoring module is used for monitoring the request times of the same client in a set period, and if the request times are greater than a set threshold value in the set period, the freezing module freezes the connection between the client and the data server;
when the same data exchange request is sent again by the same client, the loading unit loads the matching table, acquires a matching sub-table corresponding to the data exchange request from the matching table, and completes data exchange between the client and the data server according to the extracted exchange content, the verification feature and the data exchange channel corresponding to the matching sub-table, and after a set shutdown period is ended, the matched data exchange channel is closed.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210308064.2A CN114650178B (en) | 2022-03-26 | 2022-03-26 | Big data exchange method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210308064.2A CN114650178B (en) | 2022-03-26 | 2022-03-26 | Big data exchange method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114650178A CN114650178A (en) | 2022-06-21 |
| CN114650178B true CN114650178B (en) | 2023-06-27 |
Family
ID=81996072
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210308064.2A Active CN114650178B (en) | 2022-03-26 | 2022-03-26 | Big data exchange method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114650178B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115964754B (en) * | 2023-03-16 | 2023-05-23 | 长城数字能源(西安)科技有限公司 | Big data secure storage method and device |
| CN117354069B (en) * | 2023-12-06 | 2024-02-13 | 自然资源陕西省卫星应用技术中心 | Remote sensing data management system and method based on data lake |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109462595A (en) * | 2018-11-29 | 2019-03-12 | 甘肃万维信息科技有限责任公司 | Data-interface secure exchange method based on RestFul |
| CN112653667B (en) * | 2020-11-27 | 2022-12-27 | 苏州浪潮智能科技有限公司 | Multi-channel management method, device and medium of network transmission protocol |
| CN112615839B (en) * | 2020-12-10 | 2023-08-22 | 帝信科技股份有限公司 | Data transmission system, data transmission method and data transmission device |
-
2022
- 2022-03-26 CN CN202210308064.2A patent/CN114650178B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN114650178A (en) | 2022-06-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114650178B (en) | Big data exchange method and system | |
| US11019406B2 (en) | Receiving device, receiving method, program, and information processing system | |
| CN109903414A (en) | One kind is based on Internet of Things monitoring office attendance control system and method | |
| CN106488336B (en) | A kind of engine video frequency transmission method and system based on event corner | |
| CN103581216A (en) | Fragmentation data storage method, device and system | |
| US20150127942A1 (en) | Security key device for secure cloud service, and system and method for providing secure cloud service | |
| US20190174089A1 (en) | Method and device for storing warning image | |
| CN101917416A (en) | Method for guaranteeing data integrity in network storage | |
| CN103685343A (en) | File transfer method and file transfer system | |
| CN104639906B (en) | A kind of monitor video method for pushing | |
| CN105518697A (en) | Method implemented by computer for capturing evidentiary audiovisual and/or multimedia information and computer program | |
| US20150020167A1 (en) | System and method for managing files | |
| CN103490978A (en) | Terminal, server and message monitoring method | |
| CN108737786A (en) | A kind of intelligent monitor system | |
| WO2018121681A1 (en) | Method and device for remotely opening stream data transmission | |
| CN102595098B (en) | Method and device for monitoring relative processing of video and audio information and business information | |
| CN112835978A (en) | Data storage method and device and computer equipment | |
| CN110266987B (en) | Passive video recording method and computer readable storage medium | |
| CN117240937A (en) | Military data transmission method based on shared metadata in narrow bandwidth environment | |
| CN106453663A (en) | Improved cloud service-based storage capacity expansion method and device | |
| US10498787B2 (en) | Communication apparatus, communication method, and program | |
| CN109213955B (en) | Data processing method and related equipment | |
| CN114443669A (en) | Big data storage analysis management system | |
| CN106375455A (en) | Data transmission method and apparatus | |
| CN112926072A (en) | Real-time data transmission method and system and file access concurrency control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20230327 Address after: Room 2110, Bojing Building, No. 933, Shuntai North Road, Jinan Area, China (Shandong) Free Trade Pilot Zone, Jinan City, Shandong Province, 250101 Applicant after: Shandong Dajian Information Technology Co.,Ltd. Address before: 250002 C-201, building 7, Weidong Junting, south end of Shungeng Road, Shizhong District, Jinan City, Shandong Province Applicant before: Shandong Zhongliang Information Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |