CN206698236U - A kind of big data processing system with safe encryption function - Google Patents

A kind of big data processing system with safe encryption function Download PDF

Info

Publication number
CN206698236U
CN206698236U CN201720128668.3U CN201720128668U CN206698236U CN 206698236 U CN206698236 U CN 206698236U CN 201720128668 U CN201720128668 U CN 201720128668U CN 206698236 U CN206698236 U CN 206698236U
Authority
CN
China
Prior art keywords
data
unit
big data
processing system
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201720128668.3U
Other languages
Chinese (zh)
Inventor
陶晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201720128668.3U priority Critical patent/CN206698236U/en
Application granted granted Critical
Publication of CN206698236U publication Critical patent/CN206698236U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The utility model discloses a kind of big data processing system with safe encryption function, including big data security function processing unit, data safety interactive unit, data self-test unit, process scheduling unit, pretreatment unit and external interface unit, wherein data safety interactive unit is encrypted and stored to the data of reception, USB controller connects big data security function processing unit with data self-test unit, the interface of transmission is controlled, completes the storage and encryption of data;Data self-test unit is detected and verified to the data from reception, including data integrity verifying module, encryption/decryption detection module, redundancy filtering module and transmission distribution pretreatment module;Pretreatment unit is that multiple fpga chips concatenation forms.The utility model can carry out safety storage and distribution to big data interaction and analysis, realize safe and stable, efficient, the quick operation of system.

Description

A kind of big data processing system with safe encryption function
Technical field
The communications field is the utility model is related to, is handled in particular to a kind of big data with safe encryption function System.
Background technology
In big data (Big data) today, internet just further develops towards mobile, and social networks etc. is emerging Content is also constantly being risen, can very easily get desired information.However, the continuous hair with demand and business Exhibition, caused data are also in geometric growth.Large-scale dataset has an immeasurable value, and the relation between data will Played a significant role in operation, decision-making in incorporated business.While big data is focusing on and is storing mass data, its Safety problem will also face increasing challenge
In terms of big data processing, above all data processing equipment and big data are safe in the system composition of use Two aspects of protection.Common data processing equipment is by the way of server integrated network card, and server is bulky, power consumption; Network interface card is limited to the Cabinet Size limitation of server, and the limitation of traditional CPU I/O buses, and FPDP is few, treatment effeciency It is low.In high-speed data processing, the mode frequently with distributed deployment is also passed through, if necessary, data distribution equipment is added in front end, Data are pre-processed, system is huge, not only can not meet the requirement of energy-saving and emission-reduction, and increase the cost of system. In terms of big data safeguard protection, conventional method is all that these are traditional by fire wall, VPN, intrusion detection and anti-virus etc. It is complete that system and component carry out safeguards system, is got on safeguards system from procotol and pattern feature the problem of these method maximums Safety, the sensitive information and sensitive data that can not be directed to big data platform interior implement protection, that is to say, that at present so far Also neither one is directed to the specific security system of big data system.
Therefore, how efficiently, quickly large-scale data is handled simultaneously, realizes the safe and secret of information, turn into One urgent problem to be solved.
Utility model content
The technical problems to be solved in the utility model is to provide a kind of big data processing system with safe encryption function, The system can carry out safety storage and distribution to big data interaction and analysis, realize the safe and stable, efficient, quick of system Operation.
In order to solve the above technical problems, technical solution adopted in the utility model is:One kind has safe encryption function Big data processing system, it is characterised in that:Including big data security function processing unit, data safety interactive unit, data Self-test unit, process scheduling unit, pretreatment unit and external interface unit, six units are sequentially connected, and wherein data are pacified Full interactive unit is encrypted and stored to the data of reception, and it is multiple that it specifically includes USB controller, data storage medium, system Level controller, power-supply controller of electric and encryption card interface five part, USB controller is big data security function processing unit and data Self-test unit is connected, and the interface of transmission is controlled, and data storage medium, system reset controller and power-supply controller of electric are through adding Close card interface connects big data security function processing unit with data self-test unit, completes the storage and encryption of data;Data Self-test unit is detected and verified to the data from reception, including data integrity verifying module, encryption/decryption detection mould Block, redundancy filtering module and transmission distribution pretreatment module;Pretreatment unit is that multiple fpga chips concatenation forms.
Make further preferred, described big data security function processing unit to such scheme as multiple embedded settings Individual secure card is respectively configured in CPU, each CPU, and each CUP is collected to integrated interface plate, integrated interface plate and function by ROM Storage medium connects.
Make further preferred, described function storage medium to such scheme to store for hard-disc type, using SSD.
Further to such scheme work preferred, described safety card uses the safety chip with TPM.
Further to such scheme work preferred, described external interface unit includes more than two 10,000,000,000 optical electrical Interface, the optical electrical interface of multiple gigabits and multiple 40G interfaces.
Further to such scheme work preferred, described data storage medium is provided with water-cooling radiating module, and water cooling dissipates Thermal modules are provided with fin between being included in each two data storage medium, are circulation cavity inside fin, circulate cavity Inlet and outlet connect with water inlet manifold and outfall sewer respectively, and water inlet manifold and outfall sewer are two independent parallel cartridges, are entered Supply mains and outfall sewer form water-flow circuit with heat exchanger.
Further to such scheme work preferred, described fin, water inlet manifold and outfall sewer is aluminium medium.
It is using beneficial effect caused by above-mentioned technical proposal:
(1)The utility model adds data safety interactive unit and data self-test in original big data processing system Unit, realize and the data of transmitting-receiving are encrypted and filtered etc. with operation, the user sensitive information of big data platform can be examined Survey is handled, and the rank lifting of former software protection is arrived into hardware protection rank, the ability of system attack protection is greatly improved, so as to reach Dual safety to data handling system ensures effect, while on the premise of original processing composition is not changed, realizes system Safe and stable, efficient, quick operation;
(2)In the utility model, big data security function processing unit carries out multinuclear processing using multiple CPU, according to number According to flow flexibly allocate, and increase each cpu data buffering and safety assurance, avoid external data from being directly read, influence Reading speed, the storage medium life-span is reduced, data acquisition, data filtering and data processing are concentrated within one device, significantly Treatment effeciency is improved, also improves processing speed, is particularly suitable for the industry high to data processing delay requirement;
(3)The utility model realizes the Direct Communication of processor and computer storage using USB controller, breach with The slow limitation of data speed is uploaded using serial ports toward data logger, substantially reduces transmission time;
(4)The utility model is using fin and the spaced mode of big data storage device, by the way of water cooling Multiple big data storage devices are radiated simultaneously, more preferable radiating effect can be reached, ensure equipment long-term safety stable operation;
(5)The system is reasonable in design, can reliably complete the storage, reading and subsequent treatment of Large Volume Data, And the potentiality with later stage dilatation.
Brief description of the drawings
Fig. 1 is the block diagram of system of the present utility model;
Fig. 2 is the composition frame chart of big data security function processing unit in the utility model;
Fig. 3 is the structure composition schematic diagram of water-cooling radiating module in the utility model.
Embodiment
The utility model is described in further detail with reference to the accompanying drawings and detailed description.
The utility model is specifically related to a kind of big data processing system with safe encryption function, and the system is using safety Hardware composition, realize safe, the quick processing of mass data.The concrete composition of the system as shown in Figure 1, specifically includes Big data security function processing unit, data safety interactive unit, data self-test unit, process scheduling unit, pretreatment unit And external interface unit six is most of, six of which unit is sequentially connected using optical cable, forms big data processing system.This is Protection in system to data safety is mainly data safety interactive unit and data self-test unit two parts, and wherein data safety is handed over Mutual unit uses the design pattern of hardware integration, and the data received in processing unit are encrypted and stored, its hardware components USB controller, data storage medium, system reset controller, power-supply controller of electric and encryption card interface five part are specifically included, USB controller connects big data security function processing unit with data self-test unit, and the interface of transmission is controlled, and uses USB interfaces realize the Direct Communication of computer and big data processor, breach conventional data logger and are uploaded using serial ports The slow limitation of data speed, substantially reduces transmission time;Data storage medium, system reset controller and power-supply controller of electric warp Encryption card interface connects big data security function processing unit with data self-test unit, completes the storage and encryption of data, institute The signal for having access recording equipment all takes quarantine measures;Using modular thinking between hardware, structure composition is easy to maintain, Transplanting, extension;System structure design is reasonable, can reliably complete the storage, reading and subsequent treatment of Large Volume Data, and Potentiality with later stage dilatation.Meanwhile it is this it is simple in construction, assembling it is flexible, easy to maintenance.External interface unit include two with On 10,000,000,000 optical electrical interface, multiple gigabits optical electrical interface and multiple 40G interfaces, support the full system type pictorial code of Ethernet, The limitation of network interface card in conventional application is evaded, maximum flexibility is provided access link.
Data from reception are mainly detected and verified by the data self-test unit in accompanying drawing 1, including data are complete Whole property correction verification module, encryption/decryption detection module, redundancy filtering module and transmission distribution pretreatment module;It is wherein complete Property correction verification module utilize quick RAM storage and reading, formed according to data key words and information, to the complete of every group of data block Property is detected, and avoids the occurrence of wrong data;Encryption/decryption detection module is to handle list by big data security function to the unit The encryption data that member obtains is decrypted, and transmits to client, carries out preliminary encryption identification to the data that outside receives in addition, is Follow-up data encryption provides convenient;Redundancy filtering module is detected using crucial, avoids the entrance of a large amount of duplicate data, To ensure efficient, quick, the safe operation of processor;Transmission distribution pretreatment module is held in the mouth with follow-up process scheduling unit Connect, realize the preliminary identification to data block, facilitate subsequent treatment.Pretreatment unit is that multiple fpga chips concatenation forms.
Accompanying drawing 2 is big data security function processing unit composition frame chart in the utility model, and the unit is that multiple insertions are set Individual secure card is respectively configured in the CPU put, each CPU, and safety card uses the safety chip with TPM, is responsible for the encryption and decryption of key Operation, each CUP are collected to integrated interface plate by ROM, and integrated interface plate is connected with function storage medium.According to the stream of data Amount flexibly allotment, and increase each cpu data buffering and safety assurance, avoid external data from being directly read, influence to read speed Degree, the storage medium life-span is reduced, data acquisition, data filtering and data processing are concentrated within one device, substantially increased Treatment effeciency, processing speed is also improved, be particularly suitable for the industry high to data processing delay requirement;Using embedded type CPU, make Equipment volume is small, in light weight, little power consumption, and can portable mobile, saved power consumption and volume, can have been saved when batch is disposed big Cost and floor space are measured,
In said units, function storage medium stores for hard-disc type, using SSD, can effectively improve depositing for data Speed is stored up, realizes the quick processing of big data.
Accompanying drawing 3 is water-cooling radiating module in the utility model, and the module is mainly cooled for data storage medium, is protected Demonstrate,prove its stable operation.Water-cooling radiating module is provided with fin between being included in each two data storage medium, can increase radiating Liquid stores to big data, the heat absorption of equipment.Be circulation cavity inside fin, circulate the inlet and outlet of cavity respectively with water inlet House steward connects with outfall sewer, and water inlet manifold and outfall sewer are two independent parallel cartridges, water inlet manifold and outfall sewer Water-flow circuit is formed with heat exchanger.
The utility model in specific application, the operation of big data processing platform, by the safe encryption configuration of hardware, i.e., Big data processing system is set to be attacked by a large amount of invalid datas, such as hacker and wooden horse etc., the system in the utility model can also pacify Full-automatic detection, stable operation, and provide alarm.
It is described above, only it is preferred embodiment of the present utility model, any formal limit is not done to the utility model System, every any simple modification made according to the technical essence of the utility model to above example, equivalent variations, each falls within Within the scope of protection of the utility model.

Claims (7)

  1. A kind of 1. big data processing system with safe encryption function, it is characterised in that:Including the processing of big data security function Unit, data safety interactive unit, data self-test unit, process scheduling unit, pretreatment unit and external interface unit, six Individual unit is sequentially connected, and wherein data safety interactive unit is encrypted and stored to the data of reception, and it specifically includes USB controls Device, data storage medium, system reset controller, power-supply controller of electric and encryption card interface five part processed, USB controller is big number Connect, the interface of transmission is controlled, data storage medium, system are multiple with data self-test unit according to security function processing unit Level controller connects big data security function processing unit with data self-test unit with the encrypted card interface of power-supply controller of electric, complete Into the storage and encryption of data;Data self-test unit is detected and verified to the data from reception, including data integrity Correction verification module, encryption/decryption detection module, redundancy filtering module and transmission distribution pretreatment module;Pretreatment unit is Multiple fpga chip concatenations form.
  2. A kind of 2. big data processing system with safe encryption function according to claim 1, it is characterised in that:It is described Big data security function processing unit be multiple embedded CPU set, individual secure card, each CUP is respectively configured in each CPU Integrated interface plate is collected to by ROM, integrated interface plate is connected with function storage medium.
  3. A kind of 3. big data processing system with safe encryption function according to claim 2, it is characterised in that:It is described Function storage medium be hard-disc type storage, using SSD.
  4. A kind of 4. big data processing system with safe encryption function according to claim 2, it is characterised in that:It is described Safety card use the safety chip with TPM.
  5. A kind of 5. big data processing system with safe encryption function according to claim 1, it is characterised in that:It is described External interface unit include more than two 10,000,000,000 optical electrical interface, multiple gigabits optical electrical interface and multiple 40G interfaces.
  6. A kind of 6. big data processing system with safe encryption function according to claim 1, it is characterised in that:It is described Data storage medium be provided with water-cooling radiating module, water-cooling radiating module is provided between being included in each two data storage medium Fin, for circulation cavity, the inlet and outlet for circulating cavity connect with water inlet manifold and outfall sewer respectively, intake for fin inside House steward and outfall sewer are that two independent parallel cartridges, water inlet manifold and outfall sewer form water-flow circuit with heat exchanger.
  7. A kind of 7. big data processing system with safe encryption function according to claim 6, it is characterised in that:It is described Fin, water inlet manifold and outfall sewer be aluminium medium.
CN201720128668.3U 2017-02-13 2017-02-13 A kind of big data processing system with safe encryption function Expired - Fee Related CN206698236U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201720128668.3U CN206698236U (en) 2017-02-13 2017-02-13 A kind of big data processing system with safe encryption function

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201720128668.3U CN206698236U (en) 2017-02-13 2017-02-13 A kind of big data processing system with safe encryption function

Publications (1)

Publication Number Publication Date
CN206698236U true CN206698236U (en) 2017-12-01

Family

ID=60440093

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201720128668.3U Expired - Fee Related CN206698236U (en) 2017-02-13 2017-02-13 A kind of big data processing system with safe encryption function

Country Status (1)

Country Link
CN (1) CN206698236U (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111935175A (en) * 2020-09-14 2020-11-13 华芯生物科技(武汉)有限公司 Data encryption transmission method of detection equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111935175A (en) * 2020-09-14 2020-11-13 华芯生物科技(武汉)有限公司 Data encryption transmission method of detection equipment
CN111935175B (en) * 2020-09-14 2020-12-29 华芯生物科技(武汉)有限公司 Data encryption transmission method of detection equipment

Similar Documents

Publication Publication Date Title
WO2010141595A3 (en) Container air handling unit and cooling method
CN103699194A (en) Server and server host
CN107204986A (en) High in the clouds storage encryption method, decryption method and high in the clouds storage encryption device
CN104021104B (en) A kind of cooperative system and its communication means based on dual-bus structure
CN206209559U (en) Serial server
CN108628791A (en) Based on the High Speed Security Chip framework of PCIE interfaces and the data processing method of high speed
CN206698236U (en) A kind of big data processing system with safe encryption function
CN103916312A (en) Marine data collecting gateway and data collecting method
CN101447007B (en) Safe outward communication method of active data safe storing equipment
CN107943253A (en) A kind of high density multi-node server system heat radiating structure
CN107612679A (en) A kind of safe Ethernet bridge scrambling terminal based on national secret algorithm
CN1889427A (en) Safety star-shape local network computer system
CN206162182U (en) Long -range energy monitoring platform of ground source heat pump system
CN206249203U (en) A kind of shock-absorbing type computer cabinet
Ward et al. A simplified thermodynamic model for waste heat utilization from a containerized data center experimental platform
CN207573453U (en) A kind of trustable network video camera based on domestic commercial cipher algorithm
CN201623727U (en) Small single-unit firewall device based on network processor
CN108845638B (en) Firewall device of embedded system
CN104378762A (en) Method for monitoring Internet surfing flow of user
CN203084736U (en) Computer network safety control system
CN204539672U (en) Data center's micromodule
CN203102265U (en) Solid state disk (SSD) control chip
CN106909856A (en) A kind of computer network security control system
CN215813987U (en) Computer network information safety protection device
CN205993034U (en) A kind of cloud computing secret protection synthesis energy saving cabinet

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20171201

Termination date: 20190213