CN111368347A - Safe storage method based on cloud platform - Google Patents

Safe storage method based on cloud platform Download PDF

Info

Publication number
CN111368347A
CN111368347A CN202010156405.XA CN202010156405A CN111368347A CN 111368347 A CN111368347 A CN 111368347A CN 202010156405 A CN202010156405 A CN 202010156405A CN 111368347 A CN111368347 A CN 111368347A
Authority
CN
China
Prior art keywords
data
security
storage
safety
cloud platform
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010156405.XA
Other languages
Chinese (zh)
Inventor
牟明
田莉蓉
郝玉锴
于沛
伍小辉
陆敏敏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Avic Airborne System General Technology Co Ltd
Original Assignee
Avic Airborne System General Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Avic Airborne System General Technology Co Ltd filed Critical Avic Airborne System General Technology Co Ltd
Priority to CN202010156405.XA priority Critical patent/CN111368347A/en
Publication of CN111368347A publication Critical patent/CN111368347A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/70Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer
    • G06F21/78Protecting specific internal or peripheral components, in which the protection of a component leads to protection of the entire computer to assure secure storage of data
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/07Responding to the occurrence of a fault, e.g. fault tolerance
    • G06F11/14Error detection or correction of the data by redundancy in operation
    • G06F11/1402Saving, restoring, recovering or retrying
    • G06F11/1446Point-in-time backing up or restoration of persistent data
    • G06F11/1448Management of the data involved in backup or backup restore

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Storage Device Security (AREA)

Abstract

A safe storage method based on a cloud platform is provided. The technical field of safe storage is related to, and specifically relates to a data safe storage method of an airborne industrial internet cloud platform. The safe storage method based on the cloud platform is capable of achieving low-cost and high-reliability storage of mass data. The method comprises the steps of establishing a cloud platform system, wherein the cloud platform system comprises an equipment safety module, a control safety module, a network safety module, an application safety module, a data safety module, a detection sensing module and a data recovery module, the data safety module comprises the steps of data safety storage, efficient safety storage of massive large and small files, efficient data redundancy design and metadata management, and the data storage safety is guaranteed by adopting access control, storage encryption, backup and recovery modes. The invention has the advantages that the invention has the characteristics of small physical space occupied by data redundancy backup and high data recovery speed; efficient management of metadata is achieved, thus improving the efficiency of data storage and reading.

Description

Safe storage method based on cloud platform
Technical Field
The invention relates to the technical field of safe storage, in particular to a data safe storage method of an airborne industrial internet cloud platform.
Background
The industrial internet is a set of a key network basic platform, a matching platform service and an industrial APP which meet the requirements of industrial intelligent development, has the characteristics of low time delay, high reliability and wide coverage, and is a new business state and application mode formed by the deep fusion of a new generation of information technology and advanced manufacturing industry.
With the promotion of the development of civil aircraft models such as C919, CR929, AG600 and the like in China, the construction of an airborne industrial internet is deepened step by step, and a management platform, a research and development tool and an environment required by the development of an airborne system are provided. In an airborne industrial internet cloud platform, mass data generated by development units of an airborne system in the development process are stored, the data are stored through a distributed safe storage technology, a large number of storage devices of different types in a network are organized by adopting technologies such as virtualization, load balancing and the like, functions of safe storage and access of data transparent to users are provided, and the data have high reliability, availability and performance to meet the requirements of the users.
In actual work, the scale, type and speed of data generated by the development of an airborne system are exponentially increasing, the problem of information security caused by the exponential increase is increasingly prominent, and the difficulty of the security architecture design, data security storage, access authority control, digital signature and security monitoring of an internet cloud platform is continuously increased. Information is a key strategic resource for the development of the airborne industry, information safety is the basis for the development of the airborne industry, and the information safety is a major key problem which must be solved and affects the major and long-term benefits of the industry in the current airborne industry.
Disclosure of Invention
Aiming at the problems, the invention provides a safe storage method based on a cloud platform, which can realize low-cost and high-reliability storage of mass data.
The technical scheme of the invention is as follows: the method comprises the following steps:
establishing a cloud platform system, wherein the cloud platform system comprises an equipment security module, a control security module, a network security module, an application security module, a data security module, a detection sensing module and a data recovery module,
the data security module comprises the security storage of data, the high-efficiency security storage of massive large and small files, the high-efficiency data redundancy design and the metadata management,
the data storage safety is guaranteed by adopting access control, storage encryption and backup and recovery modes.
The secure storage of the data comprises big data platform security, data security protection and privacy security,
the big data platform security comprises transmission exchange security, storage security, calculation security, platform management security and infrastructure security;
wherein, the transmission exchange is safe: the interface authentication mechanism is adopted to verify the legality of an external system, and the confidentiality and the integrity of the transmission process are guaranteed by adopting a channel encryption means;
and (4) storage safety: a data access control mechanism is adopted to prevent unauthorized access of data, so that a backup and recovery mechanism is set for the data in the platform, and the confidentiality and the integrity in data storage are guaranteed;
computing safety, namely ensuring the safety of data computing by adopting an identity authentication and access authentication mode;
platform management safety: the method comprises the steps of safety configuration of a platform assembly, resource safety scheduling, patch management and safety audit;
infrastructure security includes physical security, network security, and virtualization security;
the data security protection comprises classification, metadata management, data encryption, data isolation, leakage prevention and data destruction;
the privacy security: the method is used for safety protection of personal sensitive information, and the technologies of de-identification, anonymization and ciphertext calculation are utilized to ensure that the personal data does not reveal personal privacy or information unwilling to be known by the outside in the process of processing and transferring on the platform.
Efficient and safe storage of the massive large and small files: by means of the algorithm for dividing, storing and addressing large files and the algorithm for clustering, combining, storing and addressing a large number of small files, the efficient and safe storage method suitable for both large files and small files is used.
The efficient data redundancy design comprises the following steps: a data redundancy technique using split checking.
The metadata management comprises: the metadata management method, the metadata management of DRAM + SSD heterogeneous storage, the storage index mechanism of the metadata and the migration algorithm of the metadata are used for realizing the efficient management of the metadata.
The invention has the advantages that:
1. when a potential problem of the system is detected, the data object is transferred to other equipment, so that the data loss caused by the failure of the physical equipment is avoided;
2. the storage method used by the large and small files is adopted, so that the problem of efficient and safe storage of the mixed file is solved;
3. the method has the characteristics of small physical space occupied by data redundancy backup and high data recovery speed;
4. efficient management of metadata is achieved, thus improving the efficiency of data storage and reading.
Drawings
Figure 1 is an architectural diagram of a cloud platform of the present invention,
figure 2 is a diagram of a secure storage architecture for data,
figure 3 is a block diagram of an intelligent distributed secure storage,
fig. 4 is a diagram of a P2P symmetric secure storage architecture.
Detailed Description
As shown in FIGS. 1-4, the mass safe storage of the cloud platform is realized based on the airborne industrial Internet cloud platform. The architecture of the airborne industrial internet cloud platform is shown in fig. 1, and the research and development related scope of the airborne industrial internet information security technology comprises an equipment security module, a control security module, a network security module, an application security module, a data security module, a detection sensing module and a data recovery module. The data security module comprises four aspects of data collection, data transmission, data storage and data processing, and particularly adopts access control, storage encryption, backup and recovery modes to ensure the data storage security.
The cloud platform storage technology is a storage system consisting of a server, a storage, a network and related software and hardware environments, a large number of storage devices of various different types in the cloud platform network are required to be integrated through application software to cooperatively work, data storage and service access functions are provided for the outside, and the technology for authenticity verification, confidentiality protection, integrity guarantee and reliability guarantee of heterogeneous mass data is used.
The data security module comprises the steps of data security storage, efficient and secure storage of massive large and small pieces, efficient data redundancy design and metadata management, the overall architecture of the cloud platform for the secure storage of massive data is shown in FIG. 2,
1) the safe storage of the data is divided into three levels of big data platform safety, data safety protection and privacy safety;
1.1) the security of the big data platform is the security guarantee for resources and functions of transmission, storage, operation and the like of the big data platform, and comprises transmission exchange security, storage security, calculation security, platform management security and infrastructure security;
1.1.1) the transmission and exchange safety is realized, the legality of an external system is verified by adopting an interface authentication mechanism, the safety and the controllability of the data exchange process with the external system are guaranteed, and the confidentiality and the integrity of the transmission process are guaranteed by adopting a channel encryption method;
1.1.2) the storage is safe, a data access control mechanism is adopted to prevent unauthorized access of data, a backup and recovery mechanism is set for the data in the platform, and the confidentiality and the integrity in the data storage are guaranteed;
1.1.3) calculating safety, and ensuring the safety of data calculation by adopting an identity authentication and access authentication mode;
1.1.4) platform management safety, including safety configuration, resource safety scheduling, patch management and safety audit of platform components;
1.1.5) platform software and hardware infrastructure safety, including physical safety, network safety and virtualization safety, is the basis for safe operation of a big data platform;
1.2) data safety protection, which is realized by providing safety functions for data flow in service application, including classification, metadata management, data encryption, data isolation, leakage prevention and data destruction;
1.3) the privacy is safely removed to carry out identification, anonymization and ciphertext calculation, so that the information that the privacy of the individual is not revealed or the individual is not willing to be known by the outside world in the processing and circulation process of the individual data on the platform is ensured, and the safety protection of the individual sensitive information is realized on the basis of data safety.
According to the cloud platform mass data safe storage method provided by the invention, through data management, data self-protection and an intelligent management algorithm, when a potential problem of the system is detected, the data object is transferred to other equipment, and the data loss caused by physical equipment failure is avoided.
The method specifically adopts an intelligent distributed safe storage technology to store mass data, adopts technologies such as virtualization, load balancing and the like to organize a large number of storage devices of different types in the network, provides functions such as safe data storage and access which are transparent to users, and has high reliability, usability and performance so as to meet the requirements of the users.
The intelligent distributed secure storage specific technology is shown in fig. 3, and data encryption service and data storage service are performed through a BP neural network algorithm;
the data encryption service adopts encryption and decryption algorithm, random number encryption algorithm, symmetric encryption algorithm, asymmetric encryption algorithm, electronic signature, electronic certificate and PKI method;
the data storage architecture adopted by the data storage service comprises a C/S architecture, a DAS/SAN/NAS architecture, a cluster distributed secure storage architecture and P2P symmetric secure storage;
the failed data can be recovered as soon as possible when the node fails, so that the reliability of the data and the access efficiency of a user are ensured; redundant information can be added to the data, and the availability of unique data can be ensured under the condition that part of nodes have faults; the method can be optimized and adjusted by comprehensively combining the performance of the nodes, the distance between the user and the nodes, the access cost and other factors, and the time and the expense for the user to access data are reduced; under the condition that the nodes dynamically change, the updating information can be transmitted to the storage nodes in time, and the consistency of data is maintained.
2) Efficient and safe storage of massive large files and small files: the efficient and safe storage problem of the mixed file is solved by using an efficient and safe storage method which is simultaneously suitable for large files such as GB, TB level and small files such as KB level, such as storage aiming at a segmentation, storage and addressing algorithm of the large files and storage aiming at a clustering, merging, storage and addressing algorithm of a large number of small files.
3) Efficient data redundancy design: by using the data redundancy technology of the partition check, the physical space occupied by the data redundancy backup is small, and the data recovery speed is high.
The efficient data redundancy design adopts a repeated data deleting technology and a duplicate technology;
the data amount stored in the data center can be greatly reduced by detecting repeated data and storing unique data by adopting a repeated data deleting technology. However, after the deduplication technology is adopted, only one piece of data exists, which causes a problem of data availability. Therefore, in this situation, a method for data availability in deduplication is needed, which adds redundant information to data and can guarantee the availability of unique data in case of partial node failure.
And a copy technology is adopted to add redundant information to the data and ensure the availability of the data. The placement of the copies involved in the method has important influences on the access performance of users, the load balance of a storage system, the utilization rate of network bandwidth and the consistency maintenance among the copies. According to the characteristic of node heterogeneity, the placement position of the copy can be determined by combining the performance of the node, the distance between the user and the node, the access cost and other factors, and the time and the expense for the user to access the data are reduced.
4) Metadata management: by using a metadata management method, metadata management of DRAM + SSD heterogeneous storage, a storage index mechanism of metadata, a migration algorithm of the metadata and the like, the metadata is efficiently managed so as to improve the data storage and reading efficiency.
Metadata management employs a P2P symmetric secure storage architecture, as shown in fig. 4.
The P2P symmetric secure storage architecture is a decentralized and fully symmetric architecture based on peer-to-peer technology, and the design idea is to adopt a consistent HasensthenHash algorithm to locate the position of a file in a storage node, so that the role of metadataserver is cancelled. Under ideal conditions, the model eliminates a series of related problems of performance bottleneck, single point failure, data consistency and the like of metadata, the system expansibility is obviously improved, and the system concurrency and performance can realize linear expansion growth.
The disclosure of the present application also includes the following points:
(1) the drawings of the embodiments disclosed herein only relate to the structures related to the embodiments disclosed herein, and other structures can refer to general designs;
(2) in case of conflict, the embodiments and features of the embodiments disclosed in this application can be combined with each other to arrive at new embodiments;
the above embodiments are only embodiments disclosed in the present disclosure, but the scope of the disclosure is not limited thereto, and the scope of the disclosure should be determined by the scope of the claims.

Claims (5)

1. A secure storage method based on a cloud platform is characterized by comprising the following steps:
establishing a cloud platform system, wherein the cloud platform system comprises an equipment security module, a control security module, a network security module, an application security module, a data security module, a detection sensing module and a data recovery module,
the data security module comprises the security storage of data, the high-efficiency security storage of massive large and small files, the high-efficiency data redundancy design and the metadata management,
the data storage safety is guaranteed by adopting access control, storage encryption and backup and recovery modes.
2. The cloud platform-based secure storage method according to claim 1, wherein the secure storage of data includes big data platform security, data security protection and privacy security,
the big data platform security comprises transmission exchange security, storage security, calculation security, platform management security and infrastructure security;
wherein, the transmission exchange is safe: the interface authentication mechanism is adopted to verify the legality of an external system, and the confidentiality and the integrity of the transmission process are guaranteed by adopting a channel encryption means;
and (4) storage safety: a data access control mechanism is adopted to prevent unauthorized access of data, so that a backup and recovery mechanism is set for the data in the platform, and the confidentiality and the integrity in data storage are guaranteed;
computing safety, namely ensuring the safety of data computing by adopting an identity authentication and access authentication mode;
platform management safety: the method comprises the steps of safety configuration of a platform assembly, resource safety scheduling, patch management and safety audit;
infrastructure security includes physical security, network security, and virtualization security;
the data security protection comprises classification, metadata management, data encryption, data isolation, leakage prevention and data destruction;
the privacy security: the method is used for safety protection of personal sensitive information, and the technologies of de-identification, anonymization and ciphertext calculation are utilized to ensure that the personal data does not reveal personal privacy or information unwilling to be known by the outside in the process of processing and transferring on the platform.
3. The cloud platform-based secure storage method according to claim 1, wherein the efficient secure storage of the mass large and small files comprises: by means of the algorithm for dividing, storing and addressing large files and the algorithm for clustering, combining, storing and addressing a large number of small files, the efficient and safe storage method suitable for both large files and small files is used.
4. The cloud platform-based secure storage method according to claim 1, wherein the efficient data redundancy design comprises: a data redundancy technique using split checking.
5. The cloud platform-based secure storage method according to claim 1, wherein the metadata management: the metadata management method, the metadata management of DRAM + SSD heterogeneous storage, the storage index mechanism of the metadata and the migration algorithm of the metadata are used for realizing the efficient management of the metadata.
CN202010156405.XA 2020-03-09 2020-03-09 Safe storage method based on cloud platform Pending CN111368347A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010156405.XA CN111368347A (en) 2020-03-09 2020-03-09 Safe storage method based on cloud platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010156405.XA CN111368347A (en) 2020-03-09 2020-03-09 Safe storage method based on cloud platform

Publications (1)

Publication Number Publication Date
CN111368347A true CN111368347A (en) 2020-07-03

Family

ID=71206623

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010156405.XA Pending CN111368347A (en) 2020-03-09 2020-03-09 Safe storage method based on cloud platform

Country Status (1)

Country Link
CN (1) CN111368347A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112953803A (en) * 2021-02-10 2021-06-11 西南电子技术研究所(中国电子科技集团公司第十研究所) Airborne redundant network data transmission method
CN114422546A (en) * 2021-12-27 2022-04-29 四川启睿克科技有限公司 Remote intelligent detection and processing system based on industrial internet platform
CN117675383A (en) * 2023-12-11 2024-03-08 中航机载系统共性技术有限公司 Data transmission architecture and data transmission method for networked collaborative design

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102364474A (en) * 2011-11-17 2012-02-29 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method
CN104657461A (en) * 2015-02-10 2015-05-27 北京航空航天大学 File system metadata search caching method based on internal memory and SSD (Solid State Disk) collaboration
CN105553940A (en) * 2015-12-09 2016-05-04 北京中科云集科技有限公司 Safety protection method based on big data processing platform
US20180039494A1 (en) * 2016-08-05 2018-02-08 Oracle International Corporation Zero down time upgrade for a multi-tenant identity and data security management cloud service
CN108809986A (en) * 2018-06-14 2018-11-13 苏州新研联信息科技有限公司 A kind of privately owned cloud system of enterprise

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102364474A (en) * 2011-11-17 2012-02-29 中国科学院计算技术研究所 Metadata storage system for cluster file system and metadata management method
CN104657461A (en) * 2015-02-10 2015-05-27 北京航空航天大学 File system metadata search caching method based on internal memory and SSD (Solid State Disk) collaboration
CN105553940A (en) * 2015-12-09 2016-05-04 北京中科云集科技有限公司 Safety protection method based on big data processing platform
US20180039494A1 (en) * 2016-08-05 2018-02-08 Oracle International Corporation Zero down time upgrade for a multi-tenant identity and data security management cloud service
CN108809986A (en) * 2018-06-14 2018-11-13 苏州新研联信息科技有限公司 A kind of privately owned cloud system of enterprise

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112953803A (en) * 2021-02-10 2021-06-11 西南电子技术研究所(中国电子科技集团公司第十研究所) Airborne redundant network data transmission method
CN114422546A (en) * 2021-12-27 2022-04-29 四川启睿克科技有限公司 Remote intelligent detection and processing system based on industrial internet platform
CN114422546B (en) * 2021-12-27 2023-07-07 四川启睿克科技有限公司 Remote intelligent detection and processing system based on industrial Internet platform
CN117675383A (en) * 2023-12-11 2024-03-08 中航机载系统共性技术有限公司 Data transmission architecture and data transmission method for networked collaborative design

Similar Documents

Publication Publication Date Title
Wang Research on data security technology based on cloud storage
CN107465656B (en) Security monitoring big data processing method and system based on cloud computing
CN111406252B (en) Consensus of error correction code based shared blockchain data storage
CN111417930B (en) Prioritizing shared blockchain data storage
CN111373378B (en) Data security for error correction code based shared blockchain data storage
CN107391758B (en) Database switching method, device and equipment
CN107220559B (en) Encryption storage method for non-tamperable file
CN111368347A (en) Safe storage method based on cloud platform
US11431488B1 (en) Protecting local key generation using a remote key management service
CN104580395B (en) A kind of cloudy collaboration Storage Middleware Applying system based on existing cloud storage platform
US12014065B2 (en) Multi-cloud orchestration as-a-service
Al-madani et al. IoT data security via blockchain technology and service-centric networking
CN111386519B (en) Dynamic blockchain data storage based on error correction codes
Wang et al. A high-performance hybrid blockchain system for traceable IoT applications
EP3349416B1 (en) Relationship chain processing method and system, and storage medium
Yu et al. On distributed object storage architecture based on mimic defense
Forestiero et al. A blockchain based approach for Fog infrastructure management leveraging on Non-Fungible Tokens
Xie et al. Research on blockchain storage extension based on dht
Padmanaban et al. Hadoopsec: sensitivity-aware secure data placement strategy for big data/hadoop platform using prescriptive analytics
Shrivastava et al. A Big Data Deduplication Using HECC Based Encryption with Modified Hash Value in Cloud
CN104461817B (en) A kind of method and server for detecting key
Haifeng et al. Block-chain based cloud storage integrity verifycation scheme for recoverable data
SureshPatil et al. Improving the availability and reducing redundancy using deduplication of cloud storage system
Latha et al. Enhancing performance of multi-cloud storage environment using modified erasure coding technique
Liu et al. HotLT: LT Code-based secure and reliable consortium blockchain storage systems

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20200703

RJ01 Rejection of invention patent application after publication