CN114625320A - Hybrid cloud platform data management system based on characteristics - Google Patents
Hybrid cloud platform data management system based on characteristics Download PDFInfo
- Publication number
- CN114625320A CN114625320A CN202210252890.XA CN202210252890A CN114625320A CN 114625320 A CN114625320 A CN 114625320A CN 202210252890 A CN202210252890 A CN 202210252890A CN 114625320 A CN114625320 A CN 114625320A
- Authority
- CN
- China
- Prior art keywords
- data
- data storage
- user
- storage blocks
- cloud
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000013523 data management Methods 0.000 title claims abstract description 16
- 238000013500 data storage Methods 0.000 claims abstract description 102
- 238000009826 distribution Methods 0.000 claims abstract description 9
- 238000011084 recovery Methods 0.000 claims description 23
- 238000012545 processing Methods 0.000 claims description 8
- 238000012549 training Methods 0.000 claims description 7
- 230000001502 supplementing effect Effects 0.000 claims description 4
- 230000001960 triggered effect Effects 0.000 claims description 4
- 238000004140 cleaning Methods 0.000 claims description 3
- 238000012216 screening Methods 0.000 claims description 3
- 238000005096 rolling process Methods 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 7
- 238000007726 management method Methods 0.000 abstract description 6
- 238000012423 maintenance Methods 0.000 abstract description 2
- 238000005457 optimization Methods 0.000 abstract description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 206010033799 Paralysis Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000003860 storage Methods 0.000 description 1
- 239000000725 suspension Substances 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0602—Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
- G06F3/062—Securing storage systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/14—Error detection or correction of the data by redundancy in operation
- G06F11/1402—Saving, restoring, recovering or retrying
- G06F11/1446—Point-in-time backing up or restoration of persistent data
- G06F11/1448—Management of the data involved in backup or backup restore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0629—Configuration or reconfiguration of storage systems
- G06F3/0637—Permissions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0646—Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
- G06F3/065—Replication mechanisms
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0628—Interfaces specially adapted for storage systems making use of a particular technique
- G06F3/0662—Virtualisation aspects
- G06F3/0667—Virtualisation aspects at data level, e.g. file, record or object virtualisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/06—Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
- G06F3/0601—Interfaces specially adapted for storage systems
- G06F3/0668—Interfaces specially adapted for storage systems adopting a particular infrastructure
- G06F3/067—Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Quality & Reliability (AREA)
- Databases & Information Systems (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a feature-based hybrid cloud platform data management system which comprises a plurality of data storage blocks for storing data with preset features, wherein a correlation factor is arranged between any two data storage blocks, the system authenticates the login of a user by an authentication unit, verifies the passing user permission and authority matching, a data access unit receives and processes data input by the user, a data distribution unit matches the processed data features and configures the processed data features to the corresponding data storage blocks, a data reading unit recombines and outputs data in one or more data storage blocks based on a reading request, and a data pushing unit pushes the data in one or more data storage blocks to a public cloud and/or a private cloud based on a preset rule. The cloud resource management system and the cloud resource management method realize unified operation and maintenance of a cloud environment and an on-line environment and an off-line environment, realize allocation and management of cloud resources, feature-based cloud cost allocation, ordered cloud uploading of data, data-level disaster tolerance, continuous optimization of a cloud architecture, and have long service life of a server.
Description
Technical Field
The invention relates to the technical field of digital information transmission, such as telegraph communication, in particular to a feature-based hybrid cloud platform data management system.
Background
Cloud computing is a service interaction and use mode, and refers to obtaining required services in an on-demand and easily extensible manner through a network, and the services can be IT and software, internet-related services, and other services, which means that computing capacity can also be circulated as a commodity through the internet.
The cloud and virtualization are moving the root of the enterprise's infrastructure, and new computing models brought by the cloud change storage and processing.
The cloud comprises public cloud, private cloud, mixed cloud and other forms; public cloud generally refers to a cloud that can be used, provided by a third-party provider for a user, which may be free or inexpensive, and the core attribute of the public cloud is shared resource service, which can provide services in the entire open public network today; the private cloud is constructed for a user to use independently, can be deployed in a firewall of an enterprise data center, and can also be deployed in a relatively safe host hosting place, and the core attribute of the private cloud is a proprietary resource; the hybrid cloud is fused with the public cloud and the private cloud, and the best effect can be obtained after the public cloud and the private cloud are mixed and matched.
It is expected that the hybrid cloud is a main mode for users, especially enterprise users, to select cloud computing in the future, and is also a development direction of cloud technology.
However, in the prior art, it is unclear when and under what decision to cloud data from the internal data storage server, and the disordered cloud-going of a large amount of data may result in an excessively large calculation amount of the data storage server, and in a serious case, may also result in a shortened service life of the server, easy paralysis, and failure to implement data-level disaster tolerance.
Disclosure of Invention
The invention solves the problems in the prior art and provides an optimized hybrid cloud platform data management system based on characteristics.
The technical scheme adopted by the invention is that the system for managing the data of the hybrid cloud platform based on the characteristics comprises the following steps:
the data storage blocks are used for storing data with preset characteristics; setting a correlation factor between any two data storage area blocks;
the authentication unit is used for authenticating the login of the user, and releasing and matching the authority of the user passing the authentication;
the data access unit is used for receiving data input by different users and processing the data;
the data distribution unit is used for carrying out feature matching on the processed data and allocating the processed data to the corresponding data storage block;
the data reading unit is used for recombining and outputting the data in one or more data storage blocks based on the reading request;
and the data pushing unit is used for pushing the data in the one or more data storage blocks to the public cloud and/or the private cloud based on a preset rule.
Preferably, a tag item for identifying a feature is provided in cooperation with any one of the data storage blocks, and the tag item is configured by a user with a preset authority.
Preferably, the association factor k e [ -1,1], a data storage array based on the association factor is constructed, the association factor between every two data storage blocks corresponds to one element of the data storage array, and an association pointer is set between any two data storage blocks which satisfy k e (0, 1).
Preferably, any user initiates a login request to the system, the authentication unit sends a response data packet to the current user within a preset network range, the response data packet comprises a check password, the user logs in based on the check password and a corresponding user name and key, and if the authentication is passed, the system releases the current user to acquire the authority corresponding to the user; the user's rights include readable and writable data storage blocks.
Preferably, the data access unit receives data entered by a user passing authentication; acquiring one or more label items corresponding to data, if the data storage blocks corresponding to the one or more label items are in the authority range of the current user, completely receiving and preparing to write, otherwise, returning the data outside the authority range of the current user, and receiving and preparing to write the rest of data; cleaning and supplementing default values to the data to be written;
and the data distribution unit acquires the label items of the processed data and writes the data into one or more data storage blocks.
Preferably, the data reading unit obtains a reading request of a user and a right corresponding to the current user;
screening the data storage blocks with user authority being readable, splicing and recombining data in the screened data storage blocks related to the output request, wherein data marks corresponding to the data storage blocks with the unreadable authority are missing;
and acquiring other associated data based on the association factor and the user authority, and establishing an associated read file.
Preferably, in the data pushing unit, the preset rule includes that the writable space in the data storage block is smaller than a preset value, pushed out according to time frequency, and pushed out according to data updating frequency;
and when the data of any data storage block is pushed out, one or more public clouds which can be accessed currently are obtained, loss accounting is carried out, and a scheme with a smaller loss accounting value is used for pushing out.
Preferably, when a data disaster occurs, the data is rolled back to the time of the last correct push and the tag items of the data storage blocks are acquired, so that the tag items correspond to one or more public clouds and/or private clouds, and the data at the time is acquired and retrieved.
Preferably, after the data retrieval is completed, a push-out is forcibly triggered for the data of the other data storage blocks.
Preferably, the system further comprises a safety alarm unit, and a disaster recovery early warning model is arranged in the safety alarm unit;
the disaster recovery early warning model acquires data characteristics from public cloud and big data and data warning information and disaster recovery information within a preset time period; constructing a sample set and a training set, and training the disaster recovery early warning model;
synchronously acquiring data warning information in the current system by the disaster recovery early warning model, and inputting the data warning information into the model to predict disaster recovery information;
and updating the model based on the false alarm and the measured data.
The invention provides an optimized mixed cloud platform data management system based on characteristics, which comprises a plurality of data storage blocks, wherein any data storage block is used for storing data with preset characteristics, a correlation factor is arranged between any two data storage blocks, the system authenticates the login of a user by an authentication unit, the verified user is passed and authority matched, the data access unit receives the data input by different users and processes the data, the data distribution unit is used for carrying out feature matching on the processed data and allocating the processed data to the corresponding data storage blocks, the data reading unit is used for recombining and outputting the data in one or more data storage blocks based on the reading request, and the data push unit is used for pushing the data in one or more data storage blocks to a public cloud and/or a private cloud based on a preset rule.
The invention has the beneficial effects that:
(1) unified operation and maintenance of a multi-cloud environment and an on-line environment and an off-line environment can be realized;
(2) the allocation and management of the cloud resources can be realized;
(3) feature-based cloud cost sharing can be achieved;
(4) the ordered cloud-up of data can be realized, and the service life of the server is long;
(5) data-level disaster tolerance can be realized;
(6) continuous optimization of the cloud architecture can be achieved.
Drawings
FIG. 1 is a schematic diagram of a system configuration of the present invention, in which arrows indicate the direction of data transmission;
fig. 2 is a schematic structural diagram of the present invention, which illustrates an example of a data disaster occurring in the last data storage block, wherein a dotted arrow indicates a data retrieving direction, and a solid arrow indicates data pushing out of other data storage blocks.
Detailed Description
The present invention is described in further detail with reference to the following examples, but the scope of the present invention is not limited thereto.
As shown in fig. 1, the present invention relates to a feature-based hybrid cloud platform data management system, which includes a plurality of data storage blocks, an authentication unit, a data access unit, a data allocation unit, a data readout unit, and a data push-out unit.
The data storage blocks are used for storing data with preset characteristics; setting a correlation factor between any two data storage area blocks;
and a label item for identifying the characteristics is arranged in cooperation with any one of the data storage blocks, and the label item is configured by a user with preset authority.
And the association factor k belongs to [ -1,1], constructing a data storage array based on the association factor, wherein the association factor between every two data storage blocks corresponds to one element of the data storage array, and an association pointer is set between any two data storage blocks meeting the condition that k belongs to (0, 1).
In the invention, the data storage block is improved, the traditional data storage block is subjected to feature division and is matched with each feature to set the label item, so that the data of the same service can be stored in the data storage blocks corresponding to different label items, the data can be effectively dispersed and summarized, the data can be stored according to a certain rule, and meanwhile, the data can be rapidly acquired based on the label items when the data is required to be utilized.
In the invention, the configuration setting of the label item is carried out by a user with preset authority.
In the invention, the association factor is configured between two different data storage blocks, and the association degree between the label item and the characteristic is represented in fact; the association factor k satisfies k e [ -1,1], when k is-1, it means that two data storage blocks are negatively associated, i.e. when there is one of them, data in another block cannot appear, when k is 0, it means that there is no relationship between the two data storage blocks, including a repulsion relationship, and when k is 1, it means that there is a strong association between the two data storage blocks; the data storage array is used for rapidly storing the relation between every two data storage area blocks so as to obtain rapid data recommendation; for example, for a data storage block corresponding to a tag item of a shared bandwidth, it is necessarily related to the number of people accessing the data storage block, and the correlation factor k between the data storage block and the exclusive bandwidth is obviously-1, and the correlation factor k between the data storage block and the property quality is 0.
In the invention, the associated pointer is arranged between any two data storage blocks meeting the k epsilon (0, 1), so that the management and the quick calling of data can be realized, and the data listed under different label items can be effectively integrated.
The authentication unit is used for authenticating the login of the user and performing release and authority matching on the user passing the authentication;
any user initiates a login request to the system, the authentication unit sends a response data packet to the current user in a preset network range, the response data packet comprises a check password, the user logs in based on the check password and a corresponding user name and a corresponding key, and if the authentication is passed, the system releases the current user to acquire the authority corresponding to the user; the user's rights include readable and writable data storage blocks.
In the invention, the login management and the authority matching operation of the user are completed by the authentication unit.
In the invention, after a user sends a login request, an authentication unit firstly receives a request data packet, and sends a response data packet with a check password after determining that the user is in a protected network range, and the user in a normal state can obtain the check password so as to realize authentication and login; and after obtaining the login information of the user, the authentication unit matches the authority of the user and is used for subsequent read-write processing.
The data access unit is used for receiving data input by different users and processing the data;
the data distribution unit is used for carrying out feature matching on the processed data and allocating the processed data to the corresponding data storage blocks;
the data access unit receives data input by a user passing the authentication; acquiring one or more label items corresponding to data, if the data storage blocks corresponding to the one or more label items are in the authority range of the current user, completely receiving and preparing to write, otherwise, returning the data outside the authority range of the current user, and receiving and preparing to write the rest of data; cleaning and supplementing the data to be written;
and the data distribution unit acquires the label items of the processed data and writes the data into one or more data storage blocks.
In the invention, based on the user authority acquired by the authentication unit, the work completed by the data access unit comprises the following steps:
accessing data to obtain a label item;
receiving data corresponding to the label item meeting the authority, and returning the data which is not in the writable authority range;
processing the accepted data, including but not limited to deleting duplicate data and supplementing missing data; if the missing data is in a default state, the missing data is directly supplemented, and if the missing data cannot be automatically supplemented, the missing data is prompted to be supplemented by a user.
In the invention, after the access processing of the data is finished, the data distribution unit writes the data into the corresponding data storage blocks respectively according to the label items; in fact, the data writing mode according to the label item (characteristic) avoids the situation of data batch loss when serious errors occur, and can automatically carry out estimation based on partial latest data and partial historical data acquired after errors through the built-in patching logic of the system, so that more correct contents are obtained, and the self-repair of the system is realized to the maximum extent; if the current user is 10 users and partial historical information and partial latest information of 10 users are read back after the information is read back, the invalid part in the partial historical information can be modified or covered according to the latest information after the data is read back, and the inference of the user information is realized based on the latest information.
The data reading unit is used for recombining and outputting the data in one or more data storage blocks based on the reading request;
the data reading unit acquires a reading request of a user and a right corresponding to the current user;
screening the data storage blocks with user authority being readable, splicing and recombining data in the screened data storage blocks related to the output request, wherein data marks corresponding to the data storage blocks with the unreadable authority are missing;
and acquiring other associated data based on the association factor and the user authority, and establishing an associated read file.
In the process of reading data, the work finished by the data reading unit comprises the following steps:
judging the reading request of the user based on the authority of the user, and only processing the user reading request with the user authority in a readable range;
the reading request of the user comprises the label item, the data in the data storage block is obtained based on the label item and is spliced, and the splicing rule is default and can be realized through pre-configuration;
establishing an associated read file based on the association factor and the user authority of the data storage block where the read data is located, wherein the associated read file is used for acquiring associated data meeting preset requirements together, and realizing quick reading of the data and intelligent realization of a system; the preset requirement is implemented based on the value of the association factor k.
The data pushing unit is used for pushing the data in the one or more data storage blocks to a public cloud and/or a private cloud based on a preset rule.
In the data pushing unit, a preset rule comprises that the writable space in the data storage block is smaller than a preset value, the writable space is pushed out according to time frequency and pushed out according to data updating frequency;
and when the data of any data storage block is pushed out, acquiring one or more public clouds which can be accessed currently, performing loss accounting, and pushing out a scheme with a smaller loss accounting value.
As shown in fig. 2, when a data disaster occurs, the data is rolled back to the time of the last correct push and the tag items of the data storage blocks are obtained, so that the tag items correspond to one or more public clouds and/or private clouds, and the data at the time is obtained and retrieved.
After the data retrieval is completed, the push-out is forcibly triggered to the data of other data storage blocks.
In the present invention, the rules of cloud on data include but are not limited to:
the writable space in the data storage block is smaller than a preset value, which generally does not occur in a network center with complete servers, but the data storage block needs to be clouded after more data is written in, so that the data can be timely backed up;
the deduction is performed at a time frequency, and is generally finished at an idle time, such as 00: 00, pushing out the data of the previous day;
the method is promoted according to the data updating frequency, and the data can be updated and backed up more quickly mainly aiming at the data storage block with more frequent data reading and writing operations; however, in this case, the data storage block often has a large data volume, so the data storage block can be pushed out in a breakpoint pushing manner, that is, the newly added data is segmented in a node manner, and is batched to the cloud when the data storage block is idle or the bandwidth occupancy is small.
In the invention, in the process of pushing out and uploading data, the data in the same data storage area block can be pushed out to the same public cloud or a plurality of public clouds, in the process, loss accounting is carried out based on real-time prices, specific service contents and total data volume to be pushed out of different public clouds, and a scheme with the minimum cost is selected for execution; this is a content that is easily understood by those skilled in the art, and those skilled in the art can set itself according to the needs, wherein the splitting of the service content should be decided by the user.
In the invention, when a data disaster occurs, the system realizes data rollback and retrieves the data corresponding to the latest correct push-out time from the public cloud and/or the private cloud; meanwhile, disaster recovery service is started, and smooth service is ensured.
In the invention, because the system safety problem may exist when a data disaster occurs, and further different data storage blocks may be affected step by step, after the data retrieval is completed, the data of other data storage blocks needs to be forcibly triggered and pushed out, so that the data cloud application and the data backup are completed.
The system also comprises a safety alarm unit, wherein a disaster recovery early warning model is arranged in the safety alarm unit;
the disaster recovery early warning model acquires data characteristics from public cloud and big data and data warning information and disaster recovery retrieval information within a preset time period; constructing a sample set and a training set, and training the disaster recovery early warning model;
the disaster recovery early warning model synchronously acquires data warning information in the current system, and inputs the data warning information into the model to predict disaster recovery retrieval information;
and updating the model based on the false alarm and the measured data.
In the invention, the disaster recovery early warning model can obtain characteristics based on the data alarm information and the disaster recovery information in a preset time period, meanwhile, in order to avoid cold start, big data and the characteristics thereof can be obtained, the model is constructed and used for correlating daily constant data alarm and data disaster triggering, and the updating iteration of the model is realized in the process of continuously expanding data, so that the disaster recovery early warning is more accurately realized until the disaster effect of immediately and timely early warning the data disaster is achieved after the daily data alarm triggering part of the characteristics is achieved.
In the invention, the disaster recovery early warning model can be realized based on a conventional neural network and data training, such as a BP neural network, which is a content that is easily understood by a person skilled in the art, and the person skilled in the art can set the model based on the requirement.
Based on the model, the invention enables a user to cloud or backup data into a disaster backup space when danger early warning occurs to the data within limited time, namely, the backup is completed, so that the effectiveness of subsequent data backup can be realized, the loss of the data and the suspension of the service are avoided, and the monitoring and the troubleshooting of the data safety can be more accurate.
Claims (10)
1. A hybrid cloud platform data management system based on features is characterized in that: the system comprises:
the data storage blocks are used for storing data with preset characteristics; setting a correlation factor between any two data storage area blocks;
the authentication unit is used for authenticating the login of the user, and releasing and matching the authority of the user passing the authentication;
the data access unit is used for receiving data input by different users and processing the data;
the data distribution unit is used for carrying out feature matching on the processed data and allocating the processed data to the corresponding data storage block;
the data reading unit is used for recombining and outputting the data in one or more data storage blocks based on the reading request;
and the data pushing unit is used for pushing the data in the one or more data storage blocks to the public cloud and/or the private cloud based on a preset rule.
2. The feature-based hybrid cloud platform data management system of claim 1, wherein: and a label item for identifying the characteristics is arranged in cooperation with any one of the data storage blocks, and the label item is configured by a user with preset authority.
3. The feature-based hybrid cloud platform data management system of claim 2, wherein: and the association factor k belongs to [ -1,1], constructing a data storage array based on the association factor, wherein the association factor between every two data storage blocks corresponds to one element of the data storage array, and an association pointer is set between any two data storage blocks meeting the condition that k belongs to (0, 1).
4. The feature-based hybrid cloud platform data management system of claim 1, wherein: any user initiates a login request to the system, the authentication unit sends a response data packet to the current user in a preset network range, the response data packet comprises a check password, the user logs in based on the check password and a corresponding user name and a corresponding key, and if the authentication is passed, the system releases the current user to acquire the authority corresponding to the user; the user's rights include readable and writable data storage blocks.
5. A feature-based hybrid cloud platform data management system according to claim 1 or 4, characterized by: the data access unit receives data input by a user passing the authentication; acquiring one or more label items corresponding to data, if the data storage blocks corresponding to the one or more label items are in the authority range of the current user, completely receiving and preparing to write, otherwise, returning the data outside the authority range of the current user, and receiving and preparing to write the rest of data; cleaning and supplementing the data to be written;
and the data distribution unit acquires the label items of the processed data and writes the data into one or more data storage blocks.
6. The system according to claim 1 or 2, wherein the system comprises: the data reading unit acquires a reading request of a user and a right corresponding to the current user;
screening the data storage blocks with user authority being readable, splicing and recombining data in the screened data storage blocks related to the output request, wherein data marks corresponding to the data storage blocks with the unreadable authority are missing;
and acquiring other associated data based on the association factor and the user authority, and establishing an associated read file.
7. The feature-based hybrid cloud platform data management system of claim 1, wherein: in the data pushing unit, a preset rule comprises that the writable space in the data storage block is smaller than a preset value, the writable space is pushed out according to time frequency and pushed out according to data updating frequency;
and when the data of any data storage block is pushed out, one or more public clouds which can be accessed currently are obtained, loss accounting is carried out, and a scheme with a smaller loss accounting value is used for pushing out.
8. The feature-based hybrid cloud platform data management system of claim 7, wherein: when a data disaster occurs, rolling back the data to the time of the latest correct push and acquiring the tag items of the data storage blocks, and acquiring the data at the time to retrieve by corresponding the tag items to one or more public clouds and/or private clouds.
9. The feature-based hybrid cloud platform data management system of claim 8, wherein: after the data retrieval is completed, the push-out is forcibly triggered to the data of other data storage blocks.
10. The feature-based hybrid cloud platform data management system of claim 1, wherein: the system also comprises a safety alarm unit, wherein a disaster recovery early warning model is arranged in the safety alarm unit;
the disaster recovery early warning model acquires data characteristics from public cloud and big data and data warning information and disaster recovery retrieval information within a preset time period; constructing a sample set and a training set, and training the disaster recovery early warning model;
the disaster recovery early warning model synchronously acquires data warning information in the current system, and inputs the data warning information into the model to predict disaster recovery retrieval information;
and updating the model based on the false alarm and the measured data.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210252890.XA CN114625320B (en) | 2022-03-15 | 2022-03-15 | Hybrid cloud platform data management system based on characteristics |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210252890.XA CN114625320B (en) | 2022-03-15 | 2022-03-15 | Hybrid cloud platform data management system based on characteristics |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114625320A true CN114625320A (en) | 2022-06-14 |
| CN114625320B CN114625320B (en) | 2024-01-02 |
Family
ID=81902838
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210252890.XA Active CN114625320B (en) | 2022-03-15 | 2022-03-15 | Hybrid cloud platform data management system based on characteristics |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114625320B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108959337A (en) * | 2018-03-22 | 2018-12-07 | 中国平安人寿保险股份有限公司 | Big data acquisition methods, device, equipment and storage medium |
| CN110515895A (en) * | 2019-08-30 | 2019-11-29 | 弭迺彬 | The method and system of storage are associated in big data storage system to data file |
| CN110555138A (en) * | 2019-08-05 | 2019-12-10 | 慧镕电子系统工程股份有限公司 | hybrid cloud storage method under cloud computing architecture |
| WO2020062131A1 (en) * | 2018-09-29 | 2020-04-02 | 北京连云决科技有限公司 | Container cloud management system based on blockchain technology |
| CN111030893A (en) * | 2019-12-31 | 2020-04-17 | 上海途鸽数据科技有限公司 | Method and device for analyzing user behaviors in cloud communication application scene |
| US20210176191A1 (en) * | 2019-12-06 | 2021-06-10 | Micro Focus Llc | Recommendation engine for resource tagging |
| CN113836176A (en) * | 2021-08-19 | 2021-12-24 | 重庆恩谷信息科技有限公司 | Information integration service system of cloud data |
-
2022
- 2022-03-15 CN CN202210252890.XA patent/CN114625320B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108959337A (en) * | 2018-03-22 | 2018-12-07 | 中国平安人寿保险股份有限公司 | Big data acquisition methods, device, equipment and storage medium |
| WO2020062131A1 (en) * | 2018-09-29 | 2020-04-02 | 北京连云决科技有限公司 | Container cloud management system based on blockchain technology |
| CN110555138A (en) * | 2019-08-05 | 2019-12-10 | 慧镕电子系统工程股份有限公司 | hybrid cloud storage method under cloud computing architecture |
| CN110515895A (en) * | 2019-08-30 | 2019-11-29 | 弭迺彬 | The method and system of storage are associated in big data storage system to data file |
| US20210176191A1 (en) * | 2019-12-06 | 2021-06-10 | Micro Focus Llc | Recommendation engine for resource tagging |
| CN111030893A (en) * | 2019-12-31 | 2020-04-17 | 上海途鸽数据科技有限公司 | Method and device for analyzing user behaviors in cloud communication application scene |
| CN113836176A (en) * | 2021-08-19 | 2021-12-24 | 重庆恩谷信息科技有限公司 | Information integration service system of cloud data |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114625320B (en) | 2024-01-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11520922B2 (en) | Method for personal data administration in a multi-actor environment | |
| US11393266B2 (en) | Blockchain configuration history for aircraft maintenance, modification, and activity tracking | |
| US10826799B2 (en) | Apparatus for providing cloud service based on cloud service brokerage and method thereof | |
| US11080419B2 (en) | Distributed data rights management for peer data pools | |
| US8701182B2 (en) | Method and apparatus for process enforced configuration management | |
| US8126914B2 (en) | Selecting a resource manager to satisfy a service request | |
| US20220067669A1 (en) | Predictive device maintenance | |
| WO2017092447A1 (en) | Method and apparatus for data quality management and control | |
| US20200374292A1 (en) | Intelligent device security | |
| US20210037072A1 (en) | Managed distribution of data stream contents | |
| CN114363352B (en) | Cross-chain interaction method of Internet of things system based on block chain | |
| US20200250587A1 (en) | Framework for multi-tenant data science experiments at-scale | |
| US11366821B2 (en) | Epsilon-closure for frequent pattern analysis | |
| CN113168315A (en) | Upgrading based on analysis from multiple sources | |
| CN114625320A (en) | Hybrid cloud platform data management system based on characteristics | |
| US20220278989A1 (en) | Access control for private channels in a channel-based discussion system | |
| CN110493326B (en) | Zookeeper-based cluster configuration file management system and method | |
| US20140143349A1 (en) | Distributed Architecture Data Transfer System | |
| CN116455891B (en) | Safety exchange system between data networks | |
| CN115033187B (en) | Big data based analysis management method | |
| US20240106830A1 (en) | Managing access level permissions by a distributed ledger network | |
| CN116382596B (en) | Space-time big data storage method and system based on distributed technology | |
| CN113254415B (en) | Method and device for processing read request of distributed file system | |
| CN111163088B (en) | Message processing method, system and device and electronic equipment | |
| WO2018184509A1 (en) | Data processing method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |