CN111400280A - System and method for realizing data encryption synchronous optimization processing under big data environment - Google Patents
System and method for realizing data encryption synchronous optimization processing under big data environment Download PDFInfo
- Publication number
- CN111400280A CN111400280A CN202010173889.9A CN202010173889A CN111400280A CN 111400280 A CN111400280 A CN 111400280A CN 202010173889 A CN202010173889 A CN 202010173889A CN 111400280 A CN111400280 A CN 111400280A
- Authority
- CN
- China
- Prior art keywords
- data
- encryption
- module
- algorithm
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2365—Ensuring data consistency and integrity
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/602—Providing cryptographic facilities or services
Abstract
The invention relates to a system for realizing data encryption synchronous optimization processing in a big data environment, which comprises an initialization module, a data processing module and a data processing module, wherein the initialization module is used for creating tables and inserted data related to a database; the field and algorithm template design module is connected with the initialization module and is used for configuring an encryption algorithm and field information; the encryption task configuration module is used for configuring an encryption template for the encryption job task and binding fields and specific algorithms related to the encrypted service data; and the encrypted data synchronization module is used for starting the encrypted task and synchronizing data. The invention also relates to a data encryption synchronous optimization processing method under the big data environment. The system and the method for realizing the synchronous optimization processing of the data encryption in the big data environment of the invention are adopted, and the aim of synchronous optimization of the data encryption is achieved by designing templates with different fields and different algorithms, then configuring encryption algorithms required by encryption fields and encryption fields by the encryption templates and binding the specific encryption algorithms to the fields needing encryption or desensitization.
Description
Technical Field
The invention relates to the field of data optimization, in particular to the field of data asset management, and specifically relates to a system and a method for realizing synchronous optimization processing of data encryption in a big data environment.
Background
The data service sharing platform is positioned in a sharing channel of longitudinally through and transversely interconnected enterprise data resources, so that the data service sharing platform becomes a data factory of enterprises, organizations and departments, and mainly starts from a series of problems of safety control, service management, service consumption, service development efficiency and the like, a unified platform is provided for unified service control over multi-source and multi-type data, and the enterprises are helped to use the data more effectively and reliably.
The data sharing platform is an important mode for processing data exchange, is a management mode for planning and arranging data and providing the data, comprises the flow and trend of the whole data, and realizes the data value through effective management. In the using process of the system, encryption modes of different dimensions directly influence the data extraction efficiency of the data sharing platform, whether a service scene can be met, the user experience degree and the like, and influence the efficiency of data asset management to a certain extent.
At present, in the use of a data platform, the use of data synchronous encryption is supported, that is, database data of a data source is synchronized into a target database according to configuration information of synchronous operation, and then the encrypted data is realized through a task of online operation, and the specific implementation steps are as follows:
1. initializing an environment, configuring a database and initializing the database;
2. configuring data source and target library information resources;
3. configuring data encryption information and a synchronization task;
4. configuring timing information such as calendar, frequency and the like according to the requirement of synchronous encrypted data;
5. a data encryption synchronization task is performed.
According to the steps, in a data encryption synchronization task in a data platform, only conventional data encryption synchronization requirements are met, but in actual project use, management of data encryption synchronization is more detailed, the requirement of current synchronous storage data cannot be met due to single encryption and encryption algorithms of an integral data field, the requirement of using the data cannot be met by using the current data synchronization method, and the user experience of the data platform is reduced.
The existing data platform can select a current data encryption synchronization method, the encryption synchronization function of the database realized by configuring the operation is realized by configuring the operation information of a data source and a target library, then adding the encryption attribute of a certain table and selecting an algorithm needing encryption, but in the use of actual projects, the management of data encryption synchronization is more precise, the whole encryption or the algorithm is single and cannot meet the current requirement, at the moment, the aim of encrypting and synchronizing data by fields and multiple algorithms cannot be achieved, the current data encryption synchronization method obviously cannot completely meet the current requirement, and the user experience of the data sharing platform is reduced.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provides a system and a method for realizing data encryption synchronous optimization processing in a big data environment, which have the advantages of high efficiency, high accuracy and wide application range.
In order to achieve the above purpose, the system and method for implementing data encryption synchronous optimization processing in big data environment of the present invention are as follows:
the system for realizing data encryption synchronous optimization processing under the big data environment is mainly characterized by comprising the following components:
an initialization module for creating tables and insert data involved in the database;
the field and algorithm template design module is connected with the initialization module and is used for configuring an encryption algorithm and field information;
the encryption task configuration module is connected with the field and algorithm template design module and is used for configuring an encryption task into an encryption template and binding fields and specific algorithms related to encrypted service data;
and the encrypted data synchronization module is connected with the encrypted task configuration module and used for starting the encrypted task and synchronizing data.
Preferably, the field and algorithm template design module includes a field setting information encryption unit connected to the initialization module and the encryption task configuration module, and is configured to select an encryption algorithm in a templated manner according to the synchronized field.
Preferably, the system further comprises a master library and a slave library, wherein the master library is connected with the field and algorithm template design module and is used for storing a data source of the synchronous data; the slave library is connected with a field and algorithm template design module and used for updating the data of the target library.
Preferably, the configuration content of the encryption task configuration module includes information of an encryption task operation template, a database mapping relationship, a table mapping relationship, an encryption template, and parameter settings in a field and algorithm template design module.
Preferably, the initialization module performs data addition, data modification and data deletion on the table.
The method for realizing data encryption synchronous optimization processing under the big data environment by using the system is mainly characterized by comprising the following steps:
(1) the initialization module creates tables and insertion data related in the database;
(2) the field and algorithm template design module configures an encryption algorithm and field information;
(3) the encryption task configuration module configures an encryption template for the encryption job task and binds fields and specific algorithms related to the encrypted service data;
(4) and the encrypted data synchronization module starts an encrypted task and synchronizes data.
Preferably, the step (4) further includes a step of encrypting data source data, specifically including the following steps:
(4.1) online synchronization table EMP data;
(4.2) encrypting the partial field by a separate encryption algorithm;
(4.3) encrypting the rest of the data by different encryption algorithms.
The system and the method for realizing the synchronous optimization processing of the data encryption in the big data environment of the invention are adopted, and the aim of synchronous optimization of the data encryption is achieved by designing templates with different fields and different algorithms, then configuring encryption algorithms required by encryption fields and encryption fields by the encryption templates and binding the specific encryption algorithms to the fields needing encryption or desensitization.
Drawings
Fig. 1 is a schematic structural diagram of a system for implementing data encryption synchronization optimization processing in a big data environment according to the present invention.
Fig. 2 is a flowchart of a data encryption synchronization optimization processing method in a big data environment according to the present invention.
Detailed Description
In order to more clearly describe the technical contents of the present invention, the following further description is given in conjunction with specific embodiments.
The system for realizing data encryption synchronous optimization processing in the big data environment comprises the following steps:
an initialization module for creating tables and insert data involved in the database;
the field and algorithm template design module is connected with the initialization module and is used for configuring an encryption algorithm and field information;
the encryption task configuration module is connected with the field and algorithm template design module and is used for configuring an encryption task into an encryption template and binding fields and specific algorithms related to encrypted service data;
and the encrypted data synchronization module is connected with the encrypted task configuration module and used for starting the encrypted task and synchronizing data.
As a preferred embodiment of the present invention, the field and algorithm template design module includes a field setting information encryption unit, which is connected to the initialization module and the encryption task configuration module, and is configured to select the encryption algorithm in a templated manner according to the synchronized fields.
As a preferred embodiment of the present invention, the system further comprises a master library and a slave library, wherein the master library is connected with the field and algorithm template design module and is used for storing a data source of the synchronous data; the slave library is connected with a field and algorithm template design module and used for updating the data of the target library.
As a preferred embodiment of the present invention, the configuration content of the encryption task configuration module includes information of an encryption task job template, a database mapping relationship, a table mapping relationship, an encryption template, and parameter settings in a field and algorithm template design module.
As a preferred embodiment of the present invention, the initialization module performs data addition, data modification, and data deletion on a table.
The invention discloses a data encryption synchronous optimization processing method under the environment of big data by using the system, which comprises the following steps:
(1) the initialization module creates tables and insertion data related in the database;
(2) the field and algorithm template design module configures an encryption algorithm and field information;
(3) the encryption task configuration module configures an encryption template for the encryption job task and binds fields and specific algorithms related to the encrypted service data;
(4) the encrypted data synchronization module starts an encrypted task and synchronizes data;
(4.1) online synchronization table EMP data;
(4.2) encrypting the partial field by a separate encryption algorithm;
(4.3) encrypting the rest of the data by different encryption algorithms.
The invention relates to a method for data encryption synchronization optimization based on a data sharing platform. At present, in the use of a data sharing platform, the use of data synchronization integral encryption is supported, that is, database data of a data source is encrypted and synchronized to a target database according to configuration information of a synchronization task. The encryption of data in the current data platform is to adopt integral encryption to synchronize the encrypted data to a target database through a job task, but in the actual using process, higher requirements are placed on the synchronous encryption of the data, the synchronous encryption of the data from a source database to the target database needs to be performed by field encryption and data synchronization is performed by using different encryption algorithms, namely the synchronous encryption of the data from the source database to the target database needs to be performed according to different fields and different algorithms and then is subjected to value dropping.
The invention is divided into an initialization module, a field and algorithm template design module, an encryption task configuration module and an encryption data synchronization module, as shown in figure 1.
The initialization module is used for building a data platform, needs to meet basic conditions for encryption operation task operation, mainly performs preparation such as data platform script initialization, data platform configuration installation and the like, and aims to realize the operation of the data platform;
the field and algorithm template design module is used for adding data synchronization to an encryption algorithm required in a target database when an online encryption job task is created, judging whether the synchronized fields contain information such as a main key, an alias, a column name, a type and a column, and using different encryption algorithms in a template mode when the job is created;
the encryption task configuration module is used for binding fields related to encrypted service data and specific algorithms by using an encryption template in an encryption job task configuration field and algorithm template design module;
the encryption data synchronization module is used for realizing synchronization and encryption of the target database and the data source data according to the configuration combination field of the encryption job task configuration module and the algorithm template design module.
Initialization module
The initialization module is used for building a data platform, needs to meet basic conditions of encryption operation task operation, mainly performs preparation such as data platform script initialization, data platform configuration installation and the like, aims to realize the operation of the data platform, specifically comprises an initialization data script in the data platform, creates a table related to an index database, inserts data and installs products, only comprises simplest table creation and data addition, and also adds new data in the using process of the system.
The specific description information involved in the operation for database initialization is as follows:
after the initial completion of the information of the system database table, the database has hundreds of tables of data;
tables and data of data source and target libraries depend on the system
The number of tables is large, the tables are mainly added, modified and deleted, and specific scripts for adding data are not described here.
Second, field and algorithm template design module
The field and algorithm template design module is used for adding an encryption algorithm required by data synchronization to a target database when an online encryption job task is created, and whether the synchronized fields contain information such as a main key, an alias, a column name, a type and a column, and the synchronized fields can be used for template use of different encryption algorithms when the job is created.
The MySQ L database is selected as a data source of synchronization data, and the hbase is selected as a target database
The module mainly comprises a field setting information encryption algorithm, wherein the types comprise common data types such as String, Integer, date, L ong and float, the data types required by the project can be increased, more field information can be set according to actual needs, and other or more encryption algorithms can be set according to actual needs.
The master library is used for storing data (data source), the encryption template is used for processing data which needs to be encrypted when encryption job tasks are synchronized, and the slave library is used for updating the data of the target library, so that the function of freely encrypting the data is realized.
Third, encrypt task configuration module
The encryption task configuration module is used for binding fields related to encrypted service data and specific algorithms by using an encryption template in an encryption task configuration field and algorithm template design module.
The encryption task configuration is configured on-line encryption tasks according to information of a data source, an encryption template and a target library, and mainly comprises parameters including information of the encryption task template, a database mapping relation, a table mapping relation, the encryption template and the like, and parameter setting in a field and algorithm template design module.
Fourth, encrypt the data synchronous module
The encryption data synchronization module is used for realizing synchronization and encryption of the target database and the data source data according to the configuration combination field of the encryption job task configuration module and the algorithm template design module.
After the online encryption task and the parameters in the field and algorithm template design module are configured, the online encryption task is started, the data needing to be decrypted in the data source is synchronized, and the online encryption task synchronizes the sensitive information and the data needing to be encrypted to the target library.
The section takes a method for synchronously optimizing by using data encryption in the information industry as a specific embodiment.
In the implementation case of production data, the information of the (processed) customer data is identified through business research, and part of the data is shown in the following table:
| EMPNO | ENAME | JOB | MGR | HIREDATE |
| 8 | jack8 | work2 | 5 | 2019-12-30 11:40:38 |
| 9 | jack9 | work3 | 12 | 2019-09-30 11:40:38 |
| 10 | jack1101 | work1101 | 3 | 2019-10-30 11:40:38 |
| 11 | jack110 | work110 | 3 | 2019-10-30 11:40:38 |
| 12 | jack11 | work11 | 3 | 2019-10-30 11:40:38 |
| 13 | jack7 | work1 | 9 | 2019-11-30 11:40:38 |
| … | … | … | … | … |
after obtaining the customer data table, the method according to the invention is mainly implemented as shown in fig. 2.
Initialization module
The initialization module is a basic condition required by data platform construction, mainly refers to preparation such as database initialization, data platform configuration installation and the like, aims to realize operation of the data platform, specifically includes an initialization data script in the data platform, and refers to table creation and data insertion and product installation related to the database.
The database table information includes hundreds of tables of data.
The initial files of the part are sql scripts, which comprise operations of deleting an old table, adding a new table, adding an index, inserting data and the like, and can be directly imported and executed according to the sequence. The specific scripts are many, and are not specifically described here, and only a partial script description which needs synchronization is introduced, as follows:
create table EMP
(
EMPNO INT(4)PRIMARY KEY,
ENAME VARCHAR(100),
JOB VARCHAR(100),
MGR INT(4),
HIREDATE datetime
)；
inserting data:
INSERT INTO`tuomin`.`EMP`(`EMPNO`,`ENAME`,`JOB`,`MGR`,`HIREDATE`)VALUES(8,'jack8','work2',5,'2019-12-30 11:40:38')；
INSERT INTO`tuomin`.`EMP`(`EMPNO`,`ENAME`,`JOB`,`MGR`,`HIREDATE`)VALUES(9,'jack9','work3',12,'2019-09-30 11:40:38')；
INSERT INTO`tuomin`.`EMP`(`EMPNO`,`ENAME`,`JOB`,`MGR`,`HIREDATE`)VALUES(10,'jack1101','work1101',3,'2019-10-30 11:40:38')；
INSERT INTO`tuomin`.`EMP`(`EMPNO`,`ENAME`,`JOB`,`MGR`,`HIREDATE`)VALUES(11,'jack110','work110',3,'2019-10-30 11:40:38')；
INSERT INTO`tuomin`.`EMP`(`EMPNO`,`ENAME`,`JOB`,`MGR`,`HIREDATE`)VALUES(12,'jack11','work11',3,'2019-10-30 11:40:38')；
INSERT INTO`tuomin`.`EMP`(`EMPNO`,`ENAME`,`JOB`,`MGR`,`HIREDATE`)VALUES(13,'jack7','work1',9,'2019-11-30 11:40:38')；……
second, field and algorithm template design module
The field and algorithm template design module is used for adding an encryption algorithm required by data synchronization to a target database when an online encryption job task is created, and whether the synchronized fields contain information such as a main key, an alias, a column name, a type and a column, and the synchronized fields can be used for template use of different encryption algorithms when the job is created.
The MySQ L database is selected as a data source of synchronization data, and the hbase is selected as a target database
The MySQ L database is selected as a data source of synchronization data, and the hbase is selected as a target database
The field setting information is as follows:
the types include (String, Integer, date, L ong, float, etc. common data types, and may also add the data types required by the project), and may also set more field information according to the actual needs.
The encryption algorithm is as follows:
| serial number | Algorithm | Remarks for note |
| 1 | IRREVERSIBLE_SHA | |
| 2 | IRREVERSIBLE_MD5 | |
| 3 | IRREVERSIBLE_DFA | |
| 4 | IRREVERSIBLE_HMAC | |
| 5 | REVERSIBLE_BASE64 | |
| 6 | REVERSIBLE_ENCRYPTION_AES | |
| 7 | REVERSIBLE_REG_REPLACE | |
| 8 | National secret (SM1/SM2/SM3/SM4 …) | |
| … | … | … |
Other or more encryption algorithms may be provided according to actual needs.
The master library is used for storing data (data source), the encryption template is used for processing data which needs to be encrypted when encryption job tasks are synchronized, and the slave library is used for updating the data of the target library, so that the function of freely encrypting the data is realized.
Three, real-time task configuration module
The encryption task configuration module is used for binding fields related to encrypted service data and specific algorithms by using an encryption template in an encryption task configuration field and algorithm template design module.
The encryption task configuration is configured on-line encryption tasks according to information of a data source, an encryption template and a target library, and mainly comprises parameters including information of the encryption task template, a database mapping relation, a table mapping relation, the encryption template and the like, and parameter setting in a field and algorithm template design module.
The configuration information is as follows:
| serial number | Alias name | Main key | Column name | Type (B) | Index value |
| 1 | EMPNO | Y | EMPNO | Integer | |
| 2 | ENAME | N | ENAME | String | |
| 3 | JOB | N | JOB | String | |
| 4 | MGR | N | MGR | Integer | |
| 5 | HIREDATE | N | HIREDATE | date |
| Serial number | Field desensitization algorithm | Character parameters | Replacing characters | Date format |
| 1 | ||||
| 2 | REVERSIBLE_REG_REPLACE | jack110 | @@@ | |
| 3 | IRREVERSIBLE_MD5 | work110 | ||
| 4 | ||||
| 5 | yyyy/MM/dd HH:mm:ss.SSS |
The encryption algorithm is not selected by EMPNO and MGR, the JACK110 is replaced by @ @ through ENAME combined with the algorithm REVERSIB L E _ REG _ REP L ACE, the work110 is encrypted by the algorithm IRREVERSIB L E _ MD5 through JOB, the format processing time parameter is used by HIREDATE, and the algorithm can be selected by each field according to actual needs.
In the process of using encryption, an overall algorithm can be configured, the selection of the overall algorithm is basically consistent with that of the individual field configuration algorithm, if the overall algorithm is used, the field can be encrypted without configuring the individual algorithm, the overall algorithm is used by default, and if the field uses the individual field encryption algorithm, the configured individual encryption algorithm is only adopted regardless of whether the overall algorithm is configured or not.
Fourth, encrypt the data synchronous module
The encryption data synchronization module is used for realizing synchronization and encryption of the target database and the data source data according to the configuration combination field of the encryption job task configuration module and the algorithm template design module.
After the online encryption task and the parameters in the field and algorithm template design module are configured, the online encryption task is started, the data needing to be decrypted in the data source is synchronized, and the online encryption task synchronizes the sensitive information and the data needing to be encrypted to the target library.
Part of the raw data is as follows:
the data source data is encrypted according to the following rules:
1. online synchronization table EMP data;
2. using a separate encryption algorithm;
3. encrypting a part of the field;
4. the encryption field ENAME uses the algorithm REVERSIB L E _ REG _ REP L ACE, the rule is @ @ replaces jack110, the JOB uses the algorithm IRREVERSIB L E _ MD5, the rule is encryption word 110, and HIREDATE processes the time parameter using the format, the format is yyy/MM/dd HH: MM: ss.SSS.
The data of the part after the execution of the job is as follows:
the data which needs to be encrypted in the source library is synchronized in the target library, so that the aim of optimizing the encrypted synchronous data is fulfilled.
The system and the method for realizing the synchronous optimization processing of the data encryption in the big data environment of the invention are adopted, and the aim of synchronous optimization of the data encryption is achieved by designing templates with different fields and different algorithms, then configuring encryption algorithms required by encryption fields and encryption fields by the encryption templates and binding the specific encryption algorithms to the fields needing encryption or desensitization.
In this specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (7)
1. A system for realizing data encryption synchronous optimization processing in a big data environment is characterized by comprising:
an initialization module for creating tables and insert data involved in the database;
the field and algorithm template design module is connected with the initialization module and is used for configuring an encryption algorithm and field information;
the encryption task configuration module is connected with the field and algorithm template design module and is used for configuring an encryption task into an encryption template and binding fields and specific algorithms related to encrypted service data;
and the encrypted data synchronization module is connected with the encrypted task configuration module and used for starting the encrypted task and synchronizing data.
2. The system for implementing synchronous optimization processing of data encryption under big data environment of claim 1, wherein the field and algorithm template design module comprises a field setting information encryption unit connected with the initialization module and the encryption task configuration module for templated selection of encryption algorithm according to the synchronous field.
3. The system for realizing data encryption synchronous optimization processing under the big data environment according to claim 1, characterized in that the system further comprises a master library and a slave library, wherein the master library is connected with a field and algorithm template design module and used for storing a data source of synchronous data; the slave library is connected with a field and algorithm template design module and used for updating the data of the target library.
4. The system for implementing synchronous optimization processing of data encryption under the big data environment according to claim 1, wherein the configuration content of the encryption task configuration module includes information of an encryption task job template, a database mapping relationship, a table mapping relationship, an encryption template, and parameter settings in a field and algorithm template design module.
5. The system for implementing data encryption synchronization optimization processing in a big data environment according to claim 1, wherein the initialization module performs data addition, data modification and data deletion on a table.
6. A data encryption synchronous optimization processing method under the environment of realizing big data based on the system of claim 1 is characterized by comprising the following steps:
(1) the initialization module creates tables and insertion data related in the database;
(2) the field and algorithm template design module configures an encryption algorithm and field information;
(3) the encryption task configuration module configures an encryption template for the encryption job task and binds fields and specific algorithms related to the encrypted service data;
(4) and the encrypted data synchronization module starts an encrypted task and synchronizes data.
7. The method for implementing data encryption synchronization optimization processing in a big data environment according to claim 5, wherein the step (4) further includes a step of encrypting data source data, and specifically includes the following steps:
(4.1) online synchronization table EMP data;
(4.2) encrypting the partial field by a separate encryption algorithm;
(4.3) encrypting the rest of the data by different encryption algorithms.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010173889.9A CN111400280A (en) | 2020-03-13 | 2020-03-13 | System and method for realizing data encryption synchronous optimization processing under big data environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010173889.9A CN111400280A (en) | 2020-03-13 | 2020-03-13 | System and method for realizing data encryption synchronous optimization processing under big data environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111400280A true CN111400280A (en) | 2020-07-10 |
Family
ID=71432474
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010173889.9A Pending CN111400280A (en) | 2020-03-13 | 2020-03-13 | System and method for realizing data encryption synchronous optimization processing under big data environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111400280A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111859438A (en) * | 2020-07-31 | 2020-10-30 | 上海观安信息技术股份有限公司 | Reversible desensitization encryption algorithm with specified length |
| CN112000989A (en) * | 2020-09-01 | 2020-11-27 | 上海英方软件股份有限公司 | Data desensitization device, system and method based on database synchronization |
| CN112287021A (en) * | 2020-07-13 | 2021-01-29 | 上海柯林布瑞信息技术有限公司 | Data real-time synchronization parameter generation method, data real-time synchronization parameter synchronization method, data real-time synchronization parameter generation device, data real-time synchronization parameter synchronization device, storage medium and terminal |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140137262A1 (en) * | 2012-11-12 | 2014-05-15 | Epi-Use Systems, Ltd | Secure data copying |
| CN108259412A (en) * | 2016-12-28 | 2018-07-06 | 中国移动通信集团湖北有限公司 | The methods, devices and systems of information processing |
| CN110084059A (en) * | 2019-03-21 | 2019-08-02 | 深圳壹账通智能科技有限公司 | A kind of method, apparatus and computer equipment of banking system data configuration block chain |
-
2020
- 2020-03-13 CN CN202010173889.9A patent/CN111400280A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140137262A1 (en) * | 2012-11-12 | 2014-05-15 | Epi-Use Systems, Ltd | Secure data copying |
| CN108259412A (en) * | 2016-12-28 | 2018-07-06 | 中国移动通信集团湖北有限公司 | The methods, devices and systems of information processing |
| CN110084059A (en) * | 2019-03-21 | 2019-08-02 | 深圳壹账通智能科技有限公司 | A kind of method, apparatus and computer equipment of banking system data configuration block chain |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112287021A (en) * | 2020-07-13 | 2021-01-29 | 上海柯林布瑞信息技术有限公司 | Data real-time synchronization parameter generation method, data real-time synchronization parameter synchronization method, data real-time synchronization parameter generation device, data real-time synchronization parameter synchronization device, storage medium and terminal |
| CN112287021B (en) * | 2020-07-13 | 2024-04-05 | 上海柯林布瑞信息技术有限公司 | Method and device for generating and synchronizing real-time data synchronization parameters, storage medium and terminal |
| CN111859438A (en) * | 2020-07-31 | 2020-10-30 | 上海观安信息技术股份有限公司 | Reversible desensitization encryption algorithm with specified length |
| CN112000989A (en) * | 2020-09-01 | 2020-11-27 | 上海英方软件股份有限公司 | Data desensitization device, system and method based on database synchronization |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111400280A (en) | System and method for realizing data encryption synchronous optimization processing under big data environment | |
| CN110334152B (en) | Data synchronization method and device and server | |
| TWI628551B (en) | Data library copying method and device based on log parsing | |
| WO2021051612A1 (en) | Automatic data authorization desensitization method, system, device, and storage medium | |
| US10417256B2 (en) | Synchronization adapter for synchronizing application data | |
| US9442996B2 (en) | Enabling collaborative development of a database application across multiple database management systems | |
| US20070195959A1 (en) | Synchronizing encrypted data without content decryption | |
| JP2018049656A (en) | Method of updating data table of key-value database and apparatus for updating table data | |
| US10915521B2 (en) | Blockchain gateway device and associated method of use | |
| CN106919697B (en) | Method for simultaneously importing data into multiple Hadoop assemblies | |
| WO2019019706A1 (en) | Data table backup method based on oracle database, and server | |
| CN105893016A (en) | Log recording system and method based on MVC (Model View Controller) framework | |
| CN111753320A (en) | Data encryption method and device based on interceptor and computer equipment | |
| CN109802832A (en) | A kind of processing method of data file, system, big data processing server and computer storage medium | |
| US11243942B2 (en) | Parallel stream processing of change data capture | |
| CN111737227A (en) | Data modification method and system | |
| EP2904520B1 (en) | Reference data segmentation from single to multiple tables | |
| CN104216721A (en) | Method for issuing configuration before starting of operating system | |
| CN113656384A (en) | Data processing method, distributed database system, electronic device and storage medium | |
| CN107392560A (en) | A kind of Excel list datas issue acquisition method and system based on internet | |
| US10949423B2 (en) | Operation management device, operation management method, and operation management system | |
| WO2023066222A1 (en) | Data processing method and apparatus, and electronic device, storage medium and program product | |
| WO2014000825A1 (en) | A method for maintaining one or more table values for a number of tables in a database system | |
| WO2019173766A1 (en) | Systems and methods for secure data storage and retrieval | |
| CN106471510A (en) | Compound document accesses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |