CN111444536A - Database design method and system suitable for mimicry environment - Google Patents
Database design method and system suitable for mimicry environment Download PDFInfo
- Publication number
- CN111444536A CN111444536A CN202010212954.4A CN202010212954A CN111444536A CN 111444536 A CN111444536 A CN 111444536A CN 202010212954 A CN202010212954 A CN 202010212954A CN 111444536 A CN111444536 A CN 111444536A
- Authority
- CN
- China
- Prior art keywords
- request
- database
- result
- result information
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000013461 design Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 title claims abstract description 13
- 238000012545 processing Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000005012 migration Effects 0.000 description 1
- 238000013508 migration Methods 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/55—Detecting local intrusion or implementing counter-measures
- G06F21/552—Detecting local intrusion or implementing counter-measures involving long-term monitoring or reporting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/604—Tools and structures for managing or administering access control systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- Health & Medical Sciences (AREA)
- Bioethics (AREA)
- General Health & Medical Sciences (AREA)
- Automation & Control Theory (AREA)
- Databases & Information Systems (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention relates to a database design method and a system suitable for a mimicry environment, which comprises the following steps: the request resolver receives database access requests sent by a plurality of executives, reasonably groups the database access requests according to the database access requests, performs consistency resolution on a plurality of request information in the same group and generates proper resolution result information, and sends the resolution ID and the executive body list of the group to the result distributor; the request resolver sends the resolver result information to the database application module; the database application module receives the arbitration result information sent by the request arbitrator, performs real database access operation, and sends the operation result information to the result distributor; the result distributor receives the data access result information, searches the executive body list according to the arbitration ID in the result information, and simultaneously distributes the result information to all executive bodies in the list; and each executive body receives the database operation result information, the database access is finished, and the subsequent operation is continued.
Description
Technical Field
The invention relates to the technical field of databases, in particular to a database design method and a database design system suitable for a mimicry environment.
Background
In the existing application mimicry construction scheme, it is commonly adopted that each executive runs a set of independent database for independent storage of data of each executive. This solution has two problems:
1) because each executive body data is independently stored, when the executive bodies are switched, a long time is consumed for carrying out data synchronization operation among the executive bodies, and the usability of the whole mimicry system is further reduced.
2) In order to ensure strong consistency of data among execution bodies, common randomness factors in the existing application need to be eliminated by modifying application source codes, the workload is large and complicated, and the difficulty of mimicry transformation is increased. Such as a primary key and a time stamp in a database in application development, are usually generated autonomously by database software, but in a mimicry environment, the two parts need to be generated by an application program according to a specified rule at each execution body so as to ensure the strong unity of data.
Disclosure of Invention
Aiming at the problems and the defects in the prior art, the invention provides a database design method and a database design system suitable for a mimicry environment.
The invention solves the technical problems through the following technical scheme:
the embodiment provides a database design method suitable for a mimicry environment, which is characterized by comprising the following steps of:
s1, the request resolver receives database access requests sent by a plurality of heterogeneous executors;
s2, the request resolver reasonably groups the database access requests according to a plurality of factors such as request sources, request contents, request access time and the like of the database access requests;
s3, the request resolver carries out consistency resolution on a plurality of request information in the same group, generates proper resolution result information, and sends the resolution ID and the execution body list of the group to the result distributor;
s4, requesting the resolver to send the resolver result information to the database application module;
s5, the database application module receives the judgment result information sent by the request judgment device, carries out real database access operation and sends the operation result information to the result distributor;
s6, the result distributor receives the data access result information sent by the database application module, searches the executive body list according to the resolution ID in the result information, and simultaneously distributes the result information to all executive bodies in the list;
and S7, each executive body receives the database operation result information, the database access is finished, and the follow-up operation is continued.
The embodiment also provides a database design system suitable for the mimicry environment, which is characterized by comprising a request arbitrator, a result distributor and a database application module;
the request arbitrator is used for receiving the database access request information of the heterogeneous executors and intelligently grouping the database access request information according to factors such as request sources, request contents, request time and the like of the database access request information; performing intelligent judgment on a plurality of database access request information in each group, and constructing the most appropriate result database access request information according to a judgment result; sending the arbitration ID and the executive body list corresponding to the intra-group arbitration to a result distributor; sending the database access request information generated by the arbitration to a database application module for subsequent processing;
the result distributor is used for receiving data access result information sent by the database application module, searching the executive body list according to the decision ID in the result information, and simultaneously distributing the result information to all executive bodies in the list;
the database application module is used for receiving a database access request sent by the request resolver, executing request processing operation and outputting a result to the result distributor.
On the basis of the common knowledge in the field, the above preferred conditions can be combined randomly to obtain the preferred embodiments of the invention.
The positive progress effects of the invention are as follows:
the invention constructs a database system suitable for a mimicry environment, which receives data access requests of a plurality of executors at the same time and forms a uniform data access result response after grouping, arbitration, execution and distribution. The database system can be well compatible with all core functions of the traditional database system on the premise of ensuring the safety, and the related functional requirements of various common applications on the database system are met.
Drawings
FIG. 1 is a flow chart of database design suitable for a mimicry environment according to a preferred embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. All other embodiments, which can be obtained by a person skilled in the art without any inventive step based on the embodiments of the present invention, are within the scope of the present invention.
As shown in fig. 1, the present embodiment provides a database design method suitable for a mimicry environment.
Preparation work: and finishing the system installation and deployment.
The operation process of each executive body is as follows: receiving a command, executing corresponding operation, generating a database access request in the operation process, and sending the request to a request resolver by a database driver on an execution body.
The internal operation process of the system is as follows:
1. the request resolver receives a plurality of database access requests from the execution entity.
2. The request resolver reasonably groups the requests according to a plurality of factors such as the source IP of the database access request, the sql statement content, the request access time and the like.
3. The request resolver performs consistency resolution on a plurality of request information within the same group, and generates appropriate resolution result information (resolved database access request information). At the same time, the arbitration ID and the execution body manifest of the group are sent to the result distributor.
4. And the request resolver sends the resolving result information to the database application module.
5. And the database application module receives the judgment result information sent by the request judgment device, performs real database access operation and sends the operation result information to the result distributor.
6. And the result distributor receives data access result information sent by the database application module, searches the executive body list according to the resolution ID in the result information, and simultaneously distributes the result information to all executive bodies in the list.
7. And each executive body receives the database operation result information, the database access is finished, and the subsequent operation is continued.
The embodiment also provides a database design system suitable for the mimicry environment, which comprises a request resolver, a result distributor and a database application module.
And the request resolver is used for receiving the database access request information sent by the plurality of heterogeneous executors, performing intelligent grouping and resolution, and sending the resolution result to the database application module after proper processing. The specific functions are as follows: receiving database access request information of a plurality of heterogeneous executors, preprocessing the information, and intelligently grouping the information according to factors such as request sources, request contents, request time and the like; performing intelligent judgment on a plurality of database access request information in each group, and constructing the most appropriate result database access request information according to a judgment result; sending the arbitration ID and the executive body list corresponding to the intra-group arbitration to a result distributor; and sending the database access request information generated by the arbitration to a database application module for subsequent processing. Specific implementations of the request resolver include, but are not limited to, a pure software module, a stand-alone server, an embedded system, an FPGA chip, an ASIC chip, and the like.
And the result distributor is used for accessing the result information of the data sent by the database application module and simultaneously distributing the result information to a plurality of heterogeneous metadata service executors according to the requirement. The specific functions are as follows: and receiving data access result information sent by the database application module, searching the executive body list according to the resolution ID in the result information, and simultaneously distributing the result information to all executive bodies in the list. Specific implementations of the result distributor include, but are not limited to, pure software modules, stand-alone servers, embedded systems, FPGA chips, ASIC chips, and the like.
And the database application module is used for receiving the database access request sent by the request resolver, executing the request processing operation and outputting the result to the result distributor. The database application module can be implemented as any database service system, such as mysql, sqlserver, oracle, and the like.
The invention provides a set of database design method suitable for the mimicry environment, which can be compatible with the original database drive and seamlessly replace the existing database system; the invention can avoid the problem of data migration during the switching of the execution body under the pseudo-state environment structure, reduce the switching time of the pseudo-execution body and further improve the overall usability of the system; the method can avoid the randomness problem (such as a database main key and a time stamp) related to data access in the original program development, is compatible with the logic of the original program, and reduces the workload of secondary code development in mimicry construction.
While specific embodiments of the invention have been described above, it will be appreciated by those skilled in the art that these are by way of example only, and that the scope of the invention is defined by the appended claims. Various changes and modifications to these embodiments may be made by those skilled in the art without departing from the spirit and scope of the invention, and these changes and modifications are within the scope of the invention.
Claims (2)
1. A database design method suitable for a mimicry environment is characterized by comprising the following steps:
s1, the request resolver receives database access requests sent by a plurality of heterogeneous executors;
s2, the request resolver reasonably groups the database access requests according to a plurality of factors such as request sources, request contents, request access time and the like of the database access requests;
s3, the request resolver carries out consistency resolution on a plurality of request information in the same group, generates proper resolution result information, and sends the resolution ID and the execution body list of the group to the result distributor;
s4, requesting the resolver to send the resolver result information to the database application module;
s5, the database application module receives the judgment result information sent by the request judgment device, carries out real database access operation and sends the operation result information to the result distributor;
s6, the result distributor receives the data access result information sent by the database application module, searches the executive body list according to the resolution ID in the result information, and simultaneously distributes the result information to all executive bodies in the list;
and S7, each executive body receives the database operation result information, the database access is finished, and the follow-up operation is continued.
2. A database design system suitable for a mimicry environment is characterized by comprising a request resolver, a result distributor and a database application module;
the request arbitrator is used for receiving the database access request information of the heterogeneous executors and intelligently grouping the database access request information according to factors such as request sources, request contents, request time and the like of the database access request information; performing intelligent judgment on a plurality of database access request information in each group, and constructing the most appropriate result database access request information according to a judgment result; sending the arbitration ID and the executive body list corresponding to the intra-group arbitration to a result distributor; sending the database access request information generated by the arbitration to a database application module for subsequent processing;
the result distributor is used for receiving data access result information sent by the database application module, searching the executive body list according to the decision ID in the result information, and simultaneously distributing the result information to all executive bodies in the list;
the database application module is used for receiving a database access request sent by the request resolver, executing request processing operation and outputting a result to the result distributor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010212954.4A CN111444536A (en) | 2020-03-24 | 2020-03-24 | Database design method and system suitable for mimicry environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010212954.4A CN111444536A (en) | 2020-03-24 | 2020-03-24 | Database design method and system suitable for mimicry environment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111444536A true CN111444536A (en) | 2020-07-24 |
Family
ID=71654261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010212954.4A Pending CN111444536A (en) | 2020-03-24 | 2020-03-24 | Database design method and system suitable for mimicry environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111444536A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112182018A (en) * | 2020-10-16 | 2021-01-05 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Web application-oriented mimicry structure database access system and method |
| CN113467785A (en) * | 2021-07-19 | 2021-10-01 | 上海红阵信息科技有限公司 | SQL translation method and system for mimicry database |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010037956A1 (en) * | 2008-10-02 | 2010-04-08 | France Telecom | Method and system for generating an interface for controlling the facial expressions of an avatar |
| CN106411937A (en) * | 2016-11-15 | 2017-02-15 | 中国人民解放军信息工程大学 | Mimicry defense architecture based zero-day attack detection, analysis and response system and method thereof |
| CN110177084A (en) * | 2019-04-04 | 2019-08-27 | 上海红阵信息科技有限公司 | Distributed memory system meta-service structure, construction method and system architecture for defending against network attacks |
| CN110290100A (en) * | 2019-03-06 | 2019-09-27 | 广东电网有限责任公司信息中心 | A kind of mimicry Web server and user's request processing method based on SDN |
| CN110545260A (en) * | 2019-08-05 | 2019-12-06 | 上海拟态数据技术有限公司 | Cloud management platform construction method based on mimicry structure |
| CN110764871A (en) * | 2019-10-11 | 2020-02-07 | 中国人民解放军战略支援部队信息工程大学 | Cloud platform-based mimicry application packaging and control system and method |
-
2020
- 2020-03-24 CN CN202010212954.4A patent/CN111444536A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2010037956A1 (en) * | 2008-10-02 | 2010-04-08 | France Telecom | Method and system for generating an interface for controlling the facial expressions of an avatar |
| CN106411937A (en) * | 2016-11-15 | 2017-02-15 | 中国人民解放军信息工程大学 | Mimicry defense architecture based zero-day attack detection, analysis and response system and method thereof |
| CN110290100A (en) * | 2019-03-06 | 2019-09-27 | 广东电网有限责任公司信息中心 | A kind of mimicry Web server and user's request processing method based on SDN |
| CN110177084A (en) * | 2019-04-04 | 2019-08-27 | 上海红阵信息科技有限公司 | Distributed memory system meta-service structure, construction method and system architecture for defending against network attacks |
| CN110545260A (en) * | 2019-08-05 | 2019-12-06 | 上海拟态数据技术有限公司 | Cloud management platform construction method based on mimicry structure |
| CN110764871A (en) * | 2019-10-11 | 2020-02-07 | 中国人民解放军战略支援部队信息工程大学 | Cloud platform-based mimicry application packaging and control system and method |
Non-Patent Citations (2)
| Title |
|---|
| 刘彩霞等: "一种基于MSISDN虚拟化的移动通信用户数据拟态防御机制", 《计算机学报》 * |
| 赵琳娜等: "基于异构冗余的拟态数据库模型设计与测试", 《计算机系统应用》 * |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112182018A (en) * | 2020-10-16 | 2021-01-05 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Web application-oriented mimicry structure database access system and method |
| CN112182018B (en) * | 2020-10-16 | 2023-04-21 | 华东计算技术研究所（中国电子科技集团公司第三十二研究所） | Web application-oriented mimicry construction database access system and method |
| CN113467785A (en) * | 2021-07-19 | 2021-10-01 | 上海红阵信息科技有限公司 | SQL translation method and system for mimicry database |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US5835755A (en) | Multi-processor computer system for operating parallel client/server database processes | |
| US7447693B2 (en) | Dynamic cluster database architecture | |
| US8078610B2 (en) | Optimization technique for dealing with data skew on foreign key joins | |
| US9348641B2 (en) | System and method for performing a transaction in a massively parallel processing database | |
| US20160026667A1 (en) | Memory-aware joins based in a database cluster | |
| CN103064875A (en) | Distributed query method of spatial service data | |
| CN103136364A (en) | Cluster database system and data query processing method thereof | |
| US8051422B2 (en) | Resource assignment method for query partioning based on processing cost of each partition | |
| US20150120645A1 (en) | System and Method for Creating a Distributed Transaction Manager Supporting Repeatable Read Isolation level in a MPP Database | |
| CN111814197A (en) | Data sharing method and device, server and storage medium | |
| CN111444536A (en) | Database design method and system suitable for mimicry environment | |
| CN102752372A (en) | File based database synchronization method | |
| CN106033373A (en) | A method and a system for scheduling virtual machine resources in a cloud computing platform | |
| US20170116266A1 (en) | In-memory cursor duration temp tables | |
| US20130173594A1 (en) | Techniques for accessing a parallel database system via external programs using vertical and/or horizontal partitioning | |
| CN110659327A (en) | Method and related device for realizing interactive query of data between heterogeneous databases | |
| CN104239529A (en) | Method and device for preventing Hive data from being inclined | |
| CN106776783A (en) | Unstructured data memory management method, server and system | |
| CN107784103A (en) | A kind of standard interface of access HDFS distributed memory systems | |
| CN110909077A (en) | Distributed storage method | |
| WO2017088666A1 (en) | Data storage method and coordinator node | |
| US6470331B1 (en) | Very large table reduction in parallel processing database systems | |
| CN104871153A (en) | System and method for flexible distributed massively parallel processing (mpp) database | |
| US10289723B1 (en) | Distributed union all queries | |
| CN104050297A (en) | Inquiry transaction distribution method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200724 |