CN109947841A - Oracle database simultaneous techniques in single guiding systems based on transaction journal analysis - Google Patents
Oracle database simultaneous techniques in single guiding systems based on transaction journal analysis Download PDFInfo
- Publication number
- CN109947841A CN109947841A CN201710626175.7A CN201710626175A CN109947841A CN 109947841 A CN109947841 A CN 109947841A CN 201710626175 A CN201710626175 A CN 201710626175A CN 109947841 A CN109947841 A CN 109947841A
- Authority
- CN
- China
- Prior art keywords
- oracle
- data
- database
- transaction journal
- outer end
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses oracle database simultaneous techniques in the single guiding systems analyzed based on transaction journal, the invention uses the method for analyzing oracle database transaction journal, it calls the tool logminer of oracle to analyze transaction journal, realizes that interior outer end oracle database is synchronous in single guiding systems.
Description
Technical field
The present invention relates to a kind of Internet communication technology fields, in particular in single guiding systems based on transaction journal analysis
Oracle database simultaneous techniques.
Background technique
Single guiding systems are a kind of data information network security isolation systems, the unidirectional import feature with data information.It is single
Guiding systems are made of inner end and outer end, and outer end module TX only sends data, and interior end module RX only receives data, and data information can only
Inner end is singly led from singly leading outer end and importeding into.
The oracle database of single guiding systems synchronizes the cross-platform database letter for the network that realize two security isolations
One-way synchronization is ceased, realization process is that the database synchronization module singly led obtains data generation data text from outer end oracle database
Document is passed to by single guiding systems sending module and singly leads inner end by shelves, then the database synchronization module by singly leading inner end is same data
Walk target database.
Since one-way isolation characteristic cannot transmit database data using the included external connection function of database, often now
Technology is to obtain data by trigger or select inquiry mostly, and this programme comprehensively considers each middle implementation superiority and inferiority,
By the way of parsing oracle transaction journal, operation data is analyzed, document is written in the data of generation, then is carried out by single guiding systems
It is synchronous.
Summary of the invention
To overcome above-mentioned the deficiencies in the prior art, the synchronous use of oracle database in single guiding systems in the prior art is solved
The shortcomings that trigger or selection data synchronization scheme can cause great burden and pressure to source database, is combined using outer end is singly led
The logminer tool analysis oracle transaction journal that oracle is provided, parses operation data, is converted into the transmission of json format
To single guiding systems inner end, it is then assembled into the scheme that sql sentence is synchronized to target database, realizes that single guiding systems obtain oracle number
According to occupancy source database resource is few when the data of library and the purpose minimized is caused stress and born to source database.According to singly leading
The characteristics of system, which, which is divided into, singly leads outer end and singly leads inner end portion.
Singly leading outer end portion includes:
1. source database environment configurations: installing logminer tool in source database, oracle database is arranged to return
Shelves mode；
2.oracle log read module: to oracle in such a way that code building shell script calls logminer
Database transaction log is read out parsing and generates sql formatted data, and writes the data to local file；
3. journal format conversion module: the sql formatted data that log read module obtains is converted into unified json lattice
Formula；
4. outer end data transmission blocks: singly leading inner end for transmitting data to.Singly leading inner end portion includes:
1. inner end data reception module: for receiving the data singly leading outer end and sending over；
2. data format conversion module: the json formatted data received from outer end is converted into corresponding sql format；
3. database synchronization module: the sql format statement that conversion module obtains is synchronized to target database.
Technical solution of the present invention bring the utility model has the advantages that
Transaction journal analytic method used in the present invention carries out the database synchronization of single guiding systems, being capable of least occupancy source
Database resource purely parses binary log stream, obtains data due to having bypassed the operation to source database
Speed is fast, is fully able to meet the synchronous requirement of current various oracle large size production environment databases, and safe and reliable, no
Any data can be omitted.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of invention for those of ordinary skill in the art without creative efforts, can be with
Other attached drawings are obtained according to these attached drawings.
Fig. 1 is implementation flow chart proposed by the present invention；
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on
Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other
Embodiment shall fall within the protection scope of the present invention.
The invention implementing procedure is as follows:
1. using the synchronous oracle database of mode that transaction journal parses, it is necessary first to be installed in source database
Logminer tool, the tool are the highly useful analysis tools of a reality that Oracle company provides after product 8i,
Using the tool can easily obtain Oracle it is online/archive log file in particular content, the especially tool can divide
All DML and DDL sentences for database manipulation are precipitated.If do not installed, after sqlplus being entered with SYS user identity
Following two script is run to install:
@? / rdbms/admin/dbmslm.sql
@? / rdbms/admin/dbmslmd.sql
2. to open archive mode again, if archive mode is also not configured in database server, need at sqlplus
It runs following four orders and is configured to archive mode:
shutdown immediate；-- close database
startup mount；-- log-on data library to mount state
alter database archivelog；-- switch to archive mode
alter database open；-- open database
3. singly lead outer end by log read module, using code building shell script call the mode of logminer into
Row oracle transaction journal analysis is read, and local file is written in obtained sql formatted data.
4. singly leading the journal format conversion module of outer end, the sql formatted file data conversion that log read module is obtained
At unified json formatted file.
5. json data are sent to by the sending module of single guiding systems outer end and singly lead inner end.
6. singly leading inner end receives the json formatted data sended over from outer end.
7. the json formatted data received is reassembled into sql sentence by data format conversion module.
8. the sql format statement that conversion module obtains is synchronized to target database by database synchronization module.
Code for example:
1. reading oracle transaction journal needs to call the logminer tool that arrives, the present invention program uses C++ code building
The mode of logminer of shell script calling reads analysis log, and log read module generates the generation of shell script calling section
Code is as follows:
2. the transaction journal of analysis oracle can be read, and obtained sql data are protected by the code of operation above
It has been stored in file/dbdata/oracle/oracle.data.It then is exactly that journal format conversion module reads this document, directly
It connects a sql sentence and is converted into json format, be all the operation of string matching and interception.Sql is converted using C++ code analysis
Delete sentence operation example it is as follows:
3. according to code above, so that it may realize the transaction journal for reading analysis oracle, and change into json format, be left
Be exactly sending module data by socket transmission to inner end is singly led, just code does not schematically illustrate.It can from above-mentioned process
Out, the database synchronization that outer end in single guiding systems is carried out using the transaction journal analytic approach of oracle is feasible efficient.
It is same that it is provided for the embodiments of the invention oracle database in single guiding systems based on transaction journal analysis above
Step technology is described in detail, and used herein a specific example illustrates the principle and implementation of the invention,
The above description of the embodiment is only used to help understand the method for the present invention and its core ideas；Meanwhile for the one of this field
As technical staff, according to the thought of the present invention, there will be changes in the specific implementation manner and application range, to sum up institute
It states, the contents of this specification are not to be construed as limiting the invention.
Claims (4)
1. oracle database simultaneous techniques in single guiding systems based on transaction journal analysis, which uses analysis oracle number
According to the method for library transaction journal, the tool logminer of oracle is called to analyze transaction journal, realizes interior outer end in single guiding systems
Oracle database is synchronous.
2. oracle database simultaneous techniques in single guiding systems according to claim 1 based on transaction journal analysis,
It is characterized in that: being formed by singly leading outer end and singly leading inner end, divided using the logminer tool that outer end is provided in conjunction with oracle is singly led
Oracle transaction journal is analysed, operation data is parsed, is converted into json format and is sent to single guiding systems inner end, be then assembled into sql
Sentence is synchronized to target database.
3. oracle database simultaneous techniques in single guiding systems according to claim 1 based on transaction journal analysis,
It is characterized in that: singly leading outer end portion by forming with lower module,
S1. source database environment configurations: logminer tool is installed in source database, oracle database is arranged to file mould
Formula；
S2.oracle log read module: to oracle data in such a way that code building shell script calls logminer
Library transaction journal is read out parsing and generates sql formatted data, and writes the data to local file；
S3. the sql formatted data that log read module obtains journal format conversion module: is converted into unified json format；
S4. outer end data transmission blocks: inner end is singly led for transmitting data to.
4. oracle database simultaneous techniques in single guiding systems according to claim 1 based on transaction journal analysis,
It is characterized in that: singly leading inner end portion by forming with lower module,
F1. inner end data reception module: for receiving the data singly leading outer end and sending over；
F2. the json formatted data received from outer end data format conversion module: is converted into corresponding sql format；
F3. the sql format statement that conversion module obtains database synchronization module: is synchronized to target database.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710626175.7A CN109947841A (en) | 2017-07-27 | 2017-07-27 | Oracle database simultaneous techniques in single guiding systems based on transaction journal analysis |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710626175.7A CN109947841A (en) | 2017-07-27 | 2017-07-27 | Oracle database simultaneous techniques in single guiding systems based on transaction journal analysis |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109947841A true CN109947841A (en) | 2019-06-28 |
Family
ID=67003999
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710626175.7A Pending CN109947841A (en) | 2017-07-27 | 2017-07-27 | Oracle database simultaneous techniques in single guiding systems based on transaction journal analysis |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109947841A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111414358A (en) * | 2019-12-30 | 2020-07-14 | 杭州美创科技有限公司 | Method for loading relational database data |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080052341A1 (en) * | 2006-08-24 | 2008-02-28 | Goggin Sean A | System and method for processing data associated with a transmission in a data communication system |
| EP2891994A1 (en) * | 2013-11-04 | 2015-07-08 | Guangdong Electronics Industry Institute Ltd. | Method for achieving automatic synchronization of multisource heterogeneous data resources |
| CN105005618A (en) * | 2015-07-21 | 2015-10-28 | 杭州合众数据技术有限公司 | Data synchronization method and system among heterogeneous databases |
| CN106339274A (en) * | 2015-07-14 | 2017-01-18 | 阿里巴巴集团控股有限公司 | Method and system for obtaining data snapshot |
-
2017
- 2017-07-27 CN CN201710626175.7A patent/CN109947841A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080052341A1 (en) * | 2006-08-24 | 2008-02-28 | Goggin Sean A | System and method for processing data associated with a transmission in a data communication system |
| EP2891994A1 (en) * | 2013-11-04 | 2015-07-08 | Guangdong Electronics Industry Institute Ltd. | Method for achieving automatic synchronization of multisource heterogeneous data resources |
| CN106339274A (en) * | 2015-07-14 | 2017-01-18 | 阿里巴巴集团控股有限公司 | Method and system for obtaining data snapshot |
| CN105005618A (en) * | 2015-07-21 | 2015-10-28 | 杭州合众数据技术有限公司 | Data synchronization method and system among heterogeneous databases |
Non-Patent Citations (2)
| Title |
|---|
| 刘传尧: "破除校园"数据孤岛"新思路", 《中国教育网络》 * |
| 蒋敏等: "一种基于Agent的数据同步方法", 《江南大学学报(自然科学版)》 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111414358A (en) * | 2019-12-30 | 2020-07-14 | 杭州美创科技有限公司 | Method for loading relational database data |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7917521B2 (en) | User/browser state information sharing between browser applications | |
| US9411845B2 (en) | Integration flow database runtime | |
| EP2924633A1 (en) | A system and method for extracting a business rule embedded in an application source code | |
| CN104391826A (en) | Data format conversion method and data format converter | |
| RU2008107932A (en) | METHOD FOR SUBMITTING A COMMAND DEVICE TO DO NOT SYNCHRONIZE OR ENTER THE SYNCHRONIZATION DELAY FOR MULTIMEDIA STREAMS | |
| US20120143981A1 (en) | Common server, adaptor, and data conforming method thereof | |
| TW200617713A (en) | Systems and methods for document analysis | |
| CN105005549A (en) | User-defined chained log analysis device and method | |
| CN111221831B (en) | Computing system for processing advertisement effect data in real time | |
| Zunke et al. | Json vs xml: A comparative performance analysis of data exchange formats | |
| CN110083627A (en) | Data processing method, system, computer equipment and storage medium | |
| CN109815107A (en) | The method and apparatus of automatic test | |
| CN103699555A (en) | Multisource data real-time database data generation method applicable to scheduling and transformer substation integrated system | |
| CN110807038A (en) | CMDB information full-text retrieval method based on elastic search | |
| EP4130991A3 (en) | Methods and systems for remote configuration of software applications | |
| CN109947841A (en) | Oracle database simultaneous techniques in single guiding systems based on transaction journal analysis | |
| CN101888393A (en) | Non-uniform cooperative system and method based on component middleware platforms under network environment | |
| Wang et al. | Providing research graph data in JSON-LD using Schema. org | |
| CN110069566A (en) | Heterogeneous database synchronization method in a kind of one-way import system | |
| US20200296183A1 (en) | Methods and apparatus to improve interprocess communication | |
| CN110019495A (en) | Mysql database synchronization technology in single guiding systems based on transaction journal analysis | |
| CN111858747A (en) | Method for synchronizing MySQL database to Elasticissearch | |
| CN104536769A (en) | International file achieving method | |
| CN109947726A (en) | Db2 database synchronization technology in single guiding systems based on transaction journal analysis | |
| CN113760961A (en) | Data query method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20190628 |
|
| WD01 | Invention patent application deemed withdrawn after publication |