CN112181944A - Application of offline data synchronization tool of heterogeneous data source in Internet of vehicles industry - Google Patents
Application of offline data synchronization tool of heterogeneous data source in Internet of vehicles industry Download PDFInfo
- Publication number
- CN112181944A CN112181944A CN202011016189.5A CN202011016189A CN112181944A CN 112181944 A CN112181944 A CN 112181944A CN 202011016189 A CN202011016189 A CN 202011016189A CN 112181944 A CN112181944 A CN 112181944A
- Authority
- CN
- China
- Prior art keywords
- data
- data source
- source
- internet
- database
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000001360 synchronised effect Effects 0.000 claims description 8
- 230000003993 interaction Effects 0.000 claims description 4
- 230000006855 networking Effects 0.000 abstract description 6
- 238000010586 diagram Methods 0.000 description 11
- 238000013508 migration Methods 0.000 description 10
- 230000005012 migration Effects 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000011161 development Methods 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 210000001503 joint Anatomy 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/214—Database migration support
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/23—Updating
- G06F16/2372—Updates performed during offline database operations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Abstract
The invention belongs to the technical field of vehicle networking, and relates to application of an offline data synchronization tool of a heterogeneous data source in the vehicle networking industry.
Description
Technical Field
The invention belongs to the technical field of vehicle networking, and relates to application of an offline data synchronization tool of a heterogeneous data source in the vehicle networking industry.
Background
The internet of vehicles, namely the internet of things of vehicles, takes vehicles in driving as an information perception object, realizes network connection between vehicles, vehicles and people, vehicles and roads, vehicles and service platforms by means of a new generation of information communication technology, improves the overall intelligent driving level of the vehicles, provides safe, comfortable, intelligent and efficient driving feeling and traffic service for users, improves the traffic operation efficiency and improves the intelligent level of social traffic service. The car networking realizes the all-round network link of car and cloud platform, car and car, car and road, car and people, car interior through the information communication technology of new generation, has mainly realized "three nets merge", namely fuses car intranet, intercar network and on-vehicle mobile internet. The car networking senses the state information of the vehicles by using a sensing technology, and realizes intelligent management of traffic, intelligent decision of traffic information service and intelligent control of the vehicles by using a wireless communication network and a modern intelligent information processing technology.
At present, each company and each product in the market have independent databases, and data sharing and combined query among the databases are complex. When the databases share data, the databases are generally processed in a self-contained mode in the market, so that the performance of the databases is greatly influenced, and heterogeneous databases cannot share data, thereby limiting service development.
How to provide a solution for sharing data under the condition of heterogeneous databases is still not a better solution in the industry at present.
Disclosure of Invention
The technical scheme adopted by the invention for solving the technical problem is as follows: a user sets a configuration rule through a human-computer interaction interface, synchronizes a source database to a target database according to the configuration rule, and performs data query according to the synchronized target database.
Preferably, the target database is an after-sale database, and the data query is a single-table query.
Preferably, the configuration rule includes: the data source configuration comprises a data source number, a data source type, a data source drive, a data source url, a data source account and a data source password; and the data task configuration comprises task id, source database id, target database id, task update frequency, update start time, source sq1, temporary sq1 and target sq 1.
Preferably, the data source types include, but are not limited to, Oracle, SQLServer, MySQL, PostgreSQL, Microsoft SQL Server, Microsoft Access, DB2 database.
Preferably, the task updating frequency can be set by a user according to the service requirement.
The invention has the beneficial effects that:
1. the invention is not limited to data migration between single databases, and data can be freely migrated between various databases.
2. The data migration target task is not limited to single-table operation, and supports complex linked-table query result sql task migration.
3. The invention has simple configuration, and developers can devote energy to specific services without paying attention to complicated data synchronous development.
4. According to the invention, a jobs configurable multitask can set the multitask and update the frequency according to the service requirement so as to adapt to the service scene.
Drawings
FIG. 1 is a system flow diagram of an application of an offline data synchronization tool for heterogeneous data sources in the Internet of vehicles industry;
FIG. 2 is a system architecture diagram;
FIG. 3 is a data migration diagram;
FIG. 4 is a view of the structure of a product;
FIG. 5 is a startup script bin directory diagram;
FIG. 6 is a configuration directory config directory diagram;
FIG. 7 is a diagram of a dependency package directory ars directory;
FIG. 8 is a diagram of a task configuration config/dbsync. xml file structure;
FIG. 9 is a datasource configuration information diagram;
FIG. 10 is a dbtask configuration information diagram;
FIG. 11 is a task execution information header diagram;
FIG. 12 is a task execution information sub-page diagram.
Detailed Description
The related art in the present invention will be described clearly and completely with reference to the accompanying drawings in the following embodiments, and it is to be understood that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 1 to 12, in application of an offline data synchronization tool for heterogeneous data sources in the internet of vehicles industry, a user sets configuration rules through a human-computer interaction interface, synchronizes a source database to a target database according to the configuration rules, and performs data query according to the synchronized target database.
Further, the target database is an after-sale database, and the data query is a single-table query.
Further, the configuration rule includes: the data source configuration comprises a data source number, a data source type, a data source drive, a data source url, a data source account and a data source password; and the data task configuration comprises task id, source database id, target database id, task update frequency, update start time, source sq1, temporary sq1 and target sq 1.
Further, the data source types include, but are not limited to, Oracle, SQLServer, MySQL, PostgreSQL, Microsoft SQL Server, Microsoft Access, DB2 database.
Furthermore, the task update frequency can be set by a user according to the service requirement.
Examples
The after-sale platform needs to perform simultaneous query on vehicle related information of the vehicle loan platform and the vehicle peer platform, because data exists in different databases, the data is processed in a system-owned mode, a data view is established to provide the after-sale query, different data sources need to be synchronized to the after-sale database in the current demand, the platform needs to perform single-form query, and a data migration tool is adopted to configure task information. The high-efficiency data synchronization function among various heterogeneous data sources solves the problem that the system uses data across databases;
the method has universality, the migration data is not limited to the same data source, and multiple data sources can be in data butt joint, for example, the data in oracle can be migrated to mysql, as shown in FIG. 3;
the data are synchronized to a target database in real time to be inquired directly ideally, a data migration tool starts from this point, free combination of data source migration among various databases such as MYSQL (structured query language), ORACLE (object relational language) and the like can be supported at present, developers only need to pay attention to service sql and start joba, the migration tool can complete data migration, and tedious interface development is avoided.
Wherein, the product issuing package name is: iov-dbsync-bin.tar.gz;
the product structure is as follows: as shown in fig. 4;
the bin directory is a startup script, as shown in FIG. 5;
the config directory is a configuration directory, as shown in fig. 6;
the ars directory is a dependency package directory. As shown in fig. 7, the driver package can be placed directly under this directory;
configuring log printing related information in a log configuration config/log4j2.xml file;
xml file structure of task configuration config/dbsync, as shown in fig. 8;
datasource configuration information, as shown in fig. 9;
datasource configuration parameter description, as in table one;
| parameter name | Name (R) | Description of the invention |
| id | Data source numbering | One data source corresponds to one |
| type | Data source type | ORACLE |
| driver | Data source driving | |
| url | Data Source url | |
| user | Account number | |
| password | Cipher code |
Watch 1
dbtask configuration information, as shown in FIG. 10;
dbtask configuration parameter description, as in Table two
Watch two
Bat, start after configuring the task information, the task execution information is as shown in fig. 11 and 12;
in summary, the invention provides an application of an offline data synchronization tool for heterogeneous data sources in the internet of vehicles industry, a configuration rule is set through a human-computer interaction interface, a source database is synchronized to a target database according to the configuration rule, and data query is performed according to the synchronized target database, so that the problems that processing is performed in a database self-bring mode in the prior art, the performance of the database is greatly affected, and data sharing cannot be realized for the heterogeneous database are solved, and therefore the invention has a wide application prospect.
It is to be emphasized that: the above embodiments are only preferred embodiments of the present invention, and are not intended to limit the present invention in any way, and all simple modifications, equivalent changes and modifications made to the above embodiments according to the technical spirit of the present invention are within the scope of the technical solution of the present invention.
Claims (5)
1. The application of the offline data synchronization tool of the heterogeneous data source in the Internet of vehicles industry is characterized in that a user sets a configuration rule through a human-computer interaction interface, synchronizes a source database to a target database according to the configuration rule, and performs data query according to the synchronized target database.
2. The application of the offline data synchronization tool for heterogeneous data sources in the Internet of vehicles industry as claimed in claim 1, wherein the target database is an after-market database, and the data query is a single-table query.
3. The application of the offline data synchronization tool of heterogeneous data sources in the internet of vehicles industry according to claim 1, wherein the configuration rule comprises:
the data source configuration comprises a data source number, a data source type, a data source drive, a data source url, a data source account and a data source password;
and the data task configuration comprises task id, source database id, target database id, task update frequency, update start time, source sq1, temporary sq1 and target sq 1.
4. The application of the offline data synchronization tool for heterogeneous data sources in the internet of vehicles industry as claimed in claim 3, wherein the data source types include but are not limited to Oracle, SQLServer, MySQL, PostgreSQL, Microsoft SQL Server, Microsoft Access, and DB2 database.
5. The application of the offline data synchronization tool for heterogeneous data sources in the internet of vehicles industry according to claim 3, wherein the task update frequency can be set by a user according to business requirements.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011016189.5A CN112181944A (en) | 2020-09-24 | 2020-09-24 | Application of offline data synchronization tool of heterogeneous data source in Internet of vehicles industry |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011016189.5A CN112181944A (en) | 2020-09-24 | 2020-09-24 | Application of offline data synchronization tool of heterogeneous data source in Internet of vehicles industry |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112181944A true CN112181944A (en) | 2021-01-05 |
Family
ID=73955466
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011016189.5A Pending CN112181944A (en) | 2020-09-24 | 2020-09-24 | Application of offline data synchronization tool of heterogeneous data source in Internet of vehicles industry |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112181944A (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109669983A (en) * | 2018-12-27 | 2019-04-23 | 杭州火树科技有限公司 | Visualize multi-data source ETL tool |
| CN111506556A (en) * | 2020-04-09 | 2020-08-07 | 北京市测绘设计研究院 | Multi-source heterogeneous structured data synchronization method |
-
2020
- 2020-09-24 CN CN202011016189.5A patent/CN112181944A/en active Pending
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109669983A (en) * | 2018-12-27 | 2019-04-23 | 杭州火树科技有限公司 | Visualize multi-data source ETL tool |
| CN111506556A (en) * | 2020-04-09 | 2020-08-07 | 北京市测绘设计研究院 | Multi-source heterogeneous structured data synchronization method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100547583C (en) | Database automatically and the method that dynamically provides | |
| CN105701580A (en) | Automobile resource sharing system | |
| CN102880956B (en) | Paying server and payment channel integration method | |
| CN111338812B (en) | Data processing method and device | |
| CN111400734A (en) | Intelligent logistics system based on block chain | |
| CN104200402A (en) | Publishing method and system of source data of multiple data sources in power grid | |
| US20210291671A1 (en) | Mobile transport for extracting and depositing energy | |
| CN109815254B (en) | Cross-region task scheduling method and system based on big data | |
| CN101706826A (en) | Method and system for realizing terminal track playback in network geographic information system | |
| CN106777311A (en) | Flight freight space state cache method and system | |
| CN105095496A (en) | Method for monitoring MYSQL table space through ZABBIX | |
| CN114066238B (en) | Forest land protection utilization planning index determination system, cloud platform system and method | |
| CN112181944A (en) | Application of offline data synchronization tool of heterogeneous data source in Internet of vehicles industry | |
| CN110188913A (en) | A kind of finishing Order splitting algorithm | |
| CN110543606A (en) | Method and system for storing genealogy data based on alliance chain | |
| CN102571733B (en) | The access method of BOSS system and system, cloud computing platform | |
| CN1472911A (en) | Wireless facility synchronizing system and method | |
| CN111461687B (en) | Application system of block chain service platform based on terminal equipment and implementation method thereof | |
| CN101094428A (en) | Statistical system and method of querying service database of intelligent network | |
| CN112967021A (en) | Enterprise-promoting policy intelligent matching system based on big data | |
| CN106558159A (en) | A kind of share-car method and apparatus | |
| CN107220363A (en) | It is a kind of to support the global complicated cross-region querying method retrieved and system | |
| CN104469028A (en) | Service provision method, conversation server and customer service system | |
| CN115480741A (en) | Extensible target service application system | |
| CN105550910A (en) | Application of electronic invoice technology and added-value tax smart cloud in cooperative work |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210105 |