CN109783119B - Data multi-version compatible upgrade management system and management method thereof - Google Patents
Data multi-version compatible upgrade management system and management method thereof Download PDFInfo
- Publication number
- CN109783119B CN109783119B CN201811497462.3A CN201811497462A CN109783119B CN 109783119 B CN109783119 B CN 109783119B CN 201811497462 A CN201811497462 A CN 201811497462A CN 109783119 B CN109783119 B CN 109783119B
- Authority
- CN
- China
- Prior art keywords
- data
- adapter
- storage device
- storage
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The invention discloses a data multi-version compatible upgrade management system, which comprises a storage device and at least one server side for data interaction with the storage device, and is characterized in that each server side comprises a data download resolver, a data storage layer module, a synchronization queue module, a plurality of adapters and a plurality of API interfaces. The management method of the data multi-version compatible upgrade management system is also disclosed. Compared with the prior art, the invention adopts the adapter acceleration method, effectively manages the multi-version upgrading of the data, only needs to add one adapter and modify the resolver when upgrading the version, and has no influence on the terminal user after using the acceleration method.
Description
Technical Field
The invention relates to the technical field of computers, in particular to a data multi-version compatible upgrade management system and a management method thereof.
Background
The API interface of each version manages corresponding different terminal user versions, the received data is directly stored to the local and sent to the synchronous queue, the interface of each version is independent, no correlation exists between the versions, the maintenance workload of the software version is large in the development project needing fast iteration, and the API interface of each version may need to be changed when the modification of certain service logic. Multiple versions of data are common in products that continue to iterate, with the next version making some table additions to the previous version, or adding or deleting fields from the table. Each time the business needs or the technology optimization needs, the direct expression is the change of business layer logic, the content change displayed by the display layer, and the like, and the changes all need the support of the underlying data storage, so that the data storage structure needs to be changed. Referring to fig. 1, a conventional multi-version data compatible upgrade management system is shown, which includes a storage device 10 and a plurality of servers 20, each server 20 includes a data download parser 21, a data storage layer module 22, a synchronization queue module 23 and a plurality of API interfaces 24, the data download parser 21 is connected to the storage device 10, for retrieving data from the storage device 10, a data storage layer module 22 is connected to the data download parser 21, for storing the data obtained by the data download parser 21, each API interface 24 is connected to the synchronization queue module 23, for sending the data uploaded by the end user 30 to the synchronization queue module 23, the data is sent to the storage device 10 via the synchronization queue module 23, and on the other hand, the data is respectively connected to the data storage layer module 22, and is used for sending the data uploaded by the end user to the data storage layer module 22 for storage. Since each API interface 24 manages the version of the corresponding end user, the API interfaces 24 may have the same function service, and a new API interface is a variant (partially identical) of the previous API interface, which may cause the following problems:
1. the data versions submitted by different API interfaces 24 are different, and the data storage of different versions is inconsistent;
2. different API interfaces 24 are required to filter data, resulting in incomplete data and missing integrity;
3. the data storage layer module 22 is written with inconsistency, the API 24 and the data download analyzer 21 can be operated directly, and it is difficult to judge which written data has problems when looking at the data storage layer module 22;
4. the API interface has complex business logic, requires simultaneous operation of the data storage layer module 22 and the synchronization queue module 23, and has a large processing amount, which results in a slow processing speed.
Disclosure of Invention
One of the technical problems solved by the invention is as follows: aiming at the defects of the prior art, the data multi-version compatible upgrade management system which has simple and clear logic, improves the data synchronization speed and does not influence the use experience of the end user is provided.
The second technical problem to be solved by the present invention is: a management method of the data multi-version compatible upgrade management system is provided.
The invention relates to a data multi-version compatible upgrade management system, which comprises a storage device and at least one server side for data interaction with the storage device, and is characterized in that each server side comprises a data download resolver, a data storage layer module, a synchronization queue module and a plurality of adapters S1...SNAnd several API interfaces A1...ANWherein N is not less than 2 and is an integer;
API interface A1...ANRespectively correspond to the adapters S1...SNConnections for sending the data submitted by the end users it receives to the adapters S respectively1...SN(ii) a Adapter SM-1And adapter SMConnection, where M is 2NIs connected with the synchronous queue module so that the adapter SM-1Received data layer-by-layer adapter SMTransfer, finally via adapter SNTransmitting all data submitted by the terminal user to the synchronous queue module;
the synchronous queue module is connected with the storage device on one hand and used for transmitting all the collected data to the storage device for storage, and is connected with the data download parser on the other hand and used for transmitting all the collected data to the data download parser;
the data download analyzer is connected with the storage device on one hand, and is used for acquiring data from the storage device and analyzing the acquired data and/or the data transmitted by the synchronous queue module, and is connected with the data storage layer module on the other hand, and is used for transmitting the analyzed data to the data storage layer module for storage;
the data storage layer module and adapter SNConnection for passing data requested to be acquired by the end user through a designated adapter S1...SNAnd a designated API interface A1...ANAnd sending the data to the end user.
A management method of the above-mentioned multi-version data compatible upgrade management system as a second aspect of the present invention includes the following steps:
(1) API interface AMReceiving data submitted by a terminal user, wherein M is 2.. N, N is more than or equal to 2, and N is an integer;
(2) API interface AMTransferring data submitted by an end user to an adapter SM；
(3) Adapter SMReceived data layer-by-layer adapter SM+1Transfer, finally via adapter SNTransmitting all data submitted by the terminal user to the synchronous queue module;
(4) the synchronous queue module transmits all the collected data to the storage device for storage, and simultaneously transmits a same copy of data to the data download resolver;
(5) the data download analyzer acquires data from the storage device, receives the data sent by the synchronous queue module, analyzes and checks the acquired data and/or the received data sent by the synchronous queue module to remove duplicate, and transmits the analyzed and removed data to the data storage layer module for storage.
Compared with the prior art, the invention has the following advantages:
(1) the invention adopts the adapter acceleration method, manages the multi-version upgrade of the data effectively, when upgrading the version, only need to increase an adapter, modify the resolver, the adapter that is newly increased is the adapter that is prior to the previous data version;
(2) the new API interface is no matter the adapter of the previous old version, so that the cross conflict of each version is avoided;
(3) the API interface only submits the data to the adapter, the adapter submits the data to the synchronous queue module, the synchronous queue module submits the data to the storage equipment, and the flow of the submitted data is simple and clear;
(4) the data download resolver downloads data from the storage equipment and submits the data to the local data storage layer, when the API interface needs to acquire the data, the adapter is accessed, the adapter acquires the data from the data storage layer module, and the flow direction of the acquired data is simple and clear;
(5) the synchronous queue module submits data to the storage device and downloads the data from the storage device, the two processes need to be transmitted through a network, time is consumed, in order to enable the data of the synchronous queue module to be stored in a local storage layer quickly, the synchronous queue module is adopted to submit the data to the data downloader directly, the acceleration effect is achieved, and for different data versions, only the resolver is required to be modified, and no influence is caused on a terminal user.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a conventional data multi-version compatible upgrade management system.
Fig. 2 is a schematic structural diagram of the present invention.
Detailed Description
In order to make the technical means, the creation characteristics, the achievement purposes and the effects of the invention easy to understand, the invention is further explained below by combining the specific drawings.
Referring to fig. 2, a data multi-version compatible upgrade management system is shown, which includes a storage device 100 and a plurality of servers 200 interacting with the storage device 100.
Each server 200 includes a data download parser 210, a data storage layer 220, a synchronization queue 230, and adapters S1...SNAnd several API interfaces A1...ANWherein N is not less than 2 and N is an integer.
API interface A1...ANRespectively correspond to the adapters S1...SNConnections for sending the data submitted by the end users it receives to the adapters S respectively1...SN(ii) a Adapter SM-1And adapter SMConnection, where M is 2NConnected with the synchronization queue module 230 so that the adapter SM-1Received data layer-by-layer adapter SMTransfer, finally via adapter SNAll data submitted by the end user is transmitted to the synchronization queue module 230. Adapter S1...SNThe effect of smoothly upgrading the old version API interface and the new version API interface is achieved, so that the finally stored data in the data storage layer module 220 is kept consistent.
The synchronization queue module 230 is connected to the storage device 100 for transmitting all the data collected by the storage device 100 to the storage device 100 for storage, and is connected to the data download parser 210 for transmitting all the data collected by the data download parser 210 to the data download parser 210.
The data download parser 210 is connected to the storage device 100, and is configured to obtain data from the storage device 100 and parse the obtained data and/or the data transmitted by the synchronization queue module 230, and is connected to the data storage layer module 220, and is configured to transmit the parsed data to the data storage layer module 220 for storage.
Data storage layer module 220 and adapter SNConnection for passing data requested to be acquired by the end user through a designated adapter S1...SNAnd a designated API interface A1...ANSent to end user V1...VN。
The invention discloses a management method of a multi-version data compatible upgrade management system, which comprises the following steps:
(1) end user VMInterface A to APIMSubmitting data, wherein M is 2.. N;
(2) API interface AMSubmitting data to an adapter SM；
(3) Adapter SMReceived data layer-by-layer adapter SM+1Transfer, finally via adapter SNTransmit all data submitted by the end user to the synchronization queue module 230;
(4) the synchronization queue module 230 transmits all the data collected by it to the storage device 100 for storage, and transmits a copy of the same data to the data download parser 210;
(5) the data download parser 210 obtains data from the storage device 100 and receives data sent from the synchronization queue module 230, and the data download parser 210 parses the obtained data and/or the received data sent from the synchronization queue module 230, checks the data, and removes duplicate, and transmits the parsed and deduplicated data to the data storage layer module 220 for storage.
End user V1...VNThe submitted data is not changed by the API interface originally developed, and the data only needs to be submitted to the corresponding adapter S1...SNAdapter S1...SNWill manage whether to continue to commit to the higher version of adapter S1...SNTherefore, the corresponding data version of the adapter needs to be judged, and the adapter is in a fixed sequence, namely if the data version reaches V6, a different data version adapter V needs to be created1、V2、V3、V4、V5、V6. The adapters to each different version after the different API interfaces submit data are as follows:
1. if end user V1Submitting data to API interface A1The latter being required to pass through the adapter S in turn1、S2、S3、S4、S5、S6；
2. If end user V2Submitting data to API interface A2The latter being required to pass through the adapter S in turn2、S3、S4、S5、S6；
3. If end user V3Submitting data to API interface A3The latter being required to pass through the adapter S in turn3、S4、S5、S6；
4. If end user V4Submitting data to API interface A4The latter being required to pass through the adapter S in turn4、S5、S6；
5. If end user V5Submitting data to API interface A5The latter being required to pass through the adapter S in turn5、S6；
6. If end user V6Submitting data to API interface A6The latter being required to pass through the adapter S in turn6。
In order to not affect the use of the terminal user, the data just submitted needs to be rapidly stored in the local data storage layer module 220, so that the terminal user can conveniently inquire the data just submitted; an accelerator is added in the synchronous queue module 230 to accelerate and submit a copy of data in the synchronous queue module 230 to the data download parser 210, and the process is processed quickly through local cache, so that the waiting time of two processes of network uploading and downloading is saved, and the acceleration effect is achieved.
The foregoing shows and describes the general principles and broad features of the present invention and advantages thereof. It will be understood by those skilled in the art that the present invention is not limited to the embodiments described above, which are described in the specification and illustrated only to illustrate the principle of the present invention, but that various changes and modifications may be made therein without departing from the spirit and scope of the present invention, which fall within the scope of the invention as claimed. The scope of the invention is defined by the appended claims and equivalents thereof.
Claims (2)
1. A multi-version compatible upgrade management system for data comprises a storage device and at least one server side for data interaction with the storage device, and is characterized in that each server side comprises a data download resolver, a data storage layer module, a synchronization queue module and a plurality of adapters S1...SNAnd several API interfaces A1...ANWherein N is not less than 2 and is an integer;
API interface A1...ANRespectively correspond to the adapters S1...SNConnections for sending the data submitted by the end users it receives to the adapters S respectively1...SN(ii) a Adapter SM-1And adapter SMConnection, where M is 2NIs connected with the synchronous queue module so that the adapter SM-1Received data layer-by-layer adapter SMTransfer, finally via adapter SNTransmitting all data submitted by the terminal user to the synchronous queue module;
the synchronous queue module is connected with the storage device on one hand and used for transmitting all the collected data to the storage device for storage, and is connected with the data download parser on the other hand and used for transmitting all the collected data to the data download parser;
the data download analyzer is connected with the storage device on one hand, and is used for acquiring data from the storage device and analyzing the acquired data and/or the data transmitted by the synchronous queue module, and is connected with the data storage layer module on the other hand, and is used for transmitting the analyzed data to the data storage layer module for storage;
the data storage layer module and adapter SNConnection for passing data requested to be acquired by the end user through a designated adapter S1...SNAnd a designated API interface A1...ANAnd sending the data to the end user.
2. A management method of the data multi-version compatibility upgrade management system according to claim 1, comprising the steps of:
(1) API interface AMReceiving data submitted by a terminal user, wherein M is 2.. N, N is more than or equal to 2, and N is an integer;
(2) API interface AMTransferring data submitted by an end user to an adapter SM；
(3) Adapter SMReceived data layer-by-layer adapter SM+1Transfer, finally via adapter SNTransmitting all data submitted by the terminal user to the synchronous queue module;
(4) the synchronous queue module transmits all the collected data to the storage device for storage, and simultaneously transmits a same copy of data to the data download resolver;
(5) the data download analyzer acquires data from the storage device, receives the data sent by the synchronous queue module, analyzes and checks the acquired data and/or the received data sent by the synchronous queue module to remove duplicate, and transmits the analyzed and removed data to the data storage layer module for storage.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811497462.3A CN109783119B (en) | 2018-12-07 | 2018-12-07 | Data multi-version compatible upgrade management system and management method thereof |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811497462.3A CN109783119B (en) | 2018-12-07 | 2018-12-07 | Data multi-version compatible upgrade management system and management method thereof |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109783119A CN109783119A (en) | 2019-05-21 |
| CN109783119B true CN109783119B (en) | 2022-01-28 |
Family
ID=66496814
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811497462.3A Active CN109783119B (en) | 2018-12-07 | 2018-12-07 | Data multi-version compatible upgrade management system and management method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109783119B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11010212B2 (en) * | 2019-06-13 | 2021-05-18 | Microsoft Technology Licensing, Llc | System and method for supporting and negotiating multiple API versions across multiple products |
| CN110750282B (en) * | 2019-10-14 | 2021-04-02 | 支付宝(杭州)信息技术有限公司 | Method and device for running application program and GPU node |
| CN112905226A (en) * | 2020-12-25 | 2021-06-04 | 广州朗国电子科技有限公司 | Data packaging method and device, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101008894A (en) * | 2007-01-26 | 2007-08-01 | 华为技术有限公司 | Method and device for implementing compatibility between the old and new editions of system |
| CN106383726A (en) * | 2016-08-30 | 2017-02-08 | 武汉精测电子技术股份有限公司 | Signal adapter updating method based on image video transmission interface |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10430180B2 (en) * | 2010-05-26 | 2019-10-01 | Automation Anywhere, Inc. | System and method for resilient automation upgrade |
| US10031741B2 (en) * | 2015-09-30 | 2018-07-24 | International Business Machines Corporation | Upgrade of port firmware and driver software for a target device |
-
2018
- 2018-12-07 CN CN201811497462.3A patent/CN109783119B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101008894A (en) * | 2007-01-26 | 2007-08-01 | 华为技术有限公司 | Method and device for implementing compatibility between the old and new editions of system |
| CN106383726A (en) * | 2016-08-30 | 2017-02-08 | 武汉精测电子技术股份有限公司 | Signal adapter updating method based on image video transmission interface |
Non-Patent Citations (1)
| Title |
|---|
| "ATL和VCL支持下的组件版本升级技术";周振红等;《人民黄河》;20050317;第27卷(第1期);第7-9页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109783119A (en) | 2019-05-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10803016B2 (en) | Predictive models of file access patterns by application and file type | |
| CN101656751B (en) | Method and system for accelerating file uploading and downloading | |
| CN109783119B (en) | Data multi-version compatible upgrade management system and management method thereof | |
| US20180278675A1 (en) | Dynamically provisioning instances of a single-tenant application for multi-tenant use | |
| JP7230083B2 (en) | Method and apparatus for map service testing | |
| CN105049486B (en) | Method for edition management, the apparatus and system of static file | |
| US20120158655A1 (en) | Non-relational function-based data publication for relational data | |
| US8812627B2 (en) | System and method for installation and management of cloud-independent multi-tenant applications | |
| CN109254733A (en) | Methods, devices and systems for storing data | |
| CN108170612B (en) | Automatic testing method and device and server | |
| US20210209099A1 (en) | Systems And Methods For Tracking And Representing Data Science Data Runs | |
| CN110784528B (en) | File downloading method and device and storage medium | |
| US20160170783A1 (en) | Near cache distribution in in-memory data grid (imdg)(no-sql) environments | |
| US20170085653A1 (en) | Method, device and system for message distribution | |
| CN113282555A (en) | Data processing method, device, equipment and storage medium | |
| US20160140261A1 (en) | Lean product modeling systems and methods | |
| CN108763323A (en) | Meteorological lattice point file application process based on resource set and big data technology | |
| Fan et al. | Gear: Enable efficient container storage and deployment with a new image format | |
| CN110457380A (en) | A kind of data-storage system | |
| CN113157658A (en) | Client log collecting and distributing method and device and computer equipment | |
| US11256713B2 (en) | Virtual transaction queues for database replication | |
| CN109241040B (en) | Data cleaning method and device | |
| CN114547199A (en) | Database increment synchronous response method and device and computer readable storage medium | |
| CN101340463B (en) | Method and apparatus for determining network resource type | |
| Chauhan | Learning Cloudera Impala |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |