CN116257503A - Data migration processing method, device, equipment and storage medium - Google Patents

Data migration processing method, device, equipment and storage medium Download PDF

Info

Publication number
CN116257503A
CN116257503A CN202310242942.XA CN202310242942A CN116257503A CN 116257503 A CN116257503 A CN 116257503A CN 202310242942 A CN202310242942 A CN 202310242942A CN 116257503 A CN116257503 A CN 116257503A
Authority
CN
China
Prior art keywords
data
temporary intermediate
database
system database
data migration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310242942.XA
Other languages
Chinese (zh)
Inventor
王休
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Bank Co Ltd
Original Assignee
Ping An Bank Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Bank Co Ltd filed Critical Ping An Bank Co Ltd
Priority to CN202310242942.XA priority Critical patent/CN116257503A/en
Publication of CN116257503A publication Critical patent/CN116257503A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/214—Database migration support
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Quality & Reliability (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

The application discloses a data migration processing method, a device, equipment and a storage medium, wherein a temporary intermediate original table with the same structure as an old system table is created in a new system, data is migrated on two intermediate tables according to a mapping relation, the data on the temporary intermediate tables are preprocessed, and finally data are synchronized to the database original table of the new system, so that possible data migration errors are isolated in the temporary intermediate table to solve the problem, the data errors are prevented from appearing on a line of the new system, and the technical problem that the data migration processing is difficult because the differences exist in the database types adopted by the new and old systems or the field structures of the database tables adopted by the new and old systems in the actual development process is solved.

Description

Data migration processing method, device, equipment and storage medium
Technical Field
The present disclosure relates to the field of data migration technologies, and in particular, to a data migration processing method, device, equipment, and storage medium.
Background
In the field of software development, an old system is often subjected to reconfiguration and upgrading, a new system is built to replace the old system, and a database table used independently by the new system is redesigned.
After the new system is built, the old system is required to be abandoned gradually, and in order to enable the business to run smoothly when the new and old systems are switched back, the data migration processing from the old system database to the new system database is required.
In the actual development process, the types of databases adopted by the new and old systems may be different, for example, the old system adopts an oracle database, the new system adopts a mysql database, or the field structures of database tables adopted by the new and old systems are different, thereby causing the technical problem of difficult data migration processing.
Disclosure of Invention
The application provides a data migration processing method, a device, equipment and a storage medium, which solve the technical problem that the data migration processing is difficult because the types of databases adopted by a new system and an old system may have differences or the field structures of database tables adopted by the new system and the old system have differences in the actual development process.
In view of this, a first aspect of the present application provides a data migration processing method, the method including:
s1, creating a temporary intermediate original table with the same table structure as a first system database original table of a first system database;
s2, creating a temporary intermediate table with the same table structure as the original table of the second system database;
s3, importing data in a first database original table of the first system database into the temporary intermediate original table;
s4, migrating the data in the temporary intermediate original table to the temporary intermediate table by executing a field mapping relation script of the first system database and the second system database;
s5, after preprocessing the temporary intermediate table, importing the data in the temporary intermediate table into the original table of the second system database.
Optionally, before the step S4, the method further includes:
s6, creating a field mapping relation script of the first system database and the second system database.
Optionally, the preprocessing the temporary intermediate table in step S5 specifically includes:
and checking, cleaning and correcting the data in the temporary intermediate table.
Optionally, the step S6 further includes:
and updating the time condition in the field mapping relation script, so that the data in the temporary intermediate original table is migrated to the temporary intermediate table according to the time condition in a time period.
A second aspect of the present application provides a data migration processing apparatus, the apparatus comprising:
a first creation unit configured to create a temporary intermediate original table having the same table structure as the first system database original table of the first system database;
a second creating unit for creating a temporary intermediate table having the same table structure as the original table of the second system database;
the first synchronization unit is used for importing the data in the first database original table of the first system database into the temporary intermediate original table;
the data migration unit is used for migrating the data in the temporary intermediate original table to the temporary intermediate table by executing the field mapping relation script of the first system database and the second system database;
and the second synchronization unit is used for importing the data in the temporary intermediate table into the original table of the second system database after preprocessing the temporary intermediate table.
Optionally, the method further comprises:
and the third creating unit is used for creating a field mapping relation script of the first system database and the second system database.
Optionally, the preprocessing the temporary intermediate table specifically includes:
and checking, cleaning and correcting the data in the temporary intermediate table.
Optionally, the method further comprises:
and the updating unit is used for updating the time condition in the field mapping relation script so that the data in the temporary intermediate original table is migrated to the temporary intermediate table according to the time condition in a time period.
A third aspect of the present application provides a data migration processing apparatus, the apparatus comprising a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to perform the steps of the method of data migration processing according to the first aspect described above according to instructions in the program code.
A fourth aspect of the present application provides a computer readable storage medium for storing program code for performing the method of the first aspect described above.
From the above technical solutions, the embodiments of the present application have the following advantages:
in the application, a temporary intermediate original table with the same structure as an old system table is created in a new system, data is firstly migrated on two intermediate tables according to a mapping relation, then the data on the temporary intermediate tables are preprocessed, and finally the data are synchronized to the original database table of the new system, so that possible data migration errors are isolated in the temporary intermediate table to solve the problem, the data errors are prevented from appearing on the line of the new system, and the technical problem that the data migration processing is difficult because the database types adopted by the new and the old systems may have differences or the field structures of the database tables adopted by the new and the old systems have differences in the actual development process is solved.
Drawings
FIG. 1 is a flow chart of a data migration processing method in an embodiment of the present application;
FIG. 2 is a schematic structural diagram of a data migration processing apparatus according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a data migration processing apparatus in an embodiment of the present application.
Detailed Description
In order to make the present application solution better understood by those skilled in the art, the following description will clearly and completely describe the technical solution in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application, and it is apparent that the described embodiments are only some embodiments of the present application, not all embodiments. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.
The application designs a data migration processing method, a device, equipment and a storage medium, which solve the technical problem that the data migration processing is difficult because the types of databases adopted by a new system and an old system may have differences or the field structures of database tables adopted by the new system and the old system have differences in the actual development process.
For ease of understanding, referring to fig. 1, fig. 1 is a flowchart of a method for data migration processing in an embodiment of the present application, as shown in fig. 1, specifically:
s1, creating a temporary intermediate original table with the same table structure as a first system database original table of a first system database;
before data migration, first, a temporary intermediate original table having the same table structure as the original table of the database of the old database needs to be created in the new database. The temporary intermediate primary table has the same field structure as the database primary table of the old database, but no data.
S2, creating a temporary intermediate table with the same table structure as the original table of the second system database;
before data migration, a temporary intermediate table with the same table structure as the original table of the database of the new database, that is, a backup of the new table, is also created in the new database, and the temporary intermediate table has the same table structure as the original table of the database of the new database, but has no data.
S3, importing data in a first database original table of the first system database into a temporary intermediate original table;
the data in the database original table of the old database is first imported into the temporary intermediate original table.
S4, migrating the data in the temporary intermediate original table to the temporary intermediate table by executing a field mapping relation script of the first system database and the second system database;
it should be noted that, the field mapping relation script of the first system database and the second system database is executed in the new database, so as to migrate the data in the temporary intermediate original table to the temporary intermediate table.
S5, after preprocessing the temporary intermediate table, importing the data in the temporary intermediate table into the original table of the second system database.
The data in the temporary intermediate table is preprocessed to ensure the accuracy of the final data, and then the data in the temporary intermediate table is imported into the original database table of the new database.
It can be appreciated that the problem of cross-machine and cross-database systems is solved by using a temporary intermediate original table, and the problem is simplified into a problem of data migration between different data tables in the same database system.
Because the table field structures of the new and old data tables are different, the mapping relation is complex, and the migration process is easy to make mistakes. It is proposed herein to first create a backup of a new table (same structure as the new table field, no data) "temporary intermediate table" on the new system. And then, firstly, migrating on the two intermediate tables according to the mapping relation, then, preprocessing data verification and correction on the temporary intermediate table, and finally, synchronizing the data to the corresponding original table. In this way, the possible data conversion migration errors are isolated in the temporary intermediate table, so that the data problem is avoided from occurring on a new system line.
The mapping relation of new and old system table fields is maintained by writing the mapping relation sql, and the sql is directly executed during migration without manual input, so that the efficiency is greatly improved and the errors are reduced. When the data errors are found, the data are not required to be modified one by one, the mapping relation sql is directly modified and re-executed, and the quick correction and maintenance of the data are facilitated.
Further, before step S4, the method further includes:
s6, creating a field mapping relation script of the first system database and the second system database.
Further, in step S5, the preprocessing of the temporary intermediate table specifically includes:
and checking, cleaning and correcting the data in the temporary intermediate table.
Further, step S6 further includes:
and updating the time condition in the field mapping relation script so that the data in the temporary intermediate original table is migrated to the temporary intermediate table according to the time condition in time periods.
It should be noted that, in the scenario where new and old systems are parallel and data migration needs to be staged, the data migration is easy to be performed in stages by modifying or updating the time conditions in the field mapping relation script.
Referring to fig. 2, fig. 2 is a schematic structural diagram of a data migration processing apparatus according to an embodiment of the present application, as shown in fig. 2, specifically:
a first creating unit 201 for creating a temporary intermediate original table having the same table structure as the first system database original table of the first system database;
before data migration, first, a temporary intermediate original table having the same table structure as the original table of the database of the old database needs to be created in the new database. The temporary intermediate primary table has the same field structure as the database primary table of the old database, but no data.
A second creating unit 202, configured to create a temporary intermediate table having the same table structure as the original table of the second system database;
before data migration, a temporary intermediate table with the same table structure as the original table of the database of the new database, that is, a backup of the new table, is also created in the new database, and the temporary intermediate table has the same table structure as the original table of the database of the new database, but has no data.
A first synchronization unit 203, configured to import data in a first database original table of the first system database into a temporary intermediate original table;
the data in the database original table of the old database is first imported into the temporary intermediate original table.
A data migration unit 204, configured to migrate data in the temporary intermediate original table to the temporary intermediate table by executing a field mapping relation script of the first system database and the second system database;
it should be noted that, the field mapping relation script of the first system database and the second system database is executed in the new database, so as to migrate the data in the temporary intermediate original table to the temporary intermediate table.
And the second synchronization unit 205 is configured to, after preprocessing the temporary intermediate table, import the data in the temporary intermediate table into the original table of the second system database.
The data in the temporary intermediate table is preprocessed to ensure the accuracy of the final data, and then the data in the temporary intermediate table is imported into the original database table of the new database.
It can be appreciated that the problem of cross-machine and cross-database systems is solved by using a temporary intermediate original table, and the problem is simplified into a problem of data migration between different data tables in the same database system.
Because the table field structures of the new and old data tables are different, the mapping relation is complex, and the migration process is easy to make mistakes. It is proposed herein to first create a backup of a new table (same structure as the new table field, no data) "temporary intermediate table" on the new system. And then, firstly, migrating on the two intermediate tables according to the mapping relation, then, preprocessing data verification and correction on the temporary intermediate table, and finally, synchronizing the data to the corresponding original table. In this way, the possible data conversion migration errors are isolated in the temporary intermediate table, so that the data problem is avoided from occurring on a new system line.
The mapping relation of new and old system table fields is maintained by writing the mapping relation sql, and the sql is directly executed during migration without manual input, so that the efficiency is greatly improved and the errors are reduced. When the data errors are found, the data are not required to be modified one by one, the mapping relation sql is directly modified and re-executed, and the quick correction and maintenance of the data are facilitated.
Further, the method further comprises the following steps:
and the third creating unit is used for creating a field mapping relation script of the first system database and the second system database.
Further, the preprocessing of the temporary intermediate table is specifically as follows:
and checking, cleaning and correcting the data in the temporary intermediate table.
Further, the method further comprises the following steps:
and the updating unit is used for updating the time condition in the field mapping relation script so that the data in the temporary intermediate original table is migrated to the temporary intermediate table according to the time condition in a time period.
It should be noted that, in the scenario where new and old systems are parallel and data migration needs to be staged, the data migration is easy to be performed in stages by modifying or updating the time conditions in the field mapping relation script.
The embodiment of the present application further provides another data migration processing apparatus, as shown in fig. 3, for convenience of explanation, only a portion related to the embodiment of the present application is shown, and specific technical details are not disclosed, please refer to a method portion of the embodiment of the present application. The terminal can be any terminal equipment including a mobile phone, a tablet personal computer, a personal digital assistant (English full name: personal DigitalAssistant, english abbreviation: PDA), a sales terminal (English full name: point of sales, english abbreviation: POS), a vehicle-mounted computer and the like, taking the mobile phone as an example of the terminal:
fig. 3 is a block diagram showing a part of a structure of a mobile phone related to a terminal provided in an embodiment of the present application. Referring to fig. 3, the mobile phone includes: radio Frequency (RF) circuit 1010, memory 1020, input unit 1030, display unit 1040, sensor 1050, audio circuit 1060, wireless fidelity (wireless fidelity, wiFi) module 1070, processor 1080, and power source 1090. Those skilled in the art will appreciate that the handset configuration shown in fig. 3 is not limiting of the handset and may include more or fewer components than shown, or may combine certain components, or may be arranged in a different arrangement of components.
The following describes the components of the mobile phone in detail with reference to fig. 3:
the RF circuit 1010 may be used for receiving and transmitting signals during a message or a call, and particularly, after receiving downlink information of a base station, the signal is processed by the processor 1080; in addition, the data of the design uplink is sent to the base station. Generally, RF circuitry 1010 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (English full name: lowNoiseAmplifier, english abbreviation: LNA), a duplexer, and the like. In addition, the RF circuitry 1010 may also communicate with networks and other devices via wireless communications. The wireless communication may use any communication standard or protocol, including but not limited to global system for mobile communications (english: global System ofMobile communication, english: GSM), general packet radio service (english: generalPacket Radio Service, GPRS), code division multiple access (english: code Division Multiple Access, english: CDMA), wideband code division multiple access (english: wideband Code DivisionMultipleAccess, english: WCDMA), long term evolution (english: long TermEvolution, english: LTE), email, short message service (english: shortMessaging Service, SMS), and the like.
The memory 1020 may be used to store software programs and modules that the processor 1080 performs various functional applications and data processing of the handset by executing the software programs and modules stored in the memory 1020. The memory 1020 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 1020 may include high-speed random access memory and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state memory device.
The input unit 1030 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the handset. In particular, the input unit 1030 may include a touch panel 1031 and other input devices 1032. The touch panel 1031, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1031 or thereabout using any suitable object or accessory such as a finger, stylus, etc.), and drive the corresponding connection device according to a predetermined program. Alternatively, the touch panel 1031 may include two parts, a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device and converts it into touch point coordinates, which are then sent to the processor 1080 and can receive commands from the processor 1080 and execute them. Further, the touch panel 1031 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The input unit 1030 may include other input devices 1032 in addition to the touch panel 1031. In particular, other input devices 1032 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a track ball, a mouse, a joystick, etc.
The display unit 1040 may be used to display information input by a user or information provided to the user and various menus of the mobile phone. The display unit 1040 may include a display panel 1041, and alternatively, the display panel 1041 may be configured in the form of a liquid crystal display (english full name: liquid Crystal Display, acronym: LCD), an Organic Light-Emitting Diode (OLED), or the like. Further, the touch panel 1031 may overlay the display panel 1041, and when the touch panel 1031 detects a touch operation thereon or thereabout, the touch panel is transferred to the processor 1080 to determine a type of touch event, and then the processor 1080 provides a corresponding visual output on the display panel 1041 according to the type of touch event. Although in fig. 3, the touch panel 1031 and the display panel 1041 are two independent components for implementing the input and output functions of the mobile phone, in some embodiments, the touch panel 1031 and the display panel 1041 may be integrated to implement the input and output functions of the mobile phone.
The handset may also include at least one sensor 1050, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 1041 according to the brightness of ambient light, and the proximity sensor may turn off the display panel 1041 and/or the backlight when the mobile phone moves to the ear. As one of the motion sensors, the accelerometer sensor can detect the acceleration in all directions (generally three axes), and can detect the gravity and direction when stationary, and can be used for applications of recognizing the gesture of a mobile phone (such as horizontal and vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer and knocking), and the like; other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc. that may also be configured with the handset are not described in detail herein.
Audio circuitry 1060, a speaker 1061, and a microphone 1062 may provide an audio interface between a user and a cell phone. Audio circuit 1060 may transmit the received electrical signal after audio data conversion to speaker 1061 for conversion by speaker 1061 into an audio signal output; on the other hand, microphone 1062 converts the collected sound signals into electrical signals, which are received by audio circuit 1060 and converted into audio data, which are processed by audio data output processor 1080 for transmission to, for example, another cell phone via RF circuit 1010 or for output to memory 1020 for further processing.
WiFi belongs to a short-distance wireless transmission technology, and a mobile phone can help a user to send and receive emails, browse webpages, access streaming media and the like through a WiFi module 1070, so that wireless broadband Internet access is provided for the user. Although fig. 3 shows a WiFi module 1070, it is understood that it does not belong to the necessary constitution of the handset, and can be omitted entirely as required within the scope of not changing the essence of the invention.
Processor 1080 is the control center of the handset, connects the various parts of the entire handset using various interfaces and lines, and performs various functions and processes of the handset by running or executing software programs and/or modules stored in memory 1020, and invoking data stored in memory 1020, thereby performing overall monitoring of the handset. Optionally, processor 1080 may include one or more processing units; preferably, processor 1080 may integrate an application processor primarily handling operating systems, user interfaces, applications, etc., with a modem processor primarily handling wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 1080.
The handset further includes a power source 1090 (e.g., a battery) for powering the various components, which may preferably be logically connected to the processor 1080 by a power management system, such as to provide for managing charging, discharging, and power consumption by the power management system.
Although not shown, the mobile phone may further include a camera, a bluetooth module, etc., which will not be described herein.
In the embodiment of the present application, the processor 1080 included in the terminal further has the following functions:
s1, creating a temporary intermediate original table with the same table structure as a first system database original table of a first system database;
s2, creating a temporary intermediate table with the same table structure as the original table of the second system database;
s3, importing data in a first database original table of the first system database into a temporary intermediate original table;
s4, migrating the data in the temporary intermediate original table to the temporary intermediate table by executing a field mapping relation script of the first system database and the second system database;
s5, after preprocessing the temporary intermediate table, importing the data in the temporary intermediate table into the original table of the second system database.
The embodiments of the present application also provide a computer readable storage medium for storing program code for executing any one of the data migration processing methods described in the foregoing embodiments.
In the embodiment of the application, a temporary intermediate original table with the same structure as that of an old system table is created in a new system, data is firstly migrated on two intermediate tables according to a mapping relation, then the data on the temporary intermediate tables are preprocessed, and finally data are synchronized to the original database table of the new system, so that possible data migration errors are isolated in the temporary intermediate table to solve the problem, the data errors are prevented from appearing on a line of the new system, and the technical problem that the data migration processing is difficult because the types of databases adopted by the new and old systems may have differences or the field structures of the database tables adopted by the new and old systems have differences in the actual development process is solved.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, which are not repeated herein.
The terms "first," "second," "third," "fourth," and the like in the description of the present application and in the above-described figures, if any, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be capable of operation in sequences other than those illustrated or described herein, for example. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
It should be understood that in this application, "at least one" means one or more, and "a plurality" means two or more. "and/or" for describing the association relationship of the association object, the representation may have three relationships, for example, "a and/or B" may represent: only a, only B and both a and B are present, wherein a, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship. "at least one of" or the like means any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (one) of a, b or c may represent: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, c may be single or plural.
In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.
The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application may be embodied in essence or a part contributing to the prior art or all or part of the technical solution in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments of the present application. And the aforementioned storage medium includes: u disk, mobile hard disk, read-Only Memory (ROM), random access Memory (RandomAccess Memory, RAM), magnetic disk or optical disk, etc.
The above embodiments are merely for illustrating the technical solution of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the corresponding technical solutions.

Claims (10)

1. A data migration processing method, comprising:
s1, creating a temporary intermediate original table with the same table structure as a first system database original table of a first system database;
s2, creating a temporary intermediate table with the same table structure as the original table of the second system database;
s3, importing data in a first database original table of the first system database into the temporary intermediate original table;
s4, migrating the data in the temporary intermediate original table to the temporary intermediate table by executing a field mapping relation script of the first system database and the second system database;
s5, after preprocessing the temporary intermediate table, importing the data in the temporary intermediate table into the original table of the second system database.
2. The data migration processing method according to claim 1, further comprising, before the step S4:
s6, creating a field mapping relation script of the first system database and the second system database.
3. The data migration processing method according to claim 1, wherein the preprocessing of the temporary intermediate table in step S5 specifically includes:
and checking, cleaning and correcting the data in the temporary intermediate table.
4. The data migration processing method according to claim 1, wherein after the step S6, further comprising:
and updating the time condition in the field mapping relation script, so that the data in the temporary intermediate original table is migrated to the temporary intermediate table according to the time condition in a time period.
5. A data migration processing apparatus, comprising:
a first creation unit configured to create a temporary intermediate original table having the same table structure as the first system database original table of the first system database;
a second creating unit for creating a temporary intermediate table having the same table structure as the original table of the second system database;
the first synchronization unit is used for importing the data in the first database original table of the first system database into the temporary intermediate original table;
the data migration unit is used for migrating the data in the temporary intermediate original table to the temporary intermediate table by executing the field mapping relation script of the first system database and the second system database;
and the second synchronization unit is used for importing the data in the temporary intermediate table into the original table of the second system database after preprocessing the temporary intermediate table.
6. The data migration processing apparatus according to claim 5, further comprising:
and the third creating unit is used for creating a field mapping relation script of the first system database and the second system database.
7. The data migration processing apparatus according to claim 5, wherein the preprocessing of the temporary intermediate table is specifically:
and checking, cleaning and correcting the data in the temporary intermediate table.
8. The data migration processing apparatus according to claim 5, further comprising:
and the updating unit is used for updating the time condition in the field mapping relation script so that the data in the temporary intermediate original table is migrated to the temporary intermediate table according to the time condition in a time period.
9. A data migration processing apparatus, the apparatus comprising a processor and a memory:
the memory is used for storing program codes and transmitting the program codes to the processor;
the processor is configured to perform the data migration processing method according to any one of claims 1-4 according to instructions in the program code.
10. A computer-readable storage medium storing a program code for executing the data migration processing method according to any one of claims 1 to 4.
CN202310242942.XA 2023-03-14 2023-03-14 Data migration processing method, device, equipment and storage medium Pending CN116257503A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310242942.XA CN116257503A (en) 2023-03-14 2023-03-14 Data migration processing method, device, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310242942.XA CN116257503A (en) 2023-03-14 2023-03-14 Data migration processing method, device, equipment and storage medium

Publications (1)

Publication Number Publication Date
CN116257503A true CN116257503A (en) 2023-06-13

Family

ID=86686097

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310242942.XA Pending CN116257503A (en) 2023-03-14 2023-03-14 Data migration processing method, device, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN116257503A (en)

Similar Documents

Publication Publication Date Title
CN106775637B (en) Page display method and device for application program
CN104965641B (en) information display method and device
US20210076323A1 (en) Wake-up management method, timer management method, and terminal device
CN104980455A (en) Multi-terminal data synchronization method based on cloud storage, device and system thereof
CN110597793A (en) Data management method and device, electronic equipment and computer readable storage medium
CN106484563B (en) Data migration method and terminal equipment
CN116881143A (en) Data object copying abnormality investigation method, device, equipment and storage medium
CN116303646A (en) Cross-database data comparison method, device, equipment and storage medium
CN116932625A (en) Fuzzy data generation method, device, equipment and storage medium
CN110109788B (en) Multi-key detection method and device, electronic equipment and storage medium
CN116303085A (en) Test reason analysis method, device, equipment and storage medium
CN116468382A (en) RPA robot flow management method, device, equipment and storage medium
CN116702698A (en) Word document formatting method, device, equipment and storage medium
CN110908586B (en) Keyboard display method and device and terminal equipment
CN116257503A (en) Data migration processing method, device, equipment and storage medium
CN114817419A (en) Kafka-based media asset data storage method and device, electronic equipment and storage medium
CN116841794A (en) Data verification method and device and storage medium
CN106681845B (en) Method and device for managing communication messages
CN117539460B (en) Data set editing processing method and system
CN118349540B (en) Quick fitting method, device and equipment for database structure and storage medium
CN116382945A (en) Card making processing method, system, equipment and computer readable storage medium
CN117688085A (en) Distributed database switching method, device, system, equipment and storage medium
CN118519620A (en) Flow processing method, device, equipment and computer readable storage medium
CN111459528B (en) Frequency band upgrading method, system, storage medium and mobile terminal
CN117807132A (en) Distributed database histogram creation method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination