JP6862042B2 - Data migration program creation system and data migration program creation program - Google Patents

Description

The present invention relates to a data migration program creation system and a data migration program creation program for creating a data migration program used when migrating database data due to system replacement or the like.

In the past, when creating this type of data migration program, it was customary for the operator to look at a document that describes the contents of the data migration process, which is called a design document. For this reason, there is a problem that a mistake may occur in program creation and it takes a lot of time to create an appropriate program.

On the other hand, Patent Document 1 discloses a data migration tool generation program. This program is a common item migration program acquisition means for acquiring a common item migration program for converting data related to common items included in the migration source database into data conforming to the data structure used in the migration destination database. By acquiring and combining each of the specified items, a conversion program that converts the data related to the specified items specified by the user included in the migration source database into the data conforming to the data structure used in the migration destination database. A means for generating a designated item migration program for generating a designated item migration program, and a data migration tool generating means for generating a data migration tool by combining a common item migration program and a designated item migration program. To prepare.

Further, Patent Document 2 discloses a database migration method. The method described in Patent Document 2 is based on a database definition file for each organization consisting of a file describing the hierarchical structure of each record in the network type database and the definition of the substance of each record, and the data structure in the system of each organization. Describe the step of creating a new system record specification that describes the specifications of each record that does not depend on the new system record specifications in one common format, and the SQL statement for defining each record in a tabular format from the new system record specifications. It has a step of creating a new database definition file for each organization that defines the substance of each record in the relational database, and a copy clause for each organization that defines each format of each record.

Further, in the method of Patent Document 2, a new system access routine template for describing all database access pattern processing templates is prepared, created based on the database definition file, and described in the new system access routine template. Based on the step of creating a parameter file having information to be referred to when determining the range of dependent records to be processed collectively for the temporary symbol, and the new system record specification file and the parameter file. It has a step of modifying and processing the new system access routine template to generate a new system access routine.

Japanese Unexamined Patent Publication No. 2013-41526 Japanese Unexamined Patent Publication No. 2006-293996

The program described in Patent Document 1 is formed by dividing the data of the migration source database into data related to common items and data specified by a user, and combining these to form the entire program. According to this program, it is effective for databases to which such data classification can be applied, but it may not be applicable to databases for which such classification is difficult to hold, or even if it is applied, it may not be possible to migrate successfully. There is.

On the other hand, in the database migration method of Patent Document 2, the database definition file of the old system is input, the record specification file and parameter file of the new system are created from the database definition of the old system, and the record specification file of the new system is used. It has the effect of being able to create a database access routine from the system DB definition file and the copy clause of the new system, and the record specification file and parameter file of the new system. Further, by automatically converting the application program so as to start this database access routine, there is an effect that the application program can be mechanically transferred from the old system to the new system.

Further, in the database migration method of Patent Document 2, since the record specification file of the new system is stored as a record specification that does not depend on either the database management system of the old system or the database management system of the new system, there are various types. It has the effect of being able to flexibly migrate from a database management system and to various database management systems.

However, the database migration method of Patent Document 2 integrates a plurality of databases and migrates them to one database, and requires a large-scale configuration and complicated processing. Therefore, there is a risk that the process will be heavy in creating a program for migrating database data due to system replacement or the like.

The present invention has been made in view of the current state of technology related to database data migration as described above, and an object of the present invention is a database in which the data of the migration source database is not a special configuration such as data relating to common items and other data. It is also suitable for data migration, and provides a data migration program creation system and a data migration program creation program that do not require a large-scale configuration or complicated processing.

The data migration program creation system according to the present invention is a data migration program creation system that migrates the data of the migration source database to a database having specifications different from the migration source database, and uses the template file and the input data embedded in the template. Based on this, a document creation means that creates and outputs a document in a predetermined format, a design document file that describes an outline of data migration processing including at least type information of data editing processing performed at the time of migration, and a design document file that describes the data. Import the migration process source template file that should embed the data migration process outline, give it to the document creation means to operate, generate and output the data migration program source Program source generation means, and set in the migration source table and items The program source generation means includes an edit content source file composed of a specific content program source in which a specific method of modifying the item data by adding an edit process is described, and the program source generation means is a second edit type data edit process. This is a data migration program creation system that generates data by referring to the edited content source file, and the type information of the data editing process of the design document file is set in the migration source table and items. The first edit type that migrates the item data to the migration destination table and item as it is, and the second edit type that changes the item data set in the migration source table and item by performing editing processing and migrates to the migration destination table and item. When the second edit type is divided into a plurality of data according to the content of the change process, the specific content program source in the edit content source file corresponding to each of the plurality of edit class information includes The edit content source file is configured so that it can be obtained from the edit method information of 1 in the plurality of edit method information (character string) obtained by selecting 1 in (character string), and the specific content is specified. The program source is characterized by including rules and / or conversion formulas for making the data of the required specifications.

In the data migration program creation system according to the present invention, the type information of the data editing process of the design document file includes a third editing type that does not migrate the item data set in the migration source table and the item to the migration destination table and the item. It is characterized in that a fourth edit type is provided in which the set initial values are set in the migration destination table and items as they are.

In the data migration program creation system according to the present invention, the program source generation means generates and outputs a data migration program source that sends data from the migration source database as CSV data to the migration destination database.

The data migration program creation program according to the present invention embeds a computer that performs a data migration program creation process for migrating data from a migration source database to a database having specifications different from that of the migration source database in a template file and the template. A document creation means that creates and outputs a document in a predetermined format based on the input data, a design document file that describes the outline of the data migration process including at least the type information of the data editing process performed at the time of the migration, and the design document. A migration process source template file in which the outline of the data migration process described in the file should be embedded, and a migration process source template file, which is given to the document creation means to operate, and a data migration program source is generated and output as a program source generation means, and a migration source The computer refers to the edited content source file composed of the specific content program source in which the specific method of modifying the item data set in the table and the item by editing is described as the program source generating means. It is characterized in that it is configured to be possible, and when the computer is used as the program source generation means to generate data related to the second edit type data editing process, the computer is made to function by referring to the edit content source file. In the data migration program creation program to be performed, the type information of the data editing process of the design document file is the first editing type that directly migrates the item data set in the migration source table and the item to the migration destination table and the item. , The item data set in the migration source table and the item is changed by adding the editing process, and the second editing type is migrated to the migration destination table and the item, and there are a plurality of second editing types depending on the content of the change processing. When divided into types, the specific content program source in the edit content source file corresponding to each of the plurality of edits is obtained by selecting 1 from the plurality of edit class information (character strings). The edited content source file is configured so that it can be obtained from one edit method information in the method information (character string), and the specific content program source contains rules for obtaining data of required specifications. And / or include a conversion formula.

In the data migration program creation program according to the present invention, the type information of the data editing process of the design document file includes the third editing type in which the item data set in the migration source table and the item is not migrated to the migration destination table and the item. , A fourth edit type is provided in which the set initial values are set in the migration destination table and items as they are.

The program for creating a data migration program according to the present invention is characterized in that the program source generating means functions to generate and output a data migration program source that sends data from the migration source database as CSV data to the migration destination database. ..

According to the present invention, a design document file describing an outline of data migration processing including at least type information of data editing processing performed at the time of migration and a migration processing source in which the outline of data migration processing described in the design document file should be embedded. Since the data migration program source is generated and output using the document creation means that creates and outputs a document in a predetermined format based on the template file and the input data to be embedded in the template file and the template, the input data to be embedded in the template. As a result, a program can be easily created by describing the outline of the data migration process including at least the type information of the data editing process performed at the time of migration. Therefore, it is possible to create a program suitable for data migration of a database that does not have a special configuration, and it is possible to eliminate the concern that the configuration becomes large and complicated processing is required.

The block diagram which shows the structure in embodiment of the data migration program creation system which concerns on this invention. The figure which shows the content example of the design document file used in embodiment of the data migration program creation system which concerns on this invention. The figure which shows the content example of the edit content source file used in embodiment of the data migration program creation system which concerns on this invention. The figure which shows the content example of the migration processing source template file used in embodiment of the data migration program creation system which concerns on this invention. The flowchart which shows the operation of embodiment of the data migration program creation system which concerns on this invention. The figure which shows an example of the source (before the add-in of the source of the edit content source file) created by the embodiment of the data migration program creation system which concerns on this invention.

Hereinafter, embodiments of the data migration program creation system and the data migration program creation program according to the present invention will be described with reference to the accompanying drawings. In each figure, the same components are designated by the same reference numerals, and duplicate description will be omitted. FIG. 1 shows a configuration diagram of an embodiment of a data migration program creation system according to the present invention.

As shown in FIG. 1, an embodiment of a data migration program creation system is a data migration program creation system that migrates data from a migration source database to a database having specifications different from those of the migration source database, and is a document creation means. 11 is provided. The document creating means 11 creates and outputs a document in a predetermined format based on the template file and the input data to be embedded in the template. As the document creation means 11, for example, a template engine called Velocity developed by the Apache Jakarta Project can be used.

The embodiment of the data migration program creation system includes a design document file 21 and a migration processing source template file 22. It is assumed that the design document file 21 and the migration processing source template file 22 are created by the operator and stored in the storage means (memory).

Here, it is assumed that the data of the migration source database 100 of FIG. 1 is migrated as the data of the migration destination database 200. The design document file 21 describes an outline of the data migration process including at least the type of data editing process performed at the time of migration, and is, for example, information as shown in FIG. 2 created by Excel (registered trademark). Is. That is, information about the table of the migration source database 100 is described as a "reference table" in the upper row. In this example, it is shown that the migration source database 100 has a table with the table name "TABLE1" and a table with the table name "TABLE2" in the "reference table name" used for CSV data output described later. The information described in the "extraction specifications" indicates the extraction conditions of the migration source database 100. Further, the information described in the additional condition is used for CSV data output and indicates a sort condition.

At the bottom of the design document file 21 in FIG. 2, a description of the outline of the data migration process is shown as a “migration specification”. The contents of the "migration specification" table will be described by identifying columns by the alphabet shown at the top of FIG. Column B describes the column name of the migration destination table, column C describes the item name of the migration destination table, column D describes the data type of the migration destination table, and column E describes the data type of the migration destination table. The length (capacity) is described, and column J is a remarks column.

The type information of the data editing process of the design document file is set in the column K of the table of the "migration specification". This type information includes the first edit type "Migrate the item data set in the migration source table and item as it is to the migration destination table and item" and "Edit process to the item data set in the migration source table and item". Includes a second edit type that "changes by adding and migrating to the destination table and items." In the present embodiment, the first editing type is represented as the editing type "1".

The second edit type may be divided into a plurality of types according to the content of the change process, and in the present embodiment, the second edit type is set by "edit class name (edit class information) and method name (method information)". Editing type "3" that "performs simple editing processing using the source program" and "performing complicated editing processing using the source program set by the editing class name and method name" editing type "4" It is divided into. In the edit type "3" and the edit type "4", the information set in the migration source table (physical name) and the item (physical name) is a parameter.

The source program set by the edit class name and method name used in the above second edit type edit process describes a specific method of changing the item data set in the migration source table and items by adding the edit process. This system is provided as an edited content source file 13 of the specific content program source. It is assumed that the edited content source file 13 is created by an operator using, for example, Java (registered trademark) and stored in a storage means (memory).

A specific example of the edited content source file 13 is shown in FIG. For example, it is a table configured so that a series of sources can be obtained by an edit class name (character string) and an edit method (character string). In the source column, for the sake of clarity, the description is described in sentences, but in reality, the source that is the method information is described by Java. Since the edited content source file 13 is used for database migration, for example, the age according to the era name such as Showa or Meiji may be written in the Christian era, the date may be set to several months later (before), or the temperature may be Celsius. Is stored as a source for changing the data to the required specifications, such as converting to Fahrenheit temperature, zero supply of character strings to several digits, and so on. The source corresponding to the method information shown here is only an example, and the required conversion formula etc. corresponds to the method information depending on the contents of the database and the specifications of the migration destination database to be migrated. It is considered as a source.

In addition to the above, as the type information, the third edit type that does not migrate the item data set in the migration source table and item to the migration destination table and item, and the set initial value as it is in the migration destination table and item. A fourth edit type to be set can be provided. In the present embodiment, the third edit type is represented as the edit type "5", and the fourth edit type is represented as the edit type "2".

Continue explaining the contents of the "Migration Specifications" table. The migration source table name is set in the column L, and the column M is the logical name thereof. A column name is set in column N, and column O is its logical name. The initial value for the edit type "2" is set in the column P, and the edit specification is set in the column Q. This editing specification is for instructing editing in a format that conforms to the specifications of the items in the corresponding migration destination table. The edit class name of the edit content source file 13 used when the edit type is "3" or "4" is set in the column R, and the edit used when the edit type is "3" or "4" is set in the column S. Contents The edit method name of the source file 13 is set.

The system of this embodiment is provided with a program source generating means 10. The program source generating means 10 takes in the design document file 21 and the migration processing source template file 22 and gives them to the document creating means 11 to operate them to generate and output a data migration program source. In the import of the design document file 21, the data of column B and column Q are imported for the "reference table", and column B, column K, column L, column N, column P, for the "migration specification" table. The data of column R and column S are taken in. When the program source generating means 10 generates the data related to the data editing process of the second editing type, the program source generating means 10 generates by referring to the editing content source file 13.

FIG. 4 shows an example of the migration processing source template file 22. This template is for one line of the "migration specification" of the design document file 21. Therefore, it is repeated for the number of lines of the "transition specification". In the template of FIG. 4, the line starting with # is the syntax specified by the document creation means 11 (template engine). The underlined character string portion is a character string fixedly described in the output source, and the "$ {}" portion is the output variable portion.

The data migration program creation system according to the present embodiment configured as described above is configured by a computer, and each means is realized by the CPU of the computer executing the data migration program creation program. The operation of this system will be described with reference to the flowchart shown in FIG.

The program of the present embodiment is a data migration program source that sends the data of the migration source database as CSV data to the migration destination database, and the program source generation means 10 or the like starts processing the data migration program source. As a result, information to be used at the time of output as CVS data is acquired (S11). Specifically, although not shown in the design document file 21, the design document file 21 is actually set with a character string such as a class name that specifies a migration target (database) such as a system name and an object name. And this class name is acquired. In addition, the reference table name and additional conditions of the "reference table" are acquired.

Following step S11, the migration target item and the type information (edit type) of the data editing process are acquired (S12), and the source is generated using the migration processing source template file 22 and the editing content source file 13 according to the editing type. (S13).

Explaining the process of step S13 by the contents of the design document file 21 shown in FIG. 2, since the item name in the first line is item 1 and the edit type is “1”, the migration process source template shown in FIG. 4 Corresponding to "when the edit type is" 1 "" of the file 22, the source as described in the first line of FIG. 6 showing an example of the output source is created. Further, when the item name on the second line is item 2, the edit type is "2", which corresponds to "when the edit type is" 2 "" of the migration processing source template file 22 shown in FIG. 4, and is output. A source with initial values set is created as described in the second line of FIG. 6 showing an example of the source.

Further, when the item name on the third line is item 3, the edit type is "3", which corresponds to "when the edit type is" 3 "" of the migration processing source template file 22 shown in FIG. 4, and is output. As described in the third line of FIG. 6 showing a source example, a source (data creation source 30 of FIG. 1) in which a specific content program source by an edit class name and a method name is set is created. In the example of FIG. 6, the edit class name and the method name are described, but the "build" of FIG. 1 is performed by the program source generation means 10 using the edit content source file 13, and the program source has specific contents. (Data creation module 40 of FIG. 1) is generated.

Further, when the item name on the fourth line is item 4, the edit type is "4", which corresponds to "when the edit type is" 4 "" of the migration processing source template file 22 shown in FIG. 4, and is output. A source (data creation source 30 in FIG. 1) in which an edit class name and a method name are set is created as described in the fourth line of FIG. 6 showing a source example. In the example of FIG. 6, the edit class name and the method name are described, but the "build" of FIG. 1 is performed by the program source generation means 10 using the edit content source file 13, and the program source has specific contents. (Data creation module 40 of FIG. 1) is generated.

Further, since the item name on the fifth line is item 5 and the edit type is "5", it corresponds to "when the edit type is" 5 "" of the migration processing source template file 22 shown in FIG. When the edit type is "5", the item data set in the migration source table and the item is not migrated to the migration destination table and the item, so that the description is not made in the fifth row of FIG.

In the same manner thereafter, the same processing is continued until YES in the determination of "Is all lines completed?" In step S14 of FIG. 5, and when YES in step S14, the program created above is output (S15). ), End.

Thus, a program source (data creation module 40 in FIG. 1) for migrating the data of the migration source database 100 as the data of the migration destination database 200 is generated. The program source created in this way is a program suitable for data migration of a normal database having no special configuration, and the configuration does not become large.

10 Program source generation means 11 Document creation means 13 Edit contents Source file 21 Design document file 22 Migration processing source Template file 30 Data creation source 40 Data creation module 100 Migration source database 200 Migration destination database

Claims (6)

In a data migration program creation system that migrates data from the migration source database to a database with specifications different from the migration source database.
A document creation means for creating and outputting a document in a predetermined format based on a template file and input data to be embedded in the template.
A design document file that describes the outline of the data migration process that includes at least the type information of the data editing process to be performed at the time of the migration, and a migration process source template file that should embed the outline of the data migration process described in the design document file. A program source generation means that captures data, gives it to the document creation means, operates it, and generates and outputs a data migration program source.
It is equipped with an edit content source file composed of a specific content program source that describes a specific method for modifying the migration source table and item data set in the item by performing editing processing.
The program source generation means is a data migration program creation system that generates data by referring to the edit content source file when generating data related to the second edit type data editing process.
The type information of the data editing process of the design document file is
The first edit type that migrates the item data set in the migration source table and items to the migration destination table and items as it is, and
The second edit type that edits the item data set in the migration source table and items to change and migrates to the migration destination table and items.
Including
When the second edit type is divided into a plurality of types according to the content of the change process, the specific content program source in the edit content source file corresponding to each of the plurality is in the plurality of edit class information (character strings). The edit content source file is configured so that it can be obtained from the edit method information of 1 in the plurality of edit method information (character strings) obtained by selecting 1 of, and the specific content program source includes A data migration program creation system characterized by including rules and / or conversion formulas for obtaining data of required specifications. For the type information of the data editing process of the design document file,
There is a third edit type that does not migrate the item data set in the migration source table and items to the migration destination table and items, and a fourth edit type that sets the set initial values as they are in the migration destination table and items. The data migration program creation system according to claim 1, wherein the data migration program is created. The data migration program creation system according to claim 1 or 2, wherein the program source generation means generates and outputs a data migration program source that sends data from the migration source database as CSV data to the migration destination database. A computer that performs a data migration program creation process that migrates the data in the migration source database to a database with specifications different from the migration source database.
A document creation means that creates and outputs a document in a predetermined format based on a template file and input data embedded in the template.
A design document file that describes the outline of the data migration process that includes at least the type information of the data editing process to be performed at the time of the migration, and a migration process source template file that should embed the outline of the data migration process described in the design document file. Import, give to the document creation means to operate, generate and output data migration program source, and function as a program source generation means.
The computer causes the program source generation means to create an edited content source file composed of a specific content program source in which a specific method of modifying the item data set in the migration source table and the item by editing is described. Configured to be referenceable as
Creating a data migration program characterized in that when the computer is used as the program source generating means to generate data related to the second edit type data editing process, the computer is made to function by referring to the edited content source file. Program for
The type information of the data editing process of the design document file is
The first edit type that migrates the item data set in the migration source table and items to the migration destination table and items as it is, and
The second edit type that edits the item data set in the migration source table and items to change and migrates to the migration destination table and items.
Including
When the second edit type is divided into a plurality of types according to the content of the change process, the specific content program source in the edit content source file corresponding to each of the plurality is a plurality of edit class information (character strings). The edit content source file is configured so that it can be obtained from the edit method information of 1 in a plurality of edit method information (character strings) obtained by selecting 1 in the specific content program source. , A program for creating a data migration program, which comprises rules and / or conversion formulas for obtaining data of required specifications. For the type information of the data editing process of the design document file,
There is a third edit type that does not migrate the item data set in the migration source table and items to the migration destination table and items, and a fourth edit type that sets the set initial values to the migration destination table and items as they are. The program for creating a data migration program according to claim 4, wherein the program is characterized by the above. The data migration program creation according to claim 4 or 5, wherein the program source generation means functions to generate and output a data migration program source that sends data from the migration source database to the migration destination database as CSV data. program.

Images