CN117149742A - Data migration testing method and electronic equipment - Google Patents

Data migration testing method and electronic equipment Download PDF

Info

Publication number
CN117149742A
CN117149742A CN202311081190.XA CN202311081190A CN117149742A CN 117149742 A CN117149742 A CN 117149742A CN 202311081190 A CN202311081190 A CN 202311081190A CN 117149742 A CN117149742 A CN 117149742A
Authority
CN
China
Prior art keywords
data
report
migrated
information
migration
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202311081190.XA
Other languages
Chinese (zh)
Inventor
李哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Bank of China Ltd
Original Assignee
Bank of China Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Bank of China Ltd filed Critical Bank of China Ltd
Priority to CN202311081190.XA priority Critical patent/CN117149742A/en
Publication of CN117149742A publication Critical patent/CN117149742A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21—Design, administration or maintenance of databases
    • G06F16/214—Database migration support
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/22—Indexing; Data structures therefor; Storage structures
    • G06F16/2282—Tablespace storage structures; Management thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/285—Clustering or classification
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Test And Diagnosis Of Digital Computers (AREA)

Abstract

The application provides a data migration testing method and electronic equipment, which can be used in the field of artificial intelligence. The method comprises the following steps: responding to a data migration test instruction, and acquiring a data set to be migrated; responding to the data migration signal, and acquiring a target data set; calling a preset test model, and determining model parameters of the preset test model according to the data set to be migrated; based on a preset test model, determining a test report according to model parameters of the preset test model, a data set to be migrated and a target data set. The method can improve the test efficiency of the data migration test.

Description

Data migration testing method and electronic equipment
Technical Field
The application relates to the field of artificial intelligence, in particular to a data migration testing method and electronic equipment.
Background
In the process of data migration of a new system and an old system, in order to ensure the accuracy of service data after migration in the new system, the data migration needs to be tested.
In the prior art, based on a manual test mode, after data migration is performed between new and old systems, business data after Qin migration is obtained, and staff check the database tables after migration one by one to complete the data migration test.
However, in the above manner, when the transaction data is more, the manual test manner is adopted, which consumes longer time, and has the wrong writing operation, thereby reducing the efficiency and accuracy of data migration.
Disclosure of Invention
The application provides a data migration test method and electronic equipment, which are used for solving the problem of low data migration efficiency caused by manual test.
In a first aspect, the present application provides a method of treatment, the method comprising:
responding to a data migration test instruction, and acquiring a data set to be migrated; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one piece of data to be migrated, wherein the data to be migrated is service data to be migrated, which is indicated by the data migration test instruction;
responding to the data migration signal, and acquiring a target data set; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is migrated business data; the target data and the data to be migrated are in one-to-one correspondence;
Calling a preset test model, and determining model parameters of the preset test model according to the data set to be migrated; the model parameters are used for optimizing a data processing process of a preset test model;
determining a test report based on the preset test model according to model parameters of the preset test model, the data set to be migrated and the target data set; the test report characterizes the test condition of the data migration test indicated by the data migration test instruction.
In one example, the data to be migrated has first data information characterizing data characteristics of the data to be migrated; the target data has second data information, the second data information characterizing data characteristics of the target data;
based on the preset test model, determining a test report according to model parameters of the preset test model, the data set to be migrated and the target data set, wherein the test report comprises the following steps:
classifying the data to be migrated in the data set to be migrated according to the first data information to generate a first data report; classifying the target data of the target data set according to the second data information to generate a second data report; wherein the first data report comprises at least one data to be migrated, and the second data report comprises at least one target data; the first data report forms are in one-to-one correspondence with the second data report forms;
Inputting the first data report and the second data report into the preset test model based on model parameters of the preset test model, and outputting comparison information; the comparison information characterizes the data difference condition between the first data report and the second data report;
and generating the test report according to the comparison information.
In one example, the data characteristic includes a customer type, and/or a service type; wherein, the client type is the type of the client corresponding to the service data; the service type is the type of the service to which the service data belongs.
In one example, the first data report has first report information, and the first report information characterizes a data condition of data to be migrated contained in the first data report; the second data report table is provided with second report information, and the second report information characterizes the data condition of target data contained in the second data report table;
inputting the first data report and the second data report into the preset test model based on model parameters of the preset test model, and outputting comparison information, wherein the method comprises the following steps:
And inputting the first report information of the first data report and the second report information of the second data report into the preset test model based on the model parameters of the preset test model, and outputting the comparison information.
In one example, the first report information includes first data amount information and first data structure information; the first data quantity information characterizes the data quantity of the data to be migrated contained in the first data report; the first data structure information characterizes a data structure of data to be migrated contained in the first data report;
the second report information comprises second data volume information and second data structure information; the second data quantity information represents the data quantity of target data contained in the second data report; the second data structure information characterizes a data structure of target data contained in the second data report.
In one example, determining the model parameters of the preset test model according to the data set to be migrated includes:
calling a preset mapping relation; the preset mapping relation characterizes one-to-one correspondence between task information and model parameters; the task information characterizes task attributes of data migration tasks corresponding to the data set to be migrated;
And determining model parameters of the preset test model according to the task information of the data set to be migrated and the preset mapping relation.
In one example, the task information includes a task type and a task priority; the task type is a task type of a data migration task corresponding to a data set to be migrated, and the task priority represents the priority of the data migration task corresponding to the data set to be migrated.
In one example, the method further comprises:
and cleaning the data to be migrated in the data set to be migrated to obtain a processed data set to be migrated.
In a second aspect, the present application provides a data migration testing apparatus, the apparatus comprising:
the first acquisition unit is used for responding to the data migration test instruction and acquiring a data set to be migrated; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one piece of data to be migrated, wherein the data to be migrated is service data to be migrated, which is indicated by the data migration test instruction;
the second acquisition unit is used for responding to the data migration signal and acquiring a target data set; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is migrated business data; the target data and the data to be migrated are in one-to-one correspondence;
The calling unit is used for calling a preset test model;
the first determining unit is used for determining model parameters of the preset test model according to the data set to be migrated; the model parameters are used for optimizing a data processing process of a preset test model;
the second determining unit is used for determining a test report based on the preset test model according to model parameters of the preset test model, the data set to be migrated and the target data set; the test report characterizes the test condition of the data migration test indicated by the data migration test instruction.
In one example, the data to be migrated has first data information characterizing data characteristics of the data to be migrated; the target data has second data information, the second data information characterizing data characteristics of the target data;
the second determination unit includes:
the first classification module is used for classifying the data to be migrated in the data set to be migrated according to the first data information to generate a first data report;
the second classification module is used for classifying the target data of the target data set according to the second data information to generate a second data report; wherein the first data report comprises at least one data to be migrated, and the second data report comprises at least one target data; the first data report forms are in one-to-one correspondence with the second data report forms;
The output module is used for inputting the first data report and the second data report into the preset test model based on the model parameters of the preset test model and outputting comparison information; the comparison information characterizes the data difference condition between the first data report and the second data report;
and the generating module is used for generating the test report according to the comparison information.
In one example, the data characteristic includes a customer type, and/or a service type; wherein, the client type is the type of the client corresponding to the service data; the service type is the type of the service to which the service data belongs.
In one example, the first data report has first report information, and the first report information characterizes a data condition of data to be migrated contained in the first data report; the second data report table is provided with second report information, and the second report information characterizes the data condition of target data contained in the second data report table;
the output module is specifically configured to:
and inputting the first report information of the first data report and the second report information of the second data report into the preset test model based on the model parameters of the preset test model, and outputting the comparison information.
In one example, the first report information includes first data amount information and first data structure information; the first data quantity information characterizes the data quantity of the data to be migrated contained in the first data report; the first data structure information characterizes a data structure of data to be migrated contained in the first data report;
the second report information comprises second data volume information and second data structure information; the second data quantity information represents the data quantity of target data contained in the second data report; the second data structure information characterizes a data structure of target data contained in the second data report.
In one example, the first determining unit includes:
the calling module is used for calling a preset mapping relation; the preset mapping relation characterizes one-to-one correspondence between task information and model parameters; the task information characterizes task attributes of data migration tasks corresponding to the data set to be migrated;
and the determining module is used for determining model parameters of the preset test model according to the task information of the data set to be migrated and the preset mapping relation.
In one example, the task information includes a task type and a task priority; the task type is a task type of a data migration task corresponding to a data set to be migrated, and the task priority represents the priority of the data migration task corresponding to the data set to be migrated.
In one example, the apparatus further comprises:
the cleaning unit is used for cleaning the data to be migrated in the data set to be migrated to obtain the processed data set to be migrated.
In a third aspect, the present application provides an electronic device comprising: a processor, and a memory communicatively coupled to the processor;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored in the memory to implement the method of the first aspect.
In a fourth aspect, the present application provides a computer-readable storage medium having stored therein computer-executable instructions for performing the method of the first aspect when executed by a processor.
In a fifth aspect, the present application provides a computer program product comprising: a computer program stored in a readable storage medium, from which it can be read by at least one processor of an electronic device, the at least one processor executing the computer program causing the electronic device to perform the method of the first aspect.
According to the data migration testing method and the electronic equipment, through the preset testing model, the data corresponding relation between data before migration and data after migration is tested, and a testing report is obtained; furthermore, by automatically testing the data before migration and the data after migration, the test efficiency of the data migration test is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
Fig. 1 is a schematic view of an application scenario provided by the present application;
FIG. 2 is a flow chart of a data migration testing method according to an embodiment of the present application;
FIG. 3 is a flowchart illustrating another data migration testing method according to an embodiment of the present application;
fig. 4 is a schematic structural diagram of a data migration testing apparatus according to an embodiment of the present application;
FIG. 5 is a schematic diagram of another data migration testing apparatus according to an embodiment of the present application;
fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application;
fig. 7 is a block diagram of an electronic device, according to an example embodiment.
Specific embodiments of the present application have been shown by way of the above drawings and will be described in more detail below. The drawings and the written description are not intended to limit the scope of the inventive concepts in any way, but rather to illustrate the inventive concepts to those skilled in the art by reference to the specific embodiments.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary examples do not represent all implementations consistent with the application. Rather, they are merely examples of apparatus and methods consistent with aspects of the application as detailed in the accompanying claims.
Fig. 1 is a schematic view of an application scenario provided by the present application. As shown in fig. 1, the scene includes an electronic device 101 and a user 102. The user 102 inputs a data migration test instruction to the electronic device 101 to instruct the electronic device 101 to perform a data migration test, and the electronic device 101 responds to the data migration test instruction to perform the data migration test, so as to obtain a test report for the user 102 to perform query processing.
In the process of data migration of a new system and an old system, in order to ensure the accuracy of service data after migration in the new system, the data migration needs to be tested.
In one example, based on a manual test mode, after data migration is performed between new and old systems, business data after Qin migration is obtained, and staff checks the database tables after migration one by one to complete the data migration test.
However, in the above manner, when the transaction data is more, the manual test manner is adopted, which consumes longer time, and has the wrong writing operation, thereby reducing the efficiency and accuracy of data migration.
The application provides a data migration testing method and electronic equipment, and aims to solve the technical problems in the prior art.
It should be noted that, the user information (including but not limited to user equipment information, user personal information, etc.) and the data (including but not limited to data for analysis, stored data, presented data, etc.) related to the present application are information and data authorized by the user or fully authorized by each party, and the collection, use and data migration test of the related data need to comply with the related laws and regulations and standards, and provide corresponding operation entries for the user to select authorization or rejection.
It should be noted that the data migration testing method and the electronic device of the present application may be used in the field of artificial intelligence, and may also be used in any field other than the field of artificial intelligence.
The following describes the technical scheme of the present application and how the technical scheme of the present application solves the above technical problems in detail with specific embodiments. The following embodiments may be combined with each other, and the same or similar concepts or processes may not be described in detail in some embodiments. Embodiments of the present application will be described below with reference to the accompanying drawings.
Fig. 2 is a flow chart of a data migration testing method according to an embodiment of the present application, as shown in fig. 2, where the method includes:
s101, responding to a data migration test instruction, and acquiring a data set to be migrated; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one data to be migrated, and the data to be migrated is service data which is indicated by a data migration test instruction and needs to be migrated.
The execution subject of the present embodiment may be an electronic device, for example. Firstly, when a user needs to perform a data migration test, the user inputs a data migration test instruction to the electronic equipment so as to instruct the electronic equipment to perform the data migration test. And responding to the data migration test instruction input by the user based on the test data management module of the electronic equipment, and acquiring service data which are required to be migrated and are indicated by the data migration test instruction, namely a plurality of data to be migrated, according to the indication of the data migration test instruction, and finishing to obtain a data set to be migrated. After the data to be migrated is obtained, a target database which needs to be inserted with the test data, namely the data set to be migrated, can be selected based on the test data management module, and the data set to be migrated is inserted into the target database table in a random, custom, logic dependence, enumeration and other modes according to the test requirements, so that the data migration is completed.
S102, responding to a data migration signal, and acquiring a target data set; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is the migrated business data; the target data and the data to be migrated are in one-to-one correspondence.
For example, after completing data migration, the test data management module of the electronic device generates a data migration signal to characterize that the data migration process corresponding to the data set to be migrated is completed. And responding to the data migration signal, namely, according to the test point of the data migration test, the report generating module based on the electronic equipment acquires one or more migrated service data, namely, target data, and collates the target data to obtain a target data set to be tested. Wherein, each acquired target data corresponds to each acquired data to be migrated one by one.
S103, calling a preset test model, and determining model parameters of the preset test model according to the data set to be migrated; the model parameters are used for optimizing a data processing process of a preset test model.
Illustratively, in order to obtain a more accurate result of the data migration test, a trained test model, i.e., a preset test model, is pre-deployed using artificial intelligence techniques based on a comparison verification module of the electronic device. After the data set to be migrated before data migration and the target data set after data migration are obtained, a preset test model is called, analysis is conducted on the data set to be migrated based on an artificial intelligence technology, model parameters of the preset test model are determined and used for optimizing a data processing process of the preset test model, for example, optimal model parameters in the current preset test model are determined by determining data migration related parameters corresponding to the data set to be migrated, and therefore the preset test model with more accurate test results is obtained.
S104, determining a test report based on a preset test model according to model parameters of the preset test model, a data set to be migrated and a target data set; the test report characterizes the test condition of the data migration test indicated by the data migration test instruction.
The comparison and verification module of the electronic device is used for inputting the data set to be migrated and the target data set into the preset test model after determining the model parameters of the preset test model, and comparing and verifying the service data in the data set to be migrated and the target data set by the preset test model based on the determined model parameters of the preset test model to obtain a test report, so that the test condition of the data migration test indicated by the data migration test instruction is known, and the test efficiency of the data migration test is greatly improved.
In the embodiment, a data migration testing method is provided, and a testing report is obtained by testing the data corresponding relation between data before migration and data after migration through a preset testing model; furthermore, by automatically testing the data before migration and the data after migration, the test efficiency of the data migration test is improved.
Fig. 3 is a flow chart of another data migration testing method according to an embodiment of the present application, as shown in fig. 3, the method includes:
s201, responding to a data migration test instruction, and acquiring a data set to be migrated; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one data to be migrated, and the data to be migrated is service data which is indicated by a data migration test instruction and needs to be migrated.
For example, this step may refer to step 101, and will not be described in detail.
S202, cleaning the data to be migrated in the data set to be migrated to obtain the processed data set to be migrated.
The test data management module of the electronic device is used for cleaning the data to be migrated in the data set to be migrated according to the acquired data set to be migrated and the test requirement and the data migration requirement, such as deleting some unnecessary data to be migrated or not meeting the test requirement, or cleaning and modifying the data environment of the data to be migrated in the data set to be migrated to obtain the processed data set to be migrated so as to meet the test requirement and the data migration requirement and improve the accuracy of the data migration test.
S203, responding to the data migration signal, and acquiring a target data set; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is the migrated business data; the target data and the data to be migrated are in one-to-one correspondence.
Illustratively, this step may refer to step 102, which is not described in detail.
S204, calling a preset test model.
Illustratively, in order to obtain a more accurate result of the data migration test, a trained test model, i.e., a preset test model, is pre-deployed using artificial intelligence techniques based on a comparison verification module of the electronic device. And after the data set to be migrated before data migration and the target data set after data migration are acquired, a preset test model is called.
S205, calling a preset mapping relation; the method comprises the steps that a preset mapping relation represents one-to-one correspondence between task information and model parameters; the task information characterizes task attributes of data migration tasks corresponding to the data set to be migrated.
In one example, the task information includes a task type and a task priority; the task type is a task type of a data migration task corresponding to the data set to be migrated, and the task priority represents the priority degree of the data migration task corresponding to the data set to be migrated.
For example, in order to obtain a more accurate data migration test result, an artificial intelligence technology is used to pre-store a preset mapping relation corresponding to task information and model parameters, where the task information characterizes task attributes of data migration tasks corresponding to data sets to be migrated, including task types of the data migration tasks corresponding to the data sets to be migrated, that is, task types, and priorities of the data migration tasks corresponding to the data sets to be migrated, that is, task priorities. After the preset prediction model is called, the preset mapping relation is called for processing.
S206, determining model parameters of a preset test model according to task information of the data set to be migrated and a preset mapping relation.
The method comprises the steps of extracting task information of a data migration task corresponding to a data set to be migrated, wherein the task information comprises a task type and a task priority; according to the called preset mapping relation and the task information of the data set to be migrated, determining model parameters corresponding to the task information of the data set to be migrated, wherein the model parameters are the called model parameters of the preset test model and are used for optimizing the data processing process of the preset test model.
S207, classifying the data to be migrated in the data set to be migrated according to the first data information to generate a first data report; classifying the target data of the target data set according to the second data information to generate a second data report; the first data report comprises at least one data to be migrated, and the second data report comprises at least one target data; the first data report forms are in one-to-one correspondence with the second data report forms.
In one example, data to be migrated has first data information characterizing data characteristics of the data to be migrated; the target data has second data information characterizing data characteristics of the target data.
For each piece of data to be migrated, each piece of data to be migrated has first data information to characterize the data characteristics of the data to be migrated; for each target data, each target data has second data information to characterize the data characteristics of the target data. Based on a report generating module of the electronic equipment, extracting the data characteristics of each piece of data to be migrated in the acquired data set to be migrated, and extracting the data characteristics of each piece of target data in the acquired target data set; such as transaction status of the business to which the data relates, and information about the associated operators and services of the customer to which the data relates. Classifying each piece of data to be migrated in the data set to be migrated according to the extracted data characteristics of each piece of data to be migrated, and obtaining a data report containing each piece of classified data to be migrated, namely a first data report; meanwhile, classifying each target data in the target data set according to the extracted data characteristics of each target data to obtain a data report containing each classified target data, namely a second data report; the first data report forms are in one-to-one correspondence with the second data report forms, and each data to be migrated in the first data table is in one-to-one correspondence with each target data in the second data table.
In one example, the data characteristics include a customer type, and/or a service type; the client type is the type of the client corresponding to the service data; the service type is the type of the service to which the service data belongs.
Illustratively, based on a report generation module of the electronic device, extracting data characteristics of each piece of data to be migrated in the acquired data set to be migrated, and extracting data characteristics of each piece of target data in the acquired target data set, wherein the data characteristics comprise a client type and/or a service type; the client type is the type of the client corresponding to the service data; the service type is the type of the service to which the service data belongs. According to the data characteristics of the client corresponding to each piece of data to be migrated, the type of the service to which each piece of data to be migrated belongs and the like, classifying each piece of data to be migrated in a data set to be migrated according to test requirements, and correspondingly obtaining a first data report containing the classified pieces of data to be migrated; meanwhile, according to the data characteristics of the type of the client corresponding to each target data and the type of the service to which each target data belongs, classifying each target data in the target data set according to the test requirement, and correspondingly obtaining a second data report containing a plurality of classified target data; and further, respectively obtaining a report of the data before migration and a report after migration to be verified.
S208, inputting the first data report and the second data report into a preset test model based on model parameters of the preset test model, and outputting comparison information; the comparison information characterizes the data difference condition between the first data report and the second data report.
In one example, the first data report has first report information, and the first report information characterizes a data condition of data to be migrated contained in the first data report; the second data report table has second report information, and the second report information characterizes the data condition of target data contained in the second data report.
The first data report generated by the method has first report information, the second data report generated by the method has second report information, wherein the first report information represents the data condition of the data to be migrated contained in the first data report, and the second report information represents the data condition of the target data contained in the second data report. Extracting first report information of the first data report and second report information of the second data report, inputting the first report information of the first data report and the second report information of the second data report into a preset test model, and comparing and analyzing the first report information of the first data report and the second report information of the second data report by the preset test model based on model parameters of the preset test model, for example, analyzing whether field values, classification dimensions and other information between the first data report and the second data report are consistent or not, so as to obtain comparison information corresponding to the first data report and the second data report, and further obtaining the data difference condition between the first data report and the second data report.
In one example, the first report information includes first data amount information and first data structure information; the first data quantity information characterizes the data quantity of the data to be migrated contained in the first data report; the first data structure information characterizes a data structure of data to be migrated contained in the first data report.
The second report information comprises second data amount information and second data structure information; the second data quantity information represents the data quantity of target data contained in the second data report; the second data structure information characterizes a data structure of target data contained in the second data report.
Step S208 includes: based on model parameters of a preset test model, the first report information of the first data report and the second report information of the second data report are input into the preset test model, and comparison information is output.
Specifically, first report information of a first data report is extracted, wherein the first report information comprises first data volume information and first data structure information, and the first data volume information characterizes the data volume of data to be migrated contained in the first data report; the first data structure information characterizes a data structure of data to be migrated contained in the first data report; extracting second report information of a second data report, including second data volume information and second data structure information; the second data quantity information represents the data quantity of target data contained in the second data report; the second data structure information characterizes a data structure of target data contained in the second data report. Inputting the first data volume information and the first data structure information of the first data report, the second data volume information and the second data structure information of the second data report into a preset test model, comparing and analyzing the first report information of the first data report and the second report information of the second data report by the preset test model based on model parameters of the preset test model, and analyzing whether the data volume and the data structure between the first data report and the second data report are consistent or not to obtain comparison information corresponding to the first data report and the second data report, so as to obtain the data difference condition between the first data report and the second data report.
S209, generating a test report according to the comparison information.
The method includes the steps that whether a place where the first data report and the second data report are inconsistent exists or not is determined according to comparison information corresponding to the acquired first data report and the second data report, the place where the first data report and the second data report are consistent and the place where the first data report and the second data report are inconsistent is recorded, a test report is generated, and further test conditions of a data migration test indicated by a data migration test instruction are known, so that problems and errors possibly existing in a data migration process are detected; furthermore, accuracy and efficiency of data migration test are improved.
In this embodiment, on the basis of the foregoing embodiment, on one hand, a test report is obtained by performing test processing on a data correspondence between data before migration and data after migration through a preset test model; furthermore, by automatically testing the data before migration and the data after migration, the test efficiency of the data migration test is improved; on the other hand, the accuracy of the data migration test can be improved by respectively generating reports for the data before migration and the data after migration and adjusting model parameters of a preset test model according to the information of the data migration task.
Fig. 4 is a schematic structural diagram of a data migration testing apparatus according to an embodiment of the present application, as shown in fig. 4, the apparatus 300 includes:
a first obtaining unit 301, configured to obtain a data set to be migrated in response to a data migration test instruction; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one data to be migrated, and the data to be migrated is service data which is indicated by a data migration test instruction and needs to be migrated.
A second obtaining unit 302, configured to obtain a target data set in response to the data migration signal; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is the migrated business data; the target data and the data to be migrated are in one-to-one correspondence.
The retrieving unit 303 is configured to retrieve a preset test model.
The first determining unit 304 is configured to determine model parameters of a preset test model according to the data set to be migrated; the model parameters are used for optimizing a data processing process of a preset test model.
A second determining unit 305, configured to determine a test report based on a preset test model according to model parameters of the preset test model, a data set to be migrated, and a target data set; the test report characterizes the test condition of the data migration test indicated by the data migration test instruction.
The device of the embodiment may execute the technical scheme in the above method, and the specific implementation process and the technical principle are the same and are not described herein again.
Fig. 5 is a schematic structural diagram of another data migration testing apparatus according to an embodiment of the present application, as shown in fig. 5, the apparatus 400 includes:
a first obtaining unit 401, configured to obtain a data set to be migrated in response to a data migration test instruction; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one data to be migrated, and the data to be migrated is service data which is indicated by a data migration test instruction and needs to be migrated.
A second obtaining unit 402, configured to obtain a target data set in response to the data migration signal; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is the migrated business data; the target data and the data to be migrated are in one-to-one correspondence.
The retrieving unit 403 is configured to retrieve a preset test model.
A first determining unit 404, configured to determine model parameters of a preset test model according to the data set to be migrated; the model parameters are used for optimizing a data processing process of a preset test model.
A second determining unit 405, configured to determine a test report according to model parameters of a preset test model, a data set to be migrated, and a target data set, based on the preset test model; the test report characterizes the test condition of the data migration test indicated by the data migration test instruction.
In one example, data to be migrated has first data information characterizing data characteristics of the data to be migrated; the target data has second data information characterizing data characteristics of the target data.
The second determining unit 405 includes:
the first classification module 4051 is configured to perform classification processing on data to be migrated in the data set to be migrated according to the first data information, and generate a first data report.
The second classification module 4052 is configured to perform classification processing on the target data of the target data set according to the second data information, and generate a second data report; the first data report comprises at least one data to be migrated, and the second data report comprises at least one target data; the first data report forms are in one-to-one correspondence with the second data report forms.
The output module 4053 is configured to input the first data report and the second data report into the preset test model based on model parameters of the preset test model, and output comparison information; the comparison information characterizes the data difference condition between the first data report and the second data report.
The generating module 4054 is configured to generate a test report according to the comparison information.
In one example, the data characteristics include a customer type, and/or a service type; the client type is the type of the client corresponding to the service data; the service type is the type of the service to which the service data belongs.
In one example, the first data report has first report information, and the first report information characterizes a data condition of data to be migrated contained in the first data report; the second data report table has second report information, and the second report information characterizes the data condition of target data contained in the second data report.
The output module 4054 is specifically configured to:
based on model parameters of a preset test model, the first report information of the first data report and the second report information of the second data report are input into the preset test model, and comparison information is output.
In one example, the first report information includes first data amount information and first data structure information; the first data quantity information characterizes the data quantity of the data to be migrated contained in the first data report; the first data structure information characterizes a data structure of data to be migrated contained in the first data report.
The second report information comprises second data amount information and second data structure information; the second data quantity information represents the data quantity of target data contained in the second data report; the second data structure information characterizes a data structure of target data contained in the second data report.
In one example, the first determining unit 404 includes:
a retrieving module 4041, configured to retrieve a preset mapping relationship; the method comprises the steps that a preset mapping relation represents one-to-one correspondence between task information and model parameters; the task information characterizes task attributes of data migration tasks corresponding to the data set to be migrated.
The determining module 4042 is configured to determine model parameters of a preset test model according to the task information of the data set to be migrated and a preset mapping relationship.
In one example, the task information includes a task type and a task priority; the task type is a task type of a data migration task corresponding to the data set to be migrated, and the task priority represents the priority degree of the data migration task corresponding to the data set to be migrated.
In one example, the apparatus 400 further comprises:
the cleaning unit 406 is configured to perform cleaning processing on data to be migrated in the data set to be migrated, so as to obtain a processed data set to be migrated.
The device of the embodiment may execute the technical scheme in the above method, and the specific implementation process and the technical principle are the same and are not described herein again.
Fig. 6 is a schematic structural diagram of an electronic device according to an embodiment of the present application, and as shown in fig. 6, an electronic device 500 includes: a memory 501, a processor 502; a memory 501; a memory for storing instructions executable by processor 502.
Wherein the processor 502 is configured to perform the method as provided by the above embodiments.
The electronic device 500 further comprises a receiver 503 and a transmitter 504. The receiver 503 is configured to receive instructions and data sent by other devices, and the transmitter 504 is configured to send instructions and data to an external device.
Fig. 7 is a block diagram of a terminal device, which may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, etc., in accordance with an exemplary embodiment.
The apparatus 800 may include one or more of the following components: a processing component 802, a memory 804, a power component 806, a multimedia component 808, an audio component 810, an input/output (I/O) interface 812, a sensor component 814, and a communication component 816.
The processing component 802 generally controls overall operation of the apparatus 800, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 802 can include one or more modules that facilitate interactions between the processing component 802 and other components. For example, the processing component 802 can include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.
The memory 804 is configured to store various types of data to support operations at the apparatus 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phonebook data, messages, pictures, videos, and the like. The memory 804 may be implemented by any type or combination of volatile or nonvolatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disk.
The power supply component 806 provides power to the various components of the device 800. The power components 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 800.
The multimedia component 808 includes a screen between the device 800 and the user that provides an output interface. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from a user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may sense not only the boundary of a touch or sliding action, but also the duration and pressure associated with the touch or sliding operation. In some embodiments, the multimedia component 808 includes a front camera and/or a rear camera. The front camera and/or the rear camera may receive external multimedia data when the apparatus 800 is in an operational mode, such as a photographing mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have focal length and optical zoom capabilities.
The audio component 810 is configured to output and/or input audio signals. For example, the audio component 810 includes a Microphone (MIC) configured to receive external audio signals when the device 800 is in an operational mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, audio component 810 further includes a speaker for outputting audio signals.
The I/O interface 812 provides an interface between the processing component 802 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. These buttons may include, but are not limited to: homepage button, volume button, start button, and lock button.
The sensor assembly 814 includes one or more sensors for providing status information of various aspects to the device 800. For example, the sensor assembly 814 may detect an on/off state of the device 800, a relative positioning of the assemblies, such as a display and keypad of the device 800, the sensor assembly 814 may also detect a change in position of the device 800 or one of the assemblies of the device 800, the presence or absence of user contact with the device 800, an orientation or acceleration/deceleration of the device 800, and a change in temperature of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an acceleration sensor, a gyroscopic sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 816 is configured to facilitate communication between the apparatus 800 and other devices, either in a wired or wireless manner. The device 800 may access a wireless network based on a communication standard, such as WiFi,2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 816 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, ultra Wideband (UWB) technology, bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the apparatus 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), digital Signal Processors (DSPs), digital Signal Processing Devices (DSPDs), programmable Logic Devices (PLDs), field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic elements for executing the methods described above.
In an exemplary embodiment, a non-transitory computer readable storage medium is also provided, such as memory 804 including instructions executable by processor 820 of apparatus 800 to perform the above-described method. For example, the non-transitory computer readable storage medium may be ROM, random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, optical data storage device, etc.
A non-transitory computer readable storage medium, which when executed by a processor of a terminal device, causes the terminal device to perform the split screen processing method of the terminal device.
Other embodiments of the application will be apparent to those skilled in the art from consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of the application following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the application pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
It is to be understood that the application is not limited to the precise arrangements and instrumentalities shown in the drawings, which have been described above, and that various modifications and changes may be effected without departing from the scope thereof. The scope of the application is limited only by the appended claims.

Claims (10)

1. A method of data migration testing, the method comprising:
responding to a data migration test instruction, and acquiring a data set to be migrated; the data migration test instruction is used for indicating to perform a data migration test; the data set to be migrated comprises at least one piece of data to be migrated, wherein the data to be migrated is service data to be migrated, which is indicated by the data migration test instruction;
Responding to the data migration signal, and acquiring a target data set; the data migration signal characterizes that a data migration process corresponding to the data set to be migrated is completed; the target data set comprises at least one target data, and the target data is migrated business data; the target data and the data to be migrated are in one-to-one correspondence;
calling a preset test model, and determining model parameters of the preset test model according to the data set to be migrated; the model parameters are used for optimizing a data processing process of a preset test model;
determining a test report based on the preset test model according to model parameters of the preset test model, the data set to be migrated and the target data set; the test report characterizes the test condition of the data migration test indicated by the data migration test instruction.
2. The method of claim 1, wherein the data to be migrated has first data information characterizing data characteristics of the data to be migrated; the target data has second data information, the second data information characterizing data characteristics of the target data;
Based on the preset test model, determining a test report according to model parameters of the preset test model, the data set to be migrated and the target data set, wherein the test report comprises the following steps:
classifying the data to be migrated in the data set to be migrated according to the first data information to generate a first data report; classifying the target data of the target data set according to the second data information to generate a second data report; wherein the first data report comprises at least one data to be migrated, and the second data report comprises at least one target data; the first data report forms are in one-to-one correspondence with the second data report forms;
inputting the first data report and the second data report into the preset test model based on model parameters of the preset test model, and outputting comparison information; the comparison information characterizes the data difference condition between the first data report and the second data report;
and generating the test report according to the comparison information.
3. The method according to claim 2, wherein the data characteristics comprise a customer type, and/or a service type; wherein, the client type is the type of the client corresponding to the service data; the service type is the type of the service to which the service data belongs.
4. The method of claim 2, wherein the first data report has first report information, the first report information characterizing data conditions of data to be migrated contained in the first data report; the second data report table is provided with second report information, and the second report information characterizes the data condition of target data contained in the second data report table;
inputting the first data report and the second data report into the preset test model based on model parameters of the preset test model, and outputting comparison information, wherein the method comprises the following steps:
and inputting the first report information of the first data report and the second report information of the second data report into the preset test model based on the model parameters of the preset test model, and outputting the comparison information.
5. The method of claim 4, wherein the first report information comprises first data volume information and first data structure information; the first data quantity information characterizes the data quantity of the data to be migrated contained in the first data report; the first data structure information characterizes a data structure of data to be migrated contained in the first data report;
The second report information comprises second data volume information and second data structure information; the second data quantity information represents the data quantity of target data contained in the second data report; the second data structure information characterizes a data structure of target data contained in the second data report.
6. The method according to any one of claims 1-5, wherein determining model parameters of the preset test model from the set of data to be migrated comprises:
calling a preset mapping relation; the preset mapping relation characterizes one-to-one correspondence between task information and model parameters; the task information characterizes task attributes of data migration tasks corresponding to the data set to be migrated;
and determining model parameters of the preset test model according to the task information of the data set to be migrated and the preset mapping relation.
7. The method of claim 6, wherein the task information includes a task type and a task priority; the task type is a task type of a data migration task corresponding to a data set to be migrated, and the task priority represents the priority of the data migration task corresponding to the data set to be migrated.
8. The method according to any one of claims 1-5, further comprising:
and cleaning the data to be migrated in the data set to be migrated to obtain a processed data set to be migrated.
9. An electronic device, comprising: a processor, and a memory communicatively coupled to the processor;
the memory stores computer-executable instructions;
the processor executes computer-executable instructions stored in the memory to implement the method of any one of claims 1 to 8.
10. A computer readable storage medium having stored therein computer executable instructions which when executed by a processor are adapted to carry out the method of any one of claims 1 to 8.
CN202311081190.XA 2023-08-25 2023-08-25 Data migration testing method and electronic equipment Pending CN117149742A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311081190.XA CN117149742A (en) 2023-08-25 2023-08-25 Data migration testing method and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311081190.XA CN117149742A (en) 2023-08-25 2023-08-25 Data migration testing method and electronic equipment

Publications (1)

Publication Number Publication Date
CN117149742A true CN117149742A (en) 2023-12-01

Family

ID=88911243

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311081190.XA Pending CN117149742A (en) 2023-08-25 2023-08-25 Data migration testing method and electronic equipment

Country Status (1)

Country Link
CN (1) CN117149742A (en)

Similar Documents

Publication Publication Date Title
CN109447125B (en) Processing method and device of classification model, electronic equipment and storage medium
CN104462296B (en) File management method and device and terminal
CN116069612A (en) Abnormality positioning method and device and electronic equipment
CN107977127B (en) Method, device and terminal for updating page
CN112256563A (en) Android application stability testing method and device, electronic equipment and storage medium
CN106446827B (en) Iris recognition function detection method and device
CN112333233B (en) Event information reporting method and device, electronic equipment and storage medium
CN117149742A (en) Data migration testing method and electronic equipment
CN114218005A (en) Equipment fault detection and repair processing method, device and equipment
CN107526683B (en) Method and device for detecting functional redundancy of application program and storage medium
CN108037875B (en) Method, device and storage medium for switching input modes
CN113946228A (en) Statement recommendation method and device, electronic equipment and readable storage medium
CN111814797A (en) Picture character recognition method and device and computer readable storage medium
CN111611156B (en) Function test method, function test device, and computer-readable storage medium
CN115408277B (en) Interface testing method and device
CN115225702B (en) Information pushing method and device, electronic equipment and storage medium
CN117149649A (en) Transaction testing method and device and electronic equipment
CN107784224B (en) Permission adaptation method and device and electronic equipment
CN117093486A (en) Interface testing method, device, equipment and storage medium
CN116645052A (en) Method, device, equipment and storage medium for auditing service information
CN116932397A (en) Screenshot automatic generation method and device based on test processing and electronic equipment
CN117149704A (en) File management method, device, equipment and storage medium based on performance test
CN117112107A (en) Data display method and electronic equipment
CN117035973A (en) Method, device, computer equipment and storage medium for identifying public clients
CN117588134A (en) Vehicle door control method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination