CN112882960A - Data acquisition method and device - Google Patents

Abstract

The invention relates to the technical field of data processing, in particular to a data acquisition method and device. The method includes: acquiring a test case input by a tester and identifying business elements; acquiring business data having a mapping relationship with the business elements from a pre-built business data model according to the business elements; wherein the business data model stores There are business elements, and business data having a mapping relationship with the business elements. In the data acquisition solution provided by this application, users only need to know the business elements of the test case, that is, through the configuration of the business elements of the test case, to obtain the required business test data.

Description

A data acquisition method and device

technical field

The invention relates to the technical field of data processing, in particular to a data acquisition method and device.

Background technique

In existing software testing, test data preparation is a time-consuming process, which often requires manual preparation by professional database personnel or business personnel, and then handed over to test executives for manual testing or automated testing. Especially in the financial industry, in the face of a huge user group, a large number of tests need to be carried out. Due to the requirements of real-time and diversity, a large amount of test data is required to meet the test needs. At present, relevant personnel are generally required to manually prepare test data according to relevant business processes, which is not only inefficient in data production, but also has a high threshold, and the fixed test data cannot support diversified testing.

SUMMARY OF THE INVENTION

The purpose of this application is to solve at least one of the above-mentioned technical defects. The technical scheme adopted in this application is as follows:

In a first aspect, an embodiment of the present application discloses a data acquisition method, the method comprising:

Capture test cases entered by testers and identify business elements;

Obtain business data that has a mapping relationship with the business element from a pre-built business data model according to the business element; wherein the business data model stores business elements and business data that has a mapping relationship with the business element .

Further, the building a business data model includes:

Obtain valid business data;

The effective business data model is constructed based on the tree model according to the business data hierarchy division standard; wherein the business data model includes parent class, subclass, subclass, and derived business data at least in descending order.

Further, the obtaining valid business data includes:

Get the data source of the system database table;

The dirty data in the data source is cleaned, and the data irrelevant to the business element is filtered to obtain the valid business data.

Further, the business data having a mapping relationship with the business element may be: a fixed value, a functional relationship, or an SQL rule for acquiring the business data having a mapping relationship with the business element in a database table.

Further, the acquiring business data having a mapping relationship with the business element includes:

Obtain a business field in the pre-built business data model according to the business element; wherein the business field is a unique identifier of the business data that has a mapping relationship with the business element;

The business data having a mapping relationship with the business element is determined according to the unique identifier.

Further, the method also includes:

Constructing the unique identification number of the target test case business data; wherein, the target test case includes at least two or more business elements; the identification numbers of the business data obtained according to the two business elements are the unique identification numbers;

caching the acquired first business data of the first business element in the business scenario data pool;

Obtain second business data in the pre-built business data model according to the first business data and the second business element.

In a second aspect, an embodiment of the present application provides a data acquisition device, the device includes: an acquisition module, a storage module, and a building module; wherein,

The acquisition module is used to acquire test cases input by testers and identify business elements;

The building module is used to build a business data model; the business data model stores business elements and business data that has a mapping relationship with the business elements.

The storage module is used to store the pre-built business data model;

The obtaining module is further configured to obtain business data having a mapping relationship with the business element from a pre-built business data model according to the business element.

Further, the obtaining module is also used to obtain valid business data; the building module is specifically configured to construct the business data model based on the tree model through the business data hierarchy division standard; wherein the business data model is at least as low as lower. The rank order includes parent class, subclass, subclass, and derived business data.

In a third aspect, an embodiment of the present application provides an electronic device, including a processor and a memory;

the memory for storing operation instructions;

The processor is configured to execute the method described in any of the foregoing embodiments by invoking the operation instruction.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the storage medium, and when the computer program is executed by a processor, the method described in any of the foregoing embodiments is implemented.

The embodiments of the present application provide a data acquisition solution by establishing a business data model and a business scenario data pool to dynamically acquire the data of the associated business data under the same test case, so as to finally achieve the business elements that testers only need to pay attention to, instead of Need to pay attention to the realization of business elements and underlying technical logic. The beneficial effects of the present application include at least one of the following:

(1) Based on the data acquisition scheme provided by this application, the user only needs to know the business elements of the test case, that is, through the configuration of the business elements of the test case, to obtain the required test data;

(2) Based on the data acquisition scheme provided by this application, the data acquisition process is simple and convenient, the real multiplexing of data acquisition and acquisition is realized, and the maintenance cost is low;

(3) The data generated based on the data acquisition scheme provided by the application is accurate and diverse, which can greatly improve the test efficiency and test quality, especially solve the problem that the dynamic acquisition of test data is difficult, the efficiency is low, the test data is not diverse enough and the accuracy is low Difficult pain points.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present application more clearly, the following briefly introduces the accompanying drawings that need to be used in the description of the embodiments of the present application.

1 is a schematic flowchart of a data acquisition method according to an embodiment of the present application;

Fig. 2 is a kind of business data model relation table provided by the embodiment of this application;

3 is a schematic diagram of a data acquisition apparatus provided by an embodiment of the present application;

FIG. 4 is a schematic structural diagram of an electronic device according to an embodiment of the present application.

Detailed ways

The following describes in detail the embodiments of the present application, examples of which are illustrated in the accompanying drawings, wherein the same or similar reference numerals refer to the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the present application, but not to be construed as limiting the present invention.

It will be understood by those skilled in the art that unless expressly stated otherwise, the singular forms "a", "an", "the" and "the" can also include the plural forms, wherein "first", "second", etc. The definition of object distinction is only for the purpose of introducing the scheme clearly, and does not limit the object itself. Of course, the objects defined by "first" and "second" may be the same terminal, device, user, etc., or the same type of terminal, devices and users. It should be further understood that the word "comprising" used in the specification of this application refers to the presence of stated features, integers, steps, operations, elements and/or components, but does not preclude the presence or addition of one or more other features, Integers, steps, operations, elements, components and/or groups thereof. As used herein, the term "and/or" includes all or any element and all combination of one or more of the associated listed items.

In addition, it should be understood that, in the embodiments of the present application, "at least one" refers to one or more, and "a plurality" refers to two or more. "And/or", which describes the association relationship of the associated objects, means that there can be three kinds of relationships, for example, A and/or B, it can mean that A exists alone, A and B exist at the same time, and B exists alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship. "At least one (item) of the following" or its similar expression refers to any combination of these items, including any combination of single item (item) or plural item (item). For example, at least one (a) of a, b or c may represent: a, b, c, a and b, a and c, b and c, or a, b and c, where a, b, c Can be single or multiple.

As stated in the background art, the test data in many test fields, including financial tests, requires testers to obtain test data by using a database or other auxiliary generating operations. This method has complicated steps and high labor costs. In addition, there are some technical solutions that first determine the number-making model corresponding to each test system, and then generate the test data corresponding to each test system based on the key number-setting data fields and number-setting rules in each number-setting model. The test data is fixed, and various test data cannot be generated according to scene changes. In addition, there are some solutions to obtain the corresponding driver function in the database operation function library by parsing and executing the SQL instruction information, and obtain the parameterization basis from the target database. This method is mainly used for automated test scripts, and uses pure technology. Language, difficult to understand operation. There are also some solutions that create generation rules for each test field type in advance, and convert each original data in the database into multiple test data. This method uses pure technical language, and testers need to have a deep understanding of the generation rules to be accurate. Written in corresponding sentences, it is not conducive to promotion and use. To sum up, based on the various limitations of the above test data acquisition solutions, the following embodiments of the present application disclose a data acquisition method and apparatus to solve at least one of the above technical problems.

FIG. 1 shows a schematic flowchart of a data acquisition provided by an embodiment of the present application. As shown in FIG. 1 , the method may mainly include:

S101. Obtain test cases input by testers and identify business elements;

S102: Acquire business data that has a mapping relationship with the business element from a pre-built business data model according to the business element; wherein the business data model stores business elements, and, has a mapping relationship with the business element business data.

In a further optional embodiment, the building a business data model includes:

Step 1. Obtain valid business data;

Step 2: Construct the effective business data model based on the tree model according to the business data hierarchy division standard; wherein the business data model includes at least a parent class, a subclass, a subclass, and derived business data in descending order.

In a preferred embodiment, the building a business data model includes:

Step 1. Obtain the data source of the system database table;

Step 2: Clean the dirty data in the data source and filter the data irrelevant to the business element to obtain the valid business data.

Step 3: Construct the effective business data model based on the tree model according to the business data hierarchy division standard; wherein the business data model includes parent class, subclass, subclass, and derived business data at least in descending order.

In a further optional embodiment, the value of the business element corresponds to the enumeration value of the business data, including a fixed value, a function relationship value or an SQL rule value, that is, the business data that has a mapping relationship with the business element may be:

(1) Fixed value;

(2) functional relationship;

(3) Acquire the SQL rules of the business data having a mapping relationship with the business elements in the database table.

In a further optional embodiment, the acquiring business data having a mapping relationship with the business element includes:

Step 1. Obtain business fields in the pre-built business data model according to the business elements; wherein the business fields are unique identifiers of business data that have a mapping relationship with the business elements;

Step 2: Determine the business data having a mapping relationship with the business element according to the unique identifier.

In the embodiment of the present application, the business elements included in each business transaction (that is, the business elements included in the test case) can correspond to the business data that has a mapping relationship with it, and the business data can be mapped through the library table and the library table field. , such as customer class - private customer class - private customer class with normal account status, the business data contained in it includes customer number cust_info-cust_no, customer name cust_info-cust_name, customer ID type cust_info-cust_IDtype, etc. For business transaction APICODE, Its business elements include customer number, customer name, customer certificate number, account number, etc., wherein the customer number, customer name, and customer certificate number correspond to the business data of each specific business field in the above business data. Therefore, by establishing the mapping relationship between business elements and business data, a bridge from business language to technical language can be established.

On the basis of the above embodiment, in a specific embodiment, the tester provides test cases or constructs business elements by checking/filling in the business value of the business scenario through the interface. The filling of general SQL rules or the addition of fixed values and function relation values in multiple ways converts business language into technical language. The specific implementation method is as follows:

Each business transaction has many transaction scenarios, but the business elements used in these transaction scenarios, that is, the business language, are the same, but the values will be different. Combined with the established business data model (in the specific embodiment, this The model is stored in the form of business elements - business data tables), and it only needs to use the enumeration values of business elements to fill in the SQL in the general value method or supplement the fixed value and function relationship value in multiple ways to complete the business scenario adaptation of the technical language. match. As shown in the example in Figure 2, by changing the enumeration values of the general SQL rules, the data conditions of different scenarios can be met, and the conversion from business language to technical language can be realized.

In a further optional embodiment, when the business data having a mapping relationship with the business element may be an SQL rule for acquiring the business data having a mapping relationship with the business element in a database table, the obtaining according to the business element The implementation of the business data with the mapping relationship also includes:

Step 1, constructing the unique identification number of the target test case business data; wherein, the target test case includes at least two or more business elements; the identification numbers of the business data obtained according to the two business elements are the unique identification numbers;

Step 2, caching the acquired first business data of the first business element in the business scenario data pool;

Step 3: Acquire second business data in the pre-built business data model according to the first business data and the second business element.

In the embodiment of the present application, by establishing a business scenario data pool (that is, a test scenario data pool of a business test case), and performing real-time dynamic interaction of business scenario associated elements with a unique identification number, a set of data that satisfies the scenario is obtained, If the business scenario case includes business elements A, B, C, D..., where the values of A and B are obtained from the joint table SQL, and the SQL relation part of B is determined by the value of A, the invention will give priority to the value of A based on the value of A. SQL obtains the value of A, stores it in the business scenario class data pool, and generates a unique scenario identification number, then passes the value of A into the SQL rule of B to obtain the value of B, and writes it into the scenario under the ID of the business scenario class. And so on to complete the acquisition of a set of scene business data. Based on the embodiments of the present application, the difficulties and pain points of dynamic acquisition of test data are difficult, low in efficiency, and the test data is not sufficiently diverse and low in accuracy.

Based on the data acquisition solution provided by the above embodiments of the present application, in the specific application operation, the user only needs to select and configure the relevant data class in the interface according to the business scenario, and then the corresponding test data can be obtained, without paying attention to the value logic of the data class or business scenario , improve the user experience, lower the use threshold, and greatly improve the test efficiency; in addition, the data acquisition solution provided by the above embodiment can also meet the user's 7*24-hour real-time dynamic acquisition test data needs, and the acquired test data is dynamic Diverse, enriching test scenarios while avoiding possible inadequacies of human testing. At the same time, when the data acquisition scheme disclosed in the above-mentioned embodiments of the present application is used, when a major function or architecture change occurs in the business system, it is only necessary to maintain the data relationship model of the affected data classes and business database tables in a targeted manner, and then real-time After completing the update of the test data, the user does not perceive or need to perceive it at the business level, which greatly improves the usability and robustness of the test data acquisition scheme.

Based on the data acquisition method shown in FIG. 1 , on the other hand, an embodiment of the present application provides a data acquisition apparatus. The apparatus is shown in FIG. 3 . The apparatus may include: 301 an acquisition module, 302 a storage module, and 303 a construction module module; of which,

The 301 acquisition module is used to acquire test cases input by testers and identify business elements;

The 303 building module is used to construct a business data model; the business data model stores business elements and business data that has a mapping relationship with the business elements.

The 302 storage module is used to store the pre-built business data model;

The obtaining module 301 is further configured to obtain business data having a mapping relationship with the business element from a pre-built business data model according to the business element.

In a further embodiment, according to the valid business data acquired by the acquisition module in 301, the construction module in 303 is specifically configured to construct the business data model based on a tree model through business data hierarchical division criteria; wherein the The business data model includes parent class, subclass, subclass, and derived business data at least in descending order.

It can be understood that the above-mentioned components of the data acquisition apparatus in this embodiment have the function of implementing the corresponding steps of the method in the embodiment shown in FIG. 1 . This function can be implemented by hardware or by executing corresponding software by hardware. The hardware or software includes one or more modules or systems corresponding to the above functions. The above-mentioned modules and systems may be software and/or hardware, and the above-mentioned modules and systems may be implemented independently, or multiple modules and systems may be integrated and implemented. For the functional description of the above-mentioned modules and systems, reference may be made to the corresponding description of the method in the embodiment shown in FIG. It will not be repeated here.

It can be understood that, the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the specific structure of the data acquisition apparatus. In other embodiments of the present application, the data acquisition apparatus may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

Embodiments of the present application provide an electronic device, including a processor and a memory;

memory for storing operation instructions;

The processor is configured to execute the data acquisition method provided in any embodiment of the present application by invoking the operation instruction.

As an example, FIG. 4 shows a schematic structural diagram of an electronic device to which the embodiments of the present application are applied. As shown in FIG. 4 , the electronic device 400 includes: a processor 401 and a memory 403 . The processor 401 is connected to the memory 403 , for example, through a bus 402 . Optionally, the electronic device 400 may further include a transceiver 404 . It should be noted that, in practical applications, the transceiver 404 is not limited to one. It can be understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the specific structure of the electronic device 400 . In other embodiments of the present application, the electronic device 400 may include more or less components than shown, or combine some components, or separate some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. Optionally, the electronic device may further include a display screen 405 for displaying an image, or receiving an operation instruction from the user when necessary.

The processor 401 is used in the embodiments of the present application to implement the methods shown in the foregoing method embodiments. The transceiver 404 may include a receiver and a transmitter. The transceiver 404 is applied in the embodiments of the present application, and is configured to implement the function of communicating between the electronic device and other devices in the embodiments of the present application during execution.

The processor 401 may be a CPU (Central Processing Unit, central processing unit), a general-purpose processor, a DSP (Digital Signal Processor, data signal processor), an ASIC (Application Specific Integrated Circuit, an application-specific integrated circuit), an FPGA (Field Programmable Gate Array, Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logical blocks, modules and circuits described in connection with this disclosure. The processor 401 may also be a combination that realizes computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like.

The processor 401 may also include one or more processing units, for example, different processing units may be independent devices, or may be integrated in one or more processors. The controller may be the nerve center and command center of the electronic device 400 . The controller can generate an operation control signal according to the instruction operation code and timing signal, and complete the control of fetching and executing instructions. A memory may also be provided in the processor 401 for storing instructions and data. In some embodiments, the memory in processor 401 is a cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 401 . If the processor 401 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 401 is reduced, thereby improving the efficiency of the system.

The processor 401 may execute the data acquisition method provided by the embodiments of the present application, so as to reduce the operation complexity of the user, improve the intelligence of the terminal device, and improve the user experience. The processor 401 may include different devices. For example, when a CPU and a GPU are integrated, the CPU and the GPU may cooperate to execute the data acquisition method provided by the embodiments of the present application. For example, some algorithms in the data acquisition method are executed by the CPU, and another part of the algorithms are executed by the GPU, for faster processing efficiency.

The bus 402 may include a path to communicate information between the components described above. The bus 402 may be a PCI (Peripheral Component Interconnect, Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture, Extended Industry Standard Architecture) bus or the like. The bus 402 can be divided into an address bus, a data bus, a control bus, and the like. For ease of presentation, only one thick line is used in Figure 4, but it does not mean that there is only one bus or one type of bus.

The memory 403 can be a ROM (Read Only Memory, read only memory) or other types of static storage devices that can store static information and instructions, a magnetic disk storage medium or other magnetic storage devices, or can be used to carry or store instructions or data structures. in the form of desired program code and any other medium that can be accessed by a computer, but is not limited thereto.

Optionally, the memory 403 is used to store the application program code for executing the solution of the present application, and the execution is controlled by the processor 401 . The processor 401 is configured to execute the application program code stored in the memory 403 to implement the data acquisition method provided in any embodiment of the present application.

Memory 403 may be used to store computer-executable program code, which includes instructions. The processor 401 executes various functional applications and data processing of the electronic device 400 by executing the instructions stored in the memory 403 . The memory 403 may include a stored program area and a stored data area. Among them, the stored program area can store the operating system, the code of the application program, and the like. The storage data area may store data created during the use of the electronic device 400 (such as images, videos, etc. captured by a camera application) and the like.

The memory 403 may also store one or more computer programs corresponding to the data acquisition method provided by the embodiments of the present application. The one or more computer programs are stored in the above-mentioned memory 403 and configured to be executed by the one or more processors 401, and the one or more computer programs include instructions that can be used to perform the corresponding embodiments described above. of the various steps.

Certainly, the code of the data acquisition method provided by the embodiment of the present application may also be stored in an external memory. In this case, the processor 401 may execute the code of the data acquisition method stored in the external memory through the external memory interface, and the processor 401 may control the execution of the data acquisition process.

Display screen 405 includes a display panel. In some embodiments, the electronic device 400 may include 1 or N display screens 405, where N is a positive integer greater than 1. The display screen 405 may be used to display information entered by or provided to the user as well as various graphical user interfaces (GUIs). For example, display screen 405 may display photos, videos, web pages, or documents, and the like.

The electronic device provided in the embodiments of the present application is applicable to any of the above-mentioned methods. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding methods provided above, which will not be repeated here.

Embodiments of the present application provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the program is executed by a processor, the data acquisition method shown in the foregoing method embodiments is implemented.

The computer-readable storage medium provided by the embodiment of the present application is applicable to any embodiment of the above method. Therefore, for the beneficial effects that can be achieved, reference may be made to the beneficial effects of the corresponding methods provided above, which will not be repeated here. .

Embodiments of the present application further provide a computer program product, which, when the computer program product runs on a computer, causes the computer to execute the above-mentioned relevant steps, so as to implement the methods in the above-mentioned embodiments. The computer program product provided by the embodiments of the present application is applicable to any embodiment of the above method. Therefore, the beneficial effects that can be achieved may refer to the beneficial effects of the corresponding methods provided above, which will not be repeated here.

The embodiments of the present application provide a data acquisition solution by establishing a business data model and a business scenario data pool to dynamically acquire the data of the associated business data under the same test case, so as to finally achieve the business elements that testers only need to pay attention to, instead of Need to pay attention to the realization of business elements and underlying technical logic. Based on the data acquisition solution provided by the present application, the user can obtain the required test data by configuring the business elements of the test case only by concerned with the business elements of the test case; based on the data acquisition solution provided by the present application, the data acquisition process It is simple and convenient, realizes the real reuse of data acquisition and acquisition, and has low maintenance cost; the data generated based on the data acquisition scheme provided by the application is accurate and diverse, which can greatly improve the test efficiency and test quality, especially solve the problem of dynamic acquisition of test data. Difficulty, low efficiency, difficult and painful points of insufficient diversity of test data and low accuracy.

The above contents are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the technical field disclosed in the present application can easily think of changes or substitutions, and can also Several improvements and modifications are made, and these changes, substitutions, improvements and modifications should also be deemed to be covered by the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (10)

1. a data acquisition method, is characterized in that, described method comprises: Capture test cases entered by testers and identify business elements; Obtain business data that has a mapping relationship with the business element from a pre-built business data model according to the business element; wherein the business data model stores business elements and business data that has a mapping relationship with the business element . 2. The data acquisition method according to claim 1, wherein the building a business data model comprises: Obtain valid business data; The business data model is constructed based on the tree model according to the business data hierarchy division standard; wherein the business data model includes parent class, subclass, subclass, and derived business data at least in descending order. 3. The data acquisition method according to claim 2, wherein the acquiring valid business data comprises: Get the data source of the system database table; The dirty data in the data source is cleaned, and the data irrelevant to the business element is filtered to obtain the valid business data. 4. The data acquisition method according to claim 1 or 3, wherein the business data having a mapping relationship with business elements can be: A fixed value, a functional relationship, or an SQL rule for acquiring business data that has a mapping relationship with the business element in a database table. 5. The data acquisition method according to claim 4, wherein the acquiring business data having a mapping relationship with the business element comprises: Obtain a business field in the pre-built business data model according to the business element; wherein the business field is a unique identifier of the business data that has a mapping relationship with the business element; The business data having a mapping relationship with the business element is determined according to the unique identifier. 6. The data acquisition method according to claim 1 or 5, wherein the method further comprises: Constructing the unique identification number of the target test case business data; wherein, the target test case includes at least two or more business elements; the identification numbers of the business data obtained according to the two business elements are the unique identification numbers; caching the acquired first business data of the first business element in the business scenario data pool; Obtain second business data in the pre-built business data model according to the first business data and the second business element. 7. A data acquisition device, characterized in that the device comprises: an acquisition module, a storage module and a building module; wherein, The acquisition module is used to acquire test cases input by testers and identify business elements; The building module is used to build a business data model; the business data model stores business elements and business data that has a mapping relationship with the business elements. The storage module is used to store the pre-built business data model; The obtaining module is further configured to obtain business data having a mapping relationship with the business element from a pre-built business data model according to the business element. 8. The data acquisition device according to claim 7, wherein the acquisition module is also used to acquire effective business data; the construction module is specifically used to construct a tree model based on a business data hierarchy division standard The business data model; wherein the business data model includes parent class, subclass, subclass, and derived business data at least in descending order. 9. An electronic device, comprising a processor and a memory; the memory for storing operation instructions; The processor is configured to execute the method of any one of claims 1-6 by invoking the operation instruction. 10 . A computer-readable storage medium, wherein a computer program is stored on the storage medium, and when the computer program is executed by a processor, the method according to any one of claims 1-6 is implemented. 11 .

Images