CN114218100A - Business model testing method, device, system, equipment, medium and program product - Google Patents
Business model testing method, device, system, equipment, medium and program product Download PDFInfo
- Publication number
- CN114218100A CN114218100A CN202111531143.1A CN202111531143A CN114218100A CN 114218100 A CN114218100 A CN 114218100A CN 202111531143 A CN202111531143 A CN 202111531143A CN 114218100 A CN114218100 A CN 114218100A
- Authority
- CN
- China
- Prior art keywords
- model
- service
- data
- testing
- business
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/54—Interprogram communication
- G06F9/546—Message passing systems or structures, e.g. queues
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Data Mining & Analysis (AREA)
- Debugging And Monitoring (AREA)
Abstract
The embodiment of the invention relates to the technical field of computers, and discloses a method, a device, a system, equipment, a medium and a program product for testing a service model, wherein the method comprises the following steps: reading service data in a preset real-time service data queue, wherein the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system; and inputting the service data into a first service model to be tested for model testing, and acquiring a corresponding test result. The technical scheme of the embodiment solves the problem that the timeliness of the model obtained by testing is low due to the fact that the service model testing data are delayed in the prior art, and can achieve the purpose that real-time service data of a production environment is accessed as testing data of the service model to be tested while normal operation of service functions of the production environment is not affected, so that the timeliness of the model testing data is improved.
Description
Technical Field
Embodiments of the present invention relate to the field of computer technologies, and in particular, to a method, an apparatus, a system, a device, a medium, and a program product for testing a service model.
Background
Under the information technology system safety management system, in order to ensure the system safety of the production environment, the running stability and the safety and confidentiality of production data, the modeling environment, the development test environment and the production environment of a business model are mutually isolated, and different management requirements are implemented.
However, under the current situation of the business model modeling, testing and production management, the test iteration process of the model takes a lot of time and workload from the modeling to the deployment and validation in the production environment, which may delay the data timeliness of the model, possibly cause the actual data to have a large difference from the modeling data when the model is validated, and cause the model business identification capability to be reduced, and even be unusable under severe situations. Therefore, it is desirable to improve the efficiency of the business model test and the timeliness of the test data.
Disclosure of Invention
The embodiment of the invention provides a method, a device, a system, equipment, a medium and a program product for testing a business model, which aim to access real-time business data of a production environment as test data of the business model to be tested while normal operation of business functions of the production environment is not influenced, so as to improve timeliness of the model test data.
In a first aspect, an embodiment of the present invention provides a method for testing a service model, where the method includes:
reading service data in a preset real-time service data queue, wherein the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system;
and inputting the service data into a first service model to be tested for model testing, and acquiring a corresponding test result.
In a second aspect, an embodiment of the present invention provides a service model testing apparatus, where the apparatus includes:
the system comprises a first data reading module, a second data reading module and a data processing module, wherein the first data reading module is used for reading service data in a preset real-time service data queue, and the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system;
and the first model testing module is used for inputting the service data into the first service model to be tested to perform model testing and acquiring a corresponding testing result.
In a third aspect, an embodiment of the present invention provides a service model operating system, where the system includes:
the system comprises a service model construction subsystem, a service model test subsystem and a service model production operation subsystem;
the business model building subsystem is used for carrying out data processing on preset business data according to a user operation instruction and building a business model to be tested;
the service testing subsystem is respectively connected with the service model building subsystem and the service model production operation subsystem, is used for obtaining the service model to be tested from the service model building subsystem, is used for obtaining real-time service production data from the service model production operation subsystem, and tests the service model to be tested based on the real-time service production data;
and the service model production operation subsystem is used for asynchronously sending the real-time service production data to the service test subsystem.
In a fourth aspect, an embodiment of the present invention further provides a computer device, where the computer device includes:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement a business model testing method as provided by any of the embodiments of the invention.
In a fifth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the service model testing method provided in any embodiment of the present invention.
In a sixth aspect, an embodiment of the present invention further provides a computer program product, where the computer program is stored on the computer program product, and when the computer program is executed by a processor, the computer program implements the service model testing method provided in any embodiment of the present invention.
The embodiment of the invention has the following advantages or beneficial effects:
in the embodiment of the invention, the service data is read from the preset real-time service data queue, and the preset real-time service data queue is used as a transfer station of the service data and is used for receiving and storing the real-time service production data in the service production system; then, the service data is input into the first service model to be tested for model testing, and a corresponding test result is obtained. The technical scheme of the embodiment solves the problem that the timeliness of the model obtained by testing is low due to the fact that the service model testing data are delayed in the prior art, and can achieve the purpose that real-time service data of a production environment is accessed as testing data of the service model to be tested while normal operation of service functions of the production environment is not affected, so that the timeliness of the model testing data is improved.
Drawings
Fig. 1 is a flowchart of a service model testing method according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a service model testing apparatus according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a service model operating system according to a third embodiment of the present invention;
FIG. 4 is a schematic structural diagram of a business model operating system provided in the third embodiment of the present invention;
fig. 5 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Example one
Fig. 1 is a flowchart of a service model testing method according to an embodiment of the present invention, which is applicable to a service model testing situation. The system can be realized by software and/or hardware, and is integrated in a computer device with application development function.
As shown in fig. 1, the service model testing method includes the following modules:
s110, reading the service data in a preset real-time service data queue, wherein the preset real-time service data queue is used for receiving and storing the real-time service production data in the service production system.
The business data may be business data associated with the business model to be tested, such as data of goods sale and purchase business of the e-commerce platform, and various business data of financial service platform fund transfer into and out of related business, each business corresponds to a business model, and corresponding business data is generated.
The preset real-time service data queue can be a data transfer station of a service production system and a service model test system, and the production system can asynchronously transmit real-time service production data to the preset real-time service data queue while finishing a service. Then, the service model test system, as a consumer of the message queue, will read the service production data from the preset real-time service data queue.
The preset real-time service data queue can be a kafka message queue, and the service model testing system can access the production real-time data through the message queue on the premise of ensuring the safe and stable operation of the production environment so as to support the rapid iterative optimization of the service model, thereby not only meeting the management requirements of an information technology system, but also better meeting the rapid response of the requirements of supervision, marketing and the like.
Of course, the data desensitized by the production service data acquired by the service model test system is data, and the data structure is standardized and unified. The data structure definition specification is preset to avoid the problems of data management confusion, data caliber semantic ambiguity and the like because different sources and different types of data need to be continuously accessed in the model test and model iteration process. After new service data are read each time, the data commonalities are standardly identified according to data structures corresponding to characteristics such as service scenes or data types, and the identified data commonalities are summarized into the existing data structures or newly-built data structures. Finally, a data management list is formed, which is beneficial to the long-term maintenance of the data and greatly improves the reusability of the data.
And S120, inputting the service data into the first service model to be tested for model testing, and acquiring a corresponding test result.
The first to-be-tested service model may be an optimization model of a current service model generating the service data in the service production system, and may be a result obtained after adjusting parameters of the current service model or adjusting a model structure, where the optimized model needs to be tested to determine a model optimization effect, and whether the model optimization effect can be applied to the service production system.
And testing the first to-be-tested service model through the service production data acquired in real time, namely performing online service testing. After the test result is obtained, the test result is also subjected to statistical analysis, and the statistical analysis result is uploaded to a preset data system for service personnel to perform data analysis so as to determine the optimization effect of the first model to be tested and obtain the adjustment direction for determining the future service model. The online test mode has larger degree of freedom and very high timeliness, can modify the variable of the model to be tested at any time, import the variable into the service model test system and deploy the model test, and can see the model execution effect at T +1 (the day of acquiring the real-time production service data) according to the currently acquired real-time service production data.
It can be understood that the number of the first to-be-tested models may be one model or a plurality of models, because a plurality of optimization schemes may be proposed for one service model at the same time, and the optimization schemes of the plurality of models may be tested at the same time, for example, the parameter adjustment ranges are different, the adjusted parameter objects are different, the model structure adjustment directions are different, and the like.
In a preferred embodiment, the business model to be tested is tested on-line and simultaneously, batch business tests are carried out. The service model testing system reads historical service data meeting preset conditions from a preset historical service database; and then inputting the historical service data into a second service model to be tested for model testing, and obtaining a corresponding test result. The first business model to be tested and the second business model to be tested are the same business model or different business models. The first and the second are for distinguishing the model under the online test scene from the model under the batch test scene. Each optimized model can be tested under two test scenes simultaneously and respectively. Correspondingly, the test results of the batch test are also subjected to statistical analysis, and the statistical analysis results are uploaded to a preset data system for service personnel to perform data analysis so as to determine the optimization effect of the first model to be tested and obtain the adjustment direction for determining the future service model.
The service model test system provides a batch job configuration function, and when historical service data is read, the preset condition is a condition input by a user for configuring a batch test task, namely test data configuration information. For example, the preset condition is a time interval for selecting historical data, and a batch test is performed by using service data of the past three months. The preset condition may also be a screening condition of a certain data item in the service data, for example, the transfer amount is greater than 10 ten thousand service data in the service data of the last year.
In a preferred embodiment, the service model testing system further provides a management configuration function of the test model, and a service person in charge of the service model testing is used as a user, and can manage a list of models to be tested by using the management configuration function of the test model, determine a target model to be tested, and synchronize the service model passing the test into the production system. Correspondingly, when the service model test system obtains the test model management instruction in response, the list of the models to be tested can be displayed according to the test model management instruction; and determining a target model to be tested in response to the test model selection instruction. And after the test result is obtained, responding to a model issuing instruction, and issuing the service model passing the test to the service production system for operation.
According to the technical scheme of the embodiment, the service data is read from the preset real-time service data queue, and the preset real-time service data queue is used as a transfer station of the service data and used for receiving and storing the real-time service production data in the service production system; then, the service data is input into the first service model to be tested for model testing, and a corresponding test result is obtained. The technical scheme of the embodiment solves the problem that the timeliness of the model obtained by testing is low due to the fact that the service model testing data are delayed in the prior art, and can achieve the purpose that real-time service data of a production environment is accessed as testing data of the service model to be tested while normal operation of service functions of the production environment is not affected, so that the timeliness of the model testing data is improved. In addition, the embodiment also provides a model management function, supports direct import of model files, maintains and modifies the business logic of the model according to the online processing derivative variables of the data management list, and releases the business logic in real time, so that the iterative essential work of the model can be effectively promoted. Moreover, the model understanding cost of technicians and the model carrier conversion cost can be reduced, and flexible and quick response of service requirements can be realized. After the model test operation is verified, the model is allowed to be synchronized to the production environment, and extra environment transplantation and transformation work is not needed. The method supports the retention of historical data, provides the business personnel with the functions of selecting the historical data for testing and verifying the model, can greatly reduce the testing working pressure, and effectively reduces the time required by model idle running observation.
The technical scheme of the embodiment can be applied to the banking credit card wind control business, and in addition, business scenes such as bank public business, retail business, general financial business, various marketing business and even non-bank intelligent decision-making business and the like.
Example two
Fig. 2 is a schematic structural diagram of a service model testing apparatus according to a second embodiment of the present invention, where this embodiment is applicable to a scenario of testing a service model, and the apparatus may be implemented in a software and/or hardware manner and integrated in a computer device having an application development function.
As shown in fig. 2, the service model test apparatus includes: a first data reading module 210 and a first model testing module 220.
The first data reading module 210 is configured to read service data from a preset real-time service data queue, where the preset real-time service data queue is used to receive and store real-time service production data in a service production system; the first model testing module 220 is configured to input the service data into the first service model to be tested for model testing, and obtain a corresponding test result.
According to the technical scheme of the embodiment, the service data is read from the preset real-time service data queue, and the preset real-time service data queue is used as a transfer station of the service data and used for receiving and storing the real-time service production data in the service production system; then, the service data is input into the first service model to be tested for model testing, and a corresponding test result is obtained. The technical scheme of the embodiment solves the problem that the timeliness of the model obtained by testing is low due to the fact that the service model testing data are delayed in the prior art, and can achieve the purpose that real-time service data of a production environment is accessed as testing data of the service model to be tested while normal operation of service functions of the production environment is not affected, so that the timeliness of the model testing data is improved.
Optionally, the service model testing apparatus further includes:
the second data reading module is used for reading historical service data meeting preset conditions from a preset historical service database;
the second model testing module is used for inputting the historical service data into a second service model to be tested for model testing and acquiring a corresponding testing result;
wherein the first business model to be tested and the second business model to be tested are the same business model or different business models.
Optionally, the service model testing apparatus further includes: and the data configuration module is used for acquiring test data configuration information before reading the historical service data meeting the preset conditions from a preset historical service database, and determining the preset conditions according to the configuration information.
Optionally, the service model testing apparatus further includes: the model management module is used for acquiring a test model management instruction before reading the service data and displaying a to-be-tested model list according to the test model management instruction; and determining a target model to be tested in response to the test model selection instruction.
Optionally, the service model testing apparatus further includes: and the test analysis module is used for carrying out statistical analysis on the test result after the test result is obtained and uploading the statistical analysis result to a preset data system.
Optionally, the service model testing apparatus further includes: and the model deployment module is used for responding to a model issuing instruction after the test result is obtained, and issuing the service model passing the test to the service production system for operation.
The service model testing device provided by the embodiment of the invention can execute the service model testing method provided by any embodiment of the invention, and has the corresponding functional module and beneficial effect of the execution method.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a service model operating system according to a third embodiment of the present invention, where this embodiment is applicable to the work of the overall process of service model modeling, service model testing, and service model production application, and the system may be implemented in a software and/or hardware manner and integrated in a computer device with an application development function.
As shown in fig. 3, the service model operating system includes the following structure:
a business model building subsystem 310, a business model testing subsystem 320, and a business model production running subsystem 330.
Further, the service model operating system specifically includes the structural and functional modules shown in fig. 4.
Specifically, the service model building subsystem 310 provides a modeling environment of a service model for a user, and is used for performing data processing on preset service data according to a user operation instruction and building a service model to be tested. The method can store and manage historical business production data, and can support business modeling links such as data analysis, data cleaning, feature engineering, modeling method selection, model training and model verification to obtain modeling results. It will be appreciated that these links use desensitization production data and may limit the scope of the data access that may be required through a series of approval verification processes. The service model building subsystem 310 may set the usage management authority of the user, and users with different authorities may obtain different service data.
The service test subsystem 320 is connected to the service model building subsystem 310 and the service model production operation subsystem 330, respectively. The business model to be tested (i.e., the modeling result of the business model building subsystem 310) may be obtained from the business model building subsystem 310, and used to obtain real-time business production data from the business model production operation subsystem and test the business model to be tested based on the real-time business production data.
Specifically, the business test subsystem 320 provides a development test environment (model commissioning platform) including a model management center, a model deployment engine for online testing, a model deployment engine for batch testing, a core driver module, and a database for storing data. The model management center has the functions of common organization management, authority management, version management, rule configuration, data analysis and the like, shields the underlying technical logic, provides the functions of visualization, standardization and universality, also provides the functions of customization and can realize complex logic. The model management center of the business testing subsystem 320 provides management services to business personnel. The business personnel can further process the input data into a series of derivative data for the model to use according to the data list (the derivative data form a set of shared variable library to support the continuous reuse of the subsequent model iteration work), can directly import and use the modeling result, can compile some rules according to the rule configuration function provided by the model management center, and can customize the data which is desired to be output by matching with the imported model. Specifically, the model management center provides a model management page, and business personnel in charge of business model testing can be used as users, send an operation instruction through the model management page, manage a list of models to be tested, determine a target model to be tested, and synchronize the business model passing the test into the production system. For example, when the model management center obtains a test model management instruction in response, a to-be-tested model list can be displayed according to the test model management instruction; and determining a target model to be tested in response to the test model selection instruction. And after the test result is obtained, responding to a model issuing instruction, and issuing the service model passing the test to the service production system for operation. And the model deployment engine is used for operating the determined target model to be tested, and in the process of operating the target model to be tested, the model deployment engine is connected with the core driving module to acquire service data for testing. The core driving module is mainly responsible for receiving production data, interacts with other modules such as a database and a model deployment engine, and is a core driving force of the model commissioning platform. The service data can be read from a preset real-time service data queue, the real-time production service data in the service model production operation subsystem 330 is obtained and stored in the database, and then when the target model to be tested is tested, the service data read from the preset real-time service data queue is transmitted to the model deployment engine of the online test, so that the online test of the target model to be tested is carried out. The core driving module can also acquire historical service data in a database in batches and call a batch test model deployment engine to perform batch service test on the target model to be tested. That is, the business testing subsystem 320 can support both online testing and batch business testing of the target model to be tested. The online test mode has larger degree of freedom and very high timeliness, and can modify the variables of the model to be tested at any time, import the variables into the service model test system and deploy the model test. The batch business test can obtain a large amount of test data so as to analyze the target business model to be tested. In addition, when the batch service test is carried out, the core driving module also provides a model verification operation management interface, and a user can acquire operation information and maintain the operation information through the interface. For example, a historical business data list is obtained, and list item attributes are obtained. The maintenance operation information refers to the configuration of the historical service data for model test. If the time interval of the historical data is selected, the batch test is carried out by using the service data of the past three months. And the screening condition of a certain data item in the service data can be configured, for example, the service data with the transfer amount more than 10 ten thousand in the service data of the past year is selected.
As for the business model production operation subsystem 330, it is a business production environment formally used by the business provider. In this embodiment, the production environment specifically includes a model management module, a model deployment engine, and a system service processing module. The model management module manages a business model which passes the test and can be formally used for production, and the business model which passes the test can be released to the model deployment engine to run the business model. In the process of running the business model, the model deployment engine asynchronously sends the real-time generated business data to a message queue through the system service processing module, so that the business testing subsystem 320 indirectly obtains the real-time business production data, that is, the model deployment engine asynchronously sends the real-time business production data to the business testing subsystem 320.
In addition, the external service system may also establish a connection with the service model production operation subsystem 330 to call a corresponding service, and obtain service data. The model management centers in the business model production operation subsystem 330 and the business testing subsystem 320 may also respectively send the data related to the formal production business model and the target business model to be tested to the business model construction subsystem 310 for model detail data summarization to generate a model report, which may be used for querying model indexes.
According to the technical scheme of the embodiment, a business model operation system is built through a business model building subsystem, a business model testing subsystem and a business model production operation subsystem, the building of a business model is communicated with a production application process, the work of modeling, examining and approving, system analysis, development, testing work, application deployment and the like can be completed, the modeling personnel and the business personnel are supported to directly access a business model testing subsystem management page to maintain and modify model business logic and issue the model business logic in real time, the model is synchronized to a production environment, and extra environment transplantation and modification work is not needed. And the model file of the modeling environment is directly deployed on the trial-run platform by modeling personnel and business personnel, so that the model understanding cost and the model carrier conversion cost of technical personnel are reduced. The function of selecting a historical data verification model is provided for business personnel, and the time required by model idle running observation is effectively reduced; the model correctness is continuously verified on a test operation platform, and the production data is the best natural test data, so that the test working pressure can be greatly reduced; the iterative optimization work of modeling personnel on the model is effectively supported, the effect of parameter configuration of various models can be tested on a trial-run platform, and the optimal parameters are selected according to the data verification result. The technical scheme of the embodiment solves the problem that the timeliness of the model obtained by testing is low due to the fact that the service model testing data are delayed in the prior art, and can achieve the purpose that real-time service data of a production environment is accessed as testing data of the service model to be tested while normal operation of service functions of the production environment is not affected, so that the timeliness of the model testing data is improved. In addition, the embodiment also provides a model management function, supports direct import of model files, maintains and modifies the business logic of the model according to the online processing derivative variables of the data management list, and releases the business logic in real time, so that the iterative essential work of the model can be effectively promoted. Moreover, the model understanding cost of technicians and the model carrier conversion cost can be reduced, and flexible and quick response of service requirements can be realized. After the model test operation is verified, the model is allowed to be synchronized to the production environment, and extra environment transplantation and transformation work is not needed. The method supports the retention of historical data, provides the business personnel with the functions of selecting the historical data for testing and verifying the model, can greatly reduce the testing working pressure, and effectively reduces the time required by model idle running observation.
Example four
Fig. 5 is a schematic structural diagram of a computer device according to a fourth embodiment of the present invention. FIG. 5 illustrates a block diagram of an exemplary computer device 12 suitable for use in implementing embodiments of the present invention. The computer device 12 shown in FIG. 5 is only an example and should not bring any limitations to the functionality or scope of use of embodiments of the present invention. The computer device 12 may be any terminal device with computing capability, such as a terminal device of an intelligent controller, a server, a mobile phone, and the like.
As shown in FIG. 5, computer device 12 is in the form of a general purpose computing device. The components of computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Computer device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 5, and commonly referred to as a "hard drive"). Although not shown in FIG. 5, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. System memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in system memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
The processing unit 16 executes various functional applications and data processing by executing programs stored in the system memory 28, for example, implementing the service model testing method provided by the embodiment of the present invention, the method includes:
reading service data in a preset real-time service data queue, wherein the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system;
and inputting the service data into a first service model to be tested for model testing, and acquiring a corresponding test result.
EXAMPLE five
This fifth embodiment provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements a service model testing method according to any embodiment of the present invention, and the method includes:
reading service data in a preset real-time service data queue, wherein the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system;
and inputting the service data into a first service model to be tested for model testing, and acquiring a corresponding test result.
Computer storage media for embodiments of the invention may employ any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer-readable storage medium may be, for example but not limited to: an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It will be understood by those skilled in the art that the modules or steps of the invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of computing devices, and optionally they may be implemented by program code executable by a computing device, such that it may be stored in a memory device and executed by a computing device, or it may be separately fabricated into various integrated circuit modules, or it may be fabricated by fabricating a plurality of modules or steps thereof into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (15)
1. A method for testing a business model, the method comprising:
reading service data in a preset real-time service data queue, wherein the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system;
and inputting the service data into a first service model to be tested for model testing, and acquiring a corresponding test result.
2. The method of claim 1, further comprising:
reading historical service data meeting preset conditions from a preset historical service database;
inputting the historical service data into a second service model to be tested for model testing, and acquiring a corresponding test result;
wherein the first business model to be tested and the second business model to be tested are the same business model or different business models.
3. The method according to claim 2, wherein before reading the historical service data meeting the preset condition in the preset historical service database, the method further comprises:
and acquiring test data configuration information, and determining the preset condition according to the configuration information.
4. The method according to claim 1 or 2, characterized in that before reading the traffic data, the method further comprises:
acquiring a test model management instruction, and displaying a to-be-tested model list according to the test model management instruction;
and determining a target model to be tested in response to the test model selection instruction.
5. The method according to claim 1 or 2, wherein after obtaining the test result, the method further comprises:
and carrying out statistical analysis on the test result, and uploading the statistical analysis result to a preset data system.
6. The method according to claim 1 or 2, wherein after obtaining the test result, the method further comprises:
and responding to the model issuing instruction, and issuing the service model passing the test to the service production system for operation.
7. A business model testing apparatus, the apparatus comprising:
the system comprises a first data reading module, a second data reading module and a data processing module, wherein the first data reading module is used for reading service data in a preset real-time service data queue, and the preset real-time service data queue is used for receiving and storing real-time service production data in a service production system;
and the first model testing module is used for inputting the service data into the first service model to be tested to perform model testing and acquiring a corresponding testing result.
8. The apparatus of claim 7, further comprising:
the second data reading module is used for reading historical service data meeting preset conditions from a preset historical service database;
the second model testing module is used for inputting the historical service data into a second service model to be tested for model testing and acquiring a corresponding testing result;
wherein the first business model to be tested and the second business model to be tested are the same business model or different business models.
9. A business model operating system, the system comprising:
the system comprises a service model construction subsystem, a service model test subsystem and a service model production operation subsystem;
the business model building subsystem is used for carrying out data processing on preset business data according to a user operation instruction and building a business model to be tested;
the service testing subsystem is respectively connected with the service model building subsystem and the service model production operation subsystem, is used for obtaining the service model to be tested from the service model building subsystem, is used for obtaining real-time service production data from the service model production operation subsystem, and tests the service model to be tested based on the real-time service production data;
and the service model production operation subsystem is used for asynchronously sending the real-time service production data to the service test subsystem.
10. The system of claim 9, wherein the service testing subsystem is further configured to read historical service data meeting a preset condition from a preset historical service database, and perform a batch service test on the service model to be tested.
11. The system of claim 9, wherein the business testing subsystem is further configured to provide a model management interface to be tested and a model testing configuration interface, and to respond to an operation instruction of a user on the model management interface to be tested or the model testing configuration interface to complete a corresponding model management operation or model testing configuration operation to be tested.
12. The system of claim 9, wherein the business testing subsystem is further configured to synchronously deploy the business models that pass the test into the business model production runtime subsystem.
13. A computer device, characterized in that the computer device comprises:
one or more processors;
a memory for storing one or more programs;
when executed by the one or more processors, cause the one or more processors to implement the business model testing method of any of claims 1-6.
14. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the service model testing method according to any one of claims 1 to 6.
15. A computer program product comprising a computer program which, when executed by a processor, implements a business model testing method as claimed in any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111531143.1A CN114218100A (en) | 2021-12-14 | 2021-12-14 | Business model testing method, device, system, equipment, medium and program product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111531143.1A CN114218100A (en) | 2021-12-14 | 2021-12-14 | Business model testing method, device, system, equipment, medium and program product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114218100A true CN114218100A (en) | 2022-03-22 |
Family
ID=80702107
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111531143.1A Pending CN114218100A (en) | 2021-12-14 | 2021-12-14 | Business model testing method, device, system, equipment, medium and program product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114218100A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117149664A (en) * | 2023-10-31 | 2023-12-01 | 深圳大数信科技术有限公司 | Automatic test method based on BPMN and system platform thereof |
-
2021
- 2021-12-14 CN CN202111531143.1A patent/CN114218100A/en active Pending
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117149664A (en) * | 2023-10-31 | 2023-12-01 | 深圳大数信科技术有限公司 | Automatic test method based on BPMN and system platform thereof |
| CN117149664B (en) * | 2023-10-31 | 2024-03-15 | 深圳大数信科技术有限公司 | Automatic test method based on BPMN and system platform thereof |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107370786B (en) | General information management system based on micro-service architecture | |
| CN101908015A (en) | Device and method for creating test case based on components | |
| CN110780856B (en) | Electricity data release platform based on micro-service | |
| CN110363653A (en) | Financial service request response method, device and electronic equipment | |
| US20230043882A1 (en) | Method for assisting launch of machine learning model | |
| CN116503173A (en) | Rule engine and modeling method, modeling device and instruction processing method thereof | |
| CN201435074Y (en) | Device for generating test case based on member | |
| CN110728445B (en) | Information management method, information management apparatus, electronic device, and medium | |
| CN112506771A (en) | Message comparison method and device | |
| US12079112B2 (en) | Intelligent dynamic web service testing apparatus in a continuous integration and delivery environment | |
| CN114218100A (en) | Business model testing method, device, system, equipment, medium and program product | |
| CN109711849B (en) | Ether house address portrait generation method and device, electronic equipment and storage medium | |
| CA3060692A1 (en) | Behaviour recognition method and apparatus, electronic device and storage medium | |
| US12093169B2 (en) | Intelligent dynamic web service testing apparatus in a continuous integration and delivery environment | |
| CN115422202A (en) | Service model generation method, service data query method, device and equipment | |
| CN115168848A (en) | Interception feedback processing method based on big data analysis interception | |
| CN116467156A (en) | Joint debugging test method and device, storage medium and electronic equipment | |
| CN113342667A (en) | Data processing method, data processing device, electronic equipment and computer readable storage medium | |
| CN114064498A (en) | Script development control method and device, computer equipment and storage medium | |
| CN114978944A (en) | Pressure testing method, device and computer program product | |
| CN109766228A (en) | Verification method and device on a kind of line based on interface | |
| CN113392002A (en) | Test system construction method, device, equipment and storage medium | |
| CN111405060A (en) | Service influence range determining method, device, tool and electronic equipment | |
| Zhang et al. | Financial System Design for High‐Tech Enterprise Based on Cloud Service and Task Scheduling Algorithm | |
| CN113886780B (en) | Client information verification method, device, medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |