CN112418930B - Test method, system and computer equipment - Google Patents
Test method, system and computer equipment Download PDFInfo
- Publication number
- CN112418930B CN112418930B CN202011319928.8A CN202011319928A CN112418930B CN 112418930 B CN112418930 B CN 112418930B CN 202011319928 A CN202011319928 A CN 202011319928A CN 112418930 B CN112418930 B CN 112418930B
- Authority
- CN
- China
- Prior art keywords
- result information
- model
- output
- information
- verification
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010998 test method Methods 0.000 title claims abstract description 24
- 238000012795 verification Methods 0.000 claims abstract description 45
- 238000012360 testing method Methods 0.000 claims abstract description 28
- 238000010586 diagram Methods 0.000 claims abstract description 13
- 238000000034 method Methods 0.000 claims description 19
- 238000004590 computer program Methods 0.000 claims description 9
- 238000004422 calculation algorithm Methods 0.000 abstract description 35
- 230000000694 effects Effects 0.000 abstract description 19
- 230000000875 corresponding effect Effects 0.000 abstract 1
- 238000004891 communication Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 230000003578 releasing effect Effects 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 238000011161 development Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 5
- 230000002452 interceptive effect Effects 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000012821 model calculation Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000003860 storage Methods 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 239000008186 active pharmaceutical agent Substances 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000009960 carding Methods 0.000 description 1
- 210000001520 comb Anatomy 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000009795 derivation Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000000802 evaporation-induced self-assembly Methods 0.000 description 1
- 239000003292 glue Substances 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0242—Determining effectiveness of advertisements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0241—Advertisements
- G06Q30/0251—Targeted advertisements
- G06Q30/0269—Targeted advertisements based on user profile or attribute
- G06Q30/0271—Personalized advertisement
Abstract
The application discloses a testing method, a testing system and computer equipment. A test method comprising: basic information reading: reading the appointed basic information; and a result information acquisition step: invoking a release model according to the basic information to obtain result information; and a result information verification step: verifying whether the result information output by the delivery model accords with a conventional specification; curve report acquisition: and acquiring various indexes of the input parameter sequence according to the parameters output by the input model, and generating a linear relation diagram of the input parameter sequence and the output indexes. According to the invention, the effect verification of the delivery model can be carried out through simple data configuration, and a corresponding effect curve report is generated, so that the problem that the result of the delivery model algorithm is difficult to verify is solved, the technical pressure of testers is reduced, the workload of the testers is reduced, and the non-technicians without relevant code experience are helped to understand the effect condition of the tested delivery model algorithm.
Description
Technical Field
The present disclosure relates to the field of model testing, and in particular, to a method, a system, and a computer device for testing an effect based on a model algorithm.
Background
Along with the development of accurate marketing technology, each enterprise has promoted the requirement to advertisement delivery effect. Compared with the mode of manually releasing experience to configure the releasing plan in the past, the intelligent releasing model for carrying out machine learning output based on the history releasing effect data is closer to the releasing target of the enterprise, so that the enterprise can be helped to obtain a more reasonable and scientific releasing budget plan and a better releasing effect. Based on the background, the introduction of the intelligent delivery model increases the verification difficulty of model verification for testers. The machine learning has certain randomness and uncertainty, and whether the result produced by the throwing model meets the actual requirement is difficult to confirm. Meanwhile, higher requirements are put forward on the technical level of testers, and the testers need to master the methodology of the model to be tested and the big data research and development technology of the historical effect data processing at the same time.
Therefore, for the scene, a python code is used for realizing a verification method for the effect of the delivery model algorithm, the input item of the invention is the model code of the delivery model and the basic data of each dimension, and the output item is the delivery plan configuration result and the effect verification curve report. The invention provides verification directions with different dimensions, and can adjust input data based on test requirements to obtain a required effect curve. The learning cost of the testers is reduced, and the produced report can help the non-technical students to better understand the component effect condition of the current algorithm.
Disclosure of Invention
The embodiment of the application provides a test method, a test system and a test computer device based on a put model algorithm effect, so as to at least solve the problem of subjective factor influence in the related technology.
The invention provides a test method, wherein the test method comprises the following steps:
basic information reading: reading the appointed basic information;
and a result information acquisition step: invoking a release model according to the basic information to obtain result information;
and a result information verification step: verifying whether the result information output by the delivery model accords with a conventional specification;
curve report acquisition: and acquiring various indexes of the input parameter sequence according to the parameters output by the input model, and generating a linear relation diagram of the input parameter sequence and the output indexes.
The testing method is characterized in that the basic information comprises a basic data file, model entry information, dimensions to be adjusted and a dimension parameter sequence.
The testing method is characterized in that the step of obtaining the result information comprises the steps of modifying the dimension to be adjusted in sequence according to the dimension parameter sequence, and calling the delivery model to obtain the result information.
The test method is characterized in that the step of verifying the result information specifically comprises verifying whether the result information output by the delivery model meets the conventional specification, and respectively adding a verification passing list and a verification failure list, wherein the verification failure list needs to contain failure information.
The testing method is characterized in that the curve report obtaining step specifically comprises the steps of combing the data of the verification passing list, obtaining various indexes of the verification passing list according to the parameters output by the delivery model, inputting the indexes into an excel file, and generating a linear relation curve graph of an input parameter sequence and output indexes.
The invention also provides a test system, which is characterized by being suitable for the test method, comprising a basic information reading unit, a result information acquisition unit, a result information verification unit and a curve report acquisition unit, wherein:
basic information reading unit: reading the appointed basic information;
a result information acquisition unit: invoking a release model according to the basic information to obtain result information;
and a result information verification unit: verifying whether the result information output by the delivery model accords with a conventional specification;
curve report acquisition unit: and acquiring various indexes of the input parameter sequence according to the parameters output by the input model, and generating a linear relation diagram of the input parameter sequence and the output indexes.
The test system is characterized by comprising a basic data file, model entry information, a dimension to be adjusted and a dimension parameter sequence.
The test system is characterized in that dimensions to be adjusted are sequentially modified according to the dimension parameter sequence, and the delivery model is called to obtain result information.
The test system is characterized in that whether the result information output by the delivery model accords with the conventional specification is verified, and a verification passing list and a verification failure list are respectively added, wherein the verification failure list needs to contain failure information.
The test system is characterized in that the data of the verification passing list are combed, various indexes of the verification passing list are obtained according to the parameters output by the delivery model, the indexes are input into an excel file, and a linear relation graph of an input parameter sequence and output indexes is generated.
The invention also provides a computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, characterized in that the processor implements the test method of any of the above when executing the computer program.
Compared with the related art, the test method, the test system and the computer equipment based on the effect of the delivery model algorithm are provided, and the tester does not need to manually verify the data of the delivery model calculation logic any more. A tester who cannot write codes can test the model throwing algorithm through the method, and the effect condition of the tested model can be clearly observed from the result report.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the other features, objects, and advantages of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute an undue limitation to the application. In the drawings:
FIG. 1 is a block diagram of a test method according to an embodiment of the present application;
FIG. 2 is a flow chart of a test method according to an embodiment of the present application;
FIG. 3 is a schematic diagram of the test system of the present invention;
FIG. 4 is a frame diagram of a computer device according to an embodiment of the present application;
FIG. 5 is a graph of linear relationship;
fig. 6 is an application flow chart.
Wherein, the reference numerals are as follows: according to the test method and the system framework diagram of the embodiment of the application;
basic information reading unit: 11;
a result information acquisition unit: 12;
and a result information verification unit: 13;
curve report acquisition unit: 14;
81: a processor;
82: a memory;
83: a communication interface;
80: a bus.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described and illustrated below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden on the person of ordinary skill in the art based on the embodiments provided herein, are intended to be within the scope of the present application.
It is apparent that the drawings in the following description are only some examples or embodiments of the present application, and it is possible for those of ordinary skill in the art to apply the present application to other similar situations according to these drawings without inventive effort. Moreover, it should be appreciated that while such a development effort might be complex and lengthy, it would nevertheless be a routine undertaking of design, fabrication, or manufacture for those of ordinary skill having the benefit of this disclosure, and thus should not be construed as having the benefit of this disclosure.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by those of ordinary skill in the art that the embodiments described herein can be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms used herein should be given the ordinary meaning as understood by one of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar terms herein do not denote a limitation of quantity, but rather denote the singular or plural. The terms "comprising," "including," "having," and any variations thereof, are intended to cover a non-exclusive inclusion; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to only those steps or elements but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. The terms "connected," "coupled," and the like in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as used herein refers to two or more. "and/or" describes an association relationship of an association object, meaning that there may be three relationships, e.g., "a and/or B" may mean: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship. The terms "first," "second," "third," and the like, as used herein, are merely distinguishing between similar objects and not representing a particular ordering of objects.
The invention is based on the effect of the put model algorithm and is briefly described below.
The intelligent model is also called a 'knowledge-based software development model', which combines a waterfall model with an expert system to assist the work of software developers. The model applies a rule-based system, and adopts a generalization and reasoning mechanism to enable maintenance to be performed at the system specification level. The knowledge system formed by the generation rules based on the software engineering knowledge in the implementation process of the model is combined with the expert system containing the knowledge rules of the application field to form the development system of the software of the application field. The smart model has a set of tools (e.g., data querying, report generation, data processing, screen definition, code generation, high-level graphics functions, spreadsheets, etc.), each of which enables developers to define certain features of the software at a high level and automatically generate the software defined by the developers into source code. This approach requires support in fourth generation languages. The 4GL is different from the third generation language and is mainly characterized in that a user interface is extremely friendly, and even if a trained non-professional programmer does not exist, the user interface can be used for programming; it is a declarative, interactive, and non-procedural programming language. The 4GL also has efficient program code, intelligent default assumptions, complete databases and application generators. The 4GL currently popular in the market all have the above characteristics to varying degrees. But 4GL is currently mainly limited to the development of middle and small applications for transactional information systems.
An Algorithm (Algorithm) refers to an accurate and complete description of a solution to a problem, is a series of clear instructions for solving the problem, and represents a strategy mechanism for describing the solution to the problem by using a systematic method. That is, the required output can be obtained in a limited time for a certain specification of input. If an algorithm is defective or not suitable for a problem, execution of the algorithm will not solve the problem. Different algorithms may use different time, space, or efficiency to accomplish the same task. The quality of an algorithm can be measured in terms of spatial complexity and temporal complexity. An algorithm should have the following seven important features: the finite nature of an algorithm means that the algorithm must be able to terminate after a limited number of steps are performed; exactly, each step of the algorithm must be defined exactly; an input item, an algorithm has 0 or more inputs to describe the initial condition of an operation object, wherein 0 inputs means that the algorithm itself determines initial conditions; output terms, an algorithm has one or more outputs to reflect the results of processing the input data. Algorithms without output are meaningless; feasibility, any computational step performed in an algorithm can be broken down into basic executable operational steps, i.e., each computational step can be completed in a finite time (also called validity); high efficiency, high execution speed and less occupied resources; robustness, correct response to data. In computer science, the temporal complexity of an algorithm is a function that quantitatively describes the runtime of the algorithm. Rather, it describes an asymptotic upper bound on the order of a function with another (usually simpler) function. In mathematics, it is generally used to characterize the remaining terms of truncated infinite series, especially asymptotic series; in computer science, it is very useful in analyzing the complexity of algorithms. ) Expressed, using this approach, the time complexity can be said to be asymptotic, which looks at the situation when the input value size approaches infinity.
Python is a cross-platform computer programming language. Is a high-level scripting language that combines interpretive, compiled, interactive, and object-oriented. Originally designed for writing automation scripts, the more used for independent, large-scale project development as versions are updated and new language functions are added. Python stands in design for a clear and striking style, which makes Python a popular, versatile language that is easy to read, easy to maintain, and popular with a large number of users. Python is a completely object-oriented language. Functions, modules, numbers, strings are all objects. And the method fully supports inheritance, reload, derivation and multiple inheritance, and is beneficial to enhancing the reusability of the source code. Python supports heavy duty operators and dynamic types. Python provides only limited support for functional design relative to conventional functional programming languages. Although Python may be roughly classified as a "scripting language," in practice some large-scale software development programs are widely used, and Python supporters prefer to refer to it as a high-level dynamic programming language because "scripting language" generally refers to a programming language that only works for simple programming tasks, such as shellscript, VBScript, but can only handle simple tasks, and cannot be compared to Python. Python itself is designed to be extensible and not all features and functions are integrated into the language core. Python provides rich APIs and tools so that programmers can easily write extension modules using C language, c++, cython, and their compilers themselves can be integrated into other programs requiring scripting languages. Therefore, many people also use Python as a "glue language" and use Python to integrate and package programs written in other languages. When the Python is executed, the source code in the py file is first compiled into Python's bytecodes, and then the Python virtual machine executes the compiled bytecodes. However, python Virtual Machine differs from Java or NET's Virtual Machine in that Python's Virtual Machine is a higher-level Virtual Machine. The higher level here is not a higher level in the general sense, not that the Virtual Machine of Python is more powerful than Java or NET, but rather that the Virtual Machine of Python is farther from the real Machine than Java or NET. Alternatively, it can be said that the Virtual Machine of Python is a higher level of abstraction. The byte code files compiled by C-based Python are typically in the. Pyc format. In addition, the Python can also operate in an interactive mode, for example, the mainstream operating system Unix/Linux, mac, windows can directly operate the Python interactive environment in a command mode. And the interactive operation can be realized by directly issuing an operation instruction.
According to the test method, the test system and the computer equipment based on the effect of the delivery model algorithm, a tester does not need to manually verify data aiming at the delivery model calculation logic any more, the accuracy and the effectiveness of the delivery model algorithm can be automatically verified, the workload of the tester is reduced, the time is saved, and the working efficiency is improved. A tester who cannot write codes can test the model throwing algorithm through the method, and the effect condition of the tested model can be clearly observed from the result report.
The following will describe embodiments of the present application by taking the effect of the model-based algorithm as an example.
Example 1
The embodiment provides a test method based on the effect of a put model algorithm. Referring to fig. 1-2 and 6, fig. 1 is a diagram illustrating a testing method and a system according to an embodiment of the present application; FIG. 2 is a flow chart of a test method according to an embodiment of the present application; FIG. 6 is an application flow chart; as shown in fig. 1-2 and 6, a test method includes the following steps:
basic information reading step S1: reading the appointed basic information;
result information acquisition step S2: invoking a release model according to the basic information to obtain result information;
and a result information verification step S3: verifying whether the result information output by the delivery model accords with a conventional specification;
curve report acquisition step S4: and acquiring various indexes of the input parameter sequence according to the parameters output by the input model, and generating a linear relation diagram of the input parameter sequence and the output indexes.
In an embodiment, the basic information S1 includes a basic data file, model entry information, a dimension to be adjusted, and a dimension parameter sequence.
In an embodiment, the step S2 of obtaining result information specifically includes modifying dimensions to be adjusted in sequence according to the dimension parameter sequence, and calling the delivery model to obtain result information.
Specifically, the parameter sequence loops follow the fixed basic parameters, adjusting and specifying the single-dimension data principle. The method is used for finding potential problems and abnormal data points in the put model by observing the relation between the adjusted single-dimensional data change and the model calculation result change. The user can specify a single-dimension column to be adjusted in the test process and is used for verifying the model calculation result of the specific dimension. When the specific dimension is not specified, the method can read all the adjustable dimension data, adjust the input parameters according to the default parameter sequence value or dictionary value list and acquire the result data.
In an embodiment, the step S3 of verifying the result information specifically includes verifying whether the result information output by the delivery model meets a conventional specification, and adding a verification passing list and a verification failure list respectively, where the verification failure list needs to include failure information.
In an embodiment, the curve report obtaining step S4 specifically includes carding the data of the verification passing list, obtaining each index according to the parameters output by the delivery model, inputting the index into an excel file, and generating a linear relation graph of an input parameter sequence and an output index, where the linear relation graph is shown in fig. 5.
Therefore, according to the test method, the test system and the computer equipment based on the effect of the delivery model algorithm, a tester does not need to manually verify data aiming at the calculation logic of the delivery model any more, the accuracy and the effectiveness of the delivery model algorithm can be automatically verified, the workload of the tester is reduced, the time is saved, and the working efficiency is improved. A tester who cannot write codes can test the model throwing algorithm through the method, and the effect condition of the tested model can be clearly observed from the result report.
Example two
Referring to fig. 3, fig. 3 is a schematic structural diagram of a test system according to the present invention. As shown in fig. 3, the test system of the invention is applicable to the above test method, and includes a basic information reading unit 11, a result information obtaining unit 12, a result information verifying unit 13, and a curve report obtaining unit 14, wherein:
basic information reading unit 11: reading the appointed basic information;
the result information acquisition unit 12: invoking a release model according to the basic information to obtain result information;
the result information verification unit 13: verifying whether the result information output by the delivery model accords with a conventional specification;
curve report acquisition unit 14: and acquiring various indexes of the input parameter sequence according to the parameters output by the input model, and generating a linear relation diagram of the input parameter sequence and the output indexes.
In this embodiment, the basic information reading unit 11 includes a basic data file, model entry information, a dimension to be adjusted, and a dimension parameter sequence.
In this embodiment, the result information obtaining unit 12 modifies the dimension to be adjusted in sequence according to the dimension parameter sequence, and invokes the delivery model to obtain result information.
In this embodiment, the result information verification unit 13 verifies whether the result information output by the delivery model meets the conventional specification, and adds a verification passing list and a verification failure list respectively, where the verification failure list needs to include failure information.
Further, the curve report acquiring unit 14 combs the data of the verification passing list, acquires each index according to the parameters output by the delivery model, inputs the indexes into an excel file, and generates a linear relation graph of an input parameter sequence and output indexes.
Example III
Referring to FIG. 4, this embodiment discloses a specific implementation of a computer device. The computer device may include a processor 81 and a memory 82 storing computer program instructions.
In particular, the processor 81 may include a Central Processing Unit (CPU), or an application specific integrated circuit (Application Specific Integrated Circuit, abbreviated as ASIC), or may be configured to implement one or more integrated circuits of embodiments of the present application.
Memory 82 may include, among other things, mass storage for data or instructions. By way of example, and not limitation, memory 82 may comprise a Hard Disk Drive (HDD), floppy Disk Drive, solid state Drive (Solid State Drive, SSD), flash memory, optical Disk, magneto-optical Disk, tape, or universal serial bus (Universal Serial Bus, USB) Drive, or a combination of two or more of the foregoing. The memory 82 may include removable or non-removable (or fixed) media, where appropriate. The memory 82 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 82 is a Non-Volatile (Non-Volatile) memory. In a particular embodiment, the Memory 82 includes Read-Only Memory (ROM) and random access Memory (Random Access Memory, RAM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (Programmable Read-Only Memory, abbreviated PROM), an erasable PROM (Erasable Programmable Read-Only Memory, abbreviated EPROM), an electrically erasable PROM (Electrically Erasable Programmable Read-Only Memory, abbreviated EEPROM), an electrically rewritable ROM (Electrically Alterable Read-Only Memory, abbreviated EAROM), or a FLASH Memory (FLASH), or a combination of two or more of these. The RAM may be Static Random-Access Memory (SRAM) or dynamic Random-Access Memory (Dynamic Random Access Memory DRAM), where the DRAM may be a fast page mode dynamic Random-Access Memory (Fast Page Mode Dynamic Random Access Memory FPMDRAM), extended data output dynamic Random-Access Memory (Extended Date Out Dynamic Random Access Memory EDODRAM), synchronous dynamic Random-Access Memory (Synchronous Dynamic Random-Access Memory SDRAM), or the like, as appropriate.
Memory 82 may be used to store or cache various data files that need to be processed and/or communicated, as well as possible computer program instructions for execution by processor 81.
The processor 81 implements any of the file system capacity management optimization methods of the above embodiments by reading and executing computer program instructions stored in the memory 82.
In some of these embodiments, the computer device may also include a communication interface 83 and a bus 80. As shown in fig. 4, the processor 81, the memory 82, and the communication interface 83 are connected to each other through the bus 80 and perform communication with each other.
The communication interface 83 is used to implement communications between various modules, devices, units, and/or units in embodiments of the present application. The communication interface 83 may also enable communication with other components such as: and the external equipment, the image/data acquisition equipment, the database, the external storage, the image/data processing workstation and the like are used for data communication.
Bus 80 includes hardware, software, or both, coupling components of the computer device to each other. Bus 80 includes, but is not limited to, at least one of: data Bus (Data Bus), address Bus (Address Bus), control Bus (Control Bus), expansion Bus (Expansion Bus), local Bus (Local Bus). By way of example, and not limitation, bus 80 may include a graphics acceleration interface (Accelerated Graphics Port), abbreviated AGP, or other graphics Bus, an enhanced industry standard architecture (Extended Industry Standard Architecture, abbreviated EISA) Bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an industry standard architecture (Industry Standard Architecture, ISA) Bus, a wireless bandwidth (InfiniBand) interconnect, a Low Pin Count (LPC) Bus, a memory Bus, a micro channel architecture (Micro Channel Architecture, abbreviated MCa) Bus, a peripheral component interconnect (Peripheral Component Interconnect, abbreviated PCI) Bus, a PCI-Express (PCI-X) Bus, a serial advanced technology attachment (Serial Advanced Technology Attachment, abbreviated SATA) Bus, a video electronics standards association local (Video Electronics Standards Association Local Bus, abbreviated VLB) Bus, or other suitable Bus, or a combination of two or more of the foregoing. Bus 80 may include one or more buses, where appropriate. Although embodiments of the present application describe and illustrate a particular bus, the present application contemplates any suitable bus or interconnect.
The computer device may be connected to a test system to implement the method described in connection with fig. 1, 2.
In addition, in connection with the test method in the above embodiment, the embodiment of the application may be implemented by providing a computer readable storage medium. The computer readable storage medium has stored thereon computer program instructions; the computer program instructions, when executed by a processor, implement any of the test methods of the above embodiments.
The technical features of the above-described embodiments may be arbitrarily combined, and all possible combinations of the technical features in the above-described embodiments are not described for brevity of description, however, as long as there is no contradiction between the combinations of the technical features, they should be considered as the scope of the description.
The above examples merely represent a few embodiments of the present application, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that it would be apparent to those skilled in the art that various modifications and improvements could be made without departing from the spirit of the present application, which would be within the scope of the present application. Accordingly, the scope of protection of the present application is to be determined by the claims appended hereto.
Claims (3)
1. A method of testing, the method comprising:
basic information reading: reading the appointed basic information;
and a result information acquisition step: invoking a release model according to the basic information to obtain result information;
and a result information verification step: verifying whether the result information output by the delivery model accords with a conventional specification;
curve report acquisition: acquiring various indexes of the input model according to the parameters output by the input model, and generating a linear relation diagram of an input parameter sequence and output indexes;
the basic information comprises a basic data file, model entry information, a dimension to be adjusted and a dimension parameter sequence;
the step of obtaining the result information specifically comprises the steps of sequentially modifying dimensions to be adjusted according to the dimension parameter sequence, and calling the delivery model to obtain the result information;
the step of verifying the result information specifically comprises verifying whether the result information output by the delivery model accords with a conventional specification or not, and respectively adding a verification passing list and a verification failure list, wherein the verification failure list needs to contain failure information;
the curve report obtaining step specifically includes combing the data of the verification passing list, obtaining various indexes of the verification passing list according to the parameters output by the delivery model, inputting the indexes into an excel file, and generating a linear relation graph of an input parameter sequence and output indexes.
2. A test system, characterized in that it is adapted to the test method of claim 1, and comprises a basic information reading unit, a result information obtaining unit, a result information verifying unit, and a curve report obtaining unit, wherein:
basic information reading unit: reading the appointed basic information;
a result information acquisition unit: invoking a release model according to the basic information to obtain result information;
and a result information verification unit: verifying whether the result information output by the delivery model accords with a conventional specification;
curve report acquisition unit: acquiring various indexes of the input model according to the parameters output by the input model, and generating a linear relation diagram of an input parameter sequence and output indexes;
the basic information comprises a basic data file, model entry information, a dimension to be adjusted and a dimension parameter sequence;
the result information acquisition unit sequentially modifies the dimension to be adjusted according to the dimension parameter sequence, and invokes the delivery model to acquire result information;
the result information verification unit verifies whether the result information output by the delivery model accords with the conventional specification, and respectively adds a verification passing list and a verification failure list, wherein the verification failure list needs to contain failure information;
the curve report acquisition unit is used for combing the data of the verification passing list, acquiring various indexes of the verification passing list according to the parameters output by the delivery model, inputting the indexes into an excel file and generating a linear relation graph of an input parameter sequence and output indexes.
3. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the test method of claim 1 when executing the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011319928.8A CN112418930B (en) | 2020-11-23 | 2020-11-23 | Test method, system and computer equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011319928.8A CN112418930B (en) | 2020-11-23 | 2020-11-23 | Test method, system and computer equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112418930A CN112418930A (en) | 2021-02-26 |
| CN112418930B true CN112418930B (en) | 2024-02-27 |
Family
ID=74778677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011319928.8A Active CN112418930B (en) | 2020-11-23 | 2020-11-23 | Test method, system and computer equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112418930B (en) |
Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593791A (en) * | 2013-11-07 | 2014-02-19 | 广州优蜜信息科技有限公司 | Mobile advertisement putting method and system |
| CN106227666A (en) * | 2016-07-25 | 2016-12-14 | 微梦创科网络科技（中国）有限公司 | A kind of automated testing method based on big data and system |
| CN107871244A (en) * | 2016-09-28 | 2018-04-03 | 腾讯科技（深圳）有限公司 | The detection method and device of a kind of advertising results |
| CN108985851A (en) * | 2018-07-24 | 2018-12-11 | 广州市丰申网络科技有限公司 | Advertisement analysis and monitoring method and device based on big data intensified learning |
| CN110009429A (en) * | 2019-04-10 | 2019-07-12 | 金瓜子科技发展（北京）有限公司 | A kind of method, apparatus and computer equipment of predicted flow rate data |
| CN110399298A (en) * | 2019-07-12 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of test method and device |
| CN110517080A (en) * | 2019-08-26 | 2019-11-29 | 北京百度网讯科技有限公司 | Outdoor advertising put-on method, device, equipment and computer readable storage medium |
| CN110706029A (en) * | 2019-09-26 | 2020-01-17 | 恩亿科(北京)数据科技有限公司 | Advertisement targeted delivery method and device, electronic equipment and storage medium |
| CN110750458A (en) * | 2019-10-22 | 2020-02-04 | 恩亿科(北京)数据科技有限公司 | Big data platform testing method and device, readable storage medium and electronic equipment |
| CN110781605A (en) * | 2019-11-05 | 2020-02-11 | 恩亿科(北京)数据科技有限公司 | Advertisement putting model testing method and device, computer equipment and storage medium |
| CN111062521A (en) * | 2019-11-29 | 2020-04-24 | 微民保险代理有限公司 | Online prediction method, system and server |
| CN111209201A (en) * | 2020-01-03 | 2020-05-29 | 恩亿科(北京)数据科技有限公司 | Advertisement putting test method and device |
| CN113298119A (en) * | 2021-04-28 | 2021-08-24 | 上海淇玥信息技术有限公司 | Method and device for evaluating putting strategy of machine learning model and electronic equipment |
| CN113643061A (en) * | 2021-08-12 | 2021-11-12 | 广州迈量科技有限公司 | Intelligent delivery system based on big data machine learning |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1244036A4 (en) * | 1999-12-27 | 2003-03-19 | Dentsu Inc | Total advertisement managing system using advertisement portfolio model |
| US7536599B2 (en) * | 2004-07-28 | 2009-05-19 | Oracle International Corporation | Methods and systems for validating a system environment |
| US10521828B2 (en) * | 2016-06-08 | 2019-12-31 | Adobe Inc. | Methods for determining targeting parameters and bids for online ad distribution |
-
2020
- 2020-11-23 CN CN202011319928.8A patent/CN112418930B/en active Active
Patent Citations (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103593791A (en) * | 2013-11-07 | 2014-02-19 | 广州优蜜信息科技有限公司 | Mobile advertisement putting method and system |
| CN106227666A (en) * | 2016-07-25 | 2016-12-14 | 微梦创科网络科技（中国）有限公司 | A kind of automated testing method based on big data and system |
| CN107871244A (en) * | 2016-09-28 | 2018-04-03 | 腾讯科技（深圳）有限公司 | The detection method and device of a kind of advertising results |
| CN108985851A (en) * | 2018-07-24 | 2018-12-11 | 广州市丰申网络科技有限公司 | Advertisement analysis and monitoring method and device based on big data intensified learning |
| CN110009429A (en) * | 2019-04-10 | 2019-07-12 | 金瓜子科技发展（北京）有限公司 | A kind of method, apparatus and computer equipment of predicted flow rate data |
| CN110399298A (en) * | 2019-07-12 | 2019-11-01 | 苏州浪潮智能科技有限公司 | A kind of test method and device |
| CN110517080A (en) * | 2019-08-26 | 2019-11-29 | 北京百度网讯科技有限公司 | Outdoor advertising put-on method, device, equipment and computer readable storage medium |
| CN110706029A (en) * | 2019-09-26 | 2020-01-17 | 恩亿科(北京)数据科技有限公司 | Advertisement targeted delivery method and device, electronic equipment and storage medium |
| CN110750458A (en) * | 2019-10-22 | 2020-02-04 | 恩亿科(北京)数据科技有限公司 | Big data platform testing method and device, readable storage medium and electronic equipment |
| CN110781605A (en) * | 2019-11-05 | 2020-02-11 | 恩亿科(北京)数据科技有限公司 | Advertisement putting model testing method and device, computer equipment and storage medium |
| CN111062521A (en) * | 2019-11-29 | 2020-04-24 | 微民保险代理有限公司 | Online prediction method, system and server |
| CN111209201A (en) * | 2020-01-03 | 2020-05-29 | 恩亿科(北京)数据科技有限公司 | Advertisement putting test method and device |
| CN113298119A (en) * | 2021-04-28 | 2021-08-24 | 上海淇玥信息技术有限公司 | Method and device for evaluating putting strategy of machine learning model and electronic equipment |
| CN113643061A (en) * | 2021-08-12 | 2021-11-12 | 广州迈量科技有限公司 | Intelligent delivery system based on big data machine learning |
Non-Patent Citations (1)
| Title |
|---|
| 基于特征工程的广告点击转化率预测模型;邓秀勤;谢伟欢;刘富春;张翼飞;樊娟;;数据采集与处理(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112418930A (en) | 2021-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| WO2021190597A1 (en) | Processing method for neural network model, and related device | |
| US8181163B2 (en) | Program synthesis and debugging using machine learning techniques | |
| US8997065B2 (en) | Automatic modularization of source code | |
| CN110187988B (en) | Static function call graph construction method suitable for virtual function and function pointer | |
| Suh et al. | Accelerating MATLAB with GPU computing: a primer with examples | |
| US9983977B2 (en) | Apparatus and method for testing computer program implementation against a design model | |
| US8938381B1 (en) | Automatic numerical simulation of processor environment | |
| CN110633200A (en) | Method and device for testing intelligent contracts | |
| US10241767B2 (en) | Distributed function generation with shared structures | |
| CN109447256A (en) | The design method that Tensorflow system based on FPGA accelerates | |
| Trujillo et al. | GSGP-CUDA—a CUDA framework for geometric semantic genetic programming | |
| US10295596B1 (en) | Method and system for generating validation tests | |
| Mayan et al. | Optimized test data generation over suspicious implementation of oracle problem | |
| CN112418930B (en) | Test method, system and computer equipment | |
| Gosmann et al. | Automatic optimization of the computation graph in the Nengo neural network simulator | |
| Fehlmann et al. | A framework for automated testing | |
| Stiber et al. | Braingrid+ workbench: High-performance/high-quality neural simulation | |
| WO2021047662A1 (en) | Method and apparatus for enabling autonomous acceleration of dataflow ai applications | |
| CN117242457A (en) | Locating neural network performance hot spots | |
| Cai et al. | Sionnx: Automatic unit test generator for onnx conformance | |
| Jorgensen et al. | An interactive big data processing/visualization framework | |
| CN107291439A (en) | A kind of target delta data construction method and device | |
| Popescu et al. | Python-Based Programming Framework for a Heterogeneous MapReduce Architecture | |
| Temple Lang | Enhancing R with advanced compilation tools and methods | |
| Singh | An Empirical Study of Programming Languages from the Point of View of Scientific Computing |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |