CN111782542A - Test method, device, equipment, system and computer storage medium - Google Patents
Test method, device, equipment, system and computer storage medium Download PDFInfo
- Publication number
- CN111782542A CN111782542A CN202010666821.4A CN202010666821A CN111782542A CN 111782542 A CN111782542 A CN 111782542A CN 202010666821 A CN202010666821 A CN 202010666821A CN 111782542 A CN111782542 A CN 111782542A
- Authority
- CN
- China
- Prior art keywords
- test
- public service
- information
- configuration information
- updated
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000010998 test method Methods 0.000 title abstract description 9
- 238000012360 testing method Methods 0.000 claims abstract description 294
- 238000000034 method Methods 0.000 claims description 28
- 230000015654 memory Effects 0.000 claims description 19
- 230000000007 visual effect Effects 0.000 claims description 8
- 238000009877 rendering Methods 0.000 claims description 6
- 239000000126 substance Substances 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 7
- 230000006870 function Effects 0.000 description 5
- 238000012423 maintenance Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application discloses a test method, a test device, test equipment, a test system and a computer storage medium. The test method comprises the following steps: sending an interface calling request to a public service; the public service is positioned at a public service end; receiving public service interface information fed back by public service; obtaining test configuration information according to the public service interface information; and updating the corresponding test branch codes according to the test configuration information and running the updated test codes. The test method, the test device, the test equipment and the computer storage medium provided by the embodiment of the application can improve the utilization rate of the test codes.
Description
Technical Field
The application relates to the technical field of computers, in particular to the technical field of data analysis.
Background
The A/B test is to design two schemes for the same target, and to randomly put the two schemes on the market, users with the same composition (similar) experience one of the two schemes, and according to the observation result, judge which scheme has better effect, and the result can be measured by CTR (Click-Through-Rate) or order Rate.
For advertisement putting, when an advertisement is issued to a user, a complicated a/B link needs to be set according to different service scenes. For example: bidding, advertising material, targeted crowd, etc. In the testing process, a plurality of different modes are used for testing so as to seek the advertisement putting mode with the best effect as soon as possible.
However, after most a/B tests are finished, whether suitable results are found or not, a considerable part of the code changes corresponding to the a/B tests are discarded. Unnecessary resource and time waste is caused for enterprises.
Disclosure of Invention
The application provides a test method, a test device, a test apparatus, a test system, a test apparatus and a storage medium.
According to an aspect of the present application, there is provided a test method including:
sending an interface calling request to a public service; the public service is positioned at a public service end;
receiving public service interface information fed back by public service;
obtaining test configuration information according to the public service interface information;
and updating the corresponding test branch codes according to the test configuration information and running the updated test codes.
According to another aspect of the present application, there is provided a testing method applied to a public service end, including:
receiving an interface calling request sent by a testing end;
sending corresponding public service interface information to a test end according to the interface calling request;
and sending the test configuration information to a test end through the public service interface information.
According to another aspect of the present application, there is provided a testing apparatus applied to a testing terminal, the apparatus including:
the request sending module is used for sending an interface calling request to the public service;
the interface information receiving module is used for receiving public service interface information fed back by public services;
the configuration information module is used for acquiring test configuration information according to the public service interface information;
and the running module is used for updating the corresponding test branch codes according to the test configuration information and running the updated test codes.
According to another aspect of the present application, there is provided a testing apparatus applied to a public service end, including:
the calling request receiving module is used for receiving an interface calling request sent by the testing end; the public service is positioned at a public service end;
the interface information sending module is used for sending the corresponding public service interface information to the test end according to the interface calling request;
and the test configuration information sending module is used for sending the test configuration information to the test end through the public service interface information.
According to another aspect of the present application, there is also provided a test system including a first test apparatus applied to a test side and a second test apparatus applied to a common service side.
According to another aspect of the present application, there is provided an electronic device including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to cause the at least one processor to perform a method provided by any one of the embodiments of the present application.
According to another aspect of the present application, there is provided a non-transitory computer readable storage medium having stored thereon computer instructions for causing a computer to perform a method provided by any one of the embodiments of the present application.
According to the technology of the application, the test end can request the public service interface information from the public service end, and then test configuration information is obtained according to the public service interface information, so that test codes are operated at the corresponding nodes to be tested according to the test configuration information, operation and maintenance personnel can configure the test flow or other test variables at the storage address corresponding to the public service interface, the repeated use of the test codes is realized, and when the test flow or other test variables change, only new test configuration data need to be stored in the storage address corresponding to the public service interface.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present application, nor do they limit the scope of the present application. Other features of the present application will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a schematic diagram of a testing method according to an embodiment of the present application;
FIG. 2 is a schematic diagram of a testing method according to another embodiment of the present application;
FIG. 3 is a schematic diagram of a testing method according to another embodiment of the present application;
FIG. 4A is a schematic diagram of a testing method according to another embodiment of the present application;
FIG. 4B is a schematic diagram of information transmission of a test procedure according to another embodiment of the present application;
FIG. 5 is a schematic view of a testing apparatus according to another embodiment of the present application;
FIG. 6 is a schematic view of a testing apparatus according to another embodiment of the present application;
FIG. 7 is a schematic view of a testing apparatus according to another embodiment of the present application;
FIG. 8 is a schematic view of a testing apparatus according to another embodiment of the present application;
FIG. 9 is a block diagram of an electronic device for implementing a testing method of an embodiment of the present application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
Fig. 1 shows a schematic flow chart of a testing method according to an embodiment of the present application, applied to a testing end, as shown in fig. 1, including the following steps:
step 101: sending an interface calling request to a public service; the public service is positioned at a public service end;
step 102: receiving public service interface information fed back by public service;
step 103: obtaining test configuration information according to the public service interface information;
step 104: and updating the corresponding test branch codes according to the test configuration information and running the updated test codes.
In this embodiment, the public service end may be a server end providing public service.
In this embodiment, the public service interface information is used to indicate which public service interface is specifically called. The test configuration information is obtained according to the public service interface information, and specifically, according to the public service interface information, a storage address for storing the test configuration information for testing is found, and then the test configuration information is found at the corresponding storage address. For example, at a node to be tested, the types of products to be tested are A, B, and the test flow rates of A, B two products need to be regulated and controlled, then in the test configuration information, the flow rates of A, B two products are allocated according to a set proportion, for example, 30% of the test flow rate is allocated to a, and 70% of the test flow rate is allocated to B, so that the test code is run at the corresponding node to be tested according to the obtained test configuration data, and the regulation and control of the test flow rate are realized.
In this embodiment, the testing end may be one of the nodes to be tested. For example, the node to be tested may be an advertisement presentation page, which presents the first page or the second page. For another example, the nodes to be tested may be plug-in styles of advertisement pages, including a first style and a second style. As another example, the nodes to be tested can also be the bid rate of the advertisement, the advertisement bid with discount is provided for the user, and the advertisement bid without discount; the user is provided with a first discounted advertising bid and a second discounted advertising bid.
In the embodiment of the application, the test end can request the public service interface for testing the public service, and then obtains the test configuration information according to the public service interface, so that the test code can be run at the corresponding node to be tested according to the test configuration information, and operation and maintenance personnel can configure the test flow or other test variables at the storage address corresponding to the public service interface, thereby realizing the repeated use of the test code.
The test method of the embodiment can be applied to A/B test, and particularly can be applied to A/B test in the advertisement field. The public service receives an interface calling request of a node to be tested, calculates a test parameter value issued by the test according to an A/B test distribution ratio configured by the node to be tested, and returns response information to a calling party.
In another embodiment of the present application, the test configuration information includes traffic information; obtaining test configuration information according to the public service interface information, including:
and obtaining the flow information through the public service interface.
In this embodiment, the traffic information is obtained through the public service interface, and specifically, the traffic information may be traffic allocated to different test contents. Such as a first traffic allocated for a first test content and a second traffic allocated for a second test content.
In this embodiment, the flow information may be set through the test configuration information, so that the operation and maintenance staff may configure the test flow information through the public service.
In another embodiment of the present application, updating a corresponding test branch code and running the updated test code according to the test configuration information includes:
obtaining a test parameter according to the flow information;
adding the test parameters into a preset test code to obtain an updated test code;
and running the updated test code at the node to be tested of the test end.
In the embodiment of the present application, the traffic information may include test parameters, for example, the node to be tested is an advertisement display page, in the test configuration information, the traffic information allocates 20% of traffic to the first page and 80% of traffic to the second page, and the test parameters are the first page and the second page, respectively. If the node to be tested is an advertisement display page, in the test configuration information, the flow information allocates 30% of flow to the third page and 70% of flow to the fourth page, and the test parameters are the third page and the fourth page respectively.
In one implementation of this embodiment, the common definition part of the a/B test is abstracted into an independent service and runs on the server side. The common definition section includes: test grouping, test naming, flow distribution and test proportion. The public definition part is managed by an independent configuration tool, and each set of A/B test is issued, a set of complete configuration information of the A/B test is set through the configuration tool, and meanwhile, the configuration information can be changed at a server side as required. In practical application, all configuration information corresponding to the A/B test can be obtained by calling a common service interface from a server side for the node to be tested, and then the A/B test is shunted. Without the need for separate split calculations.
In this embodiment, the test parameters are obtained according to the flow information, so that the test parameters and the corresponding flow can be obtained from the flow information, and the operation and maintenance personnel only need to store the corresponding test configuration information in the public service interface.
In another embodiment of the present application, as shown in fig. 2, after updating the corresponding test branch code and running the updated test code according to the test configuration information, the method further includes:
step 201: putting a test result obtained by running the updated test code into a test data tracking sequence;
step 202: and placing the test data tracking sequence into a storage address corresponding to a node to be tested of the test end.
In this embodiment, after the test code is released, different test results, such as click volume, purchase volume, etc., may be obtained at each stage of the test code running. And the test result is put into a test data tracking sequence, so that the automatic acquisition of the test result can be realized.
In this embodiment, the data trace of the a/B test is modularized, and only the result of the a/B test needs to be put into the fixed a/B test data trace sequence. When the method is applied to advertisement testing, the testing result is put into the data tracking sequence and then stored into the cache of the word advertisement flow taking the advertisement issuing node as the standard. And then, the state of the corresponding A/B test can be obtained at any node of the whole advertisement process through caching.
In another embodiment of the present application, as shown in fig. 3, the method further includes:
step 301: and when the updated test result exists in the storage address, performing visual image rendering according to the updated test result to obtain a test image.
In the embodiment, when the test result is detected to be updated, the visual image reflecting the test condition is updated in real time according to the updated test result, so that operation and maintenance personnel can timely acquire the change condition of the test result from the visual view. The A/B test information is uploaded to a visual data tool, the tracking A/B test effect is achieved through a flexible data query function, and an A/B test strategy can be adjusted in real time.
The embodiment of the present application further provides a testing method, applied to a public service end, as shown in fig. 4A, including:
step 401: receiving an interface calling request sent by a testing end;
step 402: sending corresponding public service interface information to a test end according to the interface calling request;
step 403: and sending the test configuration information to a test end through the public service interface information.
In this embodiment, the public service end may be a server end providing public service. The server may specifically be a server for storing the test configuration information.
In another embodiment of the present application, the sending the test configuration information to the test end through the public service interface includes:
and issuing the flow information to the test end through the public service interface corresponding to the public service interface information according to the distribution proportion corresponding to the node to be tested of the test end.
In an embodiment, as shown in fig. 4B, an operator or a tester configures test configuration information of each node to be tested to an a/B test service corresponding to the node to be tested through the a/B test service, the a/B test service allocates the test configuration information according to the information of the node to be tested in proportion, a service of the node to be tested sends an interface call request to the a/B test service, the a/B test service returns the configuration information of the node to be tested, and the service of the node to be tested runs a test logic on the node to be tested to implement an a/B test.
An embodiment of the present application further provides a testing apparatus, which is applied to a testing end, as shown in fig. 5, the apparatus includes:
a request sending module 501, configured to send an interface call request to a public service; the public service is positioned at a public service end;
an interface information receiving module 502, configured to receive public service interface information fed back by a public service;
a configuration information module 503, configured to obtain test configuration information according to the public service interface information;
the running module 504 is configured to update the corresponding test branch code according to the test configuration information and run the updated test code.
In one embodiment, the test configuration information includes traffic information; the configuration information module is further configured to:
and obtaining the flow information through the public service interface.
In one embodiment, the testing apparatus further includes a request sending module 501, an interface information receiving module 502, a configuration information module 503, and an operation module 504 shown in fig. 5. On this basis, the operation module comprises:
the test parameter unit is used for obtaining test parameters according to the flow information;
the updating unit is used for adding the test parameters into a preset test code to obtain an updated test code;
and the code running unit is used for running the updated test code at the node to be tested of the test end.
In one embodiment, the testing apparatus further includes a request sending module 501, an interface information receiving module 502, a configuration information module 503, and an operation module 504 shown in fig. 5. On this basis, as shown in fig. 6, the apparatus further includes:
a trace module 601, configured to put a test result obtained by running the updated test code into a test data trace sequence;
the storage module 602 is configured to put the test data tracking sequence into a storage address corresponding to a node to be tested at the test end.
In one embodiment, the testing apparatus further includes a request sending module 501, an interface information receiving module 502, a configuration information module 503, and an operation module 504 shown in fig. 5. On this basis, as shown in fig. 7, the apparatus further includes:
and the rendering module 701 is configured to, when it is detected that the updated test result exists in the storage address, perform visual image rendering according to the updated test result to obtain a test image.
An embodiment of the present application further provides a testing apparatus, which is applied to a public service end, as shown in fig. 8, and includes:
a calling request receiving module 801, configured to receive an interface calling request sent by a test end;
an interface information sending module 802, configured to send, according to the interface call request, corresponding public service interface information to a test end;
the test configuration information sending module 803 is configured to send the test configuration information to the test end through the public service interface information.
In one embodiment, the test configuration information includes traffic information, and the test configuration information sending module is further configured to:
and issuing the flow information to the test end through a public service interface corresponding to the public service interface information according to a distribution proportion corresponding to the node to be tested of the test end.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 9 is a block diagram of an electronic device according to an encoding method of an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 9, the electronic apparatus includes: one or more processors 901, memory 902, and interfaces for connecting the various components, including a high-speed interface and a low-speed interface. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). Fig. 9 illustrates an example of a processor 901.
The memory 902, which is a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the encoding methods in the embodiments of the present application (for example, the request sending module 501, the interface information receiving module 502, the configuration information module 503, and the execution module 504 shown in fig. 5). The processor 901 executes various functional applications of the server and data processing, i.e., implements the encoding method in the above-described method embodiments, by running non-transitory software programs, instructions, and modules stored in the memory 902.
The memory 902 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application program required for at least one function; the storage data area may store data created according to use of the video encoding electronic device, and the like. Further, the memory 902 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, memory 902 may optionally include memory located remotely from processor 901, which may be connected to video encoding electronics over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the encoding method may further include: an input device 903 and an output device 904. The processor 901, the memory 902, the input device 903 and the output device 904 may be connected by a bus or other means, and fig. 9 illustrates the connection by a bus as an example.
The input device 903 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the video encoded electronic device, such as a touch screen, keypad, mouse, track pad, touch pad, pointer, one or more mouse buttons, track ball, joystick, or other input device. The output devices 904 may include a display device, auxiliary lighting devices (e.g., LEDs), tactile feedback devices (e.g., vibrating motors), and the like. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the configurable flow or proportion conversion of A/B test is realized. Data tracking for A/B testing is automated. Visualization of the A/B test effect analysis. The development process of the A/B test can be greatly shortened. Meanwhile, the flexibility and the real-time performance of the A/B test are greatly improved. The problems of long development period, inflexible deployment, inconvenient data tracking and poor real-time performance of the A/B test are solved.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (17)
1. A testing method is applied to a testing end, and comprises the following steps:
sending an interface calling request to a public service; the public service is positioned at a public service end;
receiving public service interface information fed back by the public service;
obtaining test configuration information according to the public service interface information;
and updating the corresponding test branch codes according to the test configuration information and running the updated test codes.
2. The method of claim 1, wherein the test configuration information includes traffic information; obtaining test configuration information according to the public service interface information, including:
and obtaining flow information through the public service interface.
3. The method of claim 2, wherein updating the corresponding test branch code and running the updated test code according to the test configuration information comprises:
obtaining a test parameter according to the flow information;
adding the test parameters into a preset test code to obtain an updated test code;
and running the updated test code at the node to be tested of the test end.
4. The method of any of claims 1-3, wherein after updating the corresponding test branch code and running the updated test code according to the test configuration information, the method further comprises:
putting a test result obtained by running the updated test code into a test data tracking sequence;
and placing the test data tracking sequence into a storage address corresponding to a node to be tested of the test end.
5. The method of claim 4, further comprising:
and when the updated test result exists in the storage address, performing visual image rendering according to the updated test result to obtain a test image.
6. A testing method is applied to a public service end and comprises the following steps:
receiving an interface calling request sent by a testing end;
sending corresponding public service interface information to a test end according to the interface calling request;
and sending the test configuration information to a test terminal through the public service interface information.
7. The method of claim 6, wherein the test configuration information includes traffic information, and the sending the test configuration information to the test end through the public service interface information includes:
and issuing the flow information to the test end through a public service interface corresponding to the public service interface information according to a distribution proportion corresponding to the node to be tested of the test end.
8. A test apparatus for use in a test site, the apparatus comprising:
the request sending module is used for sending an interface calling request to the public service;
the interface information receiving module is used for receiving the public service interface information fed back by the public service;
the configuration information module is used for acquiring test configuration information according to the public service interface information;
and the running module is used for updating the corresponding test branch codes according to the test configuration information and running the updated test codes.
9. The apparatus of claim 8, wherein the test configuration information comprises traffic information; the configuration information module is further configured to:
and obtaining flow information through the public service interface.
10. The apparatus of claim 9, wherein the operation module comprises:
the test parameter unit is used for obtaining test parameters according to the flow information;
the updating unit is used for adding the test parameters into a preset test code to obtain an updated test code;
and the code running unit is used for running the updated test code at the node to be tested of the test end.
11. The apparatus of any of claims 8 to 10, wherein the apparatus further comprises:
the tracking module is used for putting a test result obtained by running the updated test code into a test data tracking sequence;
and the storage module is used for placing the test data tracking sequence into a storage address corresponding to the node to be tested of the test end.
12. The apparatus of claim 11, wherein the apparatus further comprises:
and the rendering module is used for performing visual image rendering according to the updated test result to obtain a test image when the updated test result exists in the storage address.
13. A testing device is applied to a public service end and comprises:
the calling request receiving module is used for receiving an interface calling request sent by the testing end;
the interface information sending module is used for sending the corresponding public service interface information to the test end according to the interface calling request;
and the test configuration information sending module is used for sending the test configuration information to the test terminal through the public service interface information.
14. The apparatus of claim 13, wherein the test configuration information comprises traffic information, and the test configuration information sending module is further configured to:
and issuing the flow information to the test end through a public service interface corresponding to the public service interface information according to a distribution proportion corresponding to the node to be tested of the test end.
15. A test system, comprising: a first testing device applied to the testing side and a second testing device applied to the common service side, wherein,
the first testing device is the testing device of any one of claims 8-12;
the second testing device is the testing device of claim 13 or 14.
16. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.
17. A non-transitory computer readable storage medium having stored thereon computer instructions for causing the computer to perform the method of any one of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010666821.4A CN111782542A (en) | 2020-07-13 | 2020-07-13 | Test method, device, equipment, system and computer storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010666821.4A CN111782542A (en) | 2020-07-13 | 2020-07-13 | Test method, device, equipment, system and computer storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111782542A true CN111782542A (en) | 2020-10-16 |
Family
ID=72768402
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010666821.4A Pending CN111782542A (en) | 2020-07-13 | 2020-07-13 | Test method, device, equipment, system and computer storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111782542A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115658530A (en) * | 2022-11-03 | 2023-01-31 | 荣耀终端有限公司 | Software version parallel testing method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103577321A (en) * | 2012-08-07 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Multi-version parallel test method for web pages and server |
| US20150026522A1 (en) * | 2013-07-19 | 2015-01-22 | Dawnray Young | Systems and methods for mobile application a/b testing |
| CN105740137A (en) * | 2014-12-08 | 2016-07-06 | 阿里巴巴集团控股有限公司 | Bucket test method, device and system, and method and device for providing configuration information |
| CN106506281A (en) * | 2016-11-24 | 2017-03-15 | 深圳市金溢科技股份有限公司 | Vehicle toll communication test method, the network equipment and system |
| CN106919378A (en) * | 2016-08-24 | 2017-07-04 | 阿里巴巴集团控股有限公司 | Application based on increment updates and method of testing and system, server and client |
| CN108804318A (en) * | 2018-05-24 | 2018-11-13 | 北京金山安全软件有限公司 | Page element testing method and device, electronic equipment and storage medium |
| CN110096396A (en) * | 2019-03-18 | 2019-08-06 | 北京奇艺世纪科技有限公司 | It is grouped control method, distribution application system and the storage medium of test |
| CN110413512A (en) * | 2019-07-03 | 2019-11-05 | 深圳市珍爱捷云信息技术有限公司 | AB test method, device, computer equipment and storage medium |
| CN111352823A (en) * | 2018-12-21 | 2020-06-30 | 北京字节跳动网络技术有限公司 | Test method, client and storage medium |
-
2020
- 2020-07-13 CN CN202010666821.4A patent/CN111782542A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103577321A (en) * | 2012-08-07 | 2014-02-12 | 阿里巴巴集团控股有限公司 | Multi-version parallel test method for web pages and server |
| US20150026522A1 (en) * | 2013-07-19 | 2015-01-22 | Dawnray Young | Systems and methods for mobile application a/b testing |
| CN105740137A (en) * | 2014-12-08 | 2016-07-06 | 阿里巴巴集团控股有限公司 | Bucket test method, device and system, and method and device for providing configuration information |
| CN106919378A (en) * | 2016-08-24 | 2017-07-04 | 阿里巴巴集团控股有限公司 | Application based on increment updates and method of testing and system, server and client |
| CN106506281A (en) * | 2016-11-24 | 2017-03-15 | 深圳市金溢科技股份有限公司 | Vehicle toll communication test method, the network equipment and system |
| CN108804318A (en) * | 2018-05-24 | 2018-11-13 | 北京金山安全软件有限公司 | Page element testing method and device, electronic equipment and storage medium |
| CN111352823A (en) * | 2018-12-21 | 2020-06-30 | 北京字节跳动网络技术有限公司 | Test method, client and storage medium |
| CN110096396A (en) * | 2019-03-18 | 2019-08-06 | 北京奇艺世纪科技有限公司 | It is grouped control method, distribution application system and the storage medium of test |
| CN110413512A (en) * | 2019-07-03 | 2019-11-05 | 深圳市珍爱捷云信息技术有限公司 | AB test method, device, computer equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 李航: "一种软件构件持续交付管理系统的设计与实现", 《中国优秀硕士学位论文全文数据库 信息科技辑》, no. 06, 15 June 2018 (2018-06-15), pages 138 - 680 * |
| 翘腾: "持续交付中的分支管理和版本控制", pages 1 - 7, Retrieved from the Internet <URL:《https://zhuanlan.zhihu.com/p/40871473》> * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115658530A (en) * | 2022-11-03 | 2023-01-31 | 荣耀终端有限公司 | Software version parallel testing method and device |
| CN115658530B (en) * | 2022-11-03 | 2024-04-09 | 荣耀终端有限公司 | Parallel testing method and device for software versions |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111858506B (en) | Test data processing method and device, electronic equipment and storage medium | |
| CN111506803A (en) | Content recommendation method and device, electronic equipment and storage medium | |
| CN111949272A (en) | Compilation optimization method and device for hosted application, electronic device and readable storage medium | |
| CN112015468A (en) | Interface document processing method and device, electronic equipment and storage medium | |
| CN111611168A (en) | Joint debugging test method, device and system | |
| CN112561332A (en) | Model management method, model management apparatus, electronic device, storage medium, and program product | |
| CN111610972A (en) | Page generation method, device, equipment and storage medium | |
| CN111563198A (en) | Material recall method, device, equipment and storage medium | |
| CN112667795B (en) | Dialogue tree construction method and device, dialogue tree operation method, device and system | |
| CN111782542A (en) | Test method, device, equipment, system and computer storage medium | |
| CN112532483A (en) | Test method, test device, electronic equipment and storage medium | |
| CN112561059A (en) | Method and apparatus for model distillation | |
| CN111581518A (en) | Information pushing method and device | |
| CN111177479A (en) | Method and device for acquiring feature vectors of nodes in relational network graph | |
| CN111368184A (en) | Screen saver release method and device for intelligent voice device and storage medium | |
| CN114661274A (en) | Method and device for generating intelligent contract | |
| JP2022078129A (en) | Data labeling method, apparatus, electronic device, computer readable storage medium, and computer program | |
| CN111985969A (en) | Media information display method, device and equipment and computer storage medium | |
| CN113220571A (en) | Debugging method, system, equipment and storage medium of mobile webpage | |
| CN112541710A (en) | Search product quality evaluation method and device, electronic equipment and storage medium | |
| CN112346512A (en) | Time synchronization method and device | |
| CN111177558A (en) | Channel service construction method and device | |
| CN113220982A (en) | Advertisement searching method, device, electronic equipment and medium | |
| CN112445983A (en) | Search result processing method, device and equipment and computer readable storage medium | |
| CN112446728A (en) | Advertisement recall method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |