WO2020119426A1

WO2020119426A1 - Gray scale testing method, server and computer readable storage medium

Info

Publication number: WO2020119426A1
Application number: PCT/CN2019/120379
Authority: WO
Inventors: 陈百门
Original assignee: 深圳壹账通智能科技有限公司
Priority date: 2018-12-13
Filing date: 2019-11-22
Publication date: 2020-06-18
Also published as: CN109800150B; CN109800150A

Abstract

Disclosed by embodiments of the present application are a gray scale testing method, a server and a computer readable storage medium, which are applied to the technical field of software testing. The method comprises: selecting from at least one preregistered test mailbox at least one target test mailbox used for performing gray scale testing on a target application; crawling a target test invitation link of each target test mailbox among the at least one target test mailbox; monitoring the status of the target test invitation link of each target test mailbox; associatively storing the status of the target test invitation link of each target test mailbox and test information of the target application; and sending the target test invitation link to at least one test terminal corresponding to the test information according to the status of the target test invitation link of each target test mailbox. Using the present application helps to increase the efficiency of corresponding gray scale testing.

Description

Gray scale test method, server and computer readable storage medium

This application requires the priority of the Chinese patent application submitted to the China Patent Office on December 13, 2018, with the application number 201811531236.2 and the application name as "a grayscale test method, server and computer-readable storage medium", all of its content Incorporated by reference in this application.

Technical field

This application relates to the technical field of software testing, in particular to a grayscale testing method, a server, and a computer-readable storage medium.

Background technique

At present, the official grayscale test solution of iOS TestFlight needs to collect the mailboxes of users who participate in the grayscale test before performing grayscale testing. By manually adding the email addresses of the users who participate in the grayscale test to the iOS backend, the iOS backend is given These user mailboxes send invitation links. After sending the invitation link, rely on the user to click the invitation link in their own mailbox, open the link and jump to the system Safari browser, then jump to the Apple app market to download Testflight, after downloading, participate in the experience test by entering Code, participate in App experience testing. It can be seen that the entire grayscale test program process is relatively cumbersome, resulting in low test efficiency.

Summary of the invention

Embodiments of the present application provide a grayscale testing method, a server, and a computer-readable storage medium, which are helpful for improving the efficiency of grayscale testing of applications.

In a first aspect, an embodiment of the present application provides a grayscale testing method, including:

Selecting at least one target test mailbox for grayscale testing of the target application from the at least one test mailbox registered in advance, and uploading the address of the at least one target test mailbox to the application publishing platform, so that the application publishing platform Sending target test invitation links corresponding to the grayscale test to the at least one target test mailbox respectively;

Crawl the target test invitation link of each target test mailbox in the at least one target test mailbox separately, and monitor the status of the target test invitation link of each target test mailbox, and test the target test of each target test mailbox The state of the invitation link is stored in association with the test information of the target application; wherein the state includes an unsent invitation state, a sent invitation state, or an accepted invitation state, and the test information includes the name and version of the target application Any one or more of the number, the address of the target test mailbox and the identification of the test terminal;

According to the status of the target test invitation link of each target test mailbox, a target test invitation link is sent to at least one test terminal corresponding to the test information, and the test terminals correspond to the sent target test invitation link in one-to-one correspondence.

In a second aspect, an embodiment of the present application provides a server. The server includes a unit for performing the method of the first aspect.

In a third aspect, an embodiment of the present application provides another server, including a processor, a communication interface, and a memory. The processor, the communication interface, and the memory are connected to each other, where the memory is used to store a server that supports the server to execute the above method. A computer program, the computer program includes program instructions, and the processor is configured to call the program instructions to perform the method of the first aspect. Optionally, the server may also include a user interface.

According to a fourth aspect, an embodiment of the present application provides a computer-readable storage medium that stores a computer program, where the computer program includes program instructions, which when executed by a processor causes The processor executes the method of the first aspect described above. Optionally, the computer-readable storage medium may be a computer non-volatile storage medium.

The embodiments of the present application can improve the gray-scale test efficiency of the application, and can realize that multiple applications share the test mailbox, thereby improving the utilization rate of the test mailbox.

BRIEF DESCRIPTION

In order to more clearly explain the technical solutions of the embodiments of the present application, the drawings required in the description of the embodiments will be described below.

FIG. 1 is a schematic flowchart of a grayscale testing method provided by an embodiment of the present application;

2 is a schematic flowchart of another grayscale testing method provided by an embodiment of the present application;

3 is a schematic structural diagram of a server provided by an embodiment of the present application;

4 is a schematic structural diagram of another server provided by an embodiment of the present application.

detailed description

The technical solutions of the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application.

The technical solution of the present application can be applied to a server, such as a gray-scale platform, for gray-scale testing of applications. The terminal involved in this application, such as a test terminal, may be a mobile phone, a tablet computer, a personal computer, etc., and this application is not limited.

At present, there are often cases where the version update of the terminal application requires the release of a new version of the application or the release of a new application. Before the official release, the new version of the application or the new application will generally be tested for grayscale (hereinafter referred to as the grayscale test for the application), that is, after a test phase, the application will be grayscaled by some users (test terminals) After the test, it is officially released to all users. In this application, a batch of mailboxes for grayscale testing can be registered in advance, so that when grayscale testing is performed on the application, the test mailbox for testing can be selected from the pre-registered mailboxes The mailbox quickly obtains the test invitation link, and then sends the test invitation link to the test terminal according to the status of the test invitation link and the test information of the application, so as to realize the grayscale test of the application, thereby improving the efficiency of grayscale testing of the application. And can achieve multiple applications to share the test mailbox, improve the test mailbox utilization. Each is explained in detail below.

Please refer to FIG. 1. FIG. 1 is a schematic flowchart of a grayscale testing method according to an embodiment of the present application. Specifically, the method of this embodiment can be applied to the above-mentioned server such as a gray-scale platform, and the gray-scale platform is taken as an example for description below. As shown in FIG. 1, the grayscale testing method may include the following steps:

101. Select at least one target test mailbox for gray-scale testing of the target application from at least one test mailbox registered in advance, and upload the address of the at least one target test mailbox to the application publishing platform to enable the application publishing platform Send the target test invitation link corresponding to the grayscale test to the at least one target test mailbox respectively.

Specifically, one or more mailboxes can be pre-registered or selected through other methods, which can be used as the test mailbox during the grayscale test process for subsequent testing, and the one or more mailboxes can be stored on the grayscale platform A mailbox is the information of the test mailbox. The information of the test mailbox may include the email address, name and so on. Optionally, the one or more test mailboxes may be manually registered in advance, or may be registered in batches using third-party tools, etc., which are not listed here one by one.

Optionally, different test mailboxes can be used for grayscale testing of different applications; or, different test mailboxes can be used for grayscale testing of different types of applications; or, the same test mailbox can also be used for grayscale testing of different applications Test, and can be used for grayscale testing of different applications at the same time. The grayscale platform can manage these test mailboxes and assign test mailboxes for different applications. Thus, it is possible to allocate test mailboxes for different applications in real time and dynamically.

For example, in a possible implementation manner, the grayscale platform may determine the target mailbox corresponding to the application type of the target application by determining the application type of the target application and from a plurality of preset mailbox collections (mailbox groups) Set, and then select at least one mailbox from the target mailbox set, and use the selected at least one mailbox as the at least one target test mailbox. Wherein, the mailbox set corresponds to the application type one by one, each mailbox set may include one or more test mailboxes, and the test mailbox in each mailbox set is used for the grayscale test of the application type application corresponding to the mailbox set. That is to say, after the at least one test mailbox is obtained, the at least one test mailbox can be grouped to obtain multiple mailbox collections, and the mailbox collection is associated with the application type, that is, test mailboxes in different groups can be used The grayscale testing of applications of different application types makes it possible to quickly select the target test mailbox from the corresponding mailbox set according to the application type of the application when selecting the target test mailbox for testing the application. Among them, the number of test mailboxes of each group, that is, the number of test mailboxes of each mailbox set may be the same or different. For example, according to the number of divided application types and the number of the at least one test mailbox, different types of applications can be evenly allocated test mailboxes, that is, the number of test mailboxes in each mailbox set is the same; for example, according to different application types The number of applications is grouped into mailboxes. The more applications under an application type, the more test mailboxes included in the mailbox set corresponding to the application type. Therefore, the target test mailbox for testing can be quickly selected for the application in combination with the application type, which improves the efficiency of mailbox selection.

As another example, in another possible implementation manner, the grayscale platform may obtain load information of each test mailbox in at least one test mailbox registered in advance, and then select from each test mailbox according to the load information of each test mailbox The at least one target test mailbox. Among them, the load information includes the number of processes participating in the grayscale test, the size of the mailbox capacity, and so on. That is to say, when selecting the target test mailbox for testing the application, the grayscale platform can select the target test mailbox according to the load information of the at least one test mailbox. For example, the grayscale platform can select the target test mailbox from each test mailbox according to the order of the number of processes that each test mailbox participates in the grayscale test from low to high, that is, select the test mailbox with fewer processes participating in the grayscale test As the target test mailbox; for another example, the grayscale platform can separately calculate the ratio between the number of processes that each test mailbox participates in the grayscale test and the mailbox capacity of the test mailbox, according to the order of the ratio from low to high, from the The target test mailbox is selected from each test mailbox, that is, the test mailbox with the smaller ratio is selected as the target test mailbox. Therefore, the target test mailbox for testing can be selected for the application in combination with the mailbox load, which realizes the balanced utilization of mailbox resources and avoids the waste of resources caused by the vacancy of some mailboxes.

As another example, in another possible implementation manner, when selecting a target test mailbox for testing the application, the grayscale platform may randomly select the test mailbox from all the test mailboxes registered in advance as the target test for the current grayscale test application mailbox.

After the grayscale platform selects the target test mailbox from the pre-registered test mailbox, you can upload the address of the selected target test mailbox to an application publishing platform such as iTunes Connect of the iOS system, and iTunes Connect will send an invitation to experience these test mailboxes Link to obtain a test invitation link for grayscale testing of the target application, that is, a target test invitation link. Among them, the target test mailbox (address) may correspond to the target test invitation link one-to-one.

102. Crawl the target test invitation link of each target test mailbox in the at least one target test mailbox, and monitor the status of the target test invitation link of each target test mailbox.

The status may include an unsent invitation status, an sent invitation status, an accepted invitation status, and so on. The status of the unsent invitation may refer to the status of not uploading the email address to the application publishing platform or uploading the email address to the application publishing platform but not receiving the target test invitation link sent by the application publishing platform or receiving the application publishing The status of the target test invitation link sent by the platform but not sent to the test terminal; the sent invitation status may refer to the status of receiving the target test invitation link and sent to the test terminal; the accepted invitation status may be that the test terminal has The status of accepting the invitation of the target test invitation link (if the test code included in the target test invitation link is used). Optionally, the status of the link may be identified by one or more fields, or through text records, or identified in other ways, which is not limited in this application.

After uploading the address of the target test mailbox, the grayscale platform can detect whether there is a target test invitation link in these target test mailboxes according to preset rules, such as crawling at preset time intervals, or according to preset crawling Go to the time in the time list, etc. Until the target test invitation link is crawled from these target test mailboxes, the target test invitation link is sent to the corresponding test terminal. Specifically, after crawling out the target test invitation link in all target test mailboxes, each test terminal is individually sent to Send the target test invitation link, or crawl out the target test invitation link in a target test mailbox, and immediately send the target test invitation link to a test terminal, and so on. It can also monitor and record the status of each target test invitation link, that is, mark the status of the target test invitation link of each target test mailbox.

103. Associate and store the state of the target test invitation link of each target test mailbox and the test information of the target application.

The test information may include any one or more of the target application name, version number, target test email address, target test invitation link, and test terminal identification. For example, the test information may include the name, version number, and address of the target test mailbox of the target application. That is, by linking the link state and the information of the target application to be tested, multiple applications can share the test mailbox, thereby improving the utilization rate of the test mailbox.

104. According to the status of the target test invitation link of each target test mailbox, respectively send a target test invitation link to at least one test terminal corresponding to the test information.

Wherein, the test terminal may correspond to the sent target test invitation link one-to-one. That is, for each target test invitation link, it can be sent to a test terminal. Optionally, the at least one test terminal corresponding to the test information may refer to a test terminal used for the target application this grayscale test. The at least one test terminal can be selected in advance, and the identification of the at least one test terminal and the test information of the target application (such as the name and version number of the target application) can be bound to mark the at least one test The terminal is used for this test of the target application. Further optionally, the number of the at least one test terminal may be greater than or equal to the number of the at least one target test mailbox (or target test invitation link).

Optionally, when sending the target test invitation link to the test terminal, the grayscale platform may determine that among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link in the state of unsent invitation, and the The target test invitation link in the unsent invitation state is sent to the first test terminal corresponding to the test information, and the first test terminal has a one-to-one correspondence with the target test invitation link in the unsent invitation state. In other words, after obtaining the target test invitation link, the target test mailbox can send the target test invitation link to the test terminal. When it is determined that a target test invitation link has been used, the status of the link is "invited accepted" ". Further optionally, the grayscale platform can also detect whether there is a target test invitation link whose status is in the state of sent invitation exceeds the preset time threshold in all target test invitation links; if there is a target test that exceeds the preset time threshold Invitation link, you can send the target test invitation link that exceeds the preset time threshold to the second test terminal corresponding to the test information, the second test terminal and the target test invitation link that exceeds the preset time threshold one by one correspond. That is to say, the above-mentioned at least one test terminal may include the first terminal and the second test terminal, the number of the first test terminal may be the same as the number of the at least one target test mailbox, so that the at least one target test mailbox is After obtaining the target test link, it can be sent to the first test terminal; if after sending to the first test terminal, it is detected that the user of the first test terminal has not accepted the invitation for a long time (such as 2 days), you can re-submit to the The first test terminal sends the target test invitation link, or sends the target test invitation link to a new test terminal, that is, the second test terminal, to improve the utilization rate and test conversion rate of the invitation link, thereby further improving test efficiency.

Further optionally, when the status of all target test invitation links corresponding to the at least one target test mailbox is an accepted invitation status, the grayscale platform may delete all target test invitation links and recorded records of all target test invitation links Status, and delete the test information. Or, when the status of the target test invitation link of any target test mailbox is the status of accepted invitation, the grayscale platform can delete the target test invitation link and its status until the status of all target test invitation links are marked as When accepting the invitation status, delete the test information. Thus freeing up memory to save storage resources.

Further optionally, when the status of all test invitation links corresponding to any target test mailbox is the status of accepted invitation, the grayscale platform may also delete (remove) the address of the target test mailbox from the application publishing platform.

For example, when the mailbox information is entered into the system as the address of the target test mailbox mentioned above, that is, when uploading iTunes Connect, the status of the target test invitation link corresponding to the target test mailbox is "not sent invitation status"; after entering the mailbox, the timing The crawler program will actively log in to the target test mailbox. If a test invitation link is found in a target test mailbox, that is, the target test invitation link, it can be sent to the test terminal and can be marked as "invited sent" status; at the same time, the crawler The program can actively simulate accessing the target test invitation link to see if the user has already participated in the invitation. If the user has participated in the invitation (that is, the test code of the target test invitation link is used), the status can be updated to "accepted invitation status" . Optionally, for a scenario where one mailbox is only used for one grayscale test at the same time, another timed crawler task can remove the address of the "accepted invitation status" mailbox from iTunes Connect and delete the corresponding mailbox Invite the link (email) and its status information, so that a closed-loop process can be formed to achieve the reuse of the mailbox. Or, for a scenario where a mailbox is used for multiple grayscale tests at the same time, another scheduled crawler task can delete the invitation link and its status corresponding to the "received invitation status", when all the invitation links of the mailbox are marked as When "invitation accepted", you can remove the mailbox from iTunes Connect.

After receiving the push message, the user of the test terminal can output a prompt message to prompt the user whether to participate in the test experience of the target application. When users click to participate, they can jump to Testflight to participate in the experience to complete the grayscale test of the target application.

In this embodiment, the grayscale platform can pre-register the mailbox, so that when grayscale testing is performed on the application, at least one target test mailbox can be selected from the pre-registered mailbox to obtain through the at least one target test mailbox Test the invitation link, and then monitor the status of the test invitation link, and store the status of the test invitation link and the test information of the application in association, so as to send the test invitation link to the test terminal according to the status and test information of the test invitation link, thereby Implementing gray-scale testing of the application improves the gray-scale testing efficiency of the application, and enables multiple applications to share test mailboxes, which improves the utilization rate of the test mailbox.

Please refer to FIG. 2, which is a schematic flowchart of another grayscale testing method provided by an embodiment of the present application. Specifically, as shown in FIG. 2, the grayscale testing method may include the following steps:

201. Determine the test frequency of the application of each application type according to the historical grayscale test information of the application of each application type.

The historical grayscale test information may include any one or more of the time, number of times, and version number of the historical grayscale test.

Optionally, the test frequency of an application of an application type may refer to the average test frequency or the average number of tests of each application under the application type, for example, the total test frequency of each application under the application type and the application The ratio between the number of times; Another example is the preset historical time window such as the ratio between the total number of tests of each application under the application type and the number of each application within the previous 6 months; Another example is the preset history The ratio between the total number of tests of each application under the application type and the historical time window in the time window such as the previous 6 months, etc., are not listed here one by one.

202. According to the test frequency of the application of each application type, preset preset mailbox sets corresponding to each application type to obtain multiple mailbox sets.

Wherein, the mailbox set corresponding to the first application type includes more test mailboxes (greater than) the number of test mailboxes included in the mailbox set corresponding to the second application type, and the test frequency of the application of the first application type is higher than the first Test frequency of application of two application types. That is to say, when grouping mailboxes according to the application test frequency of each application type, the higher the test frequency, the more the number of test mailboxes corresponding to the grouped mailbox collection can be, to ensure sufficient test mailboxes and improve the test mailbox Utilization.

203. Determine the application type of the target application, and determine the target mailbox set corresponding to the application type of the target application from the plurality of mailbox sets.

Wherein, the mailbox set may correspond to the application type one by one, and the test mailbox in each mailbox set may be used for the grayscale test of the application of the application type corresponding to the mailbox set.

204. Select at least one test mailbox from the target mailbox set, and use the selected at least one test mailbox as at least one target test mailbox.

In this embodiment, the test mailboxes can be grouped according to the frequency of grayscale testing of different types of applications to obtain multiple mailbox collections, and the mailbox collections are associated with the application type, that is, the testing of different mailbox collections The mailbox can be used for grayscale testing of different types of applications. Therefore, when performing the grayscale test on the target application, the grayscale platform can quickly select and use the test mailbox from the corresponding mailbox set according to the type of the target application for testing.

Further optionally, a backup mailbox set may also be preset to obtain a backup mailbox set including one or more mailboxes. If the number in the target collection is insufficient, you can also select mailboxes from the backup mailbox collection as the target test mailbox.

205. Upload the address of the at least one target test mailbox to the application publishing platform, so that the application publishing platform sends target test invitation links corresponding to the grayscale test to the at least one target test mailbox, respectively.

206. Crawl the target test invitation link of each target test mailbox in the at least one target test mailbox, and monitor the status of the target test invitation link of each target test mailbox, and link the target test invitation link of each target test mailbox The state and the test information of the target application are stored in association.

Among them, the status includes an unsent invitation status, an sent invitation status or an accepted invitation status, etc., and the test information may include any of the target application name, version number, target test mailbox address, and test terminal identification Item or items. By binding the application name, version number, test email address, and the tag status of the invitation link, the same mailbox can be used for grayscale testing of different applications at the same time, which further improves the utilization rate of the test mailbox.

207. Determine, among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link whose status is in the unsent invitation state, and send the target test invitation link in the unsent invitation state to the corresponding to the test information The first test terminal.

The first test terminal may correspond one-to-one with the target test invitation link in the unsent invitation state.

208. Detect whether there is a target test invitation link whose state is in the sent invitation state and whose duration exceeds the preset time threshold in all the target test invitation links.

209. If there is a target test invitation link exceeding the preset time threshold, send the target test invitation link exceeding the preset time threshold to the second test terminal corresponding to the test information.

The second test terminal may correspond to the target test invitation link exceeding the preset time threshold in a one-to-one correspondence.

Specifically, for the description of steps 205-209, reference may be made to the related description of the embodiment shown in FIG. 1 above, and details are not described here.

The purpose of the construction of the gray-scale platform is to allow users to participate in the application (APP) experience test, allowing users to use the experience version of the application to collect whether the new version is defective from the user's usage. Therefore, when selecting the at least one test terminal, optionally, the active users within the preset time range may be determined according to the user's historical experience data of the target application or applications of the same type, such as within the past three months A user who uses the target application (pre-test version) or uses the same application type of the target application whose daily average duration exceeds a preset duration threshold, regards the user as a test user, that is, a terminal corresponding to the user as a test terminal. And/or, optionally, the terminal corresponding to the active user in the region of use (for example, a city) may be selected as the test terminal in combination with the range of the region of use of the target application tested. And/or, optionally, you can also select the user corresponding to the user dimension label as the test user based on the type of new features added to the test (experience) version of the target application. For example, this version mainly adds financial management functions. Then, through the profile data of the back-end user, according to each user dimension label, the user whose user dimension label is wealth management can be selected as the test user, and so on. After selecting the test users, you can actively push the experience messages including the target test invitation link to the terminals corresponding to these users, that is, the test terminals. Thereby, it helps to increase the conversion rate of users participating in the application of gray-scale testing, thereby improving the efficiency of gray-scale testing. Optionally, the first test terminal and the second test terminal may be the above test terminals.

After the test terminal receives the target test invitation link or the push message including the target test invitation link, the test terminal may output a prompt message to prompt the user whether to participate in the experience of the target application, or when the user is detected to open the target application, output the Prompt message used to prompt the user whether to participate in the experience. If the user clicks to participate to receive the user's instruction to click to participate, he can jump to Testflight to participate in the APP experience. Among them, Testflight is the official APP of Apple's official participation in experience testing. All participating experience users need to go to this APP to download the target application to be tested. Optionally, after the user receives the information of the target test invitation link and clicks to participate in the experience, he can jump to a description interface for the target application that participates in the experience, the description interface can display the target application including this update Content, the experience button to jump to Testfligh, and whether the user has installed Testflight and other content. When the user clicks the experience button again, he can directly jump to the system browser Safari to open the target test invitation link. At the same time, the Safari browser can automatically update whether the user has installed Testflight to perform the jump logic: if the user has installed Testflight, you can Jump to Apple's Testflight APP, at the same time, an interface that needs to enter the experience code code can be popped up. At this time, the user can return to the Safari browser interface to copy the experience code and enter it to download the target application for experience. If the user does not install Testflight, Safari can output a guide message to guide the user to install Testfight. After the installation, the interface that needs to enter the experience code is popped up. At this time, the user can return to the Safari browser interface to copy the experience code and enter it, download the target application for experience . In summary, the gray-scale test solution of the present application can reduce the user's cooperation and participation, optimize the user's experience in participating in the gray-scale test, and improve the conversion rate of users' participation in the application of the gray-scale test. It only requires the user to click on the last step to participate, jump to Testflight, enter the experience code, and install the target application of the experience, which can achieve grayscale testing, which greatly improves the user's participation experience.

In this embodiment, the grayscale platform can pre-register mailboxes, group test mailboxes according to the frequency of grayscale testing of different types of applications to obtain multiple mailbox collections, and associate the mailbox collection with the application type, so that When performing the grayscale test on the target application, the grayscale platform can quickly select the test mailbox used from the corresponding mailbox collection according to the type of the target application, so as to obtain the test invitation link through the selected test mailbox, and then pass the monitoring test Invite the link status, store the status of the test invitation link and the test information of the application in association, so as to send the test invitation link to the test terminal according to the status and test information of the test invitation link, so as to realize the grayscale test of the application , Which improves the efficiency of grayscale testing of applications, and enables multiple applications to share test mailboxes, improves the utilization of test mailboxes, and helps reduce the user's cooperation in the entire grayscale experience test and improve users Experience, which in turn improves the conversion rate of users participating in the application experience test.

The above method embodiments are all examples of the grayscale testing method of the present application, and the description of each embodiment has its own emphasis. For a part that is not detailed in an embodiment, please refer to the relevant descriptions of other embodiments.

Please refer to FIG. 3, which is a schematic structural diagram of a server according to an embodiment of the present application. The server in the embodiment of the present application includes a unit for performing the above-mentioned grayscale testing method. Specifically, the server 300 in this embodiment may include: a processing unit 301 and a communication unit 302. among them,

The processing unit 301 is configured to select at least one target test mailbox for performing grayscale testing on the target application from at least one test mailbox registered in advance;

The communication unit 302 is configured to upload the address of the at least one target test mailbox to an application publishing platform, so that the application publishing platform sends target test invitation links corresponding to the grayscale test to the at least one target test mailbox, respectively ;

The processing unit 301 is further configured to separately crawl the target test invitation link of each target test mailbox in the at least one target test mailbox, and monitor the status of the target test invitation link of each target test mailbox. The state of the target test invitation link of each target test mailbox and the test information of the target application are stored in association; wherein, the state includes an unsent invitation state, an sent invitation state, or an accepted invitation state, and the test information Including any one or more of the name of the target application, the version number, the address of the target test mailbox, and the identification of the test terminal;

The communication unit 302 is further configured to respectively send a target test invitation link to at least one test terminal corresponding to the test information according to the status of the target test invitation link of each target test mailbox, the test terminal and the sent The target test invitation links correspond to each other.

Optionally, the processing unit 301 may be specifically configured to determine an application type of the target application, and determine a target mailbox set corresponding to the application type of the target application from a plurality of mailbox sets, the mailbox set One-to-one correspondence with application types, the test mailbox in each mailbox set is used for gray-scale testing of applications of the application type corresponding to the mailbox set; at least one test mailbox is selected from the target mailbox set, and the selected At least one test mailbox serves as the at least one target test mailbox.

Further optionally, the device further includes: a preset unit 303;

The preset unit 303 is configured to determine the test frequency of the application of each application type according to the historical grayscale test information of the application of each application type, and the historical grayscale test information includes the time and number of historical grayscale tests and Any one or more of the version numbers; according to the test frequency of the applications of the respective application types, preset preset mailbox sets corresponding to the respective application types to obtain the multiple mailbox sets;

The number of test mailboxes included in the mailbox set corresponding to the first application type in the plurality of mailbox sets is greater than the number of test mailboxes included in the mailbox set corresponding to the second application type, and the test frequency of the application of the first application type Higher than the test frequency of the application of the second application type.

Optionally, the processing unit 301 may be specifically used to obtain load information of each test mailbox in at least one test mailbox registered in advance, and the load information includes the number of processes participating in the grayscale test; participation according to each test mailbox In the order of the number of grayscale tests from low to high, the at least one target test mailbox is selected from the respective test mailboxes.

Optionally, the communication unit 302 may be specifically configured to determine, among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link whose status is in an unsent invitation state, and set the status to unsent The target test invitation link in the invitation state is sent to the first test terminal corresponding to the test information, and the first test terminal corresponds to the target test invitation link in the unsent invitation state;

The processing unit 301 may be further configured to detect whether there is a target test invitation link whose state is in the sent invitation state and whose duration exceeds the preset time threshold in all the target test invitation links;

The communication unit 302 may be further specifically configured to send the target test invitation link exceeding the preset time threshold to the corresponding to the test information when there is a target test invitation link exceeding the preset time threshold A second test terminal, which corresponds one-to-one with the target test invitation link exceeding the preset time threshold.

Optionally, the processing unit 301 may be further configured to delete all target test invitation links and the test information when the status of all target test invitation links corresponding to the at least one target test mailbox is an accepted invitation state.

Optionally, the processing unit 301 can also be used to delete the address of the target test mailbox from the application publishing platform when the status of all test invitation links corresponding to any target test mailbox is the state of accepted invitation.

Specifically, the server may implement part or all of the steps in the grayscale testing method in the embodiments shown in FIG. 1 to FIG. 2 through the above unit. It should be understood that the embodiments of the present application are device embodiments corresponding to the method embodiments, and the description of the method embodiments is also applicable to the embodiments of the present application.

Please refer to FIG. 4, which is a schematic structural diagram of another server provided by an embodiment of the present application. The server is used to perform the above method. As shown in FIG. 4, the server 400 in this embodiment may include: one or more processors 401, a memory 402, and a communication interface 403. Optionally, the server may also include one or more user interfaces 404. The processor 401, the communication interface 403, the user interface 404, and the memory 402 may be connected through the bus 405, or may be connected through other methods. The bus method is used as an example in FIG. The memory 402 may be used to store a computer program, where the computer program includes program instructions, and the processor 401 is used to execute the program instructions stored in the memory 402. The processor 401 may be used to call the program instructions to perform some or all of the steps in FIGS. 1 to 2 described above.

For example, the processor 401 may be used to call the program instructions to perform the following steps: select at least one target test mailbox for gray-scale testing of the target application from at least one pre-registered test mailbox, and test the at least one target test mailbox Upload the address of the mailbox to the application publishing platform, so that the application publishing platform sends the target test invitation link corresponding to the grayscale test to the at least one target test mailbox; crawl each of the at least one target test mailbox A target test invitation link of a target test mailbox, and monitor the status of the target test invitation link of each target test mailbox, and compare the status of the target test invitation link of each target test mailbox and the test information of the target application Perform associative storage; wherein the status includes an unsent invitation status, an sent invitation status, or an accepted invitation status, and the test information includes the target application name, version number, target test mailbox address, and test terminal identification Any one or more of; according to the status of the target test invitation link of each target test mailbox, call the communication interface 403 to send the target test invitation link to at least one test terminal corresponding to the test information, the test There is a one-to-one correspondence between the terminal and the sent target test invitation link.

Optionally, the processor 401 may specifically perform the following steps when executing the at least one target test mailbox selected for pre-registering at least one test mailbox for grayscale testing of the target application:

The application type of the target application is determined, and a target mailbox set corresponding to the application type of the target application is determined from a plurality of mailbox collections, the mailbox set corresponds one-to-one with the application type, and the test in each mailbox collection The mailbox is used for the grayscale test of the application type corresponding to the mailbox collection;

At least one test mailbox is selected from the target mailbox set, and the selected at least one test mailbox is used as the at least one target test mailbox.

Optionally, the processor 401 may also perform the following steps:

The test frequency of the applications of each application type is determined according to the historical grayscale test information of the applications of each application type, and the historical grayscale test information includes any one or more of the time, the number of times, and the version number of the historical grayscale test item;

According to the test frequency of the application of each application type, preset preset mailbox sets corresponding to each application type to obtain the multiple mailbox sets;

Obtain the load information of each test mailbox in at least one test mailbox registered in advance, where the load information includes the number of processes participating in the grayscale test;

The at least one target test mailbox is selected from each test mailbox according to the order in which the number of processes of each test mailbox participating in the grayscale test is from low to high.

Optionally, when the processor 401 executes the state of the target test invitation link according to each target test mailbox, and calls the communication interface 403 to send the target test invitation link to at least one test terminal corresponding to the test information, The following steps can be performed specifically:

Determine that among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link in the state of unsent invitation, and call the communication interface 403 to send the target test invitation link in the state of unsent invitation to all A first test terminal corresponding to the test information, the first test terminal corresponds to the target test invitation link in an unsent invitation state;

Detect whether there is a target test invitation link in the state of being in the state of sent invitation in all the target test invitation links;

If there is a target test invitation link exceeding the preset time threshold, call the communication interface 403 to send the target test invitation link exceeding the preset time threshold to the second test terminal corresponding to the test information, the first Two test terminals have a one-to-one correspondence with the target test invitation links that exceed the preset time threshold.

Optionally, the processor 401 may also perform the following steps:

When the status of all target test invitation links corresponding to the at least one target test mailbox is an accepted invitation state, delete all target test invitation links and the test information.

Optionally, the processor 401 may also perform the following steps:

When the status of all test invitation links corresponding to any target test mailbox is the status of accepted invitation, the address of the target test mailbox is deleted from the application publishing platform.

Wherein, the processor 401 may be a central processing unit (Central Processing Unit, CPU), and the processor may also be other general-purpose processors, digital signal processors (Digital Signal Processors, DSPs), application specific integrated circuits (Application Specific Integrated) Circuit, ASIC), ready-made programmable gate array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The communication interface 403 may include a receiver and a transmitter for communicating with other devices such as test terminals.

The user interface 404 may include an input device and an output device. The input device may include a touch panel, a microphone, and the like, and the output device may include a display (LCD, etc.), a speaker, and the like.

The memory 402 may include a read-only memory and a random access memory, and provide instructions and data to the processor 401. A portion of the memory 402 may also include non-volatile random access memory. For example, the memory 402 may also store the aforementioned correspondence between the function pointer and the function, and so on.

In a specific implementation, the processor 401 and the like described in the embodiments of the present application can execute the implementation described in the method embodiments shown in FIG. 1 to FIG. 2 above, and can also execute each of the methods described in FIG. 3 of the embodiment of the present application. The implementation of the unit is not repeated here.

An embodiment of the present application also provides a computer-readable storage medium that stores a computer program, and when the computer program is executed by a processor, the computer program can be implemented as described in the embodiments corresponding to FIG. 1 to FIG. 2 Part or all of the steps in the grayscale test method may also realize the function of the server of the embodiment shown in FIG. 3 or FIG. 4 of the present application, which will not be repeated here.

Embodiments of the present application also provide a computer program product containing instructions, which when run on a computer, causes the computer to perform some or all of the steps in the above method.

The computer-readable storage medium may be an internal storage unit of the server according to any one of the foregoing embodiments, such as a hard disk or a memory of the server. The computer-readable storage medium may also be an external storage device of the server, such as a plug-in hard disk equipped on the server, a smart memory card (Smart) Media (SMC), and a secure digital (SD) card , Flash card (Flash Card), etc.

In this application, the term "and/or" is merely an association relationship that describes an associated object, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, and A and B exist at the same time. There are three cases of B alone. In addition, the character "/" in this article generally indicates that the related objects before and after are in an "or" relationship. The size of the sequence numbers of the above processes does not mean that the execution order is sequential, and the execution order of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

The above is only part of the implementation of this application, but the scope of protection of this application is not limited to this, any person skilled in the art can easily think of various equivalents within the technical scope disclosed in this application Modifications or replacements, these modifications or replacements should be covered within the scope of protection of this application.

Claims

A grayscale testing method, which is characterized by including:

Selecting at least one target test mailbox for grayscale testing of the target application from the at least one test mailbox registered in advance, and uploading the address of the at least one target test mailbox to the application publishing platform, so that the application publishing platform Sending target test invitation links corresponding to the grayscale test to the at least one target test mailbox respectively;

Crawl the target test invitation link of each target test mailbox in the at least one target test mailbox separately, and monitor the status of the target test invitation link of each target test mailbox, and test the target test of each target test mailbox The state of the invitation link is stored in association with the test information of the target application; wherein the state includes an unsent invitation state, a sent invitation state, or an accepted invitation state, and the test information includes the name and version of the target application Any one or more of the number, the address of the target test mailbox and the identification of the test terminal;

According to the status of the target test invitation link of each target test mailbox, a target test invitation link is sent to at least one test terminal corresponding to the test information, and the test terminals correspond to the sent target test invitation link in one-to-one correspondence.
The method according to claim 1, wherein the selecting at least one target test mailbox for performing a grayscale test on the target application from at least one pre-registered test mailbox includes:

The application type of the target application is determined, and a target mailbox set corresponding to the application type of the target application is determined from a plurality of mailbox collections, the mailbox set corresponds one-to-one with the application type, and the test in each mailbox collection The mailbox is used for the grayscale test of the application type corresponding to the mailbox collection;

At least one test mailbox is selected from the target mailbox set, and the selected at least one test mailbox is used as the at least one target test mailbox.
The method according to claim 2, wherein the method further comprises:

The test frequency of the applications of each application type is determined according to the historical grayscale test information of the applications of each application type, and the historical grayscale test information includes any one or more of the time, the number of times, and the version number of the historical grayscale test item;

According to the test frequency of the application of each application type, preset preset mailbox sets corresponding to each application type to obtain the multiple mailbox sets;

The number of test mailboxes included in the mailbox set corresponding to the first application type in the plurality of mailbox sets is greater than the number of test mailboxes included in the mailbox set corresponding to the second application type, and the test frequency of the application of the first application type Higher than the test frequency of the application of the second application type.
The method according to claim 1, wherein the selecting at least one target test mailbox for performing a grayscale test on the target application from at least one pre-registered test mailbox includes:

Obtain the load information of each test mailbox in at least one test mailbox registered in advance, where the load information includes the number of processes participating in the grayscale test;

The at least one target test mailbox is selected from each test mailbox according to the order of the number of processes of the test mailboxes participating in the grayscale test from low to high.
The method according to any one of claims 1 to 4, wherein, according to the status of the target test invitation link of each target test mailbox, targets are respectively sent to at least one test terminal corresponding to the test information Test invitation links, including:

Determine that among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link with the status of unsent invitation, and send the target test invitation link with the status of unsent invitation to the corresponding test information The first test terminal, the first test terminal corresponds to the target test invitation link in the unsent invitation state;

Detect whether there is a target test invitation link in the state of being in the state of sent invitation in all the target test invitation links;

If there is a target test invitation link that exceeds the preset time threshold, send the target test invitation link that exceeds the preset time threshold to the second test terminal corresponding to the test information, and the second test terminal is The target test invitation links exceeding the preset time threshold are in one-to-one correspondence.
The method according to any one of claims 1-4, wherein the method further comprises:

When the status of all target test invitation links corresponding to the at least one target test mailbox is an accepted invitation state, delete all target test invitation links and the test information.
The method according to any one of claims 1-4, wherein the method further comprises:

When the status of all test invitation links corresponding to any target test mailbox is the status of accepted invitation, the address of the target test mailbox is deleted from the application publishing platform.
The method according to any one of claims 1-4, wherein the method further comprises:

Select a user terminal whose average daily duration exceeds the preset duration threshold as the test terminal according to the average daily duration of the target application or an application using the same application type of the target application within a preset time range; and/or,

Selecting user terminals within the range of the use area as test terminals according to the range of the use area of the target application; and/or,

According to the type of the newly added function of the test version of the target application, the user terminal corresponding to the user dimension label corresponding to the type is selected as the test terminal.
A server, characterized by comprising: a processing unit and a communication unit;

The processing unit is configured to select at least one target test mailbox for performing grayscale testing on the target application from at least one test mailbox registered in advance;

The communication unit is configured to upload the address of the at least one target test mailbox to an application publishing platform, so that the application publishing platform sends target test invitations corresponding to the grayscale test to the at least one target test mailbox, respectively link;

The processing unit is further configured to separately crawl the target test invitation link of each target test mailbox in the at least one target test mailbox, and monitor the status of the target test invitation link of each target test mailbox. The state of the target test invitation link of each target test mailbox is stored in association with the test information of the target application; wherein, the state includes an unsent invitation state, a sent invitation state, or an accepted invitation state, and the test information includes Any one or more of the name, version number, address of the target test mailbox and the identification of the test terminal of the target application;

The communication unit is further configured to respectively send a target test invitation link to at least one test terminal corresponding to the test information according to the status of the target test invitation link of each target test mailbox, the test terminal and the sent target The test invitation links correspond to each other.
The server according to claim 9, wherein when the processing unit selects at least one target test mailbox for gray-scale testing of the target application from at least one pre-registered test mailbox, it is specifically used to:

The application type of the target application is determined, and a target mailbox set corresponding to the application type of the target application is determined from a plurality of mailbox collections, the mailbox set corresponds one-to-one with the application type, and the test in each mailbox collection The mailbox is used for the grayscale test of the application type corresponding to the mailbox collection;

At least one test mailbox is selected from the target mailbox set, and the selected at least one test mailbox is used as the at least one target test mailbox.
The server according to claim 10, further comprising: a preset unit;

The preset unit is used to determine the test frequency of the application of each application type according to the historical grayscale test information of the application of each application type, and the historical grayscale test information includes the time, number and version of the historical grayscale test Any one or more of the numbers; according to the test frequency of the applications of the respective application types, preset preset mailbox sets corresponding to the respective application types to obtain the multiple mailbox sets;

The number of test mailboxes included in the mailbox set corresponding to the first application type in the plurality of mailbox sets is greater than the number of test mailboxes included in the mailbox set corresponding to the second application type, and the test frequency of the application of the first application type Higher than the test frequency of the application of the second application type.
The server according to claim 9, wherein when the processing unit selects at least one target test mailbox for gray-scale testing of the target application from at least one pre-registered test mailbox, it is specifically used to:

Obtain the load information of each test mailbox in at least one test mailbox registered in advance, where the load information includes the number of processes participating in the grayscale test;

The at least one target test mailbox is selected from each test mailbox according to the order in which the number of processes of each test mailbox participating in the grayscale test is from low to high.
The server according to any one of claims 9-12, characterized in that

The communication unit is specifically configured to determine, among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link whose state is in the state of unsent invitation, and invite the target test invitation in the state of unsent invitation The link is sent to the first test terminal corresponding to the test information, and the first test terminal has a one-to-one correspondence with the target test invitation link in the unsent invitation state;

The processing unit is further configured to detect whether there is a target test invitation link whose status is in the sent invitation state and exceeds a preset time threshold in all the target test invitation links;

The communication unit is specifically configured to send the target test invitation link exceeding the preset time threshold to the second test corresponding to the test information when there is a target test invitation link exceeding the preset time threshold Terminal, the second test terminal corresponds one-to-one with the target test invitation link exceeding the preset time threshold.
The server according to any one of claims 9-12, characterized in that

The processing unit is further configured to select a user terminal whose average daily duration exceeds a preset duration threshold as a test according to the average daily duration of the target application or an application using the same application type of the target application within a preset time range Terminal; and/or,

The processing unit is further configured to select a user terminal within the range of the use area as a test terminal according to the range of the use area of the target application; and/or,

The processing unit is further used to select a user terminal corresponding to the user dimension label of the type as the test terminal according to the type of the newly added function of the test version of the target application.
A server, characterized by comprising a processor, a communication interface and a memory, wherein the processor, the communication interface and the memory are connected to each other, wherein the memory is used to store a computer program, and the computer program includes a program Instructions, the processor is configured to call the program instructions and perform the following steps:

Selecting at least one target test mailbox for grayscale testing of the target application from the at least one test mailbox registered in advance, and uploading the address of the at least one target test mailbox to the application publishing platform, so that the application publishing platform Sending target test invitation links corresponding to the grayscale test to the at least one target test mailbox respectively;

Crawl the target test invitation link of each target test mailbox in the at least one target test mailbox separately, and monitor the status of the target test invitation link of each target test mailbox, and test the target test of each target test mailbox The state of the invitation link is stored in association with the test information of the target application; wherein the state includes an unsent invitation state, a sent invitation state, or an accepted invitation state, and the test information includes the name and version of the target application Any one or more of the number, the address of the target test mailbox and the identification of the test terminal;

According to the status of the target test invitation link of each target test mailbox, a target test invitation link is sent to at least one test terminal corresponding to the test information, and the test terminals correspond to the sent target test invitation link in one-to-one correspondence.
The server according to claim 15, wherein the processor specifically executes when executing the at least one target test mailbox selected for pre-registering at least one test mailbox for gray-scale testing of the target application The following steps:

The application type of the target application is determined, and a target mailbox set corresponding to the application type of the target application is determined from a plurality of mailbox collections, the mailbox set corresponds one-to-one with the application type, and the test in each mailbox collection The mailbox is used for the grayscale test of the application type corresponding to the mailbox collection;

At least one test mailbox is selected from the target mailbox set, and the selected at least one test mailbox is used as the at least one target test mailbox.
The server according to claim 15, wherein the processor specifically executes when executing the at least one target test mailbox selected for pre-registering at least one test mailbox for gray-scale testing of the target application The following steps:

Obtain the load information of each test mailbox in at least one test mailbox registered in advance, where the load information includes the number of processes participating in the grayscale test;

The at least one target test mailbox is selected from each test mailbox according to the order in which the number of processes of each test mailbox participating in the grayscale test is from low to high.
The server according to any one of claims 15 to 17, wherein the processor executes the state of the target test invitation link according to each target test mailbox, respectively When at least one test terminal sends the target test invitation link, specifically perform the following steps:

Determine that among all the target test invitation links corresponding to the at least one target test mailbox, the target test invitation link with the status of unsent invitation, and send the target test invitation link with the status of unsent invitation to the corresponding test information The first test terminal, the first test terminal corresponds to the target test invitation link in the unsent invitation state;

Detect whether there is a target test invitation link in the state of being in the state of sent invitation in all the target test invitation links;

If there is a target test invitation link that exceeds the preset time threshold, send the target test invitation link that exceeds the preset time threshold to the second test terminal corresponding to the test information, and the second test terminal is The target test invitation links exceeding the preset time threshold are in one-to-one correspondence.
The server according to any one of claims 15-17, wherein the processor further performs the following steps:

Select a user terminal whose average daily duration exceeds the preset duration threshold as the test terminal according to the average daily duration of the target application or an application using the same application type of the target application within a preset time range; and/or,

Selecting user terminals within the range of the use area as test terminals according to the range of the use area of the target application; and/or,

According to the type of the newly added function of the test version of the target application, the user terminal corresponding to the user dimension label corresponding to the type is selected as the test terminal.
A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program includes program instructions, which when executed by a processor cause the processor to execute as rights The method according to any one of claims 1 to 8.