CN108900382B

CN108900382B - Test method and device thereof

Info

Publication number: CN108900382B
Application number: CN201810790961.5A
Authority: CN
Inventors: 杨阳
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2018-07-18
Filing date: 2018-07-18
Publication date: 2021-10-26
Anticipated expiration: 2038-07-18
Also published as: CN108900382A

Abstract

The embodiment of the application provides a test method and a device thereof, wherein the method comprises the following steps: acquiring a title list (comprising one or more title information and answer information for interacting with audience users) corresponding to a live video; in the process of playing the live video, performing answer interaction with a plurality of audience users according to the question list; acquiring pressure parameters in an answer interaction process, wherein the pressure parameters comprise any one or more of the following items: the method comprises the steps of sending question information to audience users, receiving a first pressure parameter when the audience users send the question information, receiving a second pressure parameter when the audience users send interactive information fed back according to the question information, carrying out result statistics on the interactive information fed back by the audience users according to the question information, and sending answer information corresponding to the question information to the audience users; and outputting a pressure test result according to the pressure parameter in the answering interaction process. By adopting the method and the device, the pressure test can be automatically carried out on the whole process of the direct-broadcasting answer item.

Description

Test method and device thereof

Technical Field

The invention relates to the technical field of computers, in particular to a testing method and a testing device.

Background

With the development of computer technology and internet technology, various applications have come to be developed, and among them, video applications are popular with users, such as short video applications and live video applications. Currently, some live applications provide live answer items in addition to live items, and live answer items attract tens of thousands of users and even millions of users to participate in answering questions.

In the face of increasing the number of users participating in live answer, before the live answer item is applied online, the live answer item needs to be subjected to pressure test so as to avoid the situations that the users cannot participate, technical faults cause temporary cancellation, a server cannot respond and the like.

Currently, the method for performing a pressure test on an application program is a single-interface pressure test, that is, a pressure test is performed on each interface related to the application program, and a pressure test result of each interface is output, when the pressure test is performed on each interface, a tester interferes in the test process, for example, after the pressure test on the interface 1 is completed, the tester starts to perform the pressure test on the interface 2. If the single-interface pressure test is adopted to carry out the pressure test on the live broadcast answer item, manual intervention is needed to execute the pressure test, and the obtained pressure test result of each interface cannot truly reflect the pressure test result of the whole flow of the live broadcast answer item.

Disclosure of Invention

The testing method and the testing device provided by the invention do not need manual intervention, can automatically carry out pressure testing on the whole process of the direct broadcasting answering project, and can truly reflect the pressure testing result of the whole process of the direct broadcasting answering.

A first aspect of an embodiment of the present application provides a test method, including:

acquiring a topic list corresponding to a live video, wherein the topic list comprises one or more topic information used for interacting with audience users and answer information corresponding to the topic information;

in the process of playing the live video, performing answer interaction with a plurality of audience users according to the question list;

obtaining pressure parameters in the answer interaction process, wherein the pressure parameters comprise any one or more of the following items: a first pressure parameter when the topic information is issued to the audience user, a second pressure parameter when the audience user feeds back interactive information according to the topic information, a third pressure parameter when the audience user carries out result statistics according to the interactive information fed back by the topic information, and a fourth pressure parameter when answer information corresponding to the topic information is issued to the audience user;

and outputting a pressure test result according to the pressure parameter in the answer interaction process.

Optionally, the performing, according to the question list, answer interaction with a plurality of audience users includes:

issuing ith topic information to a plurality of audience users, wherein the ith topic information is any topic information in the topic list, and i is an integer greater than or equal to 1;

receiving interactive information fed back by the audience user according to the ith topic information;

carrying out result statistics on the interactive information fed back by the audience user according to the ith topic information;

and issuing answer information corresponding to the ith topic information to the audience user.

Optionally, if the ith topic information is not the last topic information in the topic list, after issuing answer information corresponding to the ith topic information to the audience user, the method further includes:

issuing (i + 1) th topic information to the plurality of audience users; receiving interactive information fed back by the audience user according to the (i + 1) th topic information; carrying out result statistics on the interactive information fed back by the audience user according to the (i + 1) th topic information; and issuing answer information corresponding to the (i + 1) th topic information to the audience user.

Optionally, if the ith topic information is the last topic information in the topic list, after issuing answer information corresponding to the ith topic information to the audience user, the method further includes:

and issuing an interactive notification of answering ending to the audience user.

Optionally, the issuing of the ith topic information to a plurality of audience users includes:

and if the ith topic information is the first topic information in the topic list, issuing the first topic information to the audience user when the current system time is the same as the answer starting time of the live broadcast video.

Optionally, the method further includes:

creating a target session;

the outputting of the pressure test result according to the pressure parameter in the answer interaction process comprises:

and outputting the pressure test result of the target field according to the pressure parameters in the answering interaction process.

Optionally, the method further includes:

deleting the target field;

and creating a next field, wherein the time interval between the creation of the next field and the creation of the target field is a preset time interval.

In a second aspect, embodiments of the present application provide a test apparatus, which includes a processing unit and an output unit,

the processing unit is used for acquiring a topic list corresponding to a live video, wherein the topic list comprises one or more topic information used for interacting with audience users and answer information corresponding to the topic information;

the processing unit is further used for conducting answer interaction with a plurality of audience users according to the question list in the process of playing the live video;

the processing unit is further configured to obtain a pressure parameter in the answer interaction process, where the pressure parameter includes any one or more of the following: a first pressure parameter when the topic information is issued to the audience user, a second pressure parameter when the audience user feeds back interactive information according to the topic information, a third pressure parameter when the audience user carries out result statistics according to the interactive information fed back by the topic information, and a fourth pressure parameter when answer information corresponding to the topic information is issued to the audience user;

and the output unit is used for outputting a pressure test result according to the pressure parameter in the answer interaction process.

Optionally, the apparatus further comprises a communication unit;

the processing unit is configured to, when performing answer interaction with multiple audience users according to the question list, specifically control the communication unit to issue an ith question information to the multiple audience users, where the ith question information is any one of the question information in the question list, and i is an integer greater than or equal to 1; a control communication unit receives interactive information fed back by the audience user according to the ith topic information; carrying out result statistics on the interactive information fed back by the audience user according to the ith topic information; and controlling a communication unit to issue answer information corresponding to the ith topic information to the audience user.

Optionally, if the ith topic information is not the last topic information in the topic list, the processing unit is configured to control the communication unit to issue an i +1 th topic information to the multiple audience users after the communication unit issues answer information corresponding to the ith topic information to the audience users; controlling the communication unit to receive interactive information fed back by the audience user according to the (i + 1) th topic information; carrying out result statistics on the interactive information fed back by the audience user according to the (i + 1) th topic information; and controlling the communication unit to issue answer information corresponding to the (i + 1) th topic information to the audience user.

Optionally, if the ith topic information is the last topic information in the topic list, the processing unit is configured to control the communication unit to issue an answer information corresponding to the ith topic information to the audience user, and then is further configured to control the communication unit to issue an answer-ending interaction notification to the audience user.

Optionally, the processing unit is configured to control the communication unit to issue an ith topic information to a plurality of audience users, and specifically, if the ith topic information is a first topic information in the topic list, issue the first topic information to the audience users when a current system time is the same as a time for starting answering a live video.

Optionally, the processing unit is further configured to create a target session;

and the output unit is used for outputting the pressure test result of the target field according to the pressure parameter in the answer interaction process when outputting the pressure test result according to the pressure parameter in the answer interaction process.

A third aspect of embodiments of the present application provides a testing apparatus, comprising a processor, an input module, an output module, a communication interface, and a memory, wherein the memory stores a computer program comprising program instructions, and the processor is configured to invoke the program code to perform the method of the first aspect.

A fourth aspect of embodiments of the present application provides a computer-readable storage medium having stored thereon a computer program comprising program instructions which, when executed by a test apparatus, cause the test apparatus to perform the method of the first aspect.

By adopting the embodiment of the application, the question list corresponding to the live broadcast video is acquired, the process of playing the live broadcast video is summarized, answer interaction is carried out on the questions and a plurality of audience users according to the question list, the pressure parameter in the answer interaction process is acquired, and the pressure test result is output according to the pressure parameter in the answer interaction process, so that the pressure test can be automatically carried out on the whole flow of the live broadcast answer item, and the pressure test result of the whole flow of the live broadcast answer can be truly reflected.

Drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.

FIG. 1 is a schematic diagram of a system architecture to which embodiments of the present application are applied;

fig. 2 is a schematic flowchart of a testing method according to an embodiment of the present disclosure;

fig. 3 is a schematic diagram illustrating a process of performing answer interaction between the testing device and a plurality of audience users according to the question list according to the embodiment of the present application;

FIG. 4 is an exemplary diagram of an interface for a client to output first topic information;

FIG. 5 is an exemplary diagram of an interface for a viewer user to input selection instructions based on first topic information;

FIG. 6a is an exemplary diagram of an interface for a client to output answer information corresponding to a first topic information;

FIG. 6b is a diagram illustrating another example of an interface for a client to output answer information corresponding to a first topic information;

FIG. 7 is a schematic diagram of a logic structure of a test apparatus according to an embodiment of the present disclosure;

fig. 8 is a schematic physical structure diagram of a testing apparatus according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.

In this embodiment of the application, the live question answering item may be an independent application, the application realizes a live question answering function, or may be a functional module embedded in the live application, the functional module may realize live question answering, or may be a functional module embedded in the H5 page, and the functional module may realize live question answering.

At present, live broadcast answer items are more and more hot, attract more and more users to participate in, and the item has characteristics such as high pressure, high concurrency, real-time, so live broadcast answer items need to be carried out the pressure test before online application to avoid the appearance of the condition such as unable participation of user, technical fault lead to compelled to cancel temporarily, server unable response.

In view of the disadvantages of the single-interface pressure testing scheme, the embodiment of the application provides a testing method and a device thereof, which can automatically perform pressure testing on the whole process of a direct-broadcast answering project without manual intervention, and can truly reflect the pressure testing result of the whole process of the direct-broadcast answering.

The testing method and the testing device provided by the embodiment of the application can be applied to a scene of performing pressure testing on a live answer item before the live answer item is online. The testing method provided by the embodiment of the application is used for carrying out pressure testing on the whole process, so that the pressure testing result of the whole process of live broadcasting answer can be truly reflected, so that testers can know the pressure and risk of the server in advance, and a scheme for dealing with the pressure and risk is prepared in advance. The testing method and the device thereof can also be applied to the scene of pressure testing on items similar to the live broadcast answering items.

It can be understood that the test method provided in the embodiment of the present application is an interface test method, and the interface test method is mainly used for detecting interaction points between external systems and between internal subsystems, and the test is mainly to check data exchange, transmission, control and management processes, mutual logical dependency relationships between systems, and the like. The interface testing method is applied to the embodiment of the application and is used for carrying out pressure testing on the interface between the server and the live broadcast answer item and the interaction point inside the live broadcast answer item so as to judge whether the server can bear the pressure brought by the live broadcast answer item in the operation process.

Please refer to fig. 1, which is a schematic diagram of a system architecture to which the embodiments of the present application are applied. The system may include a testing device 101, a server 102, and a client 103. It should be noted that the form and number of the devices shown in fig. 1 are only for example and do not constitute a limitation to the embodiments of the present application, for example, in practical applications, the number of the servers 102 is more than one, and the number of the clients is more than three.

The testing apparatus 101 may be a personal computer, a desktop computer, or the like, and is configured to execute the testing method provided in the embodiment of the present application. The tester can input the script file of the live answer item to be tested into the testing device 101 in advance, so that the testing device 101 can perform the stress test on the script file. The testing device 101 stores a script file for executing the testing method provided by the embodiment of the application, and when a testing instruction input by a tester is received, the testing device 101 can call the script file to perform a pressure test on the script file of a live-broadcast answer item to be tested.

The testing device 101 may generate a plurality of virtual users for simulating the plurality of users entering the live answering room to participate in the answering interaction process, and the magnitude of the plurality of virtual users may be millions or even tens of millions, so that the testing device 101 may test the pressure on the server 102 when the millions or even tens of millions of users participate in the answering interaction process.

In the process of executing the test method provided by the embodiment of the present application, the server 102 provides support for the test apparatus 101, for example, the server 102 responds to a request sent by the test apparatus 101 and returns data to the test apparatus 101 according to the request, and the server 102 may further send a pressure parameter to the test apparatus 101, where the pressure parameter may be used to reflect pressure performance of the server 102 in the test process, and may include parameters such as response time, average number of Transactions Per Second (TPS), maximum TPS, and response success rate.

One or more interfaces, one of which may provide a service, may be deployed on the server 102, and the interface may be a Common Gateway Interface (CGI). The server 102 may be a service cluster including a plurality of services, and for example, may include a service for issuing a topic, a service for receiving a user submitted answer, a service for counting the submitted services of the user and a service for issuing a topic answer, and the like.

The client 103 can run a live answer item, and a user can log in an account and a password on the live answer item to enter a live answer room to participate in live answer. The client 103 may be a user device such as a smart phone or a tablet computer. The user of the client 103 can be a tester, the tester can participate in any field of the live broadcast answer item through the client 103, and can enter the field at any time point to experience the conditions of each scene such as before answer opening, during answer making, answer ending and the like in the field, so as to simulate the experience of the user after the live broadcast answer item is on line, and the tester can truly experience the live broadcast answer item in the whole course, so that the tester can find the problems existing in the experience process, for example, whether the tester is forced to exit a live broadcast answer room and the like.

Referring to fig. 2, a schematic flow chart of a testing method provided in the embodiment of the present application is shown, where the method may include, but is not limited to, the following steps:

step S201, a title list corresponding to the live video is obtained.

The topic list includes one or more topic information used for interacting with the audience users and answer information corresponding to the topic information, that is, the topic list includes one or more topic information and answer information corresponding to each topic information, and the topic information is used for interacting with the audience users, for example, issue the topic information to the audience users, and the audience users submit answers for the topic information. The topic information can include a topic and topic options, such as what is meant by a topic information in zantedier? The A red bag comes B to be happy to prosper C until D is no better. The answer information corresponding to the question information refers to a correct answer to the question, for example, the answer information corresponding to the question information is good luck and happiness, that is, good luck and happiness is a correct answer to the question. In the embodiment of the application, the topic list is introduced by taking 12 pieces of topic information and answer information corresponding to each topic information as an example, and the 12 pieces of topic information can be sorted according to the difficulty level or other rules.

The testing device 101 obtains a live video and obtains a title list corresponding to the live video.

In a possible implementation manner, the testing device 101 may obtain a live video from a platform configured with live videos, where the platform configured with live videos may configure a plurality of live videos, where one live video corresponds to one session, that is, one live video may be played in one session, and an entire live video may complete 12-channel answering interaction, that is, 12-channel answering interaction in one session.

In a possible implementation manner, the testing device 101 may obtain 12 title information and answer information corresponding to each of the 12 title information from a database, and use the obtained answer information as a title list corresponding to the live video, where the title list corresponding to the live video is a title list that needs to be played in the live video. The database may be a question bank corresponding to a live question answering project, a question bank generated by the testing device 101, or a question bank edited by a tester on the testing device 101. Alternatively, the testing device 101 may randomly generate 12 title information and corresponding answer information, and use the title information as a title list corresponding to the live video.

The testing device 101 may create a session for the live video, which is referred to as a target session, and the topic list corresponding to the live video is also referred to as a topic list corresponding to the target session.

When the test device 101 acquires the topic list, the test device can upload the topic list to the server 102, so that the server 102 can respond to the request for issuing the topic information sent by the test device 101.

Step S202, in the process of playing the live video, performing answer interaction with a plurality of audience users according to the question list.

Where the number of audience users may be on the order of millions or even tens of millions, with the number being input by the tester in setting the test parameters. The plurality of audience users may include virtual users generated by the testing apparatus 101, and may also include users of the client 103 shown in fig. 1, i.e., real users. The testing device 101 may obtain the virtual user id and the real user id generated by the testing device 101 from a database or a memory of the testing device 101, and perform answer interaction with multiple audience users according to the obtained virtual user id and real user id.

In the process of playing the live video, that is, in the process of playing the live video by the testing device 101, in the process, the live answer item running on the client 103 also plays the live video synchronously.

The live video may be set with time to start answering, time to issue each item information, time difference between issue of the item information and the latest answer submitted by the user, time difference between issue of the item information and issue of the answer information, and the like, so that the testing device 101 performs answer interaction with a plurality of audience users according to the set time point and time difference in the process of playing the live broadcast.

The process of the testing device 101 performing answer interaction with a plurality of audience users according to the question list can be seen in fig. 3, and the flow shown in fig. 3 may include the following steps:

step S301, issue the ith topic information to the audience users.

Wherein i is an integer greater than or equal to 1, and for example, for 12 titles, i is an integer greater than or equal to 1 and less than or equal to 12.

When the current system time is the same as the answer start time set by the live video, the testing device 101 may issue the first topic information in the topic list to a plurality of audience users, that is, i is equal to 1. It can be understood that the issuing time of the first title information is the same as the starting answer time set by the live video, and when the current system time does not reach the starting answer time set by the live video, other contents of the live video are played, for example, speech interaction between a main broadcast or a host and audience users is played. If i is not equal to 1, the testing device 101 issues the ith topic information to a plurality of audience users when the current system time reaches the issue time of each topic information set in the live video.

The test device 101 issues the ith topic information to a plurality of audience users, and for a client that logs in the real user identifier, the client can receive the ith topic information and output the ith topic information, so that the real user can input the answer of the ith topic in the client.

In one example, see FIG. 4, an exemplary diagram of an interface for outputting first topic information for a client. The portrait shown in fig. 4 may be a living broadcast or a host of the session, and is responsible for playing title information to the audience users, performing verbal interaction with the audience users, and the like, and the interface example shown in fig. 4 may further include information, such as interactive characters, emoticons, gifts, and the like, input by the audience users. It should be noted that the exemplary interface diagram shown in fig. 4 is only for example and is not to be construed as limiting the embodiments of the present application.

In a possible implementation manner, the testing device 101 issues the first topic information to the N audience users when the current system time is the same as the time for starting answering set by the live video, and if M audience users in the N audience users submit correct answers (M is less than or equal to N, and M and N are positive integers), the testing device 101 issues the second topic information to the M audience users when the current system time is the same as the time for issuing the second topic information set by the live video, and so on until the last topic information in the topic list is issued. It can be understood that only audience users who answer a first question have an opportunity to participate in answering a second question, so that the audience users cannot know the question information of a next question when answering a wrong question, and cheating among the users can be prevented to a certain extent. If no audience user answers a certain question under the condition that the question information is not completely issued, the testing device 101 may issue an answer-ending interactive notification to all audience users of the target session, that is, notify the audience users that the answer of the target session is ended, and at this time, the testing device 101 may delete the target session.

In a possible implementation manner, the testing device 101 issues topic information to the same number of audience users each time, so that it can be ensured that the pressure of the users issuing topic information each time is the same, and further, the pressure parameter of the server can be better tested.

When executing step S301, the test apparatus 101 sends a topic information issue request to the server 102, and the server 102 responds to the request to support the test apparatus 101 in issuing topic information to the viewer user. The server 102 may output the first pressure parameter when the testing apparatus 101 completes the step S301, where the first pressure parameter may include parameters such as a response time, an average TPS, a maximum TPS, and a response success rate, and the server 102 may send the output first pressure parameter to the testing apparatus 101, so that the testing apparatus 101 may obtain the pressure parameter when the testing apparatus 101 executes the step S301.

Step S302, receiving the interactive information fed back by the audience user according to the ith topic information.

Under the condition that the audience user acquires the ith topic information, an answer can be selected according to the ith topic information, and the answer is the interactive information fed back by the audience user according to the ith topic information. The testing device 101 can control the generated virtual user to randomly select an answer, and the real user can input an option in the live interface of the target session displayed by the client to feed back the interactive information.

In one possible implementation, the testing device 101 can identify the difficulty level of each topic, and mark a difficulty level, e.g., difficult, medium, easy, etc., for each topic. The testing apparatus 101 configures a proportion of virtual users selecting wrong answers for the questions with different difficulty levels, for example, for a first question with the highest difficulty level, i.e., the hardest question, 30% of virtual users selecting wrong answers are configured, and for a second question with a higher difficulty level, 10% of the remaining virtual users (i.e., the virtual users remaining after eliminating the virtual user submitting the wrong answer according to the answer result of the first question) selecting wrong answers or 10% of the virtual users selecting wrong answers are configured. Therefore, the test environment is closer to the real application environment, the problems in the test process can be better reflected, and the configuration of the difficulty degree of the questions in the field can be conveniently adjusted by the tester according to the pressure test result obtained in the mode.

In one example, see FIG. 5, an exemplary diagram of an interface for a viewer user to enter selection instructions based on first topic information. The client selects the option corresponding to the selection instruction, displays the selected option and the unselected options in a distinguishing manner, and feeds back the result of the option to the testing device 101 as the interactive information of the first topic information.

The testing device 101 may receive the interactive information fed back by the viewer user according to the ith topic information within a preset time period, where the preset time period refers to a time interval from a time point of issuing the ith topic information to a certain time point, for example, the time interval is 20s, and then the viewer user needs to feed back the interactive information according to the ith topic information within 20 s.

The server 102 may output the second pressure parameter when the testing apparatus 101 completes the step S302, and send the output second pressure parameter to the testing apparatus 101, so that the testing apparatus 101 may obtain the pressure parameter when the testing apparatus 101 executes the step S302.

Step S303, counting the result of the interactive information fed back by the audience user according to the ith topic information.

The test device 101 performs result statistics on the interactive information fed back by the audience users according to the ith question information, that is, statistics is performed on the answer result of the ith question, how many audience users select the first option, how many audience users select the second option, and the like.

Alternatively, the tester may set the time for the testing device 101 to execute step S303, that is, set how long the testing device needs to complete the result statistics of the interaction information, and if the number of users is large, complete the result statistics within the set time, and increase the pressure of the server 102 in a certain procedure, so as to perform the pressure test better.

Optionally, the testing device 101 may determine whether the statistics is completed according to how many audience users have been issued the ith topic information, for example, issue the ith topic information to one million audience users, and if the difference between the number of received interactive information and one million is within a preset range, it may be determined that the statistics is completed, otherwise, the statistics is not completed. The specific value range of the preset range can be set by a tester or a developer.

Alternatively, the testing device 101 may check whether the statistical result matches the expected result when completing the statistics, and the expected result may be preset by the tester, such as a range of proportion of each item in each topic, a range of quantity selected for each item, and the like. Because the plurality of audience users include the virtual user, the tester may configure the interactive information of the virtual user for the ith topic information through the testing device 101 or the testing device 101 autonomously configures the interactive information of the virtual user for the ith topic information, and the expected result may be generated by the testing device 101 according to the configuration or set by the testing device 101, and if the statistical result does not match the expected result, it indicates that the testing device 101 has a problem when executing step S303.

The server 102 may output the third pressure parameter when the testing apparatus 101 completes the step S303, and send the output third pressure parameter to the testing apparatus 101, so that the testing apparatus 101 may obtain the pressure parameter when the testing apparatus 101 executes the step S303.

Step S304, the answer information corresponding to the ith topic information is issued to the audience users.

Optionally, the testing device 101 issues answer information corresponding to the ith topic information to the audience users, and may also issue statistical results of the ith topic information to the audience users at the same time, so that the audience users can know how many audience users select correct answers while knowing correct answers.

In one example, referring to fig. 6 a-6 b, two exemplary diagrams of interfaces for outputting answer information corresponding to a first topic information to a client are shown. In the exemplary diagrams of the interfaces shown in fig. 6a and 6b, the option D is the correct answer to the first topic information, and information such as "right answer" or "wrong answer" can be input above the topic or at other positions to prompt the viewer whether the user selects correctly. The client displays the correct answer option of the first topic information and other answer options in a distinguishing way, and can also display the correct answer option and the option selected by the audience user in a distinguishing way. The client may also output the resolution of the correct option, which may be displayed in the interface shown in fig. 6a or fig. 6b, or in the next interface. Fig. 6a is different from fig. 6B in that fig. 6B outputs statistics of the first topic information, i.e., how many viewer users selected the a option, how many viewer users selected the B option, how many viewer users selected the C option, and how many viewer users selected the D option, while outputting correct answers to the first topic information.

The server 102 may output the fourth pressure parameter when the testing apparatus 101 completes the step S304, and send the output fourth pressure parameter to the testing apparatus 101, so that the testing apparatus 101 acquires the pressure parameter when the testing apparatus 101 executes the step S304.

In step S305, it is determined whether i is equal to 12.

The testing device 101 determines whether i is equal to 12, that is, determines whether 12 items of title information are issued, and if so, executes step S306; if the issue is not completed, adding 1 to i, and then executing the steps S301 to S304, that is, issuing the (i + 1) th topic information, receiving the interactive information fed back by the audience user according to the (i + 1) th topic information, performing result statistics on the interactive information fed back by the audience user according to the (i + 1) th topic information, issuing answer information corresponding to the (i + 1) th topic information to the audience user, and repeating the steps until 12 topic information is issued.

And step S306, if i is equal to 12, issuing an answer-ending interactive notification to the audience user.

When the 12 items of information are delivered, the testing device 101 delivers an answer completion interactive notification to the audience user, which is used to notify the audience user that the answer of the target session is completed.

Alternatively, the testing device 101 may issue an answer-ending interaction notification to the audience user when the preset testing time is reached. Alternatively, the test apparatus 101 may issue an answer-ending interaction notification to the audience user when there is no answer pair of the audience user for a certain question.

In a possible implementation manner, the testing device 101 issues answer information corresponding to each item information in all the item information to the audience user when all the item information is issued, that is, in the process of answering the questions by the audience user, the audience user is not informed of the answer of each item, and the audience user is informed of the answer only when all the items are answered by the audience user. The test apparatus 101 can count the number of questions answered by each audience user and the number of the answered questions, and send the counted questions to the corresponding audience user, so that the audience user can know how many questions are answered by himself or herself and which questions are answered by himself or herself.

In the answer interaction process shown in fig. 3, the server 102 may perform virtual expansion or contraction to deal with the rapid expansion or contraction of the pressure, thereby ensuring the validity of the test.

Step S203, acquiring pressure parameters in the answering interaction process.

Wherein the pressure parameter may comprise any one or more of: the method comprises the steps of sending topic information to audience users, receiving a second pressure parameter when the audience users send interactive information back according to the topic information, carrying out result statistics on the interactive information fed back by the audience users according to the topic information, and sending answer information corresponding to the topic information to the audience users.

The first pressure parameter may include a pressure parameter output by the server 102 every time the testing device 101 performs the issue of the title information to the audience user, or may include a pressure parameter output by the server 102 after the testing device 101 performs the issue of the title information to the audience user 12 times. The second pressure parameter, the third pressure parameter and the fourth pressure parameter are the same.

And S204, outputting a pressure test result according to the pressure parameter in the answer interaction process.

The testing device 101 outputs a pressure test result according to the pressure parameter during the answering interaction process, so that the tester can expand the capacity of the server 102 or adjust the script file of the live answering project according to the pressure test result.

In one possible implementation, in the case of creating the target test session, the pressure test result is the pressure test result of the target session. For each field, the test results for each field can be obtained according to the flow shown in fig. 2. The testing device 101 may perform integrated analysis on the first pressure parameter, the second pressure parameter, the third pressure parameter, and the fourth pressure parameter, or process the four parameters according to a calculation rule, so as to obtain a pressure testing result of the target testing session.

Alternatively, in the case of outputting the pressure test result of the target session, the test apparatus 101 may delete the target session and create a next session, and the flow of the next session is the same as that of the target session. The time interval between the next session and the target session is a preset time interval, and the specific value of the preset time interval can be set by a tester or by a test device by default, for example, the difference between the creation time of the target session and the next session is ten minutes or one hour. In other words, the frequency of creation of the fields, or the time intervals between fields, is configurable, making the test more flexible.

In a possible implementation manner, the testing device 101 may output the pressure testing result within a preset time period according to the pressure parameter during the answering interaction process. The predetermined time period may be set by the tester, for example, the pressure test results from 8 o 'clock to 10 o' clock at night, during which more than one test session may be performed.

In a possible implementation manner, the testing device 101 may output a pressure test result according to the pressure test results of the designated several fields, for example, the first field to the fifth field are designated, and the testing device 101 may perform integrated analysis on the pressure test results of the first field to the fifth field to obtain a pressure test result and output the pressure test result.

In the embodiment shown in fig. 2, by obtaining the question list corresponding to the live video, in the process of playing the live video, performing answer interaction with a plurality of audience users according to the question list, obtaining the pressure parameter in the answer interaction process, and outputting the pressure test result according to the pressure parameter in the answer interaction process, the pressure test can be automatically performed on the whole process of the live answer item without manual intervention, and the pressure test result of the whole process of the live answer can be truly reflected.

The method of the embodiments of the present application is set forth above in detail and the apparatus of the embodiments of the present application is provided below.

Referring to fig. 7, a schematic diagram of a logic structure of a testing apparatus according to an embodiment of the present disclosure is shown, in which the testing apparatus 70 includes a processing unit 701 and an output unit 702.

A processing unit 701, configured to obtain a topic list corresponding to a live video, where the topic list includes one or more topic information used for interacting with a viewer user and answer information corresponding to the topic information;

the processing unit 701 is further configured to perform answer interaction with a plurality of audience users according to the question list in the process of playing the live video;

the processing unit 701 is further configured to obtain a pressure parameter in the answer interaction process, where the pressure parameter includes any one or more of the following: the method comprises the steps of sending question information to audience users, receiving a first pressure parameter when the audience users send the question information, receiving a second pressure parameter when the audience users send interactive information fed back according to the question information, carrying out result statistics on the interactive information fed back by the audience users according to the question information, and sending answer information corresponding to the question information to the audience users;

and the output unit 702 is used for outputting a pressure test result according to the pressure parameter in the answer interaction process.

Optionally, the testing device 70 further includes a communication unit 703, and the processing unit 701 is configured to, when performing answer interaction with multiple audience users according to the topic list, specifically control the communication unit 703 to issue an ith topic information to the multiple audience users, where the ith topic information is any topic information in the topic list, and i is an integer greater than or equal to 1; the control communication unit 703 receives the interactive information fed back by the audience user according to the ith topic information; carrying out result statistics on interactive information fed back by audience users according to the ith question information; the control communication unit 703 issues answer information corresponding to the ith topic information to the viewer user.

Optionally, if the ith topic information is not the last topic information in the topic list, the processing unit 701 is configured to control the communication unit 703 to issue, to the audience users, i +1 th topic information after the communication unit 703 issues answer information corresponding to the ith topic information, and control the communication unit 703 to issue, to the plurality of audience users, the ith topic information; the control communication unit 703 receives the interactive information fed back by the audience user according to the (i + 1) th topic information; carrying out result statistics on interactive information fed back by audience users according to the (i + 1) th topic information; the control communication unit 703 issues answer information corresponding to the (i + 1) th topic information to the viewer user.

Optionally, if the ith topic information is the last topic information in the topic list, the processing unit 701 is configured to control the communication unit 703 to issue an answer information corresponding to the ith topic information to the audience user, and then is further configured to control the communication unit 703 to issue an answer-ending interaction notification to the audience user.

Optionally, the processing unit 701 is configured to control the communication unit 703 to issue an ith topic information to a plurality of audience users, and specifically, when the ith topic information is a first topic information in a topic list, issue the first topic information to the audience users when a current system time is the same as a time for starting answering a live video.

Optionally, the processing unit 701 is further configured to create a target session;

the output unit 702 is configured to, when outputting a pressure test result according to the pressure parameter during the answer interaction process, specifically, output a pressure test result of the target session according to the pressure parameter during the answer interaction process.

Optionally, the processing unit 701 is further configured to delete the target field; and creating a next field, wherein the time interval between the creation of the next field and the creation of the target field is a preset time interval.

The testing apparatus 70 may implement the functions of the testing apparatus 101 in the foregoing method embodiment, and the detailed process executed by each unit in the testing apparatus 70 may refer to the execution steps of the testing apparatus 101 in the foregoing method embodiment, which are not described herein again.

Referring to fig. 8, which is a schematic physical structure diagram of a testing apparatus provided in an embodiment of the present disclosure, the testing apparatus 80 includes a processor 801, an input module 802, an output module 803, a communication interface 804, and a memory 805. The processor 801, the input module 802, the output module 803, the communication interface 804 and the memory 805 may be connected to each other by a bus 806, or may be connected by other means. The related functions performed by the processing unit 701 shown in fig. 7 may be implemented by one or more processors 801. The related functions implemented by the output unit 702 shown in fig. 7 may be implemented by the output module 803. The related functions implemented by the communication unit 703 shown in fig. 7 may be implemented by the communication interface 804.

The processor 801 includes one or more processors, such as one or more Central Processing Units (CPUs), and in the case that the processor 801 is one CPU, the CPU may be a single-core CPU or a multi-core CPU. In the embodiment of the present application, the processor 801 is used to control the testing apparatus 80 to implement the embodiment shown in fig. 2.

The input module 802 may be an input device such as a keyboard, a mouse, a touch screen, etc., and is used for receiving instructions, data, etc. input by a user. In this embodiment, the input module 802 is used to receive an instruction, a script file, and the like input by a tester.

The output module 803 may be an output device such as a screen, a sound, a loudspeaker, etc., and is used for outputting information such as a graphical interface, multimedia data, etc. In this embodiment, the output module 803 is used for outputting the pressure test result.

The communication interface 804 is used for communication with other devices, such as clients, servers, and the like. In the embodiment of the present application, the communication interface 804 is used for information interaction with the client 103 and the server 102.

The memory 805 includes, but is not limited to, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), or a portable read-only memory (CD-ROM), and the memory 805 is used for storing relevant instructions and data. In the embodiment of the present application, the memory 805 is used for storing program codes, instructions and the like required by the processor 801 to execute.

It should be noted that, for simplicity of description, the above-mentioned embodiments of the method are described as a series of acts or combinations, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by associated hardware instructed by a program, which may be stored in a computer-readable storage medium, and the storage medium may include: flash Memory disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

The content downloading method, the related device and the system provided by the embodiment of the present invention are described in detail above, and a specific example is applied in the text to explain the principle and the embodiment of the present invention, and the description of the above embodiment is only used to help understanding the method and the core idea of the present invention; meanwhile, for a person skilled in the art, according to the idea of the present invention, there may be variations in the specific embodiments and the application scope, and in summary, the content of the present specification should not be construed as a limitation to the present invention.

Claims

1. A method of testing, comprising:

in the process of playing the live video, performing answer interaction with a plurality of audience users according to the question list; the plurality of audience users comprise virtual users generated by the testing device;

2. The method of claim 1, wherein said interacting with a plurality of audience users according to said topic list comprises:

3. The method of claim 2, wherein if the ith topic information is not the last topic information in the topic list, after issuing answer information corresponding to the ith topic information to the viewer user, further comprising:

4. The method of claim 2, wherein if the ith topic information is the last topic information in the topic list, after issuing answer information corresponding to the ith topic information to the viewer user, further comprising:

5. The method of claim 2, wherein the delivering the ith topic information to the plurality of audience users comprises:

6. The method of claim 1, further comprising:

creating a target session;

7. The method of claim 6, further comprising:

deleting the target field;

8. A testing device is characterized by comprising a processing unit and an output unit,

the processing unit is further used for conducting answer interaction with a plurality of audience users according to the question list in the process of playing the live video; the plurality of audience users comprise virtual users generated by the testing device;

9. A test apparatus, comprising a processor, an input module, an output module, a communication interface, and a memory, wherein the memory stores a computer program comprising program instructions, and wherein the processor is configured to invoke the program code to perform the method of any of claims 1-7.

10. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program comprising program instructions that, when executed by a test apparatus, cause the test apparatus to perform the method according to any one of claims 1-7.