KR101811212B1 - Method and apparatus for diy usability test - Google Patents

Abstract

A method for verifying DIY usability, which is performed by a computer, is provided. The method according to the present invention includes the steps of: receiving product information from a client terminal; recommending at least one task associated with the product information; receiving the selection of the at least one task included in a task list, from the client terminal; selecting a participant to participate in a test; and automatically determining a test scheduling plan based on plan information of the participant recorded in a participant terminal of the selected participant. Accordingly, the present invention can provide a usability test method with high convenience and accuracy based on machine learning or deep learning technology.

Description

[0001] METHOD AND APPARATUS FOR DIY USABILITY TEST [0002]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a usability testing method and apparatus, and more particularly, to a usability testing apparatus based on user creation.

Usability testing is a way to better understand user requirements by observing user behavior. Unlike traditional research methodology, usability test analyzes user's requirements by observing the actual use of actual users, so it can obtain more accurate test results. Recently, companies have been giving priority to research methods for products or services It is in a trend of being reviewed as a ranking.

Typical usability testing methods consist of defining user groups, selecting user tasks, testing, and analyzing test results. When a usability test is conducted, the usability test expert performs a series of processes to analyze the test results from the definition of the user group as the test facilitator. This is because the usability test is a research conducted to find problems based on the test results of a small test participant, and thus the host is more likely to experience a bias problem depending on the level of knowledge and experience in the test progress. In fact, for the same target product, the usability test results from various usability testing companies in the US showed very different results (forrester research results), which indicates that test results from a small number of test participants It is analyzed because it is easy to be distorted. Therefore, we are conducting tests based on the experience and knowledge of the facilitator for the results of more reliable usability tests.

On the other hand, if the test is conducted based on the experience and knowledge of the host, it may take a considerable time to cause a high cost or to receive the result. Recently, a DIY tool (Do-it-yourself tool) Is introduced. For example, one of the US usability testing companies, user testing ( http://usertesting.com ), defines a group of users for a website or app and selects tasks to design a usability test directly To provide services.

However, the methods that are introduced in user testing are limited to a specific field, namely, a web site or an app, and increase the possibility of distorting the result by allowing an unexperienced requester to arbitrarily define a user group, Therefore, it is very sensitive to the order in which the task is input, without verifying or evaluating the task that yields meaningful results.

US 2012-0218396 A

Therefore, there is a need for a user-based usability testing method that can be applied to a wide variety of fields without the help of a test expert and can accurately analyze the results.

According to one aspect of the invention, a method of DIY usability testing is provided that is performed by a computer. The method includes: receiving product information from a client terminal; Recommending at least one task associated with the product information; Receiving a selection from the requestor terminal for the at least one task included in the task list; Selecting participants to participate in the test; And automatically determining a test scheduling schedule based on the participant's schedule information recorded in the participant terminal of the selected participant.

In one embodiment, the step of selecting a participant terminal to participate in the test may include analyzing information on a participant terminal related to the selected task by combining the selected task with the second large-capacity data; And determining a participant condition based on the analysis result and transmitting the participant condition to the requestor terminal.

In one embodiment, the participant's schedule information recorded in the selected participant terminal may be schedule information of a participant recorded in a Google calendar application, an MS Outlook schedule or other schedule management application of the terminal.

In one embodiment, recommending at least one task related to the product information includes storing information related to the task used in the usability test in the task DB, and classifying the first large capacity data stored in the task DB Wherein classifying the first large capacity data stored in the task DB classifies the first large capacity data according to a plurality of categories, and the categories are not fixed and can be variably set based on the analysis of the large capacity data - combining the product information and the first mass data to search for at least one task associated with the product information in the task DB, cataloging the task and transmitting the task list to the requester terminal ; And storing information related to the participant terminal participating in the usability test in the participant information DB and classifying the second large-capacity data stored in the participant information DB.

In one embodiment, data mining, text mining, web mining, social mining, opinion mining, machine learning, statistical analysis, Method is applied so that the category can be variably set.

In one embodiment, the step of classifying the first mass data collected in relation to the task used in the usability test includes classifying product information related to the task according to product classification information, major classification information, and classification information. And classifying the task according to the evaluation feedback and whether the task is used in the usability test and the frequency with which the task is used, from the client terminal associated with the task.

In one embodiment, the participant condition may include at least one of age, gender, income, education, nationality, occupation, and web accessibility level.

In one embodiment, the method includes receiving a weight for a participant condition from the sponsor terminal; And sequentially presenting the participant terminals having a high similarity level of the participant conditions by reflecting the weight values.

In one embodiment, in the step of presenting the participant terminals having a high degree of similarity of the participant condition in order of reflecting the weight values, the step of comparing the participant information stored in the participant information DB to check whether the participant conditions are satisfied for each item And calculating the degree of similarity between the participants stored in the participant information DB and the participant condition through scoring reflecting the weight of the condition.

According to another aspect of the present invention there is provided a computer apparatus operable to execute any one of the methods described above.

According to another aspect of the present invention there is provided a computer readable storage medium having stored thereon one or more instructions for causing a computer to execute a method of any of the methods described above, A readable storage medium is provided.

According to the present invention, a usability testing method that is accurate and user-friendly can be provided based on a machine learning or a deep learning technique.

1 is a network configuration diagram for a usability test based on a big data, according to an embodiment of the present invention.
2 is a flowchart of a usability test method according to an embodiment of the present invention.
3 is a diagram showing a classification of a product associated with a task according to an embodiment of the present invention.
4 is a diagram illustrating an example of a task according to an embodiment of the present invention.
5 is a diagram illustrating an example of a participant condition according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. Hereinafter, when it is determined that there is a possibility that the gist of the present invention may be unnecessarily blurred, a detailed description of known functions and configurations will be omitted. In addition, it should be understood that the following description is only an embodiment of the present invention, and the present invention is not limited thereto.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention. For example, an element expressed in singular < Desc / Clms Page number 5 > terms should be understood as including a plurality of elements unless the context clearly dictates a singular value. In addition, in the specification of the present invention, it is to be understood that terms such as "include" or "have" are intended to specify the presence of stated features, integers, steps, operations, components, It is not intended that the use of the term exclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

As used herein, the term " block " or " part " means a functional part that performs at least one function or operation, and may be implemented in hardware or software or a combination of hardware and software. Also, a plurality of 'blocks' or 'sub-units' may be embodied in at least one processor integrated with at least one software module, except for 'blocks' or 'sub-units' that need to be implemented in specific hardware .

In addition, all terms used herein, including technical or scientific terms, unless otherwise defined, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Commonly used predefined terms are to be interpreted as having a meaning consistent with the contextual meaning of the related art and are not to be construed as being excessively limited or extended unless explicitly defined otherwise in the specification of the present invention You should know.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a network configuration diagram for a usability test based on a big data, according to an embodiment of the present invention.

As shown in FIG. 1, the requester accesses the usability test apparatus 110 based on the Big Data according to an embodiment of the present invention through the communication network 150 using the requester terminal 120, inputs product information, It is possible to receive the recommendation task provided by the test apparatus 110 and enter the participant condition to proceed with the usability test procedure without the assistance of the usability test expert. In one embodiment, the supplicant terminal 120 may include a desktop PC, a tablet PC, a smart phone, a notebook, a note pad, a workstation, etc., having a wireless LAN and / or a wired LAN module. In one embodiment, the requester terminal 120 may include a web browser and may be configured to access the internet using the web browser to browse and search various web pages. The communication network may include a wired communication network of the Internet, a WiFi and a 3G / 4G wireless communication network. The usability testing apparatus 110 according to an embodiment of the present invention may be configured to provide support to the client terminal 120 accessing the usability testing procedure through a web page.

As shown, the network configuration according to an embodiment of the present invention may further include a database 140. [ In one embodiment, the database 140 may be implemented using a disk drive, magnetic disk, optical disk, or other suitable storage device. In one embodiment, the database 140 may store information about at least one task used in the usability test, wherein the information about the task includes information about the task, product information on which the task was performed, , And information about the frequency with which the task was used in the usability test of the product. In one embodiment, the database 140 may further store information about the participants participating in the usability test, wherein the information about the participants includes information about age, gender, income, education, nationality, occupation, and web accessibility level can do. Here, the level of web accessibility can be divided into low, medium, and excellent as a criterion on how easily a participant can obtain information through a website.

The participant terminals 130-1 to 130-N according to the embodiment of the present invention are terminals used by participants participating in the usability test, and include a desktop PC having a wireless LAN and / or a wired LAN module, a tablet PC, , A notebook, a notepad, a workstation, and the like. In one embodiment, the requester terminal 120 may include a web browser and may be configured to access the internet using the web browser to browse and search various web pages.

The usability testing apparatus 110 according to an embodiment of the present invention interworks with the database 140 to store information related to the task used in the usability test in the task DB and classify the first large capacity data stored in the task DB into classification . In one embodiment, the classification of the first large-capacity data is performed by classifying the product information related to the task in accordance with the product classification information, the major classification information, and the classification information, and judging from the requester requesting the task whether the task is important for the usability test Evaluation feedback and the frequency with which the task is used. For example, information on tasks that have been performed in the existing usability testing process can be stored in the task DB.

In one embodiment, the usability testing apparatus 110 may classify the first large capacity data stored in the task DB according to a plurality of categories. In one embodiment, the categories are not fixed and can be learned and varied by the various techniques and large amounts of data described below. The usability testing apparatus 110 may include data mining, text mining, web mining, social mining, opinion mining, machine learning, statistical analysis, Method can be applied to classify the first large-capacity data.

The usability testing apparatus 110 may be configured to interoperate with the database 140 to store information related to the participant terminal participating in the usability test in the participant information DB and to classify the second large capacity data stored in the participant information DB. Here, the information related to the participant terminal includes information on the participant, and the information on the participant may be at least one of the age, sex, income, education, nationality, occupation, and web accessibility level of the participant.

In one embodiment, the usability testing apparatus 110 may be configured to receive product information from the supplicant terminal 120. Here, the product information may be predefined product classification information, major classification information, middle classification information, or a unit of language, as information on a target (product) to be tested for usability. For example, when the applicant wishes to carry out the usability test on the 'washing machine', the requester can use the requester terminal 120 to classify (pre-defined) product classification (manufacture), major category (home appliances), middle category ) To enter product information, or to input a 'washing machine' directly.

In one embodiment, the usability testing apparatus 110 may be configured to combine product information and first mass data to select at least one task associated with product information in the task DB and transmit the selected task to the requester terminal. For example, when the product information is 'washing machine', at least one task among the first large capacity data stored in the task DB may be retrieved and listed, and the task list may be provided to the requester.

In one embodiment, the usability testing apparatus 110 receives a selection of the at least one task included in the task list from the requestor terminal, combines the selected task with the second large capacity data, And may determine the participant conditions based on the analysis result and transmit the determined participant conditions to the client terminal. Here, the participant condition may include at least one of a participant's age range, gender, a range of income, a range of education, a nationality, a job, and a range of web accessibility levels, similar to participant information.

According to the empirical rule based on the conventional usability testing method conducted by a test professional, it is not easy to find a participant who exactly matches the condition of the participant set by the client. Therefore, comparing the conditions set by the user in the usability testing apparatus 110 with the participant information and obtaining the degree of similarity is a method for increasing the accuracy of the test result by enlarging the population of participants in the usability testing method based on the big data.

In one embodiment, the usability testing apparatus 110 may be configured to receive a weight for the participant condition from the sponsor terminal 120 and to reflect the weight in order to present the participant terminal with high degree of similarity of the participant condition in order. For example, when the sponsor considers the participant's income as important, he or she can select a participant by adding a weight to the income. In one embodiment, the participant information stored in the participant information DB is compared to confirm that the participant conditions for each item match, and the participant conditions and the similarity between the participants stored in the participant information DB are obtained through scoring reflecting the weight of the condition . Those skilled in the art will be able to conceive of a method of comparing similarities in various forms, and therefore, a detailed description thereof will be omitted here.

2 is a flowchart of a usability test method performed in a usability testing apparatus according to an embodiment of the present invention.

The usability test method starts from the step S201 of building the task DB and the participant information DB in the usability testing apparatus 110 and classifying the data stored in each DB. The task DB may store information about at least one task used in the usability test, wherein the task information includes information on the task, product information on which the task was performed, feedback information of the requester on the task, May include information about the frequency used in the < RTI ID = 0.0 > The participant information DB may store information about the participant who participated in the past usability test, and information about the participant may include information about age, gender, income, education, nationality, occupation, and level of web accessibility.

In step S201, the usability testing apparatus 110 may be configured to classify the first large capacity data stored in the task DB in cooperation with the database 140. The classification of the first large capacity data may include, for example, Classification information, major classification information, and classified classification information, and can classify according to the evaluation feedback on whether the task is important for the usability test from the requester who requested the task, and the frequency with which the task is used. For example, information on all tasks that have been performed in the existing usability testing process may be stored in the task DB. Here, the information on the task may include a description of the task, a frequency at which the task is selected, a rating of the task, and product information related to the task.

Also, in step S201, the usability testing apparatus 110 can classify the first large capacity data stored in the task DB according to a plurality of categories. The categories are not fixed, and various techniques described below and the first large capacity data Can be learned and changed.

In step S201, the usability testing apparatus 110 interlocks with the database 140 to store information related to the participant terminal participating in the usability test in the participant information DB, and to classify the second large-capacity data stored in the participant information DB .

Next, in step S202, the usability testing apparatus 110 receives product information from the client terminal 120. [ Here, the product information may be predefined product classification information, major classification information and classification information, or a unit of language. For example, when the applicant wishes to carry out the usability test on the 'washing machine', the requester can use the requester terminal 120 to classify (pre-defined) product classification (manufacture), major category (home appliances), middle category ) Can be selected to input product information, or a 'washing machine' can be directly input.

3 is a diagram showing a classification of a product associated with a task according to an embodiment of the present invention. Referring to FIG. 3, the product category is divided into 'software' or 'manufacture', and 'software' is again classified into 'package SW / IT service' ), And 'OS', 'security', 'storage SW', 'IT operation management', 'data management' (small classification).

2, in step S203, the usability testing apparatus 110 combines the product information and the first large-capacity data, selects at least one task related to the product information from the task DB, and transmits the selected task to the requester terminal . For example, if the product information is 'hospital web site', at least one task that can be associated with the 'hospital web site' among the first large capacity data stored in the task DB may be searched and the corresponding task may be listed and provided to the requester .

4 is an exemplary diagram illustrating a user test task for a web site of a hospital in accordance with an embodiment of the present invention. As shown in FIG. 4, a user test task for the web site of the hospital can be provided. The description of each task and the evaluation (evaluation) of the task and the number of applicants using the task, Frequency information indicating whether or not the user has proceeded can be provided.

Returning to FIG. 2, in step S204, the usability testing apparatus 110 receives a selection of the at least one task included in the task list from the requestor terminal, combines the selected task with the second large- Analyzing information on the participant terminal related to the selected task, and transmitting a suggestion on the participant condition to the client terminal 120 based on the analysis result. Here, the participant condition may include at least one of a participant's age range, gender, a range of income, a range of education, a nationality, a job, and a range of web accessibility levels, similar to participant information.

5 is a diagram illustrating an example of a participant condition according to an embodiment of the present invention. As shown in FIG. 5, the participant conditions are classified into a range of participant age (50 to 55 years old), income (1 million to 1.5 million won), gender (female), nationality (Korea) Can be set.

Returning to FIG. 2, in step S205, the usability testing apparatus 110 receives correction items and weights for the participant conditions from the client terminal 120, reflects the modifications and the weights, The participants may be presented in order according to the degree of similarity between the participants. For example, when the sponsor considers the participant's income as important, he or she can select a participant by adding a weight to the income. In one embodiment, the degree of similarity can be determined by confirming the consistency of each item and by scoring the weights. Those skilled in the art will be able to conceive of a method of comparing similarities in various forms, and therefore, a detailed description thereof will be omitted here.

In step S206, the usability testing apparatus 110 may request the selected participant to confirm the participation of the testing based on the similarity level. In other words, participants who are highly similar to the participant condition are first confirmed to participate. The usability testing apparatus 110 receives the participation from the participant terminal 130, determines whether the number of participants is secured, and stops the request to confirm participation when all the participants are secured.

In step S207, the usability test apparatus 110 performs scheduling of the determined participants. This step may be performed selectively, or may be omitted. If there is no time constraint due to the characteristics of the usability test, that is, regardless of whether the participant performs the usability test at any time through the participant terminal 130, the present step may be omitted.

Meanwhile, if scheduling with a participant is required, such as face-to-face testing, the usability testing apparatus 110 performs participant scheduling. In one embodiment, participant scheduling may include scheduling of a participant, such as a Google Calendar application, an MS Outlook calendar, or other calendar management application, collected via the participant terminal 130, if the participant's schedule is recorded in the participant terminal 130 A test schedule can be automatically generated based on the schedule.

Optionally, a request for confirmation can be sent and received from a participant on an automatically generated test schedule.

As will be appreciated by those skilled in the art, the present invention is not limited to the examples described herein, but may be variously modified, rearranged and replaced without departing from the scope of the present invention. For example, the various techniques described herein may be implemented in hardware or software, or a combination of hardware and software. Thus, certain aspects or portions of an analysis machine for software safety analysis in accordance with the present disclosure may be implemented with one or more computer programs executable by a general purpose or special purpose microprocessor, micro-controller, or the like. A computer program according to an embodiment of the present invention may be stored in a storage medium readable by a computer processor or the like such as a nonvolatile memory such as EPROM, EEPROM, flash memory device, a magnetic disk such as an internal hard disk and a removable disk, CDROM disks, and the like. Also, the program code (s) may be implemented in assembly language or machine language.

Although exemplary embodiments of the Big Data based usability testing method are mainly described herein with reference to various drawings, other similar embodiments may be used. And all changes and modifications that fall within the true spirit and scope of the present invention are intended to be embraced by the following claims.

110: usability testing device
120:
130-1 to 130-N: participant terminal
140: participant terminal

Claims (10)

A method of DIY usability testing performed by a computer,
Receiving product information from a client terminal;
Recommending at least one task associated with the product information,
Wherein recommending at least one task associated with the product information comprises:
Storing information related to the task used in the usability test in the task DB and classifying the first large capacity data stored in the task DB,
Searching for at least one task related to the product information in the task DB by combining the product information and the first large-capacity data, cataloging the task, and transmitting the task list to the client terminal,
The step of classifying the first large-capacity data stored in the task DB may include classifying the first large-capacity data according to a plurality of categories, wherein the category is not fixed, and the classification is based on an analysis of the large- Configurable -;
Receiving a selection from the requestor terminal for the at least one task included in the task list;
Selecting participants to participate in the test; And
Determining automatically a test scheduling schedule based on the participant's schedule information recorded in the participant terminal of the selected participant
Lt; / RTI >
The step of selecting a participant to participate in the test
Storing information related to the participant participating in the usability test in the participant information DB and classifying the second large capacity data stored in the participant information DB
Analyzing information on a participant associated with the selected task by combining the selected task with the second mass data; And
Determining a participant condition based on the analysis result, and transmitting the participant condition to the sponsor terminal;
Receiving a weight for a participant condition from the sponsor terminal; And
And presenting the participants in order based on the similarity of the participant conditions reflecting the weights
Usability testing method. The method according to claim 1,
Wherein the participant's schedule information recorded in the selected participant terminal is schedule information of a participant recorded in a Google calendar application, an MS Outlook schedule, or other schedule management application of the terminal. delete delete The method according to claim 1,
The step of classifying the first mass data collected in connection with the task used in the usability test
Classifying product information related to the task according to product classification information, major classification information, and classified classification information; And
Classifying the task according to the evaluation feedback and whether the task is used in the usability test and the frequency of using the task from a client terminal associated with the task;
≪ / RTI > delete The method according to claim 1,
The step of presenting the participants in sequence based on the similarity of the participant conditions reflecting the weights
Comparing the participant information stored in the participant information DB to check whether the participant condition matches the participant condition for each item, and calculating the degree of similarity between the participant condition and the participants stored in the participant information DB through scoring reflecting the weight of the condition Usability testing methods. The method according to claim 1,
The step of automatically determining a test scheduling schedule based on the participant's schedule information recorded in the participant terminal of the selected participant
The method comprises: confirming participant scheduling by participating participants in order based on similarity;
Determining whether the number of participants is secured, stopping the request to confirm participation of testing if all participants are secured; And
A step of automatically confirming the schedule based on the schedule of the participants collected through the participant terminal
≪ / RTI > A computer device operable to perform the method of any one of claims 1, 2, 5, 7 and 8. A computer-readable storage medium having stored thereon one or more instructions, wherein the one or more instructions, when executed by a computer, cause the computer to perform the steps of any one of claims 1, 2, 5, 7, Readable < / RTI > storage medium.

Images