WO2015102233A1

WO2015102233A1 - Usability measurement apparatus and method

Info

Publication number: WO2015102233A1
Application number: PCT/KR2014/011465
Authority: WO
Inventors: 이한솔; 김승하
Original assignee: 주식회사 앤벗
Priority date: 2014-01-06
Filing date: 2014-11-27
Publication date: 2015-07-09
Also published as: KR20150081762A; KR20160021704A

Abstract

The present invention relates to a usability measurement apparatus and method and, more particularly, to a usability measurement apparatus and method for measuring a usability of a particular application by analyzing a use pattern of the particular application and receiving an input of a survey response according to the analysis. A usability measurement apparatus according to an embodiment of the present invention comprises: a usability information collection unit for collecting usability information on a purpose application by receiving an input of a user command through an input layer existing on an upper layer of a screen interface by the purpose application; and a communication unit for transmitting the collected usability information.

Description

Usability measuring device and method

The present invention relates to a usability measuring apparatus and method, and more particularly, to a usability measuring apparatus and method for measuring the usability of a specific application by analyzing a usage pattern of a specific application and receiving a questionnaire response accordingly.

With the proliferation of personal devices with touch-based interfaces such as smartphones and tablets today, there is an increasing demand to measure indicators of the usability of such devices and applications running on them.

In order to evaluate usability, not only the collection of quantitative data but also the collection of emotions felt by users are used. For this purpose, various techniques such as laboratory tests, expert reviews, and focus group interviews are used.

On the other hand, in order to evaluate the usability of the target application for usability evaluation, the usage pattern of the corresponding target application should be collected. As a separate application operating on the operating system, it is difficult to collect the usage pattern of the target application.

Therefore, there is a need for the emergence of an invention that makes it possible to collect a usage pattern of a target application in a simpler way and determine the usability accordingly.

An object of the present invention is to measure the usability of a specific application by analyzing a usage pattern of the specific application and receiving a questionnaire response accordingly.

The objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned will be clearly understood by those skilled in the art from the following description.

In order to achieve the above object, the usability measuring device according to an embodiment of the present invention collects usability information on the target application by receiving a user command through an input layer existing on a screen interface by the target application. An information collecting unit, and a communication unit for transmitting the collected usability information.

In the usability measuring method according to an embodiment of the present invention, the step of collecting the usability information for the target application by receiving a user command through an input layer on the upper screen interface by the target application, and the collected usability information Transmitting a step.

Specific details of other embodiments are included in the detailed description and the drawings.

According to the usability measuring apparatus and method of the present invention as described above, by using a specific application and analyzing the usage pattern of the corresponding application and receiving a questionnaire response accordingly, the usage pattern of the target application is collected in a more convenient way, and accordingly There is an advantage that can determine the usability.

1 is a view showing a usability measurement system according to an embodiment of the present invention.

2 is a block diagram showing a usability measuring apparatus according to an embodiment of the present invention.

3 is a diagram illustrating a detailed configuration of the usability information collecting unit illustrated in FIG. 2.

4 is a view showing a user command is input according to an embodiment of the present invention.

5 is a diagram illustrating a questionnaire output on a screen according to an exemplary embodiment of the present invention.

6 is a diagram illustrating a questionnaire input screen according to an embodiment of the present invention.

7 is a diagram illustrating a checkpoint input screen according to an embodiment of the present invention.

8 is a view showing the results of usability analysis according to an embodiment of the present invention.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. Advantages and features of the present invention, and methods for achieving them will be apparent with reference to the embodiments described below in detail in conjunction with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but can be implemented in various forms. The embodiments of the present invention make the posting of the present invention complete and the general knowledge in the technical field to which the present invention belongs. It is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined only by the scope of the claims. Like reference numerals refer to like elements throughout.

Unless otherwise defined, all terms (including technical and scientific terms) used in the present specification may be used in a sense that can be commonly understood by those skilled in the art. In addition, the terms defined in the commonly used dictionaries are not ideally or excessively interpreted unless they are specifically defined clearly.

1 is a view showing a usability measurement system according to an embodiment of the present invention, the usability measurement system 10 includes a usability analysis server 100 and the usability measurement apparatus 200.

The usability measurement apparatus 200 according to the embodiment of the present invention refers to a device for performing related tasks by driving an installed application. The usability measurement apparatus 200 is fixed to a specific place such as a personal computer (PC). And, it may be portable such as laptop, tablet PC and smart phone.

However, the usability measuring apparatus 200 preferably includes input means for inputting information or a user command and output means for outputting input information or received information.

One or more applications may be installed and operated on the usability measuring apparatus 200, and the usability measuring apparatus 200 may collect usability information of a target application that is a target of usability measurement and transmit the collected information to the usability analysis server 100. .

Usability in the present invention (usability) means the usefulness or convenience that is evaluated by the user with respect to the running application, the usability information means that the usability information is composed of data by digitizing.

In addition, the usability information according to the embodiment of the present invention may include a questionnaire response provided from the user.

On the other hand, it may be difficult to use another application on the usability measuring device 200 to measure the usability for a particular application.

For example, in order to measure the usability of an application to be measured for usability, it should be possible to detect both a task performed by the target application or a command input to the target application, but it is not easy to detect such a task or command by a separate application. Because it does not.

Hereinafter, an application that is a usability measurement target is called a target application, and an application that detects a task or command for the target application is called a measurement application.

Whenever a task is performed by the target application, information about the task is delivered to the operating system, and the measurement application separated from the target application can receive information about the task from the operating system. In an environment where detection is possible, there is a limit to the range in which the measurement application can detect the operation or command of the target application.

Thus, the measurement application according to an embodiment of the present invention may be included in the target application. That is, the measurement application may exist in the target application in the form of a library, and thus the measurement application may obtain a right to collect information on a task performed by the target application.

On the other hand, it may not be easy to embed the measurement application when the target application is already made in advance. The target application has a variety of objects, and a number of variables and parameters are set for each object. Even a developer producing a target application may not easily connect a specific object to a measurement application.

In particular, in the case of a target application that provides a screen interface, a plurality of buttons may be provided as objects, and it is not easy to connect the buttons and the measurement application.

Thus, the measurement application according to the embodiment of the present invention may use a separate layer that is located above the screen interface to check the command input to the screen interface.

For example, when the user selects a button, the layer first detects the user command before the selection command for the button occurs. The user command collects the usability command through the detected user command. It will issue a select command for the button.

Here, the detection of the user command through the layer may be performed based on the coordinates of the user command generated on the layer and the coordinates of each object present in the screen interface, which will be described later with reference to FIG. 4.

The usability analysis server 100 analyzes the usability information received from the usability measuring apparatus 200 and provides a result (hereinafter referred to as a usability analysis result).

The usability analysis result may be implemented in text or video and provided to a developer or a user of a target application.

The network 300 may be a wired or wireless internet, or may be a core network integrated with a wired public network, a wireless mobile communication network, or a portable internet, and the like, and various services existing in the TCP / IP protocol and its upper layer, that is, HTTP (Hyper). A global open computer network architecture that provides Text Transfer Protocol, Telnet, File Transfer Protocol (FTP), Domain Name System (DNS), and Simple Mail Transfer Protocol (SMTP).

2 is a block diagram illustrating a usability measuring apparatus according to an exemplary embodiment of the present invention, wherein the usability measuring apparatus 200 includes a usability information collecting unit 210, an input unit 220, a storage unit 230, a controller 240, It is configured to include an output unit 250 and the communication unit 260.

Usability information collection unit 210 according to an embodiment of the present invention can be understood as the measurement application itself or included in the measurement application described above. Therefore, the usability information collecting unit 210 may be understood as being embedded in the target application in the form of a library.

The usability information collecting unit 210 collects usability information on the target application by receiving a user command through an input layer existing on the screen interface by the target application.

To this end, the usability information collecting unit 210 may include a command determining unit 211 that determines a user command input through the input layer. The command determining unit 211 may include a user command input on the input layer. The object corresponding to the user command may be determined by referring to the coordinates and the coordinates of the object existing in the screen interface.

In addition, the usability information collecting unit 210 may further include at least one of the exception determining unit 212, the screen information collecting unit 213, and the questionnaire information collecting unit 214 as well as the command determining unit 211.

The exception receiving unit 212 serves to receive information about exceptions generated during the operation of the target application.

Since the usability information collecting unit 210 is embedded in the target application in the form of a library, the exception receiving unit 212 has a right to obtain information on the exception generated in the target application from the operating system. When an exception occurs by the information is transmitted to the operating system, the exception receiving unit 212 is to receive information about the exception from the operating system.

The screen information collecting unit 213 collects information (hereinafter, referred to as object information) about each object constituting the screen interface. The object information may include the size, coordinates, and identification ID of the object, or may be a captured image of a screen interface.

The questionnaire information collection unit 214 serves to present a questionnaire and receive a response thereto.

The storage unit 230 stores various questionnaires for collecting usability information, and the questionnaire information collecting unit 214 extracts a questionnaire stored in the storage unit 230 and presents it to the user and responds to it (hereinafter, Receiving a questionnaire response) and storing it in the storage unit 230.

In receiving the questionnaire response, the questionnaire information collecting unit 214 presents a questionnaire corresponding to the questionnaire presentation condition when a user command satisfying a preset condition (hereinafter, referred to as a questionnaire presentation condition) among user commands is input. And receive a response.

For example, when the user selects a specific button or selects a specific button for a predetermined number of times, the questionnaire information collecting unit 214 extracts a questionnaire related to the corresponding button from the storage unit 230 and presents it to the user.

As a result, the usability information collected by the usability information collecting unit 210 may include a type of an object corresponding to a user command, coordinates of a screen interface corresponding to the user command, information about an exception, a captured image of the screen interface, and a response to a questionnaire. It can be understood to include at least one of.

2 again, the input unit 220 performs a role of receiving a user command or a questionnaire response. The input unit 220 may include a button, a wheel, a jog shuttle, and the like to receive a command from a user. Here, the input unit 220 may be a single device by itself. For example, the wireless remote controller may serve as the input unit 220. That is, the user can input information using buttons and wheels provided in the wireless remote controller, and when the wireless remote controller is provided with an inertial sensor, the user can input information corresponding to the corresponding movement trajectory by applying movement to the wireless remote controller. Can be.

FIG. 2 illustrates that the input unit 220 and the output unit 250 are configured with different modules. However, when the usability measuring device 200 is equipped with a touch screen function, the input unit 220 and the output unit 250 are It may be composed of one module. That is, the user may input a user command based on the screen interface displayed on the screen.

The storage unit 230 stores the usability information collected by the usability information collecting unit 210. In addition, the storage unit 230 may store a questionnaire and a questionnaire response, and the questionnaire response may be stored in the usability information.

The output unit 250 outputs the input information input through the screen interface and the input unit 220. In addition, the output unit 250 may output the questionnaire extracted by the questionnaire information collecting unit 214, and may output the questionnaire analysis result when the usability analysis result is received from the usability analysis server 100.

The output unit 250 may output not only an image but also an audio. The input information, the questionnaire, and the usability analysis result input through the input unit 220 may be output in at least one of an image and an audio.

The communication unit 260 transmits the usability information collected by the usability information collecting unit 210 to the usability analysis server 100 and receives a usability analysis result from the usability analysis server 100.

In addition, the communication unit 260 may receive a questionnaire and a questionnaire presentation condition from the usability analysis server 100, and the received questionnaire and the questionnaire presentation condition are stored in the storage 230.

The controller 240 performs overall control of the usability information collecting unit 210, the input unit 220, the storage unit 230, the output unit 250, and the communication unit 260.

As described above, the command determiner 211 according to an embodiment of the present invention determines a user command input through the input layer 420 that is located above the screen interface 410 by the target application. Illustrates the screen interface 410 and the input layer 420 above it.

Various objects, such as a multimedia display window 411, a text display window 412, and a button 413, may exist on the screen interface 410. As the input layer 420 is located above the screen interface 410, input may be performed. The layer 420 preferentially acquires a user command compared to the screen interface 410.

For example, when the user selects a specific button using the input unit 220 implemented in the form of a touch screen, the user's finger 430 indicates a point 432 corresponding to the button, where the user's finger The first input of the touch command is the input layer 420.

Accordingly, the command determining unit 211 checks a button on the screen interface 410 using the coordinates of the point 431 touched on the input layer 420, and identifies identification information (for example, ID) can be sent to the target application. Thus, the target application can perform the operation assigned to the corresponding button.

At this time, the command determining unit 211 may store the usability information before transmitting the identification information of the button. That is, the coordinates on the screen interface 410 and the type of the selected object may be stored.

In addition, the determination result by the command determining unit 211 may be transmitted to the questionnaire information collecting unit 214, so that the questionnaire information collecting unit 214 determines whether the corresponding user command meets a preset questionnaire presentation condition. If so, the questionnaire may be presented and the questionnaire response may be received.

That is, the questionnaire is presented to the user before the operation of the corresponding button is performed, and since the questionnaire response is received from the user as soon as the user command is input, more reliable usability information can be obtained.

When the target application is driven to output the screen interface 410, the screen information collection unit 213 collects information about each object constituting the screen interface 410.

Thus, a user may input a user command through the input unit 220. For example, when a specific button is selected from the screen interface 410, the command determiner 211 may be configured on the input layer 420 on which the user command is input. Using the coordinates and the information about the object collected by the screen information collecting unit 213, it is determined which button is selected.

When the selection of the button is completed, the command determining unit 211 may transmit the identification information of the button or the coordinates in which the user command is input to the survey information collecting unit 214, and the survey information collecting unit 214 may receive the received information. It may be determined whether the questionnaire 500 is presented with reference to the information.

For example, the questionnaire information collecting unit 214 may present a questionnaire 500 when a specific button is selected or when a specific button is selected for a predetermined number of times.

Alternatively, the coordinates of the user command input by the user may be an empty space instead of a point where the object is located. The coordinates of the empty space may be transmitted to the survey information collecting unit 214 and the survey information collecting unit 214. May determine whether to present the questionnaire 500 using only the coordinates of the user command.

The questionnaire 500 presented by the questionnaire information collecting unit 214 may be presented in at least one form of an image and a voice, and FIG. 5 illustrates a questionnaire 500 composed of images.

The user may respond to the questionnaire 500 using the input unit 220. When the input of the questionnaire response is completed, the questionnaire information collecting unit 214 stores the input questionnaire response in the storage unit 230, and the questionnaire ( 500) from the screen.

As the questionnaire 500 is removed from the screen, control is transferred to the target application, and the target application performs an operation corresponding to the user command.

6 is a diagram illustrating a questionnaire input screen according to an embodiment of the present invention. A measurer who wants to measure the usability information. For example, a developer of the target application may prepare a questionnaire for the target application and provide the same to the user. FIG. 6 illustrates a questionnaire input screen 600 by the measurer.

The measurer may input the questionnaire content 620 and the selection item 630 for the questionnaire content through the questionnaire input screen 600, and may determine the arrangement of each object included in the screen.

In addition, the measurer can determine when the question is presented. That is, the point of time that the questionnaire is presented to the user at the time set by the measurer is presented to the user.

The checkpoint according to an embodiment of the present invention refers to a time point or condition at which a questionnaire is presented to a user, and the above-described questionnaire presentation condition may be used as information for determining whether the checkpoint has been reached.

The check point input screen 700 includes a check point list 710 and detailed items 720 for the selected check point.

The measurer may set a specific task among the tasks performed by the target application as a checkpoint and input the checkpoint list 710. For example, the measurer may start operation of the target application, log in, number of sessions, logout, and the like. It can be set as a checkpoint and entered in the checkpoint list.

FIG. 7 illustrates that the number of sessions in the checkpoint list is selected by the measurer, and a third session is entered as a detailed item.

According to this, when the session is performed for the third time, it becomes the questionnaire presentation condition. If the condition is satisfied, the questionnaire is presented to the user.

After the checkpoint is set as described above, the measurer can input the questionnaire while switching the checkpoint through the checkpoint selection item 610 included in the questionnaire input screen 600 of FIG. 6.

There may be a plurality of screen interfaces provided by the target application, and the usability analysis server 100 may analyze and provide usability for each screen interface.

The usability analysis result screen 800 includes Session 811, Duration 812, Interaction Count 813, Page View 814, Visit Rate ( Visit Ratio (815), Duration Ratio (816), Interaction Ratio (817), Unresponsive Action (818), Open App (821), At least one of a pre-close visit rate (Close App) 822, and a test page conversion rate (Test Activity) 823, 824.

8 illustrates a usability analysis result screen 800 for a specific screen interface 830 among a plurality of screen interfaces provided by a target application. Hereinafter, the screen interface that is the object of usability analysis is referred to as the target screen interface 830.

The session number 811 represents the number of visits to the target screen interface 830 after the operation of the target application is started.

The duration 812 represents a cumulative time for which the target screen interface 830 is output after the target application is installed.

The number of interchanges 813 indicates the number of times an object included in the destination screen interface 830 has been selected by the user.

The number of visits 814 represents a ratio of the number of visits to the target screen interface 830 after the current operation is started among the number of visits to the target screen interface 830 after the installation of the target application.

The visit rate 815 represents a ratio of the number of visits to the target screen interface 830 among the number of visits to the full screen interface after the target application is installed.

The sustain ratio 816 represents a ratio of the accumulated time of outputting the target screen interface 830 to the accumulated time of outputting the full screen interface after the target application is installed.

The interchange rate 817 represents the number of times the object included in the target screen interface 830 was selected by the user for the number of times the object included in the full screen interface was selected by the user after the target application was installed.

The non-response rate 818 represents a rate at which an object included in the destination screen interface 830 is not selected. The object screen interface 830 includes an object, such as a button, and an empty space. The number of times the empty space is selected among the total number of selections may be a non-response ratio.

The post-start visit rate 821 indicates a rate at which the target screen interface 830 is output among the entire screen interfaces after the target application is started.

The visit rate before termination 822 indicates a ratio at which the target screen interface 830 is output among the entire screen interfaces before the target application is terminated.

The test

page switching ratios

823 and 824 indicate a rate at which the target screen interface 830 is output after the specific test page is output or the specific test page is output after the target screen interface 830 is output.

In addition, the usability analysis result screen 800 may include a ratio in which each object and the empty space included in the target screen interface 830 are selected.

Meanwhile, the usability analysis result screen 800 illustrated in FIG. 8 is an example, and some items may be omitted or additional items may be added.

In addition, the usability analysis results for the plurality of screen interfaces instead of one target screen interface may be included in one usability analysis result screen.

Although embodiments of the present invention have been described above with reference to the accompanying drawings, those skilled in the art to which the present invention pertains may implement the present invention in other specific forms without changing the technical spirit or essential features thereof. You will understand that. Therefore, it should be understood that the embodiments described above are exemplary in all respects and not restrictive.

Claims

A usability information collecting unit configured to collect usability information on the target application by receiving a user command through an input layer located above the screen interface by the target application; And

Usability measuring device comprising a communication unit for transmitting the collected usability information.
The method of claim 1,

The usability information collecting unit includes a command determining unit determining the user command input through the input layer.

An exception receiving unit receiving information on an exception generated during operation of the target application;

A screen information collecting unit collecting information on each object constituting the screen interface; And

Usability measuring device further comprises at least one of the survey information collection unit for presenting the survey and receiving a response thereto.
The method of claim 2,

And the command determiner determines an object corresponding to the user command by referring to coordinates of the user command input on the input layer and coordinates of an object present in the screen interface.
The method of claim 3, wherein

The usability information includes at least one of a type of an object corresponding to the user command, coordinates on the screen interface corresponding to the user command, information about the exception, a captured image of the screen interface, and a response to the questionnaire. Usability measuring device.
The method of claim 2,

The survey information collecting unit, when a user command that satisfies a preset condition among the user command is input, the usability measuring device for presenting a questionnaire corresponding to the condition and receiving a response thereto.
The method of claim 1,

The usability information collection unit is a usability measurement device built in the target application.
Collecting usability information on the target application by receiving a user command through an input layer located above the screen interface by the target application; And

Usability measuring method comprising the step of transmitting the collected usability information.
The method of claim 7, wherein

The collecting of the usability information includes determining the user command input through the input layer.

Receiving information regarding an exception generated during operation of the target application;

Collecting information on each object constituting the screen interface; And

And presenting a questionnaire and receiving a response thereto.
The method of claim 7, wherein

The receiving of the user command may include determining an object corresponding to the user command by referring to coordinates of the user command input on the input layer and coordinates of an object present in the screen interface. .
The method of claim 9,

The usability information includes at least one of a type of an object corresponding to the user command, coordinates on the screen interface corresponding to the user command, information about the exception, a captured image of the screen interface, and a response to the questionnaire. Usability measurement method.
The method of claim 8,

The presenting of the questionnaire and receiving a response thereto may include determining whether a user command satisfying a preset condition among the user commands has been input; And

And presenting a questionnaire corresponding to the condition and receiving a response when a user command satisfying a preset condition is input according to the determination result.
The method of claim 7, wherein

The usability information collection unit performing the step of collecting the usability information is a usability measurement method embedded in the target application.