JP2011253348A - Usability evaluation support device, method and program for web base system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To support an evaluator to perform the usability evaluation of a Web system by using a cognitive walkthrough method by omitting a question which may lead to the same answer as a question item which has been previously answered in order to cope with such a problem that the amounts of question items to be answered become huge.SOLUTION: A usability evaluation support device is provided with: a maintenance means for storing not only the question item of usability evaluation preliminarily prepared in association with evaluation object Web but also a question answered by an evaluator in the past and an operation event and the source of the Web; a comparison means for comparing the source of the evaluation object Web and the operation event to the operation object with the source answered in the past and the operation event stored in the maintenance means, and for determining whether or not the evaluation object Web is pertinent to the answer result which is similar with the past evaluation; and a control means for omitting a question which it may not be necessary to evaluate with respect to the evaluation object Web according to the result of determination.

Description

  The present invention relates to an apparatus, a method, and a program for supporting usability evaluation of a graphical user interface (GUI) related to a Web system.

  Non-Patent Document 1 describes a cognitive walk-through method that is one of conventional methods for evaluating usability. This is an inspection method in which the evaluator evaluates usability from the user's standpoint, and is pre-defined based on a cognitive model that models the process of exploring and learning a system that the user does not know how to use. It is a way to find usability problems by answering the questions asked. In this method, a task (task) to be achieved is given at the time of evaluation, and the evaluator answers a plurality of question item sets each time an operation action sequence (subtask) for achieving the task is executed. It will be. Subtasks are a subset of tasks. For example, “Enter a model number and click a search button” or “Enter a quantity and click an order button” for a task “Order a computer”. Subtask exists.

  Patent Document 1 obtains a user's subjective evaluation result by inputting an answer to a question for each screen together with log data such as a screen transition operated by the user in order to perform usability evaluation of a website. This is a document describing a usability evaluation support method.

  Patent Document 2 acquires an evaluation result (emotion information) that a user feels for each screen together with an operation history (transition information) such as screen transitions operated by an evaluation target user, and scores the feeling of use for each browsing route. This is a document describing a usability evaluation support method.

JP 2004-013242 A JP 2006-31383 A

C. Wharton, J. Rieman, C. Lewis and P. Polson, The Cognitive Walkthrough Method: A Practitioner's Guide, Usability Inspection Methods, J. Nielsen and RL Mack (Eds.), Pp.105-140, Jon Wiley & Sons , Inc., 1994

  When evaluating the usability of a graphical user interface by the method of Non-Patent Document 1, it is necessary to execute a plurality of subtasks for a given task, and the evaluator assigns a plurality of question items each time one subtask is executed. It is necessary to answer.

  If there are not many tasks and subtasks, it will not take time to answer the question items. On the other hand, when evaluating a complicated Web system or the like, many tasks and subtasks must be evaluated, which takes a lot of man-hours for the evaluation. Assuming that the number of question items for one subtask is 10, the average number of subtasks for one task is 5, and there are 40 tasks to be evaluated, the number of questions to be answered is 10 × 5. × 40 = 2000 (pieces) It takes a lot of man-hours to manually answer all of these question items, and it may be necessary to mechanically select or omit the question items to be answered.

  Even in the usability evaluation support methods described in Patent Literature 1 and Patent Literature 2, no consideration is given to the amount of question items and the man-hour for answering the questions.

  An object of the present invention is to provide a usability evaluation support apparatus for a web-based system that selects and omits question items to be answered from an evaluation step in a usability evaluation method that extracts usability problems of a web system by answering question items. It is to provide a method and a program.

  The user system evaluation support apparatus for a Web system according to the present invention includes a question answer of an evaluator who has been answered in the past, an operation event, together with a question item of user ability evaluation prepared in advance in association with the Web to be evaluated. And a storage means for storing and holding the Web source, an operation event for the Web source and the evaluation object to be evaluated, and a source and an operation event that have been answered and stored in the storage means in the past, By comparing the evaluation target Web with the evaluator, a comparison unit that determines whether the answer item is considered to be a pattern that is considered to be input to the question item in the past, and according to the determination result by the comparison unit , I will omit the question items that do not need to be evaluated by the evaluator for the evaluation target Web And a control means for presenting question items to the evaluator.

  According to the present invention, in a usability evaluation method for extracting a usability problem of a Web system by answering a question item, a question item that has the same answer as a question item that has been answered in the past is displayed with a similar operation component or screen configuration. It is possible to efficiently perform usability evaluation by omitting evaluation regarding similar question items.

It is a block diagram which shows the structure of the form for implementing 1st invention of this invention. It is a figure which shows the example of a similar pattern. It is a block diagram which shows the structure of the form for implementing 1st invention of this invention. It is a flowchart which shows the operation | movement of the form for implementing 1st invention. It is a flowchart which shows the operation | movement of the form for implementing 1st invention. It is a flowchart which shows the operation | movement of the form for implementing 1st invention. It is a flowchart which shows the operation | movement of the form for implementing 1st invention. It is a figure which shows the example of an evaluation window. It is a figure which shows the example of the question answer screen of an evaluation window. It is a figure which shows the example of event information. It is a figure which shows the example of the matching rule of a question and a similar pattern. It is a figure which shows the example in case the change of a screen structure is the same.

  Next, embodiments for carrying out the invention will be described in detail with reference to the drawings.

  Referring to FIG. 1, a usability evaluation support device 10 for a web-based system according to a first embodiment of the present invention includes a browsing operation receiving unit 101, a browsing operation unit 102, a browsing display control unit 103, and browsing information. The acquisition unit 104, the event analysis unit 105, the subtask comparison unit 106, the question answer reception unit 107, the storage unit 108, and the evaluation display control unit 109 are configured.

  The browsing operation receiving unit 101 receives the browsing operation of the user input with the input device 12. The browsing operation unit 102 identifies and interprets the user operation information received by the browsing operation receiving unit 101, accesses the server 13 via the network, requests information on the Web page of the evaluation target Web system 131, and browses Receive information to do. The browsing display control unit 103 identifies the information of the Web page received by the browsing operation unit 102, generates display screen data to be viewed by the user, and displays it on the browsing window 111 of the display device 11. The browser is responsible for displaying the browsing window 111.

  The browsing information acquisition unit 104 acquires the source of the Web page browsed by the user from the browsing operation unit 102 and stores it in the storage unit 108. The browsing information acquisition unit 104 captures a screen image (screen shot) of the Web page and stores it in the storage unit 108. The event analysis unit 105 analyzes a user's browsing operation event acquired from the browsing operation receiving unit 101 and a source of HTML (Hyper Text Markup Language) corresponding to the event, and determines which operation component (radio button or An operation event such as whether a check box, a menu button, or the like is clicked is stored in the storage unit 108 as event information.

  The subtask comparison unit 106 compares the event information analyzed by the event analysis unit 105 with the event information stored in the storage unit 108 in the past, and stores the Web page source acquired by the browsing information acquisition unit 104 in the past. The Web page source stored in the unit 108 is compared to determine whether there is a pattern similar to the operation component or the display screen. Here, the operation parts / display screens are classified into four similar patterns depending on how they are similar. Four similar patterns are shown in FIGS. Pattern 1 has the same or similar screen configuration, Pattern 2 has the same operation component name (display character), Pattern 3 has the same operation component type and display method, and Pattern 4 has the same operation component arrangement. . The operation parts here are buttons, links, text boxes, radio buttons, check boxes, pull-down menus, etc. that the user must click or input to achieve the purpose. Then, based on the similar pattern, it is determined which question can be omitted based on the question that has been answered in the past.

  The question / answer receiving unit 107 receives an answer from the user to the question about the Web page to be evaluated from the input device 12 and stores it in the storage unit 108 as question / answer information.

  The storage unit 108 is a database that stores information handled by the usability evaluation support apparatus 10 for the Web-based system. FIG. 3 shows information stored in the storage unit 108. Information stored in the storage unit 108 is a rule 201 for associating a question with a similar pattern, event information 202, source information 203, screen image information 204, question answer information 205, and question item information 206.

  The rule 201 for associating a question with a similar pattern is a rule that defines which question is omitted if it is applicable to which similar pattern, and one or more similar patterns can be associated with one question item. . The subtask comparison unit 106 uses the association rule 201 between the question and the similar pattern to specify a question item that has the similar pattern and should be omitted from asking the evaluator.

  The event information 202 is information related to an operation event such as which operation component on the Web page the user clicked. The information recorded as the event information 202 includes operations such as “click”, “select”, and “input” performed by the user, and information on the component that is the target of the operation. Further, it is stored in association with the subtask. The information is stored by the event analysis unit 105 and is used by the subtask comparison unit 106 to determine the similar pattern of the operation component. Further, as the event information, the time required for the operation, the movement path of the cursor, and the movement distance may be acquired and analyzed and recorded in the storage unit 108.

  The source information 203 is HTML source code of a Web page viewed by the user. Stored in association with subtasks. The information is stored by the browsing information acquisition unit 104 and is used by the subtask comparison unit 106 to determine the degree of similarity such as the screen configuration.

  The screen image information 204 is a screen shot of a web page viewed by the user. Stored in association with subtasks. The information is stored by the browsing information acquisition unit 104 and displayed on the evaluation window 112 by the evaluation display control unit 109.

  The question answer information 205 is an answer to the question item input by the user. Stored in association with subtasks. The input answer is stored by the question answer receiving unit 107 and displayed on the evaluation window 112 by the evaluation display control unit 109.

  The question item information 206 is a question item group for pointing out a usability problem of the Web page to be evaluated, which is prepared and registered in advance by an administrator. Stored in association with subtasks.

  The evaluation display control unit 109 extracts the question item information 206 to be displayed for the subtask to be evaluated by the evaluator based on the determination result in the subtask comparison unit 106, and displays the extracted question item in the evaluation window 112. To do. In other words, for the subtask to be evaluated, even if the evaluator does not evaluate it by man-hours, since the device can estimate the answer from the past answer result, the question item that does not need to be answered is evaluated item The question item is presented to the evaluator. In addition, if necessary, answers to questions in past similar subtasks are also displayed.

  Next, an operation example of the usability evaluation support device 10 for the web-based system will be described with reference to the flowchart of FIG. In the following, an operation example for evaluating a subtask will be described.

  When the user presses the evaluation start button displayed on the evaluation window 112, the Web-based system usability evaluation support apparatus 10 starts recording a browsing operation (evaluation operation) (step S101). The event analysis unit 105 sets the browsing operation recording flag to ON, and sets the subtask counter for identifying the same subtask to 0. Further, the browsing information acquisition unit 104 acquires a screen image together with the source of the Web page of the browsing window 111 at the time when the evaluation start button is pressed, and stores it in the storage unit 108 together with the subtask counter (step S102). The event analysis unit 105 continues to monitor the user's browsing operation on the browsing window 111 until an event is received (steps S103 and S104). When the event is received, the event is analyzed, and the event information 202 is stored together with the value of the subtask counter (step S105). If the event is not a click on a button or a link, the process returns to step S103 to continue monitoring the browsing operation (step S106). When the event is a click such as a button or a link, the browsing information acquisition unit 104 stores the screen image and the source code together with the value of the subtask counter (step S107). The subtask counter is incremented by 1 in order to use a button / link click as a subtask break (step S108).

  The subtask comparison unit 106 compares the event information of the current subtask with the event information of the past subtask, compares the source of the current web page with the source of the past web page, and whether there is a similar pattern between the current subtask and the past subtask And the type of the pattern is specified (step S109). If there is a past subtask that applies to any of the similar patterns described above for the subtask under evaluation, the evaluation display control unit 109 determines the question corresponding to the similar pattern based on the rule 201 for associating the question with the similar pattern. Is acquired from the storage unit 108 as an already acquired answer and displayed on the evaluation window 112. Alternatively, the question items are omitted as already answered, and only the remaining question items are displayed in the evaluation window 112. Further, the screen image of the Web page corresponding to the previous subtask is taken out from the storage unit 108 and displayed on the evaluation window 112 so that the user can evaluate (answer input) by looking at the evaluation target screen (steps S110 to 112). . It should be noted that information that can be used to select whether or not to display an answer received in the past when each question corresponds to a similar pattern is included in the rule 201 for associating a question with a similar pattern. Good. Moreover, you may make it determine whether display or omission is performed according to the kind of similar pattern.

  If there is no subtask that applies to the similar pattern in step S110, the evaluation window 112 displays the subtask under evaluation from the question item 206 without acquiring the answer input in the past from the question answer information 205 or omitting the question. All the associated question items are displayed (steps S110 and S112).

  The question answer receiving unit 107 receives an answer input from the evaluator via the input device 12 for the question item displayed in the evaluation window 112, and waits for an instruction to the next step (step S113).

  When an instruction to the next step is received and the user presses the evaluation end button of the evaluation window 112 and the browsing operation record flag is OFF, the operation is ended, otherwise, the process returns to step S103 and the next subtask is processed. Is continuously monitored (step S114).

  Here, the operation for specifying the similar pattern of the subtask in step S109 will be described in detail with reference to the flowcharts of FIGS.

  First, referring to FIG. 5, the operation of determining a similar pattern for each subtask will be described. The subtask comparison unit 106 extracts the source information 203 and the event information 202 from the storage unit 108 in order from the subtask whose subtask counter is 0 (steps S201 and S202). Then, by comparing the source information 203, it is determined whether or not the similar pattern 1 is applicable (step S203). Next, by comparing the event information 202 and the like, it is determined whether or not the similar patterns 2 to 4 are applicable (steps S204 to S206). The determination of similar patterns to all past subtasks that can be compared with the current subtask is repeated (steps S207 and S208).

  Next, the algorithm for determining the similar pattern in steps S203 to S206 will be described in detail.

Pattern 1 is a case where screen configurations are similar. In order to determine whether or not the pattern 1 is applicable, an edit distance (Levenstein distance) between HTML sources of Web pages is obtained. The edit distance is an index indicating how many times character insertion, deletion, and replacement can be performed when converting from the character string α to the character string β. If the edit distance between the character string strα composing the screen α and the character string strβ composing the screen β is expressed as LD (strα, strβ) and the number of characters of the character string strα is expressed as len (strα), len (strα)> When len (strβ), the similarity sim (α, β) between the screen α and the screen β can be defined by the following formula (1).

  If the similarity is greater than a predetermined threshold, it is determined that the screen configuration is not similar, and if the similarity is small, it can be determined that the screen configuration is similar.

  Pattern 2 is a similar pattern in which the notation or the like of the operation component is the same. Whether or not the pattern 2 is applicable can be determined by taking out the label name of the part operated by the user from the event information 202 and comparing it. A flowchart example of this processing is shown in FIG. If the part operated by the user is a link (S301), first refer to the innerHTML of the <A> tag (a character string including a tag surrounded by tags) to check whether the <IMG> tag is included. (S302). If the <IMG> tag is included, since it is in the image link, the alt attribute of the <IMG> tag is used as the label name of the operation component (S303). If the <IMG> tag is not included, the link is a text link, so the inner text of the <A> tag (a character string that does not include a tag surrounded by tags) is used as the label name (S304).

  If the part operated by the user is a button (S305), the value attribute of the <INPUT> tag is set as the label name of the operating part (S306). If the component operated by the user is a text box, radio button, check box, or pull-down menu (S307), the name attribute of the <INPUT> tag is set as the label name of the operation component (S308). Then, the label name acquired in the current subtask and the label name acquired in the past subtask are compared. ). This process is continued until all the past event information 202 is compared (S312).

  Pattern 3 is a similar pattern in which the types and display methods of the operation parts are the same. FIG. 7 shows a flowchart of a processing example for determining whether or not the pattern 3 is applicable. First, the event information of the current subtask and the event information of the past subtask are compared (S401), and it is identified whether or not the type of operation component (link, button, text box, etc.) is the same (S402). If the types are not the same, it is determined that the pattern 3 is not applicable (S408). If the types are the same, it is next checked whether the type of the operation component is a link (S403). If it is not a link, it is immediately determined that the pattern 3 is true (S409).

  If the type of the operation component is a link, it is checked whether the <IMG> tag is included in the innerHTML of the <A> tag (S404). If the <IMG> tag is included, the src attribute of the <IMG> tag is compared, and if it is not the same, the pattern 3 is not applied (S405, S408). If the src attribute is the same as the text link, the <HTML> innerHTML of the <A> tag includes the <FORM> tag, <SPAN> tag color attribute, size attribute, <B> (bold), and <U> It is confirmed whether a character decoration tag such as (underline) is included (S406). If they are not included, it is determined that the pattern 3 is applicable (S409). When the character decoration is included, if the same character decoration is included in both, it is determined that the pattern 3 is applicable (S407, S409). If the character decorations are not the same, it is determined that the pattern 3 does not apply. If it is not the last event information, the process returns to step S701 and is repeated (S410).

  Pattern 4 is a similar pattern in which the operation components are arranged in the same manner. Whether or not the pattern 4 is applicable is considered to be applicable to the pattern 4 if the coordinates (x, y) of the clicked operation component coincide with the coordinates of the past event information within a predetermined error range.

  In patterns 2 to 4, a plurality of pieces of event information 202 may be included in one subtask. However, if even one piece of event information applies to the similar pattern, the subtasks also apply to the similar pattern.

  When evaluating a task, the Web pages of subtasks constituting the task are referred to the Web source and the operation event to the evaluation target over a plurality of pages while following the screen transition (change of the Web page). This may be achieved by determining similarity, or an evaluation page may be provided separately for the task.

  As described above, by operating the usability evaluation support device, it is possible to select or omit the question items to be answered by the evaluator at the time of usability evaluation of the Web base system to be evaluated. This is achieved by determining the question items that are considered to have the same answers as the question items answered in the past even if the evaluator evaluates the evaluation target Web from the similarity of the operation parts and the screen configuration. .

  That is, when evaluating the usability of the Web using the cognitive walkthrough method (the method of Non-Patent Document 1) and Patent Documents 1 and 2, the same answer as the answer to the past question is repeatedly performed in the process of answering the question item. The waste of man-hours can be reduced. In the present invention, the task or subtask being evaluated is identified when the parts to be operated have the same characteristics or the screen structure is substantially the same, and the answer to the similar question can be omitted.

  Next, the operation of the embodiment for carrying out the present invention will be described using an example showing a specific display.

  The evaluator operates the input device 12 while referring to the evaluation target Web system in the browsing window 111 and inputs the evaluation result in the evaluation window 112. FIG. 8 is a display example of the evaluation window 112. The evaluation window 112 includes a screen image display screen 801, a question answer screen 802, an evaluation start button 803, and an evaluation end button 804. When the evaluation start button 803 is pressed, recording of the browsing operation is started, and when the evaluation end button 804 is pressed, recording of the browsing operation is ended.

  Each time the evaluator clicks a link or button, the evaluator performs an evaluation on the previous Web page. When the button or link is clicked, the evaluation target Web system 131 displayed in the browsing window 111 transitions to the next screen. Therefore, the evaluation is performed while viewing the screen image of the previous screen displayed in the evaluation window 112 during the evaluation. I do. Note that the evaluation target Web system 131 may be displayed in the browsing window 111 so that it can be seen that the Web screen is to be evaluated, and it is desirable to display the screen before transition in order to assist evaluation input.

  FIG. 9 is an enlarged view of the question answer screen 802 of the evaluation window 112. In the upper part of the screen, the question items associated with the subtasks to be evaluated are similar to any of the similar patterns, and the answers to the question items for the past subtasks included in the question answer information 205 have been extracted and extracted The problem 901 is displayed. In other words, when the evaluator evaluates the question item of the subtask to be evaluated, the answer result that will be input is displayed. There is a check box next to each problem, and if there is a problem that has been applied to the past subtask but not to the subtask currently being evaluated, it should not be handled as a problem by unchecking the check box. Can do. When the check box is unchecked, the omitted question item is displayed in the answer column 902 and the item can be answered. Below the extracted problem 901, an answer column 902 for a question item is provided. Answer “Yes” or “No” to the question and enter the reason in the text box. By pressing a question answer storage button 903, the contents of the answer can be stored in the storage unit.

  If the subtask comparison unit 106 determines that the currently evaluated subtask is similar to the past subtask in any similar pattern, the question item corresponding to the similar pattern is omitted so as not to be displayed on the question answer screen 802. Is done. In the example of FIG. 9, Q2 is followed by Q5, and Q3 and Q4 question items are omitted, but it is determined that Q3 and Q4 are the same as questions that have already been answered in similar subtasks. Because. When the user finishes the evaluation work of the subtask in the evaluation window 112, returns to the operation of the browsing window 111, and clicks a link or button, the evaluation shifts to the next subtask.

  In addition, without displaying the question item, the extracted question may be input to the answer item as the corresponding item, and the answer input to the question item may be omitted.

  Next, information recorded in the storage unit 108 will be exemplified. An example of the event information 202 will be described with reference to FIG. The event information 202 includes items of an event 1001, a tag 1002, a component type 1003, a label 1004, a decoration 1005, and coordinates 1006. The event 1001 is an operation related to an operation applied to the operation component, such as a click operation. In the case of a text box, it becomes an input (type) operation. In addition, operations such as drag-and-drop and double-clicking that carry a predetermined icon to a predetermined position may be registered in the event 1002. A tag 1002 is an HTML tag indicating an operation component to which an event is applied. The component type 1003 is a component type determined from the tag, and is a text link, an image link, a button, a text box, a radio button, a check box, a pull-down menu, or the like. A label 1004 is a label name of the operation component extracted from the tag. The method for specifying the label name is as shown in steps S301 to S308 in FIG. The decoration 1006 is a tag for performing decoration such as a color and a size when the component type is a text link or an image link, and an attribute of the tag. <B> element (bold), color attribute (color), size attribute (size), etc. apply. A coordinate 1007 is a position on the screen of the operation component. The event information 202 stores the subtask to which it belongs, the value of the subtask counter, and the like in association with each operation event.

  Next, an example of the association rule 201 between the question and the similar pattern is shown in FIG. This correlates with which similar pattern the answer to the question item is considered to be the same. For example, Q1 is a question “What can the user know to do first in order to achieve the objective?” This is the same objective, and if the screen configuration is the same, the evaluator will The answers will be the same. Therefore, when the similar pattern is pattern 1, the answer result of the previous question is presented as the question of Q1. The question of Q2 is a question “Does the user notice the presence of the operation component?”, But this has the same screen configuration, the same type and display method of the operation component, and the same arrangement of the operation component. If this is the case, it will be the same answer. Therefore, when all the patterns 1, 3, and 4 are applicable, the answer to the previous question is presented in the question of Q2. The same applies to Q3 to Q6. Since Q7 to Q9 are questions that are determined by looking at changes in the screen over a plurality of visually different pages, it is considered that the answers to the questions will be the same if the changes in the screen configuration are the same. That is, it is only necessary to check whether the past subtask has the same screen configuration change as the screen configuration change of the subtask under evaluation and the next subtask. It should be noted that the change in the screen over a plurality of visually different pages is, for example, a screen change in which the screen is switched to another Web page when a button is clicked, or a hidden screen based on a program embedded on the Web page. This refers to a change in the screen that displays a hidden character or hides a character.

  In the example shown in FIG. 12, the subtask 11 that is the subtask being evaluated and the subtask 1 that has been evaluated in the past are similar in the similar pattern 1, and further evaluated with the subtask 12 that is the subtask next to the subtask 11 that is being evaluated. Since the subtask 2 corresponding to the next subtask of the already completed subtask 1 is similar in the similar pattern 1, the change in the screen configuration visually displayed from the subtask 11 to the subtask 12 is the change in the screen configuration from the subtask 1 to the subtask 2 It can be determined that

  By configuring and operating in this way, for example, in one subtask A, after inputting a name, address, and telephone number into a text box, an operation of pressing a button “confirm” is performed, and another subtask In B, when the user selects gender, age, and occupation from the radio buttons or pull-down menus and presses the button labeled “Confirm”, “User knows the meaning of the word“ Confirm ”. The answer to the question “Do you?” Can be omitted from the second time. This is because it is determined that the evaluator's answer result for subtask A and the answer result for subtask B are the same.

  In this way, if the answer to the question item is the same as the answer of the question item to the subtask executed in the past, the answer to the past question is diverted to reduce the number of question items to be answered, By omitting the man-hours necessary for answering, it becomes possible to efficiently evaluate the evaluation target.

  Moreover, it can be estimated whether the answer to a question will become the same as the answer of a past question item by determining whether the characteristic of a component to operate and a screen structure are similar.

  In addition, since it depends on the nature of the question whether the feature is similar and the answer to the question item is the same, the rule for associating the question with the similar pattern is determined, so the similar pattern based on the rule This makes it possible to efficiently determine questions that are considered to have the same answer.

  As described above, according to the present invention, it is possible to select or omit question items to be answered and to omit evaluation on similar question items at the time of usability evaluation of the Web-based system to be evaluated.

In addition, this invention is not limited to the said embodiment and Example. The configuration and operation of the present invention can be modified in various manners that can be understood by those skilled in the art within the scope of the present invention.
For example, in the case of a usability evaluation program for a Web system that is installed and used in a personal computer, the browsing operation is received by operating hardware such as a CPU that is expanded in a main memory RAM and functions as a control unit. Unit 101, browsing operation unit 102, browsing display control unit 103, browsing information acquisition unit 104, event analysis unit 105, subtask comparison unit 106, question answer reception unit 107, storage unit 108, and evaluation display control unit 109 function as a personal computer Let

  At this time, the usability evaluation support program for the Web-based system stores, in the HDD, a rule 201 for associating a question with a similar pattern, event information 202, source information 203, screen image information 204, question answer information 205, question item information 206, and the like. Keep the memory. Further, the program may be recorded on a storage medium and distributed. The program recorded in the storage medium is read into the main memory via wired, wireless, or the recording medium itself, and operates hardware such as a control unit.

  If the usability evaluation support program for the Web-based system is described in another expression, the program is expanded in the RAM and provides usability evaluation means to the evaluator and receives an evaluation start instruction from the input device or the like. Then, the evaluator operates the GUI of the Web system that is the evaluation target stored in the server, HDD, etc., and inputs an answer to each question item relating to usability. The answer information input by the evaluator is stored in the storage means in association with various information. By allowing the evaluator to continue a series of evaluations, evaluation items for which the evaluator makes similar evaluations are generated. The program according to the present invention stores in advance a pattern that makes a similar evaluation such as the evaluation item, and extracts a question item that matches the pattern. That is, the source that is being evaluated and the evaluated target are compared in terms of source, operation (event), and the like, and answers that can be used as the target being evaluated are extracted from the evaluated answers. The extracted response is a response that can be reflected on items that need not be evaluated by the evaluator. The evaluation device uses the extracted information to omit the evaluator from inputting an answer to the question item to be presented via the display device, or to enter the answer item in advance, or similar to the omitted question item You can make adjustments by displaying selectable answers in the past.

In addition, a part or all of the above-described embodiments can be described as follows. Note that the following supplementary notes do not limit the present invention.
[Appendix 1]
A storage means for storing and storing question answers, operation events, and web sources that have been answered in the past by the evaluator, along with usability evaluation question items prepared in advance in association with the web to be evaluated,
The evaluation source is evaluated by comparing the source of the Web to be evaluated and the operation event to the evaluation target with the source and the operation event that have been answered in the past and stored in the storage means. A comparison means for determining whether or not a pattern that is considered to input an answer result similar to the answer result that was previously answered in the question item by
Control means for presenting question items to the evaluator so as to omit question items that are considered unnecessary for the evaluator to evaluate the Web to be evaluated according to the determination result by the comparing means. A usability evaluation support apparatus for a web-based system characterized by the above.
[Appendix 2]
A usability evaluation support device for a web-based system as described above,
The comparison means includes
Usability evaluation for a web-based system characterized in that a comparison between an evaluation object and a past evaluation result is made by referring to a Web source over a plurality of visually different pages and an operation event to the evaluation object to determine similarity. Support device.
[Appendix 3]
A usability evaluation support device for a web-based system as described above,
The comparison unit includes:
For similarity judgment of screen composition,
Calculate the edit distance between the sources of the web pages to be compared,
A usability evaluation support device for a Web-based system, wherein the edit distance is used to determine whether the compared screen configurations are similar or dissimilar.
[Appendix 4]
A usability evaluation support device for a web-based system as described in the above supplementary note,
The comparison unit includes:
For similarity determination of operation parts and / or display screen,
Analyze the source of the Web page to be compared, and based on the similarity of the display character and the ortho attribute of the target part that has received the operation event, the similar or dissimilarity of the compared operation part and / or display screen A usability evaluation support device for a Web-based system, characterized by determining.

[Appendix 5]
A usability evaluation support device for a web-based system as described above,
The control means includes
A usability evaluation support device for a web-based system, characterized by omitting inputting an answer as omission of a question item.
[Appendix 6]
A usability evaluation support device for a web-based system as described above,
The control means includes
A usability evaluation support device for a web-based system, characterized in that the question item is omitted, and the answer item is already input.
[Appendix 7]
A usability evaluation support device for a web-based system as described above,
The control means includes
Usability for a Web-based system characterized in that, in addition to omitting a question item, an answer that has been answered in the past similar to the omitted question item is displayed in a selectable manner, and the omission of the question item can be canceled by an evaluator's selection operation Evaluation support device.
[Appendix 8]
A browsing operation receiving unit for receiving a Web browsing operation;
A browsing operation unit that executes a browsing operation and acquires Web page information;
A browsing display control unit for displaying information received by the browsing operation unit on a screen;
A browsing information acquisition unit that acquires a screen image of a Web page and stores it together with a source of the Web page received from the browsing operation unit;
An event analysis unit that receives an event of a browsing operation from the browsing operation unit, analyzes which operation component is operated, and sets it as event information;
A question answer receiving unit for receiving an answer to the question input from the input device;
A storage unit for storing the source of the web page, the acquired screen image, event information, and answer information to the question;
Compare the web page source and event information of the subtask currently being evaluated and the past subtask,
Judge whether it is applicable to the similar pattern of “same or similar screen configuration”, “same operation component name”, “same operation component type / display method”, “same operation component layout”
A subtask comparison unit that identifies a question item to be omitted based on a similar pattern and question item association rule;
Usability evaluation for a Web-based system, comprising: an evaluation display control unit that acquires information used for evaluation displayed in the evaluation result input window from a storage unit based on a determination result of the subtask comparison unit, and controls display Support device.

[Appendix 9]
Along with usability evaluation question items prepared in advance associated with the evaluation target Web, the evaluator stores the question answer, operation event, and Web source that have been answered in the past in the storage means,
A question item is obtained by comparing the source and operation event of the Web to be evaluated and the operation event to the evaluation target with the source and operation event that have been stored and held in the past, and allowing the evaluator to evaluate the evaluation target Web. To determine whether it corresponds to a pattern that is considered to input the same answer result as the answer result answered in the past,
According to the determination result, the question item is presented to the evaluator via the display unit so as to omit the question item considered not to be evaluated by the evaluator with respect to the Web to be evaluated. A usability evaluation method for a web-based system.
[Appendix 10]
A usability evaluation method for a web-based system as described in the above supplementary note,
The comparison is
Usability evaluation for a web-based system characterized in that a comparison between an evaluation object and a past evaluation result is made by referring to a Web source over a plurality of visually different pages and an operation event to the evaluation object to determine similarity. Method.
[Appendix 11]
A usability evaluation method for a web-based system as described in the above supplementary note,
The comparison is
For similarity judgment of screen composition,
Calculate the edit distance between the sources of the web pages to be compared,
A usability evaluation method for a Web-based system, wherein similarity or dissimilarity of compared screen configurations is determined using the edit distance.
[Appendix 12]
A usability evaluation method for a web-based system as described in the above supplementary note,
The comparison is
For similarity determination of operation parts and / or display screen,
Analyze the source of the Web page to be compared, and based on the similarity of the display character and the ortho attribute of the target part that has received the operation event, the similar or dissimilarity of the compared operation part and / or display screen A usability evaluation method for a web-based system, characterized by determining.
[Appendix 13]
A usability evaluation method for a web-based system as described in the above supplementary note,
Presentation of a question item that omits the question item
A usability evaluation method for a web-based system, characterized in that inputting an answer is omitted as omission of a question item.
[Appendix 14]
A usability evaluation method for a web-based system as described in the above supplementary note,
Presentation of a question item that omits the question item
A usability evaluation method for a Web-based system, characterized in that, as an omission of a question item, the answer item is already input.
[Appendix 15]
A usability evaluation method for a web-based system as described in the above supplementary note,
Presentation of a question item that omits the question item
For a Web-based system, wherein a question item is omitted, a reply answered in the past similar to the omitted question item is displayed in a selectable manner, and the omission of the question item is canceled by an evaluator's selection operation Usability evaluation method.
[Appendix 16]
Receive web browsing operations,
Execute browsing operation, acquire information of web page,
Display the acquired information on the screen,
Acquire the screen image of the displayed Web page, store it with the acquired Web page source,
Receives browsing operation events for displayed web pages, analyzes and stores which operating components have been operated,
Receive and store answers to questions entered from input devices,
Compare the web page source and event information of the subtask currently being evaluated and the past subtask,
Judge whether it is applicable to the similar pattern of “same or similar screen configuration”, “same operation component name”, “same operation component type / display method”, “same operation component layout”
Identify question items that should be omitted based on similar pattern and question item mapping rules,
A usability evaluation method for a Web-based system, characterized in that the question items to be displayed are controlled based on information stored in an evaluation result input window for evaluation displayed based on a determination result.

[Appendix 17]
The control unit of the information processing device
A storage means for storing and storing question answers, operation events, and web sources that have been answered in the past by the evaluator, along with usability evaluation question items prepared in advance in association with the web to be evaluated,
The evaluation source is evaluated by comparing the source of the Web to be evaluated and the operation event to the evaluation target with the source and the operation event that have been answered in the past and stored in the storage means. A comparison means for determining whether or not a pattern that is considered to input an answer result similar to the answer result that was previously answered in the question item by
According to the determination result by the comparison means, the evaluator is caused to function as a control means for presenting a question item so as to omit a question item that is considered unnecessary to be evaluated by the evaluator with respect to the Web to be evaluated. A usability evaluation program for a web-based system characterized by the above.
[Appendix 18]
A usability evaluation program for a web-based system as described above,
The comparing means;
A Web base characterized in that a comparison between an evaluation target and past evaluation results is performed so as to determine similarity by referring to Web sources and operation events to the evaluation target over a plurality of visually different pages. System usability evaluation program.
[Appendix 19]
A usability evaluation program for a web-based system as described above,
The comparison unit is
For similarity judgment of screen composition,
Calculate the edit distance between the sources of the web pages to be compared,
A usability evaluation program for a Web-based system, which is operated so as to determine whether the compared screen configurations are similar or dissimilar using the editing distance.
[Appendix 20]
A usability evaluation program for a web-based system as described above,
The comparison unit is
For similarity determination of operation parts and / or display screen,
Analyze the source of the Web page to be compared, and based on the similarity of the display character and the ortho attribute of the target part that has received the operation event, the similar or dissimilarity of the compared operation part and / or display screen A usability evaluation program for a web-based system, characterized by being operated so as to be determined.
[Appendix 21]
A usability evaluation program for a web-based system as described above,
The control means;
A usability evaluation program for a web-based system, characterized in that an operation for inputting an answer as an omission of a question item is omitted.
[Appendix 22]
A usability evaluation program for a web-based system as described above,
The control means;
A usability evaluation program for a web-based system, which is operated so as to omit a question item and input an answer item in advance.
[Appendix 23]
A usability evaluation program for a web-based system as described above,
The control means;
Along with the omission of the question item, it is possible to display selectable answers answered in the past that are similar to the omitted question item, and operate so that the omission of the question item can be canceled by the evaluator's selection operation Usability evaluation program for web-based systems.
[Appendix 24]
The control unit of the information processing device
A browsing operation receiving means for receiving a browsing operation on the Web;
A browsing operation means for executing a browsing operation and acquiring information of a web page;
Browsing display control means for displaying information received by the browsing operation means on a screen;
Browsing information acquisition means for acquiring a screen image of the Web page and storing it together with the source of the Web page received from the browsing operation means;
An event analysis unit that receives an event of a browsing operation from the browsing operation unit, analyzes which operation component is operated, and sets the event information;
A question answer receiving means for receiving an answer to the question input from the input device;
A storage means for storing a web page source, an acquired screen image, event information, and information on answers to questions;
Compare the web page source and event information of the subtask currently being evaluated and the past subtask,
Judge whether it is applicable to the similar pattern of “same or similar screen configuration”, “same operation component name”, “same operation component type / display method”, “same operation component layout”
A subtask comparison means for identifying question items to be omitted based on a similar pattern and question item association rule;
Usability evaluation for a Web-based system, which functions as an evaluation display control means for acquiring information used for evaluation displayed in an evaluation result input window from a storage means based on the determination result of the subtask comparison means and controlling the display program.

10 Web-based system usability evaluation support device (evaluation device)
101 Browsing operation receiving unit (browsing operation receiving means)
102 Browsing operation unit (browsing operation means)
103 Browsing display control unit (browsing display control means)
104 Browsing information acquisition unit (browsing information acquisition means)
105 Event analysis unit (event analysis means)
106 Subtask comparison unit (subtask comparison means)
107 Question answer receiving part (question answer receiving means)
108 Storage unit (storage means, storage means)
109 Evaluation display control unit (evaluation display control means)
11 Display device (monitor)
111 browsing window 112 evaluation window 12 input device (input means)
13 server (storage means)
131 Evaluation Target Web System 201 Rules for Associating Questions with Similar Patterns 202 Event Information 203 Source Information 204 Screen Image Information 205 Question Answer Information 206 Question Item Information

Claims (10)

A storage means for storing and storing question answers, operation events, and web sources that have been answered in the past by the evaluator, along with usability evaluation question items prepared in advance in association with the web to be evaluated,
The evaluation source is evaluated by comparing the source of the Web to be evaluated and the operation event to the evaluation target with the source and the operation event that have been answered in the past and stored in the storage means. A comparison means for determining whether or not a pattern that is considered to input an answer result similar to the answer result that was previously answered in the question item by
Control means for presenting question items to the evaluator so as to omit question items that are considered unnecessary for the evaluator to evaluate the Web to be evaluated according to the determination result by the comparing means. A usability evaluation support apparatus for a web-based system characterized by the above. A usability evaluation support device for a web-based system according to claim 1,
The comparison means includes
Usability evaluation for a web-based system characterized in that a comparison between an evaluation object and a past evaluation result is made by referring to a Web source over a plurality of visually different pages and an operation event to the evaluation object to determine similarity. Support device. The usability evaluation support device for a web-based system according to claim 1 or 2,
The comparison unit includes:
For similarity judgment of screen composition,
Calculate the edit distance between the sources of the web pages to be compared,
A usability evaluation support device for a Web-based system, wherein the edit distance is used to determine whether the compared screen configurations are similar or dissimilar. A usability evaluation support device for a web-based system according to claim 1 or 3,
The comparison unit includes:
For similarity determination of operation parts and / or display screen,
Analyze the source of the Web page to be compared, and based on the similarity of the display character and the ortho attribute of the target part that has received the operation event, the similar or dissimilarity of the compared operation part and / or display screen A usability evaluation support device for a Web-based system, characterized by determining. The usability evaluation support device for a web-based system according to any one of claims 1 to 4,
The control means includes
A usability evaluation support device for a web-based system, characterized by omitting inputting an answer as omission of a question item. The usability evaluation support device for a web-based system according to any one of claims 1 to 4,
The control means includes
A usability evaluation support device for a web-based system, characterized in that the question item is omitted, and the answer item is already input. The usability evaluation support device for a web-based system according to claim 5 or 6,
The control means includes
Usability for a web-based system characterized in that, together with omission of a question item, an answer answered in the past similar to the omitted question item can be selected and the omission of the question item can be canceled by an evaluator's selection operation Evaluation support device. A browsing operation receiving unit for receiving a Web browsing operation;
A browsing operation unit that executes a browsing operation and acquires Web page information;
A browsing display control unit for displaying information received by the browsing operation unit on a screen;
A browsing information acquisition unit that acquires a screen image of a Web page and stores it together with a source of the Web page received from the browsing operation unit;
An event analysis unit that receives an event of a browsing operation from the browsing operation unit, analyzes which operation component is operated, and sets it as event information;
A question answer receiving unit for receiving an answer to the question input from the input device;
A storage unit for storing the source of the web page, the acquired screen image, event information, and answer information to the question;
Compare the web page source and event information of the subtask currently being evaluated and the past subtask,
Judge whether it is applicable to the similar pattern of “same or similar screen configuration”, “same operation component name”, “same operation component type / display method”, “same operation component layout”
A subtask comparison unit that identifies a question item to be omitted based on a similar pattern and question item association rule;
Usability evaluation for a Web-based system, comprising: an evaluation display control unit that acquires information used for evaluation displayed in the evaluation result input window from a storage unit based on a determination result of the subtask comparison unit, and controls display Support device. Along with usability evaluation question items prepared in advance associated with the evaluation target Web, the evaluator stores the question answer, operation event, and Web source that have been answered in the past in the storage means,
Question items by comparing the source of the Web to be evaluated and the operation event to the evaluation target with the source and operation event that have been stored in the past and having the evaluator evaluate the evaluation target Web To determine whether it corresponds to a pattern that is considered to input the same answer result as the answer result answered in the past,
According to the determination result, the question item is presented to the evaluator via the display unit so as to omit the question item considered not to be evaluated by the evaluator with respect to the Web to be evaluated. A usability evaluation method for a web-based system. The control unit of the information processing device
A storage means for storing and storing question answers, operation events, and web sources that have been answered in the past by the evaluator, along with usability evaluation question items prepared in advance in association with the web to be evaluated,
The evaluation source is evaluated by comparing the source of the Web to be evaluated and the operation event to the evaluation target with the source and the operation event that have been answered in the past and stored in the storage means. A comparison means for determining whether or not a pattern that is considered to input an answer result similar to the answer result that was previously answered in the question item by
According to the determination result by the comparison means, the evaluator is caused to function as a control means for presenting a question item so as to omit a question item that is considered unnecessary to be evaluated by the evaluator with respect to the Web to be evaluated. A usability evaluation program for a web-based system characterized by the above.

Images