JP2002183369A - System, server, terminal and method of measuring operability - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system, a terminal and a method of measuring operability allowing objective evaluation by measuring operability when operating an object to be measured such as a web page. SOLUTION: In this operability measuring system formed by connecting the measuring terminal 2 and the measuring server 1 to each other through a network, an operator for operating the object to be measured by using the measuring terminal measures the operation performed according to the predetermined operation, and the measuring server 1 analyzes a result of the measurement to objectively evaluate the operability.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operability measuring system, a measuring server, a measuring terminal, and an operability measuring method for measuring the operability of a measurement object such as a web page.

[0002]

2. Description of the Related Art In recent years, various companies publish information on web pages such as a home page on the Internet, and introduce companies, advertise new products, and provide support after sales.

[0003] The value of this web page as a medium is increasing year by year, and the content is being enhanced day by day.

[0004] When the amount of information to be provided increases with the enrichment of the contents, the structure of the website may become complicated and the operability may decrease.

[0005] For this reason, when updating a web page, the page is easy to read, easy to understand, good to contact related items,
Ease of operation depending on the size and arrangement of buttons, ease of input, etc. (In the present invention, these are collectively referred to as operability for convenience)
The page is created in consideration of.

[0006]

However, this operability judgment is made empirically by the creator and is not objective.

In particular, since the creator of the web page itself has sufficient knowledge and experience of the web and the computer, even if the creator has good operability,
Operability was not always good for beginners and the elderly.

In view of such circumstances, the present invention measures an operability when an object to be measured such as a web page is operated, and enables an operability measurement system, a measurement server, and a measurement terminal capable of objective evaluation. And a method for measuring operability.

[0009]

The operability measurement system, the measurement server, the measurement terminal and the operability measurement method of the present invention widely request general users to measure the operability of a website or the like via a network. By totalizing the measurement results using the user's terminal, it is possible to objectively judge the operability of the measurement object such as the website in accordance with the actual situation.

An operability measurement system according to the present invention is a system in which a measurement terminal and a measurement server are connected via a network, wherein the measurement terminal inputs information on an operation on a measurement target, and information on the operation. Object control means for controlling the measurement object based on the information, operation instruction means for instructing an operator performing an operation on the measurement object to perform a predetermined operation, and operation information obtained from the input means to obtain information on the operation performed in accordance with the instruction Operability measuring means for measuring operability, and transmitting means for transmitting the measurement result to the measurement server via the network, the measurement server receiving means for receiving the measurement result from the transmitting means, An analysis unit analyzes the measurement result received by the reception unit, and an output unit outputs the analysis result of the analysis unit.

The measurement server of the present invention is connected to a measurement terminal via a network, and includes an operation transmitting means for transmitting information on a predetermined operation on a measurement target to the measurement terminal, and an operator of the measurement terminal. Accepting means for receiving a measurement result obtained by measuring the operation performed according to the information of the predetermined operation on the measurement target using the measurement terminal,
An analysis unit analyzes the measurement result received by the reception unit, and an output unit outputs the analysis result of the analysis unit.

As a result, it is possible to provide an operability measurement system capable of objectively evaluating a measurement target such as a web page.

The transmitting means of the measuring terminal may simply store the operation information in a state where it can be provided to the transmitting server, and the measuring server may connect to each terminal and download the information.

It is desirable that the operation transmitting means of the measurement server transmit the information of the predetermined operation by e-mail, but the present invention is not limited to this as long as it can transmit the measurement object and the operation procedure. For example, a file in which a predetermined operation is recorded by the operation transmitting unit is created, and the measurement terminal accesses the measurement server and downloads the file to transmit the file.
The information may be transmitted via a medium such as a CD-ROM or a flash memory.

[0015] When creating the operation information for the measurement terminal, the measurement server may designate an access time so as to provide a time difference between the terminals so that access of each terminal according to the operation information is not congested.

The measurement server of the present invention is connected to a measurement terminal via a network, and includes an operation transmitting means for transmitting predetermined operation information on a measurement target to the measurement terminal, and an operator of the measurement terminal. Accepting means for receiving a measurement result obtained by measuring the operation performed according to the information of the predetermined operation on the measurement target using the measurement terminal,
An analysis unit analyzes the measurement result received by the reception unit, and an output unit outputs the analysis result of the analysis unit.

As a result, it is possible to provide a measurement server capable of objectively evaluating a measurement target such as a web page.

In this case, it is preferable that the predetermined operation is at least one of a search operation, an input operation, an overread operation, a selection operation, a download operation, a transfer operation, a transfer operation, a settlement operation, and a questionnaire response operation. is there.

[0019] Further, the measuring means takes the time required for the predetermined operation, the number of erroneous operations during the predetermined operation, the moving amount of the pointer of the pointing device during the predetermined operation,
Measuring the operability based on at least one of the above, and having a payment unit for paying the measurement fee to the measurement terminal, wherein the analysis unit statistically measures the measurement results from the plurality of measurement terminals. It is preferred to process.

The measuring terminal of the present invention comprises: input means for inputting information on an operation performed by an operator performing an operation on a measurement target; target control means for controlling the measurement target in accordance with the operation information; And an operability measuring means for measuring operability based on the operability.

As a result, it is possible to provide a measuring terminal capable of objectively evaluating a measuring object such as a web page.

The operability measurement method of the present invention connects a measurement server and a measurement terminal via a network, and measures operability. For an operator operating a measurement target using the measurement terminal, Instructing a predetermined operation; inputting information of an operation performed by the operator according to the instruction; measuring operability based on the input information of the operation; and The method includes the steps of transmitting a measurement result to the measurement server, receiving the measurement result from the measurement terminal, analyzing the measurement result, and outputting a result of the analysis.

In the step of analyzing the measurement results, the measurement results from a plurality of measurement terminals may be totaled.

In the present invention, the above components can be combined as much as possible.

[0025]

Embodiments of the present invention will be described below with reference to the drawings.

<Embodiment 1> FIG. 1 is a schematic configuration diagram of an operability measurement system of the present invention.

The operability measuring system of the present embodiment has a measuring server 1 and a measuring terminal 2 connected via a network (Internet).

In this system, the measurement server 1 sends a measurement instruction to the measurement terminal 2, and a user (operator) 21 of the measurement terminal 2 connects to the web server 3 using the measurement terminal 2 according to the instruction, and A predetermined operation is performed on a web site (a set of web pages) provided by the server 3.

The measurement terminal 2 measures the operability from the operation time and the number of erroneous operations when the predetermined operation is performed, and transmits the measurement result to the measurement server 1.

The measurement server 1 requests this measurement to a plurality of users (measurement terminals), sums up the measurement results, and evaluates whether this website is easy to use for general users.

Then, based on this evaluation, the web server 3
First, a proposal for improvement of the web page is made.

On the other hand, the web server 3 pays the measurement server 1 for the improvement proposal, and the measurement server 1 pays the measurement terminal 2 for the measurement.

Next, specific configurations of these devices will be described.

FIG. 2 is a block diagram of the measuring terminal 2.

The measuring terminal 2 includes an MPU (mi
and a hard disk (solid magnetic storage device) 13 storing software for arithmetic processing, and the arithmetic processing unit 1.
2 and an input / output port 14 which is an input / output unit for data of the hard disk 13.

The main body 20 has an input / output port 14.
Input means such as a keyboard 15 and a mouse 16 via
Output means such as a display 17, a modem 18, a printer 19, and a speaker 41 are connected.

An operating system (OS) and application software are installed on the hard disk 13 of the main body 11.

The arithmetic processing section 12 performs processing based on information from peripheral devices and application software to execute object control means 22, operation instructing means 23, operability measuring means 24,
Functions such as a transmission unit (log transmission unit) 25 are realized.

The function of the object control means 22 is to display the Web site to be measured on the display 17 for each page, to transmit information to the Web server 3 via the input / output means, download information, and the like. ing. The web page may be displayed by the function of the target control unit 22 itself, or may be displayed by calling up dedicated software, a so-called web browser.

The function of the operation instructing means 23 is to display a predetermined operation instruction from the measurement server 1 on the display 17 or to emit a sound or the like from the speaker 41 to the operator.

The function of the operability measuring means 24 is to detect (measure) information operated by the user using the keyboard 15 or the mouse 16 in accordance with the above-mentioned instructions, for example, the time involved in input and the amount of movement of the mouse pointer, Is temporarily recorded on the hard disk 13.

The function of the log transmitting means 25 is as follows.
The operation log measured by the operability measuring means 24 is stored in the modem 1
8 to the measurement server 1 via a network according to a predetermined communication protocol.

FIG. 3 is a block diagram of the measurement server 1.

The information collecting terminal 1 includes an MPU
(Micro processor unit), an arithmetic processing unit 52 composed of a main memory, etc., a hard disk (solid magnetic storage device) 53 storing software for arithmetic processing, and an input / output unit for data of the arithmetic processing unit 52 and the hard disk 53. An input / output port 54 and the like are provided.

The main body 51 has an input / output port 54.
Input means such as a keyboard 55 and a mouse 56 via
Output means such as a modem 57 is connected.

An operating system (OS) and application software are installed on a hard disk 53 of the main body 51.

The arithmetic processing unit 52 realizes functions such as an operation transmitting unit 61, a log receiving unit 62, a log analyzing unit 63, a billing unit 64, and a payment unit 65 by processing based on information from peripheral devices and application software. are doing.

As a function of the operation transmitting means 61, a URL of a measurement target and a file in which an operation procedure for the measurement is recorded are transmitted to the measuring terminal 2 by e-mail as information of a predetermined operation.

The function of the log receiving means 62 is to receive the operation log recorded by the measuring terminal 2 and
I remember.

The function of the log analysis means 63 is to collect operation logs from a plurality of measurement terminals for each operation item,
Many users have identified operations that are difficult or incorrect.

As a function of the billing means 64, a slip is created and a bill is issued based on information on an operation log and a measurement object in order to bill for an improvement proposal.

The function of the payment means 65 is as follows.
In order to pay for the measurement to 1, a payment slip, transmission of electronic money, transmission of service points that can be exchanged for products, transfer to a predetermined account, and the like are performed.

FIG. 4 is an explanatory diagram of a procedure for measuring the operability with these configurations.

First, the user 21 accesses the measurement server 1 through an Internet terminal such as a personal computer and performs user registration. At this time, as user attribute information,
Email address, age, gender, computer calendar, job title,
A qualification, a measurable time zone, a terminal model, a use provider, and the like are registered (Step 1, hereinafter abbreviated as S1).

The user 21 downloads the operability measurement program from the measurement server 1 using the terminal (S2). The program may be sent by e-mail or distributed on a CD-ROM.

The user 21 installs the program on the terminal and prepares to function as the operability measuring terminal 2 (S3).

The measurement server 1 transmits operation information to the measurement terminal 2 based on the mail address registered in step 1 (S4).

The operation information of this example includes a URL (measure body text) for notifying the user 21 of the URL of the measurement object and the time zone for starting the measurement, and a data file (attached document) in which the operation procedure is recorded as data that can be read by the measurement terminal 2. ).

The user 21 inputs a measurement start to the measurement terminal 2 by starting a measurement program or the like at the measurement start time indicated in the operation information (S5).

The measuring terminal 2 starts up a web browser by the function of the object control means 23 and connects to the Internet (S6).

The measuring terminal 2 displays an operation instruction on the display 17 according to the data file of the operation information (S
7).

FIG. 5 shows a display example at this time, in which a web browser 71 displaying a default home page and an instruction dialog 72 displaying operation instructions are displayed. For example, the user instructs "Please enter the specified URL."

The user 21 operates according to the instruction (S8). That is, look at the URL of the mail, enter it in the address field of the web browser, and click the “Next” button in the instruction dialog 72 when the input is completed.

The measuring terminal 2 measures the time from when this instruction is displayed to when the “next” button is clicked, and the number of times of erroneous re-input (operation) (number of errors) (S 9). The result of the operation is stored in the hard disk 53.

The operation instruction S7, the operation S8, and the measurement S9 are performed for the following items, and are repeated until the instruction recorded in the operation information in advance is completed (S10).

After completing the operation instruction, the measurement terminal 2 transmits the operation results accumulated in the hard disk 53 to the measurement server 1 as an operation log (S11).

The measurement server 1 receives this operation log and performs log analysis (S12).

As a result, it is possible to specify an operation which takes time for a general user or an operation which is likely to be mistaken.

The operator of the measurement server 1 creates a better interface design or the like based on the result, and makes an improvement proposal to the operator of the providing server 3.

When the proposal is accepted, the measurement server 1 obtains the time required for the measurement, the number of the users 21 who have performed the measurement, the amount of the operation instruction, and the like from the operation log, and calculates a charge for the improvement proposal. Create billing data and provide server 3
(S13).

The measurement server 1 pays for the measurement by sending electronic money to the user 21, issuing service points, discounting the Internet connection fee, providing a free personal computer (S14), and the providing server 3 The price of the improvement proposal obtained from is distributed.

Next, the measurement items for the web page, that is, the predetermined operations included in the operation information will be specifically described.

The predetermined operation includes, for example, a search operation,
There are input work, overreading work, selection work, download work, transfer work, transfer work, settlement work, questionnaire answer work, and the like.

The search operation is a process of specifying target information or a keyword, and finding the target information from a target site or by using a target search engine. Measure the number of searches.

For example, “Search for a support page and press the next button when it is displayed.” “Enter the inquiry number of the product released last month.” “Use the site search function. Please search for xxx (arbitrary keyword). "

The input operation is an operation of inputting predetermined input information, such as input of a password, input of a delivery destination when purchasing a product, user registration, input of a URL, and the like. The time required for this and the number of errors are measured.

The overreading operation is a process of reading through a predetermined sentence, and measures the time until the reading of the introduction of the product is completed, the time to read the explanation, and the time to understand the measurement, and whether or not the contract clause is read. I do.

For example, the user instructs "Read the introduction of the new product and press the next button when finished."

Further, the user instructs "Please read the method of use and input predetermined items.", And measures the time until the user can understand the read contents and input correctly according to the method of use.

Further, the user instructs "Please read the agreement and press the agreement button." Before the agreement button is pressed, whether all the agreements have been displayed using the scroll button or the like is determined. In such a case, it is assumed that it has not been read.

The selecting operation is an operation for selecting a predetermined item, and measures the time required for selecting a pull-down menu, a link collection, and an option.

The download operation is a process of searching for a predetermined file from a library or the like and downloading the file, and measures the time until the download, the probability of downloading the wrong file, and the like.

For example, “Download the driver for Linux.” “Download the file name xxxxxx from the library.” These operations are combined and instructed according to the measurement object. May be. For example, a series of operations along the system to be measured, such as a transfer operation (combination of an input operation and an overread operation), a transfer operation, an e-commerce settlement operation, and a user registration operation in the Internet banking system may be designated.

Further, as a questionnaire answering operation, after performing a series of operations, a question is asked to the user 21.
Answer this.

For example, "What was the name of the new product?"
Ask a simple question such as "What is the basic philosophy of this company?""Please select the product you would like to buy from the site." Measure whether the information in the site that you should have seen in the work is correctly transmitted to the operator.

Also, the user selects or inputs an impression of the site, such as small characters, excessively colorful colors, a dark background that is difficult to read, and many images that are too heavy.

For these measurements, in addition to the time from when the instruction is displayed to the time when the next button of the instruction dialog is pressed, the time between when the instruction is displayed and when a predetermined button to be measured is pressed, a certain operation is performed. From the time until the next operation, the time spent in the measurement target site, the input information, the downloaded information, the moving distance of the pointer (mouse pointer, cursor, caret) of the pointing device, etc. are measured and recorded as an operation log are doing.

As an analysis process of the results of performing these operations, the operation results are totaled for each operation item. For example, an operation in which the user 21 makes a mistake at a predetermined ratio (arbitrary, such as 5 to 10%) or an operation that takes a predetermined time or more is extracted as a problem.

Also, if the time from when the instruction is displayed until the user starts working is long, it can be determined that the web page is difficult to see or understand, and the user immediately starts working after displaying the instruction. In such a case, it can be determined that the operation of the web page is complicated.

Thus, the operator of the measurement server 1 can make a detailed description of the operation and make an improvement proposal such as switching a time-consuming operation to an offline operation.

At this time, the total may be calculated according to the attribute of the operator. For example, the age and gender of the operator, the computer calendar (period since the computer was used, etc.), and the job type are totaled.

Thus, the website to be measured is
If the target is an elderly person, the operation results of the users 21 of a predetermined age (arbitrarily, such as 45 to 65) or more are totaled and reflected in the improvement proposal.

In addition, when used by anyone, such as an administrative organization, the data is tabulated by age and gender, such as teens, 20s, 30... Operation is specified, and improvements are made so that the same operability is obtained in each section.

Also, a page may be provided which addresses the problem of a specific division, such as a page for young people and a page for elderly people.

Further, after the improvement is made by making such an improvement proposal, the same measurement may be performed again to calculate the effect of the improvement.

As described above, according to the present embodiment, the operability of the web site can be measured and evaluated objectively.

Further, since this measurement can be widely requested to a general user, it is possible to perform an evaluation according to the actual situation.

The operability measurement system, the measurement server, the measurement terminal, and the operability measurement method of the present invention are not limited to the illustrated examples described above, but may be variously modified without departing from the gist of the present invention. Can of course be added.

In the above embodiment, the measurement of the Web site does not necessarily need to be performed while connected to the network.
The data may be stored in a ROM or the like, and the stored page may be operated and measured.

As a result, it is possible to exclude congestion of access to the measurement target and a difference in communication environment. In addition, communication costs can be reduced.

The operation instructing means of the measuring terminal is not essential, and the operator may perform the predetermined operation while looking at the information of the predetermined operation (URL to be measured and operation procedure) sent by mail or facsimile. .

In the above-described embodiment, the measurement target is a website. However, the present invention is not limited to this, and a computer-readable program or a controllable device (NC machine tool, CAM: Computer aided manufactu) is not limited thereto.
ring, HA: Home automation).

For example, application software such as a word processor, a spreadsheet, and a photo retoucher is set as a measurement target, and an operation performed by a user is detected (measured) to obtain an operation result, which is transmitted to a measurement server for statistical processing.

In the above-described embodiment, the measurement is performed by the user in accordance with a predetermined operation instruction. However, the present invention is not limited to this, and an operation necessary for the measurement may be extracted from the operation arbitrarily set by the user and may be measured. .

[0105]

As described above, according to the present invention, the operability when a measurement object such as a web page is operated is measured.
An operability measurement system, a measurement terminal, and an operability measurement method that enable objective evaluation can be provided.

[Brief description of the drawings]

FIG. 1 is a diagram showing a schematic configuration of an operability measurement system of the present invention.

FIG. 2 is a block diagram showing a schematic configuration of a measurement terminal of the present invention.

FIG. 3 is a block diagram showing a schematic configuration of a measurement server of the present invention.

FIG. 4 is an explanatory diagram of the operability measurement method of the present invention.

FIG. 5 is a diagram showing a display example of an operation instruction according to the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Measurement server 2 Measurement terminal 3 Web server 11, 20, 51 Main body 12, 52 Arithmetic processing unit 13, 53 Hard disk 14, 54 Input / output port 15, 55 Keyboard 16, 56 Mouse 17 Display 18, 57 Modem 19 Printer 22 Target control Means 23 Operation instructing means 24 Operability measuring means 25 Log transmitting means (transmitting means) 41 Speaker 61 Operation transmitting means 62 Log receiving means (receiving means) 63 Log analyzing means (analyzing means) 64 Billing means 65 Payment means

Claims (15)

[Claims] 1. An operability measurement system in which a measurement terminal and a measurement server are connected via a network, wherein the measurement terminal inputs information on an operation on the measurement target, and the measurement target is based on the operation information. Control means for controlling the operation, an operation instructing means for instructing an operator performing an operation on the measurement target to perform a predetermined operation, and an operation for measuring operability by obtaining information on an operation performed in accordance with the instruction from the input means Gender measurement means, and transmission means for transmitting the measurement result to the measurement server via the network, wherein the measurement server receives the measurement result from the transmission means, and receives the measurement result from the reception means. An operability measurement system comprising: an analysis unit configured to analyze a measurement result; and an output unit configured to output an analysis result of the analysis unit. 2. The operability measurement system according to claim 1, wherein the measurement target is a web page provided via the network. 3. A measurement server connected to a measurement terminal via a network, an operation transmitting means for transmitting information on a predetermined operation on a measurement target to the measurement terminal, and an operator of the measurement terminal using the measurement terminal. Receiving means for receiving a measurement result obtained by measuring an operation performed on the measurement target in accordance with the information on the predetermined operation; analyzing means for analyzing the measurement result received by the receiving means; and an output for outputting the analysis result of the analyzing means Means, and a measurement server. 4. The measurement server according to claim 3, wherein the measurement target is a web page provided via the network. 5. The method according to claim 1, wherein the predetermined operation is at least one of a search operation, an input operation, an overread operation, a selection operation, a download operation, a transfer operation, a transfer operation, a settlement operation, and a questionnaire response operation. The measurement server according to claim 3. 6. The operability is determined based on at least one of a time required for the predetermined operation, a number of erroneous operations during the predetermined operation, and a moving amount of a pointer of a pointing device during the predetermined operation. The measurement server according to claim 3, wherein measurement is performed. 7. The measurement server according to claim 3, further comprising a payment unit for paying a fee for the measurement to the measurement terminal. 8. The measurement server according to claim 3, wherein the analysis unit statistically processes measurement results from the plurality of measurement terminals. 9. An input means for inputting information on an operation performed by an operator performing an operation on an object to be measured, an object control means for controlling an object to be measured according to the information on the operation, and operability based on the information on the operation. A measuring terminal, comprising: an operability measuring means for measuring. 10. An apparatus according to claim 1, further comprising operation instructing means for instructing said operator to perform a predetermined operation, wherein said operability measuring means measures operability based on information of an operation performed in accordance with said instruction. Item 9. The measuring terminal according to Item 9. 11. The measurement terminal according to claim 9, wherein the measurement target is a web page provided via the network. 12. The method according to claim 1, wherein the predetermined operation is a search operation, an input operation,
The measuring terminal according to any one of claims 9 to 11, wherein the measuring terminal is at least one of an overread operation, a download operation, and a selection operation. 13. The operability is measured based on at least one of a time required for the predetermined operation, a number of erroneous operations during the predetermined operation, and a moving amount of a pointer of a pointing device during the predetermined operation. The measurement terminal according to claim 9, wherein the measurement terminal performs the measurement. 14. An operability measurement method for connecting a measurement server and a measurement terminal via a network and measuring operability, wherein a predetermined operation is instructed to an operator who operates a measurement target using the measurement terminal. Performing the operation, inputting information of an operation performed by the operator according to the instruction, measuring operability based on the input operation information, and measuring the measurement result via the network. An operability measurement method comprising: transmitting to a measurement server; receiving a measurement result from the measurement terminal; analyzing the measurement result; and outputting a result of the analysis. 15. The operability measurement method according to claim 14, wherein in the step of analyzing the measurement results, measurement results from a plurality of measurement terminals are totaled.