JP2016212464A - Skill evaluation device, skill evaluation method, program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a skill evaluation device capable of evaluating a user's skill even when data regarding operation of a device does not follow a normal distribution, and to provide a skill evaluation method, a program, and a recording medium.SOLUTION: An operation terminal 10 which is also a skill evaluation device includes: a frequency distribution generation unit 121 which generates frequency distribution of an interval of operation according to history of an occurrence time of operation by a user to an apparatus; and an index calculation unit 122 which calculates an index value for evaluating skill of the user regarding operation of the apparatus according to the frequency distribution.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a skill evaluation device, a skill evaluation method, a program, and a recording medium.

  Conventionally, a technique has been proposed in which information is adjusted and provided in an optimal form for various requests of various user characteristics (see, for example, Patent Document 1). Thus, it is required to present information according to various user characteristics, and for this purpose, a technique for automatically determining user characteristics is required.

  In particular, one of the user characteristics, evaluating the skill of how much a user can use ICT (Information and Communication Technology) devices such as PCs, smartphones, and tablets, is to present information according to the user's characteristics. Important to do.

  As for the operation of ICT equipment, it is assumed that a certain user acquires data such as the time taken to achieve a specific task, the number of mistakes, and the obtained data is based on a normal distribution. There is a method of calculating the average or variance of data as an index for evaluating skills. Since this kind of data is based on a normal distribution, it is meaningful to obtain an average or variance.

Japanese Patent Laid-Open No. 2005-056151

  However, not all types of data follow a normal distribution. For data that does not follow the normal distribution, even if the average or variance is calculated assuming that it is a normal distribution as in the past, the significance of the calculation result is sparse, and the user's skill is evaluated accurately. Have difficulty.

  The present invention has been made in view of the above points, and an object of the present invention is to make it possible to evaluate a user's skill even when data regarding device operation does not follow a normal distribution.

  Therefore, in order to solve the above-described problem, the skill evaluation device includes a generation unit that generates a frequency distribution of the operation intervals based on a history of operation occurrence times by the user with respect to the device, and the device based on the frequency distribution. A calculation unit that calculates an index value for evaluating the user's skill regarding the operation.

  It is possible to evaluate the skill of the user even when the data regarding the operation of the device does not follow the normal distribution.

It is a figure which shows the hardware structural example of the operating terminal in embodiment of this invention. It is a figure which shows the function structural example of the operating terminal in embodiment of this invention. It is a flowchart for demonstrating an example of the process sequence which an operating terminal performs. It is a figure which shows the structural example of a log memory | storage part. It is a figure which shows the example of a display of a determination period input screen. It is a flowchart for demonstrating an example of the process sequence of a calculation process of an index value and the goodness of fit. It is a figure which shows an example of the log information contained in a determination period. It is a figure which shows an example of the calculation result of a time interval. It is a figure which shows an example of the frequency distribution of a time interval. It is a figure which shows the structural example of a frequency division memory | storage part. It is a figure which shows the example of the approximated curve at the time of fitting frequency distribution to the logarithmic axis. It is a figure which shows the structural example of a skill evaluation division memory | storage part. It is a figure which shows the example of an output of the evaluation result of a skill.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating a hardware configuration example of an operation terminal according to an embodiment of the present invention. The operation terminal 10 in FIG. 1 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, a display device 106, an input device 107, and the like that are mutually connected by a bus B.

  A program for realizing processing in the operation terminal 10 is provided by a recording medium 101 such as a flexible disk, a CD-ROM, an MO, a DVD-ROM, or an SD memory card. When the recording medium 101 storing the program is set in the drive device 100, the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100. However, the program need not be installed from the recording medium 101 and may be downloaded from another computer via a network. The auxiliary storage device 102 stores the installed program and also stores necessary files and data.

  The memory device 103 reads the program from the auxiliary storage device 102 and stores it when there is an instruction to start the program. The CPU 104 realizes functions related to the operation terminal 10 in accordance with a program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network. The display device 106 displays a GUI (Graphical User Interface) or the like by a program. The input device 107 includes a keyboard and mouse, a touch panel, or the like, and is used for inputting various operation instructions. When the input device 107 is a touch panel, the input device 107 may be configured integrally with the display device 106.

  FIG. 2 is a diagram illustrating a functional configuration example of the operation terminal according to the embodiment of the present invention. In the present embodiment, the operation terminal 10 is a terminal that is a target of operation by the user, and is also an apparatus that evaluates the skill of operation by the user. As a functional configuration for evaluating the skill of operation by the user, the operation terminal 10 includes a log input unit 11, a log processing unit 12, a skill evaluation unit 13, a skill output unit 14, and the like. Each of these units is realized by processing that causes the CPU 104 to execute one or more programs (hereinafter referred to as “skill evaluation programs”) installed in the operation terminal 10. The operation terminal 10 also uses a log storage unit 151, a frequency category storage unit 152, a skill evaluation category storage unit 153, an index storage unit 154, and the like. Each of these storage units can be realized using, for example, the auxiliary storage device 102 or a storage device that can be connected to the operation terminal 10 via a network.

  Each time a user operation occurs, the log input unit 11 records log information indicating the generation time of the operation in the log storage unit 151. Therefore, the log storage unit 151 stores a history of operation occurrence times. The operation by the user is an operation on the operation terminal 10 related to various applications installed in the operation terminal 10 by the user. That is, the user operation is an operation on the operation terminal 10 that is performed in a normal operation using the operation terminal 10. The various applications may be mailers, word processing software, or other programs. The skill evaluation program operates without being conscious of the user (for example, in the background), and causes the CPU 104 to function as the log input unit 11 or the like.

  The log processing unit 12 analyzes the log information stored in the log storage unit 151 and calculates an index value and the like for evaluating the skill of operation of the operation terminal 10 by the user. The log processing unit 12 includes a frequency distribution generation unit 121, an index calculation unit 122, and the like. The frequency distribution generation unit 121 calculates a time interval of each operation by the user based on the log information, and generates a frequency distribution related to the time interval. The index calculation unit 122 calculates an index value for evaluating the user skill regarding the operation of the operation terminal 10 based on the frequency distribution generated by the frequency distribution generation unit 121.

  The skill evaluation unit 13 evaluates the user's skill based on the index value calculated by the log processing unit 12. The skill output unit 14 outputs an evaluation result by the skill evaluation unit 13.

  Hereinafter, a processing procedure executed by the operation terminal 10 will be described. FIG. 3 is a flowchart for explaining an example of a processing procedure executed by the operation terminal. In addition, it became clear by experiment of this inventor that there exists possibility that a user's comprehensive skill level can be estimated by the frequency distribution of an evaluation parameter | index. The operation terminal 10 performs the process shown in FIG. 3 based on such experimental results.

  In step S1, the operation terminal 10 activates a skill evaluation program in response to, for example, an input by a user who receives skill evaluation. The skill evaluation program may be a launcher application, for example. Further, the skill evaluation program may be automatically started, for example, when the operation terminal 10 is started or when a user logs in to the operation terminal 10.

  Subsequently, when the user performs some input operation on the operation terminal 10, the log input unit 11 stores log information indicating the occurrence of the operation in the log storage unit 151 based on the sensor information regarding the input operation. Record (step S2). Any input operation is, for example, a touch on a touch panel, an input via a keyboard, or an input operation using a mouse or the like.

FIG. 4 is a diagram illustrating a configuration example of the log storage unit. In FIG. 4, the log storage unit 151 stores log information including date and time for each operation input by the user. The date and time are the date and time when the operation was performed. In FIG. 4, the column “T _n ” is a column added for convenience of explanation. That is, in the following description, the date and time indicated by each log information itself and each log information (date and time), expressed by T _n.

  The log information is recorded until a skill determination request is input by the user (step S3). Therefore, the log storage unit 151 stores a log information history related to the input operation performed until the determination request is input.

  When a skill determination request is input by the user (YES in step S3), the log processing unit 12 receives an input of a determination period from the user (step S4). The determination period is information for defining a range of log information used for skill determination. That is, the log information whose date and time are included in the determination period is used for skill determination. For example, the determination period may be input via a determination period input screen shown in FIG.

  FIG. 5 is a diagram illustrating a display example of the determination period input screen. In FIG. 5, the determination period input screen 510 can input the start time and end time of the determination period. In FIG. 5, an example in which the start time and the end time are specified by date is shown, but specification up to the time may be possible. The user designates an arbitrary period from when the skill evaluation program is activated until now and presses the determination start button 511.

  Subsequently, based on the log information included in the determination period, the log processing unit 12 calculates an index value used for skill evaluation and a value indicating the goodness (relevance) of the index value (step S5). .

  Details of step S5 will be described with reference to FIG. FIG. 6 is a flowchart for explaining an example of the processing procedure of the calculation process of the index value and the goodness of fit.

  In step S101, the frequency distribution generation unit 121 of the log processing unit 12 acquires log information included in the determination period from the log information storage unit. According to the example in FIG. 5, the determination period is 2015/04/01 to 2015/05/01. Therefore, log information whose date is included in the period is acquired.

FIG. 7 is a diagram illustrating an example of log information included in the determination period. FIG. 7 shows an example in which 94 pieces of log information from T _{1 to} T ₉₄ are acquired.

Subsequently, the frequency distribution generation unit 121 calculates a time interval ΔT _n between the acquired log information and the immediately preceding log information based on the following equation (1) (step S102).
ΔT _n = T _{n + 1} −T _n (Expression 1)
FIG. 8 is a diagram illustrating an example of the calculation result of the time interval. For N pieces of log information, (N-1) time intervals are calculated. Therefore, FIG. 8 shows the calculation results of 93 time intervals from ΔT _{1 to} ΔT ₉₃ for 94 pieces of log information from T _{1 to} T ₉₄ . For example, in FIG. 8, the time interval ΔT ₁ between T ₁ and T ₂ is 00: 00: 00: 380. Further, the time interval ΔT ₂ between T ₂ and T ₃ is 00: 00: 00: 854.

In step S103 and S104, based on the [Delta] T _n, the log processing unit 12, the calculation of the index value for determining a skill is performed. Index with [Delta] T _n There are multiple. For example, a power index may be obtained from the frequency distribution of ΔT _{n and} the power index may be used as an index value. Alternatively, ΔT _n may be Lorentz plotted, and the feature may be used as an index value. Furthermore, a Fourier transform may be performed on the change in ΔT _n and the feature may be used as an index value. In this embodiment, an example in which a power index is obtained from the frequency distribution of ΔT _{n and} the power index is used as an index value will be described.

In step S103, the frequency distribution generator 121, the [Delta] T _n, generates a frequency distribution. As a result, a frequency distribution as shown in FIG. 9 is obtained.

FIG. 9 is a diagram illustrating an example of a frequency distribution of time intervals. FIG. 9 shows a frequency distribution related to ΔT _n shown in FIG. That is, the frequency distribution of the time interval regarding 94 operations.

In FIG. 9, the number of appearances when the time interval ΔT _n is divided in units of 1 second is plotted. The delimiter (section) of the time interval ΔT _n is specified with reference to the frequency section storage unit 152, for example.

FIG. 10 is a diagram illustrating a configuration example of the frequency division storage unit. In Figure 10, [Delta] T _n is, if for less than 1 second or more 0 seconds, power label is 1, if it is less than 2 seconds 1 seconds, are shown examples frequency label is 2. In step S103, each ΔT _n is classified in units of frequency labels, and the number of appearances (that is, frequency) is counted in units of frequency labels.

  Subsequently, the index calculation unit 122 of the log processing unit 12 calculates an index value based on the frequency distribution (step S104). The calculated index value is stored in the index storage unit 154.

In the present embodiment, a case _where the frequency distribution of ΔT _n follows a power distribution will be described. The power distribution means a case where the relationship represented by the following expression (2) is established between two variables y and x. At this time, if the logarithm of both sides is taken, the following equation (2 ′) is established.
y = bx− ^γ (Expression 2)
logy = logb−γlogx (Formula 2 ′)
Expression (2 ′) is a straight line having a slope of minus γ on the logarithmic axis graph. This slope γ is called a power index. The power index γ represents the degree of data accumulation, and indicates that the smaller the absolute value of γ, the relatively larger the proportion of the data whose frequency is small. According to the experiment by the present inventor, it has been found that a correlation is recognized between the power index γ and the user's skill. Therefore, in the present embodiment, the power index value is used as an index value.

  Specifically, the index calculation unit 122 obtains an approximate curve for the frequency distribution when the frequency distribution of FIG. 9 is applied to the logarithmic axis.

FIG. 11 is a diagram illustrating an example of an approximate curve when the frequency distribution is applied to the logarithmic axis. The approximate curve is obtained by power approximation. In addition to the approximate curve, the index calculation unit 122 also calculates R ² that is a determination coefficient as goodness of fit of the approximate curve. FIG. 11 shows an example in which the power index γ is 1.84 and the determination coefficient R ² is 0.9229.

  Above, detailed description of step S5 of FIG. 3 is complete | finished.

Subsequently, step S6 and subsequent steps in FIG. 3 are executed. In step S6, skills assessment unit 13 determines the goodness of true coefficient of determination R ² obtained in step S5 (the validity). That is, whether or not the power index γ calculated in step S5 is adopted is determined based on the determination coefficient R2.

The coefficient of determination R ² has a value of 0 to 1, the approximate curve obtained closer to 1 indicates a well true that the data. In the present embodiment, the skill evaluation unit 13 determines that the fit is bad if R ² is less than 0.5. In this case (NO in S6), the skill output unit 14 displays a message indicating that the skill cannot be determined on the display device 106, and ends the process (step S7). That is, the power index γ is not adopted as an index value for evaluating the skill.

On the other hand, if R ² is 0.5 or more, the skill evaluation unit 13 determines that the fit is good. In this case (YES in S6), after step S8, the skill evaluation unit 13 uses the power index γ to determine the skill. That is, the power index γ is adopted as an index value for evaluating the skill. Note that the threshold value for R ² may be a value other than 0.5.

  For example, the skill evaluation unit 13 determines a skill with reference to predefined information stored in the skill evaluation category storage unit 153.

  FIG. 12 is a diagram illustrating a configuration example of the skill evaluation category storage unit. As shown in FIG. 12, in the skill evaluation category storage unit 153, skill evaluation categories (high, medium, low) are stored in association with the range of the power index γ that is an index value of the skill. Yes. The skill evaluation category is a skill level category.

  Therefore, for example, the skill evaluation unit 13 determines whether the power index γ is within the high skill range (γ> 1.8) based on the first record in the skill evaluation category storage unit 153 ( Step S8). When the power index γ is within the high skill range (YES in step S8), the skill evaluation unit 13 determines that the user is high skill (step S9). When the power index γ is out of the high skill range (NO in step S8), the skill evaluation unit 13 determines that the power index γ is a medium skill based on, for example, the second record in the skill evaluation category storage unit 153. (1.8 ≧ γ ≧ 1.6) is determined (step S10).

  When the power index γ is within the range of the medium skill (YES in step S10), the skill evaluation unit 13 determines that the user has the medium skill (step S11). When the power index γ is outside the range of the medium skill (NO in step S10), the skill evaluation unit 13 determines that the user has a low skill (step S12).

  In the present embodiment, since the power index is 1.84, it is determined that the skill is high. Note that the number of skill evaluation categories is not limited to three. The classification number may be any value as long as it is 2 or more.

  Subsequently, the skill output unit 14 outputs a skill determination result (skill evaluation result) by the skill evaluation unit 13 (step S13).

  FIG. 13 is a diagram illustrating an output example of skill evaluation results. The evaluation result output screen 520 shown in FIG. 13 indicates that the user is determined to be highly skilled in the period from 2015/04/01 to 2015/05/01.

As described above, according to the present embodiment, the skill level related to the operation of the operation terminal 10 is determined by focusing on the distribution of data, not the average or variance of data (ΔT _n in the present embodiment), Evaluation is also made taking into account the characteristics of the frequency distribution of the evaluation index. Therefore, even when the data regarding the operation of ICT (Information and Communication Technology) such as the operation terminal 10 does not follow the normal distribution, the user skill can be automatically and quantitatively evaluated objectively. it can.

In the present embodiment, the case where the frequency distribution of data (ΔT _n in the present embodiment) follows a power distribution has been described. However, for data according to another distribution, the present embodiment is based on the frequency distribution of the data. As in the case of, the user skill may be evaluated.

  Further, in the present embodiment, an example is shown in which the device to be operated and the device for evaluating the skill of the user (hereinafter referred to as “evaluation device”) are the same device, but the device and the evaluation device. And may be separate devices. In this case, the device only needs to include the log input unit 11 and the log storage unit 151. The evaluation apparatus may execute the processes after step S4 based on the log information stored in the log storage unit 151 of the device.

  In the present embodiment, the operation terminal 10 is an example of a skill evaluation apparatus. The frequency distribution generation unit 121 is an example of a generation unit. The index calculation unit 122 is an example of a calculation unit. The skill evaluation unit 13 is an example of a determination unit.

  As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to such specific embodiment, In the range of the summary of this invention described in the claim, various deformation | transformation・ Change is possible.

DESCRIPTION OF SYMBOLS 10 Operation terminal 11 Log input part 12 Log processing part 13 Skill evaluation part 14 Skill output part 100 Drive apparatus 101 Recording medium 102 Auxiliary storage apparatus 103 Memory apparatus 104 CPU
105 Interface Device 106 Display Device 107 Input Device 121 Frequency Distribution Generation Unit 122 Index Calculation Unit 151 Log Storage Unit 152 Frequency Division Storage Unit 153 Skill Evaluation Division Storage Unit 154 Index Storage Unit B Bus

Claims (8)

A generation unit that generates a frequency distribution of the intervals between the operations based on a history of occurrence times of operations by the user on the device;
Based on the frequency distribution, a calculation unit that calculates an index value for evaluating a user's skill regarding the operation of the device;
A skill evaluation apparatus characterized by comprising: The calculation unit calculates a power index of the frequency distribution as the index value;
The skill evaluation apparatus according to claim 1, wherein: The calculation unit calculates a coefficient of determination related to the power index together with the power index,
A determination unit for determining whether or not the power index is accepted based on the determination coefficient;
The skill evaluation apparatus according to claim 2, wherein: Computer
A generation procedure for generating a frequency distribution of the intervals between the operations based on a history of occurrence times of operations by the user on the device;
Based on the frequency distribution, a calculation procedure for calculating an index value for evaluating a user skill regarding the operation of the device;
A skill evaluation apparatus characterized by executing The calculation procedure calculates a power index of the frequency distribution as the index value.
The skill evaluation method according to claim 4, wherein: The calculation procedure calculates a coefficient of determination related to the power index together with the power index,
The computer further executes a determination procedure for determining whether the power index is accepted or not based on the determination coefficient.
The skill evaluation method according to claim 5, wherein:   A program for causing a computer to execute the skill evaluation method according to any one of claims 4 to 6.   A computer-readable recording medium on which the program according to claim 7 is recorded.

Images