JP3851261B2 - Data processing system, data processing apparatus, data processing program - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a data processing system that analyzes and evaluates an operation tendency based on an operation history of a mouse, a keyboard, or the like, in order to provide a user who uses a personal computer a more suitable operation environment.
[0002]
[Prior art]
In recent years, relatively inexpensive and high-performance personal computers have been provided, and work performed using personal computers in schools and offices is becoming indispensable. It has come to use. However, there are actually users who have high operation skills and those who have low operation skills, and a general computer provides an operation environment that can be suitably used for all users. It cannot be said that it is a thing.
[0003]
For this reason, software manufacturers who always require better interface design and hardware manufacturers that develop input means such as mice and keyboards, are responding to the user's operating environment needs and current problems. In order to accurately grasp the points, for example, operation tendency data indicating the user's operation tendency is collected by, for example, requesting a monitor survey or recruiting subjects to conduct an evaluation experiment.
[0004]
In addition, for example, a manufacturer is provided that can selectively switch between a hardware keyboard and a software keyboard according to a user's proficiency level (see, for example, Patent Document 1).
[0005]
[Patent Document 1]
Japanese Patent Laid-Open No. 10-11190 (2nd page, FIG. 1)
[0006]
[Problems to be solved by the invention]
However, the method of collecting data by monitoring surveys and the like involves a great investment, but has a problem that it is inefficient because desired data that is desired is not obtained.
[0007]
In addition, it is possible to select and switch between the hardware keyboard and software keyboard according to the user's proficiency level, but it is not suitable for users with various proficiency levels. have.
[0008]
Therefore, the present invention automatically collects operation histories, and based on the collected operation histories, each manufacturer can develop user-oriented products by accurately grasping user operation trends and current problems, The present invention is intended to provide a data processing system capable of providing accurate advice to a user having an operation trouble based on the operation history.
[0009]
[Means for Solving the Problems]
That is, the data processing apparatus of the present invention includes a user device having input means such as a mouse and a keyboard, basic software and a word processor for managing basic functions of the user device based on an operation history using the input means in the user device. A data processing device that performs data processing for knowing a user's operation tendency with respect to various software such as software and application software such as a WEB browser, wherein the user device uses the input means An operation history acquisition unit that acquires an operation history of an input operation, an operation history storage unit that stores an operation history acquired by the operation history acquisition unit, and an operation history stored in the operation history storage unit are stored in the data processing apparatus. Operation history transmission means for transmitting, and the data processing device transmits the operation history transmission means. An operation history accepting unit that accepts the operation history output by the operation history data processing unit that performs a predetermined process for knowing the user's operation tendency with respect to the software based on the operation history accepted by the operation history accepting unit; Operation tendency data output means for outputting operation tendency data indicating the user's operation tendency obtained by the predetermined processing of the operation tendency data processing means; A time specification data receiving means for receiving time specification data for specifying an operation history; The operation tendency data processing means But, Processing for calculating dwell time data indicating the dwell time of the mouse pointer displayed on the display from the operation history received by the operation history receiving means And at least a process for associating the operation history specified by the time specification data received by the time specification data receiving means with the corresponding mouse pointer trajectory data into operation trend data. Because The operation trend data output means visualizes the dwell time data calculated by the operation trend data processing means as a circle as operation trend data whose radius increases in proportion to the elapsed time at the standby point of the mouse pointer and displays it on the screen. In addition, the locus data of the mouse pointer associated by the operation tendency data processing means is displayed on the screen as a continuous locus, and the locus data can be traced to an arbitrary time by operating the scroll bar. It is characterized by that.
[0010]
With such a configuration, the operation history can be easily acquired, and the user's operation tendency and current problems can be accurately grasped based on the acquired operation history. Thus, each manufacturer can develop user-oriented products, and can also give accurate advice to the user in operation trouble based on the operation history.
[0011]
In the data processing apparatus, in order to know the user's operation tendency, the operation tendency data processing means But, Processing for calculating mouse movement distance data indicating the movement distance of the mouse pointer displayed on the display within a predetermined time from the operation history received by the operation history reception means Configured to do more The operation tendency data output means visualizes the mouse movement distance data calculated by the operation tendency data processing means as operation tendency data. ,further It is desirable to display it on the screen.
[0012]
Further, the predetermined process in the operation tendency data processing means is the operation tendency data processing means. But, Processing for calculating the number of keystrokes by keyboard input from the operation history received by the operation history receiving means Configured to do more The operation tendency data output means visualizes the number of keystrokes calculated by the operation tendency data processing means as operation tendency data. ,further A mode of displaying on the screen is also included.
[0013]
And the operation tendency data processing means But, Processing for calculating the number of delete function operations indicating the number of delete function key operations for deleting characters such as delete keys and backspace keys from the operation history received by the operation history receiving means Configured to do more The operation tendency data output means visualizes the number of deletion function operations calculated by the operation tendency data processing means as operation tendency data. ,further It is also possible to display on the screen.
[0014]
Further, the operation tendency data processing means But, By combining a predetermined key with an instruction to be executed by selecting and clicking a menu displayed on the display with a mouse from the operation history received by the operation history receiving means and a specific character string input by the keyboard or a command Processing to calculate the number of specific command operations set for executable Configured to do more The operation tendency data output means visualizes the number of specific command operations calculated by the operation tendency data processing means as operation tendency data. ,further If the operation tendency data output means is to display the screen by visualizing the total number for each specific command operation, the effect becomes remarkable.
[0015]
Still further, the data processing device includes time designation data accepting means for accepting time designation data for designating an operation history, and the operation tendency data when the time designation data accepting means accepts the time designation data. The processing means performs processing for associating the operation history designated by the time designation data with the corresponding mouse pointer trajectory data to obtain operation tendency data, and the operation tendency data output means is configured to operate the operation tendency data. There is also an example in which the mouse pointer trace data associated by the processing means is displayed on the screen as a continuous trace.
[0016]
Further, the operation tendency data processing means But, Processing for calculating the number of clicks by a mouse operation in a predetermined range on the display from the operation history received by the operation history receiving means Configured to do more The operation tendency data output means visualizes the number of clicks calculated by the operation tendency data processing means as operation tendency data. ,further What is displayed on the screen.
[0017]
Further, in order to know a more detailed user operation tendency based on the operation tendency data, an action determination that extracts action determination requirements such as a type stop time, a mouse stop time, and a correction key pressing rate based on the operation tendency data. Requirement extraction means, behavior pattern storage means for storing a behavior pattern identification model for identifying a user's behavior pattern, behavior discrimination requirements extracted by the behavior discrimination requirement extraction means, and behavior pattern storage means What is necessary is just to provide the action analysis means which calculates | requires the analogy user action which shows the user's action analogized from an operation history based on a user's action pattern.
[0018]
Then, if support information transmitting means for transmitting support information for supporting the user's operation to the user device is provided based on the analogy user behavior obtained by the behavior analyzing means, the user's operation can be suitably supported. it can.
[0019]
By the way, in order to suitably obtain the user's operation tendency with respect to various software such as basic software for managing the basic functions of the computer and application software such as word processor software and WEB browser without much investment. The operation history acquisition means for acquiring the operation history of the input operation using the input means such as a mouse or a keyboard, the operation history storage means for storing the operation history acquired by the operation history acquisition means, Based on the operation history, the operation history stored in the operation history storage means is calculated based on the operation history, and dwell time data indicating the dwell time of the mouse pointer displayed on the display is calculated. Processing When, Processing to display the calculated dwell time data as a circle, which is an operation trend data whose radius increases in proportion to the elapsed time at the waiting point of the mouse pointer. And at least A data processing program for functioning as an operation history transmission means for transmitting to the data processing apparatus to be performed may be executed by the user apparatus.
[0020]
When the data processing program monitors the usable area of the memory area provided in the computer and detects that the usable area shows a value smaller than a predetermined value, the operation history transmitting means As a memory management means for instructing the operation history to be sent to the data processing device further If it is made to function, it is possible to prevent such a problem that the acquired operation history disappears due to memory overflow.
[0021]
In order to provide a user device that can be suitably used for a user having any operation skill such that the user can operate the user device without stress in accordance with each proficiency level, the operation history of the computer is used. Get means Proficiency level judgment that determines the proficiency level for software operations based on the operation history means And a screen according to proficiency level that displays a screen according to the proficiency level according to the proficiency level determined by the proficiency level determination means. means A data processing program for further functioning may be executed on the user device.
[0022]
At this time, the proficiency level is the delete function key operation number indicating the number of delete function key delete operations such as delete key and backspace key. The number of specific command operations indicating the number of specific command operations set to be executable by combining a predetermined key with a command to be executed by selecting and clicking and a specific character string input or command using the keyboard with respect to the total number of operations If it is shown by the use ratio, the effect can be made remarkable.
[0023]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below.
[0024]
FIG. 1 is a device configuration diagram showing a user device P1 and a data processing device P2 of the data processing system in the present embodiment. In this figure, P1 is a user device P1 used by a user, while P2 is a data processing device P2. The user device P1 and the data processing device P2 are connected to each other via a communication network INET such as the Internet so that bidirectional communication is possible.
[0025]
The user device P1 is a computer having a general information processing function such as a personal computer or a PDA, for example. As shown in FIG. 2, the CPU 101, an internal memory 102, an external storage device 103 such as an HDD, a communication network INET, etc. A communication interface 104 such as a modem for connection to the PC, a display 105, an input means 106 such as a mouse and a keyboard, and the like.
[0026]
On the other hand, the data processing device P2 is a general-purpose computer having a relatively advanced information processing function such as a workstation. As shown in FIG. 3, the CPU 201, the internal memory 202, an external storage device 203 such as an HDD, a communication A communication interface 204 such as a modem for connecting to the network INET, a display 205, an input means 206 such as a mouse and a keyboard, and the like are provided.
[0027]
In the present embodiment, as shown in FIG. 4, a predetermined program is installed in the user apparatus P1, and the CPU 101 and peripheral devices are made to cooperate with each other based on the program. Functions as acquisition means 11, operation history storage means 12, memory management means 13, operation history transmission means 14, proficiency level determination means 15, proficiency level screen display means 16, support information reception means 17, support information display means 18 and the like It is comprised so that it may comprise.
[0028]
Further, by installing a predetermined program in the data processing device P2 and causing the CPU 201 and peripheral devices to cooperate with each other based on the program, the data processing device P2 can operate the operation history receiving means 21 and the operation history receiving means 22. , Function as time designation data receiving means 23, operation tendency data processing means 24, action determination requirement extraction means 25, action pattern storage means 26, action analysis means 27, support information transmission means 28, operation tendency data output means 29, etc. It comprises so that it may comprise.
[0029]
Hereinafter, each part will be described in detail.
[0030]
In the user device P1, the operation history acquisition unit 11 acquires an operation history using a mouse or a keyboard as an input unit. As shown in FIG. 5, the operation history includes mouse operation history (coordinates indicated by the mouse pointer displayed on the display 105, click information (right and left), click count, and the like acquired by mouse operation depending on the type of input means. ), Window operation history (window position, window size, state, class name, title bar, menu bar operation information), keyboard operation history (input key content, total number of inputs, “BackSpace” number, “Delete” number), etc. It can be classified into operation history (operation date and time, user discrimination information (user name, computer name). The mouse operation history is acquired by operating the mouse, and the window operation history is obtained from a mouse or a keyboard. The keyboard operation history is obtained by an operation. The other operation history is for specifying the operation time and operator of the mouse operation history, window operation history, and keyboard operation history, and the operation date and time is the normal OS. The user discriminating information is obtained from the information stored in a predetermined area of the internal memory 202 or the external storage device 203. Like to do.
[0031]
In this embodiment, the input unit 106 is described as a mouse P1M and a keyboard P1K. However, a human being such as a pointing device, a trackball, a tablet, or a joystick directly operates the computer or indirectly by voice. However, the present invention is not limited to this as long as a human can operate the computer.
[0032]
The operation history storage unit 12 stores the operation history acquired by the operation history acquisition unit 11 and is formed in a predetermined area such as the internal memory 102 or the external storage device 103. In this embodiment, as shown in FIGS. 6A to 6C, when this operation history is stored in the operation history storage means 12, a window operation file, a mouse coordinate file MC, and key input contents are stored. The file KC is classified and stored. More specifically, the window operation file includes a start time file element WS indicating the time when the system is activated, an end time file element WE indicating the end time, and an operation content file element WC indicating the operation contents of the window. Become. This start time file element WS is set with a time stamp indicating the time when the operation was performed, an operation summary, the name of the computer where the operation was performed, the user name, and the system startup time as attributes, as shown in FIG. As shown in the uppermost column, values such as “502786”, “OPEN”, “OEMCOMPUTER”, “takeshi”, and “200001128233836” are stored as attribute values. Needless to say, in the attribute values indicated by the start time file element WS, attribute values other than the operation summary indicate different values in the acquired state. The end time file element WE has a time stamp and an operation summary as attributes, and “57641” and “CLOSE” are set as attribute values, respectively. By the way, “,” in the start time file element WS and the end time file element WE indicates dummy data used to match the number of attributes of the operation content file element WC. The operation content file element WC is set as an attribute in a state in which the time stamp, the operation outline, the class of the target window, the window name, the window coordinates, and the window state are associated with each other. The values are stored while being sequentially arranged in time series in a state surrounded by “” and associated with the time stamp.
[0033]
The mouse coordinate file MC stores an operation history in which a time stamp indicating the time when the mouse position is acquired and the x coordinate and y coordinate as the mouse pointer position at that time are recorded. For example, “502806, 389, 315” shown in the top row in FIG. 6B indicates that the mouse pointer position (x, y) was at (389, 315) when the time stamp was 502806. Yes. In the present embodiment, the operation history when the mouse is not moved is enormous, and it is predicted that the user apparatus P1 will malfunction. Therefore, for the purpose of suitably preventing this, the coordinates of the mouse pointer are A differential recording method is employed in which an operation history is recorded in the file when moved. Further, the interval for acquiring the mouse position when moving the mouse can be appropriately set according to the embodiment, for example, every 0.1 second.
[0034]
The key input content file KC stores an operation history recorded in a state where a time stamp indicating a key pressing time and a key pressed are associated with each other when the keyboard is pressed. For example, “508596,“ {Alt} + {half-width / full-width} ”” shown in the uppermost row in FIG. 6C indicates that “Alt key” and “half-width / full-width key” are displayed when the time stamp is 508596. This indicates that there was an operation to simultaneously press the key. The “+” indicates that a plurality of keys are simultaneously pressed. In addition, the alphabetic characters in “{}” mean that there was a key hit of the Alt key if “{Alt}”, and a key hit of the Shift key if “{Shift}”. ing.
[0035]
The memory management unit 13 monitors the usable area in the internal memory 102 and the external storage device 103, and when detecting that the usable area shows a value smaller than a predetermined value, the operation history transmitting unit 14 is instructed to transmit the operation history stored in the internal memory 102 and the external storage device 103. When the memory management unit 13 recognizes that the operation history is reliably transmitted to the data processing device P2, the memory management unit 13 deletes the transmitted operation history stored in the internal memory 102 and the external storage device 103. It is configured as follows.
[0036]
The operation history transmission means 14 transmits the operation history stored in the internal memory 102 and the external storage device 103 to the data processing device P2, and is configured using the communication interface 104 or the like. ing. Note that the transmission timing to the data processing device P2 is configured to be transmitted at predetermined intervals, for example, one hour interval. However, regardless of the predetermined interval, the memory management unit 13 receives a transmission instruction. Needless to say, it will be sent to you. In the present embodiment, when the operation history is transmitted from the operation history transmission means 14 to the data processing device P2, the operation history is stored in order to prevent the user's personal information from being intercepted or tampered with. The personal information of the user is protected by encryption using an encryption method such as a DES method or an RSA method.
[0037]
The proficiency level determination means 15 determines the proficiency level related to the operation of software or the like based on the operation history acquired by the operation history acquisition means 11. More specifically, the delete function indicating the number of operations of the delete function key that deletes characters such as the delete key and the backspace key. If the use ratio of the number of operations to the total number of operations is high, the proficiency level is low. If it is low, it is judged that the proficiency level is high. Then, for example, a proficiency level consisting of 4 levels, whose usage ratio is divided every 25%, is set in the descending order of proficiency: “expert level”, “engineer level”, “beginner level”, “introduction” An embodiment is also conceivable in which the proficiency level is evaluated at a proficiency level such as “person level”. Similarly, a command that is executed by selecting and clicking a menu displayed on the display with a mouse and a specific character string input or command by a keyboard is set to be executable by a combination of predetermined keys. An embodiment in which the usage ratio of the number of specific command operations indicating the number of operations of the operation is used as a criterion, and the proficiency level is high if the usage ratio of the specific command operation count is high, and the proficiency level is low if the usage ratio is low Is also possible.
[0038]
The proficiency level screen display means 16 displays a predetermined proficiency level screen on the display 205 in accordance with the proficiency level determined by the proficiency level determination means 15. More specifically, for example, if the proficiency level determined by the proficiency level determination means 15 is “beginner level”, a text explaining the contents of the icon is always displayed when the icon is pointed with the mouse pointer. For example, if it is “beginner level”, an embodiment in which the above-described sentence is displayed only when the right-click is performed can be considered.
[0039]
The support information receiving unit 17 receives support information transmitted from the data processing device P2, and is configured using the communication interface 104 or the like.
[0040]
The support information display means 18 outputs the support information received by the support information receiving means 17 to the display 105 on the screen. More specifically, the received support information is displayed on the display 105 as a moving image MV of the operator OP as shown in FIG. If the support information includes sound, the sound is reproduced by a speaker (not shown). As a result, the user can receive suitable support from the operator of the data processing device P2. At this time, depending on the state of the communication line on the user side, the specifications of the apparatus, and the like, it is possible to support a wide range of users by using only a still image or text as what is displayed on the screen at the time of support. Furthermore, if this support information is used, the user operator It can also be used for interactive support.
[0041]
On the other hand, in each means of the data processing device P2, the operation history receiving means 21 receives an operation history transmitted from the user device P1, and is configured using the communication interface 204 or the like. .
[0042]
The operation history receiving unit 22 receives the operation history received by the operation history receiving unit 21. The operation history to be accepted is not limited to the operation history received by the operation history receiving unit 21, but may be configured to accept, for example, an operation history recorded on a recording medium such as a floppy (registered trademark) disk or a CD-ROM. You can also.
[0043]
The time designation data accepting means 23 accepts time designation data for selecting and displaying the operation history at a desired time when displaying the data related to the operation history processed by the operation tendency data processing means 24 or the like. The input means 206 and the like are used. More specifically, it is possible to accept time designation data for only 10 minutes after starting the apparatus, or time designation data obtained by cutting out an arbitrary time zone.
[0044]
The operation trend data processing unit 24 generates operation trend data indicating the operation trend of the user based on the operation history reception received by the operation history reception unit 22. Examples of the operation tendency data include mouse movement distance data, the number of keystrokes, the number of deletion function operations, the number of specific command operations, trajectory data, the number of clicks, and dwell time data. More specifically, the mouse movement distance data indicates the movement distance of the mouse pointer displayed on the display within a predetermined time. The number of keystrokes indicates the number of operations by keystrokes on the keyboard. The number of delete function operations indicates the number of delete function key operations for deleting characters such as delete keys and backspace keys. The number of specific command operations is a specific command that is set to be executable by combining a command that is executed by selecting and clicking a menu displayed on the display with a mouse and a specific character string input or command using a keyboard. This indicates the number of command operations. The trajectory data indicates the trajectory of the mouse pointer corresponding to the operation history designated by the time designation data. The number of clicks indicates the number of clicks by a mouse operation in a predetermined range on the display. Here, the predetermined range includes a menu bar, a command button, a place where a hyperlink is made, and the like. The dwell time data indicates the dwell time of the mouse pointer displayed on the display. In the present embodiment, 10 seconds or more are regarded as waiting for the mouse.
[0045]
The action determination requirement extraction means 25 extracts action determination requirements such as a type stop time, a mouse stop time, and a correction key pressing rate based on the operation tendency data processed by the operation tendency data processing means 24. More specifically, the type stop time is extracted from the operation tendency data when there is no keystroke input by the keyboard, and in this embodiment, when the keyboard keystroke interval becomes 0.5 seconds or more. The keystroke interval is set to be extracted as a type stop time. The mouse stop time is obtained by extracting the time during which the mouse was stopped without moving from the operation tendency data. The correction key stroke rate is obtained by extracting the total number of keystrokes of the keyboard and the number of keystrokes having a character deletion function such as “Delete key” and “BackSpace key” from the operation tendency data, and the character deletion function for the total number of keystrokes. It shows the ratio of the number of keystrokes of keys having a key.
[0046]
The behavior pattern storage means 26 stores a behavior pattern identification model for identifying a user's behavior pattern, and is formed in predetermined areas of the internal memory 202 and the external storage device 203. In this embodiment, the behavior pattern identification model is classified into an input concentration pattern, a thinking pattern, and a puzzled pattern that are expressed by one or a combination of the type stop time, the mouse stop time, and the correction key stroke rate. Stored. More specifically, the input concentration pattern is an index for measuring that the user is concentrating on the personal computer. For example, the type stop time and the mouse stop time within a predetermined time are each 5 seconds or less. Can be mentioned. The thinking pattern is an index for measuring that the user is thinking. As shown in FIG. 19, the type stop time or the mouse stop time is sandwiched between the keyboard keystrokes or the mouse operation and is constant. The one that appeared in more than the time. The puzzled pattern is an index for measuring that the user is in a state of being confused without knowing what to do with the computer operation. For example, the number of operations of the delete function key is 10 times or more in 5 seconds. Can be mentioned. These patterns are not limited to those described above. For example, in the input concentration pattern, the type stop time or mouse stop time within a predetermined time is 5 seconds or less, 5 seconds to 30 seconds or less, 30 seconds or more. An embodiment is also possible in which the user's concentration is measured in association with the proficiency level while being classified into patterns such as things. Further, other patterns such as an input rejection pattern indicating that the user is not concentrated on the personal computer may be stored.
[0047]
The behavior analysis means 27 indicates the user behavior estimated from the operation history based on the behavior discrimination requirements extracted by the behavior discrimination requirement extraction means 25 and the user behavior patterns stored in the behavior pattern storage means 26. Analogue user behavior is sought. The analogy user behavior includes “input concentration” having a predetermined relationship with the input concentration pattern, “thinking” having a predetermined relationship with the thinking pattern, and “confusing” having a predetermined relationship with the puzzled pattern. ". As specific examples of this predetermined relationship, the correlation between the user's behavior pattern that can be derived from the behavior discrimination requirement and the user's behavior pattern stored in the behavior pattern storage means 26 is approximate. Is mentioned. Further, in this embodiment, every time the cumulative time of the input concentration pattern elapses for a certain period of time, the user's fatigue level is reduced by wrapping in stages such as “high fatigue level”, “medium fatigue level”, and “low fatigue level”. By analogy.
[0048]
The support information transmission unit 28 transmits support information for supporting the user to the user device P1 based on the analogy user behavior obtained by the behavior analysis unit 27, and uses the communication interface 204 or the like. It is composed. As this support information, for example, information including text and voice, information including a still image and a moving image, and the like can be set as appropriate according to the embodiment. Further, an embodiment in which the support information transmitting unit 28 is configured to transmit and receive support information and interactively support the user is also conceivable. Furthermore, you may comprise so that the application which can operate the user apparatus P1 remotely from the data processing apparatus P2 can be operated. In the present embodiment, when the analog user action indicates “high fatigue level” in the behavior analysis unit 27, the support information transmission unit 28 described later is instructed to transmit support information to the user device P1. is doing.
[0049]
The operation tendency data output means 29 visualizes the operation tendency data generated by the operation tendency data processing means 24 in a predetermined format and outputs it on the display 205. More specifically, when the operation tendency data is mouse movement distance data MM, as shown in FIG. 8B, the elapsed time is plotted on the horizontal axis, and the operation status is graphed in time series and output on the screen. . The unit of elapsed time can be changed according to the time when the operation history is acquired. On the vertical axis, mouse movement distance data MM is output to the screen as a line graph. Further, as shown in FIG. 8A, a sheet listing operation histories used for creating the graph is displayed together with the graph shown in FIG. 8B. The last line in the sheet of FIG. 8A shows the total number of items. Thus, by outputting the sheet and the graph together on the screen, the operator can preferably analyze the user's operation tendency while referring to the chart. In this embodiment, as shown in FIGS. 8A and 8B, the mouse movement distance data MM, the number of keystrokes K, and the number of deletion function operations BD are configured to be displayed on the same chart. ing. Further, the number of specific command operations and the number of clicks, which will be described later, can be displayed on the screen in the same manner.
[0050]
When the operation tendency data is the specific command operation number SC, as shown in FIG. 9B, the total number for each specific command operation is displayed in a pie chart in a percentage display divided by the total count. I am trying to output. At this time, as shown in FIG. 9 (a), if the number of keystrokes K is similarly expressed in a pie chart and output on the screen together with FIG. 9 (b), the operator refers to these figures. The operation tendency of the user can be preferably analyzed.
[0051]
When the operation tendency data is trajectory data, as shown in FIG. 10, a virtual screen VD corresponding to the display 105 of the user apparatus P1 is output on the screen, and the trajectory TR of the mouse pointer is superimposed on the line graph on the screen. It is trying to display. In this embodiment, the graph and the scroll bar at the bottom of the screen are linked so that the locus of the mouse operation of the user can be traced to an arbitrary time.
[0052]
When the operation tendency data is the number of clicks, as shown in FIG. 11A, a virtual screen VD corresponding to the display 105 of the user device P1 is output on the screen, and the point PT clicked by the user is superimposed on this. Configured to output the screen. At the same time, as shown in FIG. 11B, the number of clicks collected for each command in a menu bar (eg, file, edit, display, etc.) or command button (eg, cut, copy, paste, etc.) If it is counted and shown in the table, it can be used for judging characteristics of operation proficiency such as frequent use of pull-down menus and frequency of command use.
[0053]
When the operation tendency data is dwell time data, as shown in FIG. 12, a virtual screen VD corresponding to the display 105 of the user apparatus P1 is output on the screen, and this is proportional to the elapsed time at the standby point of the mouse pointer. Thus, the circle C having an increased radius is output on the screen. Thereby, it can utilize for the judgment material of operation status, such as the waiting time in a user's mouse | mouth operation, the change frequency of a mouse | mouth and a keyboard.
[0054]
In this embodiment, the operation tendency data is output to the display on the screen. However, for example, the operation tendency data is written and output to a recordable recording medium such as a CD-R, or connected to the Internet. An embodiment is also conceivable in which transmission is output to the outside. Further, an embodiment is also conceivable in which output is performed together with analogy user behavior analogized by the behavior analysis means 27.
[0055]
Next, an operation example of this system will be described in detail with reference to FIGS.
[0056]
First, when the user turns on the power of the user device P1, the data processing program operates simultaneously.
[0057]
This data processing program operates such that the user device P1 has a function of acquiring operation histories of various operations using the input means 106 in, for example, word processor software or mail transmission / reception, and the OS is UNIX. (Registered Trademark) is similar to “Demon”, and WINDOWS NT (Registered Trademark) is similar to “Service”.
[0058]
Thus, when an input operation is performed by the input means 106 such that the menu icon displayed on the screen is clicked by the mouse or the character input is performed on the application software being driven by the keyboard (step S101). The operation history acquisition unit 11 acquires an operation history indicating the input operation (step S102), and the acquired operation history is stored in the operation history storage unit 12 (step S103).
[0059]
If a predetermined time has passed since the power was turned on (step S104) and an operation history is to be transmitted (step S105), the operation history transmission unit 14 performs data processing on the operation history stored in the operation history storage unit 12 It is set to transmit to the device P2 (step S106). In step S105, whether or not to transmit the operation history is determined by, for example, outputting a message for inquiring whether or not the stored transmission is to be displayed on the display 105 and receiving the instruction from the user. Alternatively, it may be set as appropriate according to the embodiment, such as a configuration in which transmission is performed every time a certain time has elapsed since power-on.
[0060]
When the memory management unit 13 detects that the usable area in the internal memory 102 and the external storage device 103 is smaller than a predetermined value in steps S101 to S105 described above (this is This corresponds to a memory management step.), All or a predetermined operation history stored in the operation history storage means 12 is set to be transmitted to the data processing device P2. The predetermined operation history refers to an operation history that is deleted after being transmitted to the data processing device P2 so that the usable area can be suitably secured, and the old normal operation history applies.
[0061]
Further, in the present embodiment, a screen according to the proficiency level corresponding to the proficiency level of the user is output to the display 105 based on an operation history for a predetermined time from when the user apparatus P1 is turned on.
[0062]
Specifically, if a certain time has passed since the power-on of the user device P1 (step S201), the proficiency level determination means 15 determines the proficiency level based on the operation history stored in the operation history storage means 12 (step S202). ). Then, based on the proficiency level determined by the proficiency level determination means 15, the proficiency level screen display means 16 outputs the proficiency level screen corresponding to the proficiency level to the display 105 (step S203).
[0063]
Note that the timing for determining the proficiency level is not limited to this. For example, the proficiency level determination unit 15 is configured to determine the proficiency level when the user apparatus P1 ends, and the proficiency level determined at the end when the power is turned on next time. An embodiment in which the screen according to the proficiency level 16 outputs a screen corresponding to the screen is also conceivable.
[0064]
When the support information receiving means 17 receives support information from the data processing device P2 (step S301), the support information display means 18 outputs the received support information on the screen as shown in FIG. 7 (step S302). .
[0065]
Further, as shown in FIG. 7, an icon QQ is displayed on the display to make an inquiry to the operator OP. For example, by clicking at any timing of the steps S101 to S106, mutual communication with the operator OP can be performed. If comprised in this way, a user can operate in a comfortable operation environment, receiving the support from operator OP suitably.
[0066]
On the other hand, as shown in FIG. 16, in the data processing device P2, when the operation history receiving unit 21 receives an operation history from the user device P1 (step S401), the operation history storage unit 12 accepts the operation history. (Step S402). Then, if processing for knowing the user's operation tendency is performed (step S403), various operation tendency data is obtained through the steps shown in FIG. 17 and screen output is performed.
[0067]
More specifically, if the mouse movement distance is displayed as the operation tendency data (step S501), the operation tendency data processing unit 24 calculates the mouse movement distance based on the operation history stored in the internal memo 202. (Step S502) The operation tendency data output means 29 outputs the mouse movement distance obtained by the operation tendency data processing means 24 to the display 205 as shown in FIG. 8 (step S503).
[0068]
If the number of keystrokes K (keystrokes) is displayed (step S511), the operation tendency data processing means 24 calculates the number of keystrokes K on the keyboard based on the operation history stored in the internal memo 202 ( In step S512), the operation tendency data output means 29 outputs the keyboard keystroke number K obtained by the operation tendency data processing means 24 to the display 205 as shown in FIG. 8 (step S513).
[0069]
If the keyboard deletion function operation count BD (BD key count) is to be displayed (step S521), the operation trend data processing means 24 uses the keyboard deletion function operation count BD based on the operation history stored in the internal memo 202. (Step S522), and the operation tendency data output means 29 outputs the keyboard deletion function operation number BD obtained by the operation tendency data processing means 24 to the display 205 as shown in FIG. Step S523).
[0070]
If the specific command operation number SC (number of shortcut keys) of the keyboard is to be displayed (step S531), the operation tendency data processing means 24 uses the operation history stored in the internal memo 202 to specify the specific command operation number SC of the keyboard. (Step S532), and the operation tendency data output means 29 outputs the specific command operation number SC of the keyboard obtained by the operation tendency data processing means 24 to the display 205 as shown in FIG. Step S533).
[0071]
If the mouse pointer trajectory (flow line graph) is to be displayed (step S541), the time designation data accepting means 23 accepts the time designation data (step S542), and the operation tendency data output means 29 accepts the time designation data. Based on the time designation data received by the receiving means 23 and the operation history stored in the internal memo 202, the locus of the mouse pointer is output to the display 205 as shown in FIG. 10 (step S543).
[0072]
If the number of clicks by the mouse (click count graph) is to be displayed (step S551), the operation tendency data processing means 24 calculates the number of mouse clicks based on the operation history stored in the internal memo 202 (step S552). ), The operation tendency data output means 29 outputs the number of mouse clicks obtained by the operation tendency data processing means 24 to the display 205 as shown in FIG. 11 (step S553).
[0073]
If the mouse standby point graph is to be displayed (step S561), the operation tendency data processing means 24 calculates the dwell time at the mouse standby point based on the operation history stored in the internal memo 202 (step S562). The operation tendency data output means 29 outputs a mouse standby point graph to the display 205 as shown in FIG. 11 based on the mouse residence time obtained by the operation tendency data processing means 24 (step S563).
[0074]
In this way, various operation tendency data is displayed on the screen, but the various operation tendency data can be output to the display 205 alone or in combination.
[0075]
If the user's behavior pattern is inferred based on the operation trend data (step S601), the behavior determination requirement extraction unit 25 performs the data processing on the operation trend data processing unit 24, Behavior discrimination requirements such as type stop time, mouse stop time, correction key pressing rate and the like are extracted (step S602). Then, based on the behavior discrimination requirement extracted by the behavior discrimination requirement extraction unit 25 and the user behavior pattern stored in the behavior pattern storage unit 26, the behavior analysis unit 27 analogizes the estimated user behavior from the operation history. (Step S603), the operation tendency data output means 29 outputs the analog user action obtained by the action analysis means 27 on the screen (Step S604). In this way, the operator of the data processing device P2 can know the specific operation tendency of the user.
[0076]
Therefore, according to the present embodiment configured as described above, it is possible to accurately grasp the user's operation tendency and current problems based on the acquired operation history. Thus, each manufacturer can develop user-oriented products, and can give accurate advice to the user who has an operation trouble based on the operation history.
[0077]
And since the operation history is analyzed based on various aspects such as mouse movement distance data, number of keystrokes, number of deletion function operations, number of specific command operations, trajectory data, number of clicks, residence time data, A user's operation tendency that is often overlooked in normal analysis can be suitably found. Furthermore, since a characteristic behavior determination requirement is extracted from various operation tendency data and this is compared with a behavior pattern stored in a database, a more specific and accurate operation tendency of the user can be inferred.
[0078]
As described above, operation history can be collected automatically and without much investment, and based on the collected operation history, user operation trends and current problems can be accurately grasped, and all skills It is possible to provide a data processing system having very excellent data processing capability for providing data that can be utilized as a user who can use a personal computer appropriately.
[0079]
In the present embodiment, the data processing device P2 is described as one unit. However, a system may be constructed using a plurality of data processing devices P2.
[0080]
The types of operation history acquired by the operation history acquisition unit 11 of the user apparatus P1 and operation trend data generated by the operation trend data processing unit 24 are not limited to those described in the present embodiment. Similarly, the types of behavior pattern identification models stored in the behavior pattern storage means 26 are not limited to those described in the present embodiment.
[0081]
In addition, the present invention is not limited to the above described examples, and various modifications can be made without departing from the spirit of the present invention.
[0082]
【The invention's effect】
As described in detail above, according to the present invention, the operation history can be easily acquired without much investment, and the user's operation tendency and current problems are accurately grasped based on the acquired operation history. To provide a data processing system having a high-performance data processing function in which each manufacturer can develop user-oriented products and can give accurate advice to a user in an operation trouble based on the operation history. Can do.
[Brief description of the drawings]
FIG. 1 is an overall device configuration diagram according to an embodiment of the present invention.
FIG. 2 is an internal device configuration diagram of a user apparatus in the embodiment.
FIG. 3 is an internal device configuration diagram of the data processing apparatus according to the embodiment.
FIG. 4 is a functional block diagram showing an overall functional configuration of the system in the embodiment.
FIG. 5 is a view showing types of operation histories acquired in the embodiment.
FIG. 6 is a view showing a storage mode of an operation history in the embodiment.
FIG. 7 is an exemplary view showing a display screen of the user apparatus in the embodiment.
FIG. 8 is a view showing operation tendency data (MK graph) displayed on the screen in the embodiment.
FIG. 9 is a view showing operation tendency data (shortcut key count graph) displayed on the screen in the embodiment.
FIG. 10 is a view showing operation tendency data (flow line graph) displayed on the screen in the embodiment.
FIG. 11 is a diagram showing operation tendency data (click count) displayed on the screen in the embodiment.
FIG. 12 is a view showing operation tendency data (mouse standby point graph) displayed on the screen in the embodiment.
FIG. 13 is a flowchart showing the operation of the user apparatus in the embodiment.
FIG. 14 is a flowchart showing the operation of the user apparatus in the embodiment.
FIG. 15 is a flowchart showing the operation of the user apparatus in the embodiment.
FIG. 16 is an exemplary flowchart showing the operation of the data processing apparatus according to the embodiment;
FIG. 17 is an exemplary flowchart showing the operation of the data processing apparatus according to the embodiment;
FIG. 18 is an exemplary flowchart illustrating the operation of the data processing apparatus according to the embodiment;
FIG. 19 is a diagram showing a thinking pattern in the embodiment;
[Explanation of symbols]
11 ... Operation history acquisition means
12 ... Operation history storage means
14 ... Operation history transmission means
22 ... Operation history receiving means
23 ... Time designation data receiving means
24 ... Operation tendency data processing means
25 ... Action discrimination requirement extraction means
26 ... Action pattern storage means
27. Action analysis means
28 ... Support information transmission means
29 ... Operation tendency data output means
105 ... Display
106 ... Input means
BD: Number of delete function operations
K ... Number of keystrokes
MM ・ ・ ・ Moving distance data
P1 ... User device
P1M ... Mouse
P1K ... Keyboard
P2 ... Data processing device
SC ... Number of specific command operations
WS, WC, WE, MC, KC ... Operation history
S101 ... Operation history acquisition step
S102 ... Operation history storage step
S106 ... Operation history transmission step
S202 ... Proficiency level determination step
S203 ... Screen display step according to proficiency level

Claims (14)

User device having input means such as a mouse and a keyboard, basic software for managing basic functions of the user device based on an operation history using the input means in the user device, and application software such as word processing software and WEB browser A data processing device that performs data processing for knowing the user's operation tendency with respect to various software of
The user device includes an operation history acquisition unit that acquires an operation history of an input operation using the input unit, an operation history storage unit that stores an operation history acquired by the operation history acquisition unit, and an operation history storage unit Operation history transmission means for transmitting the stored operation history to the data processing device,
The data processing apparatus is configured to know an operation history receiving unit that receives the operation history output by the operation history transmitting unit, and a user operation tendency with respect to the software based on the operation history received by the operation history receiving unit. An operation trend data processing unit that performs a predetermined process, an operation trend data output unit that outputs operation trend data indicating a user's operation trend obtained by the predetermined process of the operation trend data processing unit, and an operation history Time designation data receiving means for receiving the time designation data of
The operation tendency data processing part, the operation history received by the operation history receiving unit, a process of calculating the residence time data indicating the residence time of the mouse pointer displayed on the display, received by the time specified data receiving means The operation history designated by the time designation data and the corresponding mouse pointer locus data are associated with each other to obtain operation tendency data, and at least the processing is performed.
The operation tendency data output means, the residence time data calculation process by the operation tendency data processing part, visualized screen displayed as operation tendency data serving circle radius is enlarged in proportion to the elapsed time in the standby point of the mouse pointer In addition, the mouse pointer trajectory data associated by the operation trend data processing means is displayed on the screen as a continuous trajectory, and the trajectory data can be traced to an arbitrary time by operating the scroll bar. A data processing system. An operation history receiving means for receiving an operation history using an input means such as a mouse or a keyboard for various software such as basic software for managing basic functions of a computer and application software such as word processing software and a WEB browser, and the operation history Based on the operation history received by the receiving means, an operation tendency data processing means for performing a predetermined process for knowing a user's operation tendency with respect to the software, and a user operation obtained by the predetermined process of the operation tendency data processing means An operation trend data output means for outputting operation trend data indicating a trend, and a time designation data reception means for accepting time designation data for designating an operation history ,
The operation tendency data processing part, the operation history received by the operation history receiving unit, a process of calculating the residence time data indicating the residence time of the mouse pointer displayed on the display, received by the time specified data receiving means The operation history designated by the time designation data and the corresponding mouse pointer locus data are associated with each other to obtain operation tendency data, and at least the processing is performed.
The operation tendency data output means, the residence time data calculation process by the operation tendency data processing part, visualized screen displayed as operation tendency data serving circle radius is enlarged in proportion to the elapsed time in the standby point of the mouse pointer In addition, the mouse pointer trajectory data associated by the operation trend data processing means is displayed on the screen as a continuous trajectory, and the trajectory data can be traced to an arbitrary time by operating the scroll bar. A data processing apparatus. The operation tendency data processing part, the operation history received by the operation history receiving unit, so as to further processing for calculating the mouse moving distance data indicating a moving distance in a predetermined time period of the mouse pointer displayed on the display Is composed of :
3. The data processing apparatus according to claim 2, wherein the operation tendency data output means visualizes the mouse movement distance data calculated by the operation tendency data processing means as operation tendency data and further displays it on a screen. The operation tendency data processing means is configured to further perform a process of calculating the number of keystrokes by keyboard input from the operation history received by the operation history receiving means,
4. The data processing apparatus according to claim 2, wherein the operation tendency data output means visualizes the number of keystrokes calculated by the operation tendency data processing means as operation tendency data and further displays the screen. . The operation tendency data processing part, the operation history received by the operation history receiving unit further performs a process of calculating the number of delete function operation indicating number of operations delete function key to remove the delete key and the backspace key or the like characters Which is configured as follows:
5. The data according to claim 2, wherein said operation tendency data output means visualizes the number of deletion function operations calculated by said operation tendency data processing means as operation tendency data and further displays it on a screen. Processing equipment. The operation tendency data processing part, the operation history received by the operation history receiving unit, an input or command of a particular string by the instruction and the keyboard to perform by a menu displayed on a display to select a mouse click , Further configured to perform a process of calculating the specific command operation number of the specific command operation set to be executable by a combination of predetermined keys,
6. The data according to claim 2, wherein said operation tendency data output means visualizes the number of specific command operations calculated by said operation tendency data processing means as operation tendency data and further displays it on a screen. Processing equipment.   7. The data processing apparatus according to claim 6, wherein the operation tendency data output means visualizes the total number for each specific command operation and displays the screen. The operation tendency data processing means is configured to further perform a process of calculating the number of clicks by a mouse operation in a predetermined range on the display from the operation history received by the operation history receiving means,
The operation tendency data output means, the operation tendency data processing to visualize the clicks calculated treated as operation tendency data unit, further data processing device according to any one of claims 2 to 7, characterized in that the screen display . Based on the operation tendency data, a behavior discrimination requirement extraction means for extracting behavior discrimination requirements such as a type stop time, a mouse stop time, a correction key pressing rate, and a behavior pattern identification model for identifying a user's behavior pattern are stored. An analogy user indicating the user's behavior inferred from the operation history based on the behavior pattern storage means, the behavior discrimination requirement extracted by the behavior discrimination requirement extraction means, and the user's behavior pattern stored in the behavior pattern storage means the data processing device according to any one of claims 2 to 8, characterized in that it comprises a behavioral analysis unit for determining the action. 10. The data processing apparatus according to claim 9, further comprising support information transmitting means for transmitting support information for supporting a user operation to the user device based on the analogy user behavior obtained by the behavior analyzing means. To know the user's operating tendency for various software such as basic software that manages basic functions of the computer and application software such as word processing software and WEB browser,
An operation history acquisition means for acquiring an operation history of an input operation using an input means such as a mouse or a keyboard;
Operation history storage means for storing the operation history acquired by the operation history acquisition means;
Based on the operation history, the operation history stored in the operation history storage means is calculated based on the operation history, and dwell time data indicating the dwell time of the mouse pointer displayed on the display is calculated. transmission and processing of, the residence time data calculation process, to at least perform the data processing apparatus and processing for visualized screen as operation tendency data serving circle radius proportionately to expand the elapsed time in a standby point of the mouse pointer A data processing program for functioning as an operation history transmission means. When the computer monitors the usable area of the memory area provided in the computer and detects that the usable area is smaller than a predetermined value, the operation history is transmitted to the operation history transmitting means. 12. The data processing program according to claim 11 , further functioning as memory management means for instructing transmission to the data processing apparatus. Based on the operation history acquired by the operation history acquisition means, the computer determines a proficiency level determining means for determining a proficiency level for operation of software, etc., and a predetermined proficiency level according to the proficiency level determined by the proficiency level determining means 13. The data processing program according to claim 11 or 12, for further functioning as a proficiency level screen display means for displaying a degree screen on a display. Deletion function that deletes characters such as the delete key and backspace key, and the usage rate of the deletion function operation number with respect to the total number of operations and the menu displayed on the display are selected and clicked with the mouse. The number of specific command operations that indicate the number of specific command operations that can be executed by combining a predetermined key combination with a specific character string input or command that is executed by the keyboard and a command. 14. The data processing program according to claim 13 , wherein the data processing program is displayed.

Images