JP7205007B1 - Support device, operation system, display data creation device, support method, display data creation method, support program, and display data creation program - Google Patents

Abstract

The display data creation device (10) generates operation log information (121) indicating a log of operations on the user interface (201) and operation indicating the layout of operation components displayed on the user interface (201) when the operation is performed. An acquisition unit (11) that acquires component placement information (202), an extraction unit (13) that extracts operation patterns that appear repeatedly in the operation log information (121), and operations extracted by the extraction unit (13). a creation unit (14) for creating display data for displaying the pattern together with the arrangement of the operation components indicated by the operation component arrangement information (202).

Description

The present disclosure relates to a support device, an operation system, a display data creation device, a support method, a display data creation method , a support program, and a display data creation program.

2. Description of the Related Art In FA (Factory Automation) sites represented by factories, a control system is operated that implements various processes by controlling a large number of devices with a control device represented by a programmable controller. The processes realized by the control system are managed by the on-site user via, for example, a display as a UI (User Interface) terminal connected to the control device. The content of the operation screen of this type of display device is not always set by the manufacturer of the display device, but is designed by the user according to the needs of the site.

In designing the operation screen, it is necessary to consider usability for many operators including the person in charge of the design and users other than the person in charge. Therefore, a technique has been proposed for analyzing the history of operations on the operation screen and assisting the person in charge of design (see, for example, Japanese Unexamined Patent Application Publication No. 2002-100003). Patent Literature 1 describes an event analysis device that analyzes event log data indicating the history of operations by an operator and estimates the structure of an operation procedure. This device can support new creation and improvement of procedure manuals.

JP 2017-091178 A

In the technique of Patent Literature 1, an operation procedure is output to an output screen as a graph in which nodes representing unit operations are connected. However, such graph display requires the designer to know what operations are associated with the nodes. In particular, when there are many objects to be managed using the operation screen, a wide range of knowledge about the operation screen is required, and confirmation work frequently occurs. For this reason, the work burden on the person in charge of designing the operation screen is heavy, and it may become difficult to design an appropriate operation screen.

The present disclosure has been made in view of the circumstances described above, and aims to facilitate the design of an appropriate operation screen.

In order to achieve the above object, the support device of the present disclosure includes operation log information indicating a log of operations on a user interface and operation component layout information indicating the layout of operation components displayed on the user interface when an operation is performed. , an extracting means for extracting an operation pattern, which is a plurality of consecutive operations appearing repeatedly in the operation log information, and the operation pattern extracted by the extracting means for the operation indicated by the operation component layout information. display means for displaying together with the arrangement of the parts , the operation log information indicates the operation parts used in the operation, and the display means emphasizes one operation part used in the operations forming the operation pattern. Display a series of images showing the operation screen .

According to the present disclosure, the display means displays the operation pattern together with the arrangement of the operation components . If the operation pattern is displayed together with the arrangement of the operation components, the user can easily recognize the operation component corresponding to the operation pattern. Therefore, it is possible to easily design an appropriate operation screen.

FIG. 1 shows a functional configuration of a display data creation device according to Embodiment 1; FIG. 4 shows a display example of a user interface according to Embodiment 1; A diagram showing an example of operation component arrangement information according to the first embodiment A diagram showing an example of component information according to the first embodiment FIG. 1 shows a hardware configuration of a display data creation device according to Embodiment 1; A diagram showing an example of operation log information according to the first embodiment Flowchart showing display data creation processing according to the first embodiment FIG. 4 is a diagram for explaining division of an operation log into operation sequences according to the first embodiment; A diagram for explaining determination of a threshold value according to the first embodiment. FIG. 4 is a diagram showing an example of calculation of the distance between two operation sequences according to the first embodiment; FIG. 4 shows an example of classifying operation patterns from the operation sequence according to the first embodiment; A diagram showing an example of first operation pattern information according to Embodiment 1 A diagram showing an example of second operation pattern information according to Embodiment 1 FIG. 4 shows a first example of a display screen based on display data according to Embodiment 1; FIG. 10 is a diagram showing a second example of a display screen based on display data according to Embodiment 1; FIG. 10 is a diagram showing a third example of a display screen based on display data according to Embodiment 1; FIG. 4 is a diagram for explaining related information according to Embodiment 1 A diagram showing a functional configuration of a display data creation device according to a second embodiment. FIG. 1 is a first diagram showing an example of a proposal for a new arrangement of operation components according to the second embodiment; A diagram for explaining integration of distances between operation components according to the second embodiment. FIG. 2 shows an example of a proposal for a new arrangement of operation components according to the second embodiment; The figure which shows the example of a change of the page transition based on Embodiment 2. FIG. 3 shows an example of a proposal for a new arrangement of operation components according to the second embodiment; A diagram showing a device information storage device according to a modification The figure which shows the apparatus information acquisition part which concerns on a modification.

Hereinafter, the display data creation device 10 according to the embodiment of the present disclosure will be described in detail with reference to the drawings.

Embodiment 1.
As shown in FIG. 1, the display data creation device 10 according to the present embodiment includes a display 20 corresponding to a UI terminal, and an operated device 21 that operates according to the user's operation content on the display 20. Configure system 100 . The operation system 100 is used to improve the operation screen of the display 20 in facilities represented by factories.

The operated device 21 is, for example, a PLC (Programmable Logic Controller), an I/O (Input/Output) unit used by being connected to the PLC, a machine tool, or other FA equipment. The operated device 21 is connected to the display 20 via a communication line such as a USB (Universal Serial Bus) cable or an industrial network, and communicates with the display 20 .

Display 20 is a computer having a user interface 201 . The user interface 201 may be a touch screen in which a display device and an input device, typified by an LCD (Liquid Crystal Display), are integrally configured, or may be a display device and a mouse that are individually configured. It may also be a combination of input devices such as a pointing device and a keyboard. The configuration of the user interface 201 is not limited to this, as long as it is possible to display information to the user and input information from the user.

On the user interface 201 , operation components are arranged and displayed based on preset operation component arrangement information 202 . Operation components refer to images that are elements constituting an operation screen, such as buttons, text input fields, and switches displayed on the screen. The operation component is operated by the user of the display 20. FIG. Operation of an operational component includes, for example, selecting the operational component by user input represented by pressing and tapping, moving the operational component by dragging, or moving the operational component using a hardware or software keyboard. Means input of numerical value or character string. For example, when an operation component assigned in advance to start operation of the operated device 21 is operated, the display 20 transmits an instruction to start operation to the operated device 21, and the operated device 21 responds to this command. Operate according to the instructions. The operation of the operation component is not limited to the above example, and may be input by the user of information related to the operated device 21 to the displayed operation component.

The operation screen of the user interface 201 is appropriately changed according to the installation environment of the operated device 21 and the display device 20 . That is, the operation component layout information 202 is set according to the situation on site. For example, when a new operated device 21 is installed as an operation target, an operation screen for operating the new operated device 21 is designed.

An image or window including an operation component displayed on the operation screen is hereinafter referred to as a page. Operation components included in a page and page transitions are defined by the operation component layout information 202 . Specifically, as illustrated in FIG. 2, operation parts PT01, PT02, PT03, PT04, and PT05 are arranged on a page PG01 displayed on the main screen. Then, when the operation part PT02, which is a button, is operated, the displayed page transitions to the page PG02 as the device D1 operation screen, and the operation parts PT11 and PT12 are arranged on this page PG02. Further, when another operation component on PG01 is operated, page PG03 is displayed, and when any operation component on page PG02 is operated, page PG04 is displayed.

As illustrated in FIG. 3, the operational component layout information 202 includes page information 203 regarding pages and component information 204 regarding operational components arranged within the page. The page information 203 includes, for each page, a page ID (Identifier) for identifying the page, the page name, the page type, the position on the screen representing the coordinates of the upper left corner point of the page, and the width of the page. and a size indicating height are associated with each other in a table format.

As illustrated in FIG. 4, the part information 204 includes, for each part constituting the operation screen, a part ID for identifying the part, the name of the part, the type of the part, and the page on which the part is arranged. , a display label indicating the contents of the label displayed on the operation component on the user interface 201, a position on the screen representing the coordinates of the upper left corner point of the component, and the width and height of the operation component is data in a table format that associates the size indicating the operation component with the behavior when the operation component is operated. Behavior indicates the behavior of the display 20 when the part is operated. In FIG. 4 , page transition is described as one type of behavior, but information regarding page transition may be defined as information different from the part information 204 . Also, components for which equivalent behavior is defined may be placed on different pages. The components whose layout is defined in the component information 204 may include components other than operation components, such as images that are displayed regardless of the presence or absence of user operations.

The display device 20 is connected to the display data creation device 10 via a communication line or an industrial network and communicates with the display data creation device 10 . Also, the operated device 21 may be connected to the display data creation device 10 as shown in FIG. The display device 20 records the operation on the user interface 201 and provides the recording result to the display data creation device 10 .

The display data creation device 10 is a computer that provides analysis results of user operations on the operation screen of the display device 20 to assist a designer in designing the layout of operation components displayed on the operation screen. FIG. 5 shows the hardware configuration of the display data creation device 10. As shown in FIG. The display data creation device 10 has a processor 31, a main storage section 32, an auxiliary storage section 33, an input section 34, an output section 35, and a communication section 36, as shown in FIG. The main storage section 32 , auxiliary storage section 33 , input section 34 , output section 35 and communication section 36 are all connected to the processor 31 via an internal bus 37 .

The processor 31 includes a CPU (Central Processing Unit) or an MPU (Micro Processing Unit). The processor 31 performs functions described later by executing the program P1 stored in the auxiliary storage unit 33 . Program P1 corresponds to an example of a display data creation program.

The main storage unit 32 includes a RAM (Random Access Memory). A program P1 is loaded from the auxiliary storage unit 33 into the main storage unit 32 . The main storage unit 32 is used as a work area for the processor 31 .

Auxiliary storage unit 33 includes a non-volatile memory typified by EEPROM (Electrically Erasable Programmable Read-Only Memory). The auxiliary storage unit 33 stores various data used for the processing of the processor 31 in addition to the program P1. Auxiliary storage unit 33 supplies data used by processor 31 to processor 31 and stores the data supplied from processor 31 in accordance with instructions from processor 31 .

The input unit 34 includes input devices typified by input keys and a keyboard. The input unit 34 acquires information input by the user of the display data creation device 10 and notifies the processor 31 of the acquired information.

The output unit 35 includes a display device represented by an LED (Light Emitting Diode) and an LCD (Liquid Crystal Display) and an output device such as a speaker. The output unit 35 presents various information to the user according to instructions from the processor 31 .

The communication unit 36 includes a communication interface circuit for communicating with external devices. The communication unit 36 receives a signal from the outside and notifies the processor 31 of information indicated by this signal. The communication unit 36 also transmits a signal indicating information output from the processor 31 to an external device.

The display data creation device 10 exhibits the function of displaying the result of extracting the operation pattern from the log of the user's operation on the user interface 201 of the display device 20 through the cooperation of the hardware configuration described above. Specifically, as shown in FIG. 1, the display data creation device 10 acquires the operation log information 121 indicating the operation log of the user interface 201 and the operation component arrangement information 202 from the display device 20 as its function. an acquisition unit 11 for storing in a storage unit 12; a storage unit 12 for storing various information; an extraction unit 13 for extracting operation patterns that appear repeatedly in operation logs from the operation logs; and a display unit 15 for displaying the operation pattern and the layout of the operation components to the user of the display data generation device 10 based on the display data. Hereinafter, the user of the display data creation device 10 will be appropriately referred to as the designer.

Acquisition unit 11 is mainly implemented by communication unit 36 . The acquisition unit 11 acquires the operation log information 121 and the operation component arrangement information 202 by requesting the display device 20 to transmit them, and writes them to the storage unit 12 . The acquisition unit 11 obtains, in the display data creation device 10, operation log information indicating a log of operations on the user interface, and operation component layout information indicating the layout of the operation components displayed on the user interface when an operation is performed. This corresponds to an example of acquisition means for acquiring. The storage unit 12 is mainly implemented by the auxiliary storage unit 33 .

As exemplified in FIG. 6, the operation log information 121 includes, for each user operation, a time stamp indicating the time when the operation was performed, a page ID indicating the page containing the operated operation component, and a component of the operation component. A record that associates an ID, a first value and a second value that are input accompanying an operation, an operator indicating the user's ID, and device information about the operated device 21 when the operation is performed. This is tabular data arranged in chronological order. The device information includes the model of the product manufactured by the operated device 21 and state information indicating the state of the operated device 21 . Device information is provided from the operated device 21 . The device information may be added to the operation log information 121 by the display device 20, or the device information directly provided to the operation log information 121 provided from the display device 20 by the acquisition unit 11 without going through the display device 20. may be added. The status information indicates, for example, an error occurring in the operated device 21, an operation mode, or a type of process being performed by the operated device 21. FIG.

The extraction unit 13 is mainly implemented by the processor 31 . Logs of operations recorded over a sufficiently long period of time often show repeated sequences of consecutive operations. For example, a first step of setting a plurality of parameters using an operation component and then operating one operated device 21, and a second step of setting other parameters and operating another operated device 21. , are alternately executed, the sequence of operations performed when starting the first step and the sequence of operations performed when starting the second step appear alternately. In addition, the operated device 21 may be caused to perform the same operation even if the sequences of operations are different. For example, when the input order of the parameters is different, when the operator is different, or when the operator is inexperienced and makes a useless or wrong operation, a sequence of different but similar operations appears repeatedly. can. The extraction unit 13 classifies the series of operations that repeatedly appear in the operation log into groups, and determines an operation pattern that represents each group. Then, the extraction unit 13 writes the operation pattern information 122 indicating the operation pattern to the storage unit 12 . The extraction unit 13 corresponds to an example of an extraction unit that extracts an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information, in the display data creation device 10 .

An operation pattern is a series of operations for the user interface 201, and means frequently inputted operations. The operation pattern may be the same series of operations, or may be a series of similar operations as described later.

Here, the operation means the minimum unit of information input to the user interface 201 . For example, the input of certain information can be decomposed into a first operation and a second operation that follows the first operation. Where it can be done, the entry of such information will correspond to more than one operation. If the second operation always follows the first operation, the input of information including the first operation and the second operation is handled as one operation. Regarding the input of a character string into an input field such as one block, if the character string is to be processed by the display unit 20 after the input of all the character strings is completed, the input of the entire character string is 1. When each character is input and a process based on the character occurs on the display 20 each time the character is input, the input of each character may correspond to one operation.

The creating unit 14 is mainly implemented by the processor 31 . The creation unit 14 reads the operation pattern information 122 and the operation component layout information 202 from the storage unit 12, and displays the layout of the operation components corresponding to the operations included in the operation pattern together with the operation pattern for the designer. Data is created and output to the display unit 15 . Details of the display data will be described later. The creating unit 14 corresponds to an example of creating means for creating display data for displaying the operation patterns extracted by the extracting means together with the arrangement of the operation components indicated by the operation component arrangement information in the display data creation device 10 . .

The display unit 15 is mainly implemented by the output unit 35 . The display unit 15 assists the designer in rearranging the operation components by displaying the operation patterns and the layout of the operation components to the designer based on the display data. The display data may be data directly indicating an image to be displayed, or data indicating the configuration of such an image. When the display data indicates the configuration of the image, the display unit 15 generates and displays the image based on the display data.

Next, operation pattern display processing executed by the display data generation device 10 will be described with reference to FIGS. 7 to 16. FIG. The display data creation process shown in FIG. 7 is started, for example, by activation of specific application software of the display data creation device 10 or specific input by the designer. This display data creation process corresponds to an example of a display data creation method executed by the display data creation device 10 . Note that the execution order and execution details of the steps constituting the display data creation process shown in FIG. 7 are merely an example, and the execution order and execution details may be changed arbitrarily.

In the display data creation process, the acquisition unit 11 acquires the operation log information 121 from the display device 20 (step S1). Instead of acquiring one file as the operation log information 121, the acquiring unit 11 acquires different data for each operator, for each manufactured model of the operated device 21, or for each state of the device indicated by the device information. As a result, the operation log information 121 as shown in FIG. 6 may be obtained. Then, the acquiring unit 11 acquires the operational component layout information 202 from the display device 20 (step S2).

Next, the extraction unit 13 divides the operation log indicated by the operation log information 121 into operation sequences based on the time intervals of operations (step S3). The operation sequence is a portion obtained by dividing the operation log into several parts, and corresponds to a series of operations. Desired input by the user is not necessarily completed by operating a single operation component. For example, when an error occurs in the operated device 21 or when the user confirms information on the operation screen, the input to the user interface 201 is completed by the user sequentially operating a plurality of operation components. Since a record of the operation log information 121 is added each time an operation component is operated once, one input of information by the user usually corresponds to an operation sequence, which is a series of consecutive operations.

Here, as shown in FIG. 8, when each record of the operation log information 121 is arranged at corresponding times, the length of time from one operation to the next operation in the operation sequence is short. On the other hand, the length of time from the end of one operation sequence to the start of the next operation sequence is considered relatively long. Therefore, the extraction unit 13 determines that these operations belong to the same operation sequence when the time length from one operation to the next operation is less than the threshold, and determines that these operations belong to the same operation sequence when the time length exceeds the threshold. belong to different operation sequences. For example, if there are records for 0, 1, 2, 13, and 15 seconds at 13:00, and the threshold is 10 seconds, the operations performed at 0, 1, and 2 seconds are The operation log is segmented into an operation sequence containing and a next operation sequence containing operations made at 13 seconds and 15 seconds.

The threshold for obtaining the operation sequence may be preset as a fixed value. However, for the display device 20 whose operation screen is designed on site, it is difficult to predetermine an appropriate threshold value, and a fixed value may be inappropriate as a threshold value for separating operation sequences. In addition, since the operation screen is designed on site, it is not possible to adopt a method of separating the operation sequence based on a predetermined configuration of the operation screen.

Therefore, the extraction unit 13 determines the threshold by analyzing past records. Specifically, the extraction unit 13 sequentially calculates the length of time from each past operation to the next operation shown in the operation log information 121, and as shown in FIG. Create a histogram. Then, the extraction unit 13 determines a threshold based on the created histogram. Specifically, the threshold is determined by approximating the histogram to a probability distribution represented by a normal distribution or a logarithmic normal distribution. The extraction unit 13 may apply a mixture Gaussian distribution model to the histogram and obtain the threshold by maximum likelihood estimation. Also, as shown in FIG. 9, the value of σ, which is the standard deviation when the histogram is approximated by a normal distribution, may be used as the threshold. In this way, if the threshold is determined by statistically analyzing past records, it is expected that an appropriate threshold will be determined for the display device 20 installed in various environments and having an arbitrary operation screen. be.

In addition, it may be preferable to adopt different thresholds for a page that takes a long time to operate because the amount of displayed information is large and requires confirmation work, and a page that can be operated in a short time. Furthermore, since the time required for operation differs between an operation component that is a button that can be operated by pressing and an operation component that requires input of a character string, it may be preferable to adopt different thresholds. Therefore, the extracting unit 13 extracts a record in the operation log information 121 for each page or each operation component, and analyzes the time interval between the operations before and after it, so that the operation time varies depending on the page or operation component. The threshold value may be determined taking into consideration the fact that For example, the threshold used for the length of time until operation of an operation component that is a button may be shorter than the threshold used for the length of time until operation of an operation component that is a character string input field.

The records to be analyzed by the extraction unit 13 regarding the length of time between records may be all the operation logs indicated by the operation log information 121, or some of the operation logs indicated by the operation log information 121. operation log. For example, the extraction unit 13 may extract records of operations related to a specific page from the operation log information 121 and analyze the length of time between records. In addition, the extraction unit 13 extracts records of operations including page transitions, such as transitions from a specific page to any other page X and transitions from page X to a specific page, and extracts records between records. may be analyzed for the duration of The extraction unit 13 extracts records of operations related to transitions between specific two pages, such as transitions from page PG01 to page PG02 and transitions from page PG02 to page PG01, and determines the time length between the records. may be analyzed. Although examples of extracting records relating to pages have been listed, the time length may be analyzed after extracting records for operation components in the same way.

Also, the operation time may differ depending on the operator. For example, the time interval between operations by an inexperienced operator is considered to be longer than the time interval between operations by an experienced operator. Therefore, the extracting unit 13 may extract and analyze past records from the operation log information 121 for each operator to determine a more suitable threshold corresponding to the operator.

Further, the extraction unit 13 may extract a record for each state of the operated device 21 and determine a threshold corresponding to this state. Determination of threshold values associated with the page, operation component, operator, and state of the operated device 21 as described above may be combined arbitrarily.

Note that the operation sequences divided from the operation log in step S3 of FIG. 7 may include those that do not correspond to appropriate operation sequences. For example, two operation sequences can be divided into one operation sequence because the time interval from the last operation of one operation sequence to the first operation of the next operation sequence is short. In addition, since the user is thinking without concentrating on the operation, the operation takes time, and one operation sequence may be divided into two operation sequences. Furthermore, due to an operation error or a different operation procedure for each user, a plurality of operation sequences with slightly different order of operations may appear as the same type of operation sequences.

Therefore, as shown in FIG. 7, the extraction unit 13 classifies the operation sequences obtained in step S3 into groups, and extracts operation patterns corresponding to the groups (step S4). The same or similar operation sequences belong to each group. The operation pattern is an operation sequence that represents this group, and may be any operation sequence that actually belongs to the group. It may be an operation sequence created in

Whether or not the operation sequences are similar to each other is determined, for example, based on the distance between the operation sequences calculated by DP (Dynamic Programming) matching. FIG. 10 shows an example of calculating the distance between two operation sequences. Here, since the distance between operation sequences becomes smaller as the operation sequences are more similar, it corresponds to the degree of similarity indicating the degree of similarity between the operation sequences.

The operation sequence SQ1 shown in FIG. 10 is a series from the first operation "SQ1-1" to the ninth operation "SQ1-9", and the operation sequence SQ2 is "SQ2-1". It is a sequence from the 1st operation to the 11th operation called "SQ2-11". Each operation corresponds to a combination of the page on which the operational component is displayed and the operated operational component. For example, the operation "SQ1-1" means that the operation component PT01 has been operated on the page PG01. Note that a combination of a page, an operation component, and a value input regarding an operation may be treated as one operation.

As shown in FIG. 10, a table is created by arranging the operations that constitute two operation sequences in the row direction and the column direction, and by calculating the value in each cell of this table, the distance between the operation sequences is is calculated. First, when the operation "SQ1-1" shown immediately above the upper left square and the operation "SQ2-1" shown to the left of this square match, the value of this square becomes zero, and these operations are executed. If not, the value of this square is 3, which is the mismatch penalty. In the example of FIG. 10, since the operations match, the upper left cell has a value of zero.

Next, the extraction unit 13 calculates the values of the cells adjacent to the right side, the cell adjacent to the lower side, and the cell adjacent to the lower right side of the cell whose value has been calculated. Specifically, for the squares specified in the column of the operation “SQ1-2” and the row of the operation “SQ2-1”, as a result of comparing these operations, if they match, the square to be calculated is moved from the left to the right. Since it is moving in the direction, add 1, which is the penalty for moving to the right, to 0, which is the value of the left square, and set the value of the square specified by "SQ1-2" and "SQ2-1" to 1. and Here, if the operations do not match, 3 is added as a mismatch penalty. For the squares specified by "SQ1-1" and "SQ2-2", the values are calculated by adding downward movement penalties.

Regarding the squares specified by "SQ1-2" and "SQ2-2", the direction with the smallest value among the three directions of movement from above, movement from the upper left, and movement from the left is Adopted. In the example of FIG. 10, the movement penalty is the smallest zero when moving from the upper left, and since the operations match and no mismatch penalty is added, the value of this cell is zero. However, if the operations are different, a mismatch penalty is added. For example, for the square identified by the column "SQ1-3" and the row "SQ2-3", the minimum movement penalty is zero when moving from the upper left, and the square moves to the value of zero, which is the value of the upper left square. A value of 3 is calculated by adding the penalty of zero and the mismatch penalty of 3. Thereafter, similarly, the values of the cells are calculated in order from approximately the upper left to approximately the lower right. The value in the lower right corner of the table thus obtained is the distance between the operation sequences. Note that the mismatch penalty may be zero if both the page and the operation component match, 1 if one of them is different, and 2 if both are different.

The extraction unit 13 calculates the distance between the operation sequences as illustrated in FIG. 10 by round-robin for two combinations of the operation sequences obtained in step S3 of FIG. Then, the extraction unit 13 obtains a tree structure as shown in FIG. Sort sequences into groups. Among the classified operation sequences, the extraction unit 13 leaves operation sequences with a relatively large number as operation patterns, and excludes operation sequences with a small number as outliers from subsequent processing targets. For example, the extraction unit 13 may discard groups in which the number of operation sequences belonging to the group is less than 10, or may treat the top 50% of groups in which the number of operation sequences is large as subsequent processing targets.

Note that the method of classifying similar operation sequences is not limited to the above example, and any method may be adopted. For example, the extraction unit 13 may replace each operation with a numerical value, and group the operation sequence vector having the numerical value of each operation as a component by hierarchical clustering, k-means method, decision tree, or random Clustering may be performed by a forest-like method.

As described above, the extraction unit 13 uses thresholds determined based on past records to divide the operation log into operation sequences. There are cases where an operation sequence is divided as one operation sequence, and an operation sequence to be classified into one operation pattern is divided as a plurality of operation sequences. Therefore, the extraction unit 13 detects the appearance of the operation pattern extracted in step S4 of FIG. 7 from the operation log (step S5). Specifically, the extraction unit 13 successively compares the operation sequence appearing in the operation log with each operation pattern. This comparison may be a distance calculation as shown in FIG. 10, or may be another similarity calculation. Then, the extraction unit 13 detects the appearance of an operation sequence similar to the operation pattern, using a predetermined threshold value as a reference. At that time, the process by the extraction unit 13 searches the operation log for an operation that matches the first operation of the operation pattern, and then increases the record to, for example, twice the length of the operation pattern. A process of detecting the appearance of an operation sequence that is equal to or less than a threshold may be used. Step S5 can be said to divide the operation log into operation sequences based on the operation pattern extracted in step S4 instead of the time interval in step S3.

If there is an operation pattern extracted in the past at the start of the display data creation process of FIG. 7, the extraction unit 13 omits steps S3 and S4 and uses the operation pattern extracted in the past. step S5 may be executed.

Next, the extraction unit 13 updates the operation pattern by further classifying the operation pattern detected in step S5 as a new operation sequence (step S6). It is expected that this will update the classification of the operation sequence and obtain a more suitable operation pattern. Note that step S6 may be omitted in consideration of the computational load caused by the reclassification of the operation patterns.

The operation pattern extracted in step S6, or the operation pattern extracted in step S4 when step S6 is omitted, is associated with the time of appearance on the operation log in step S5, and stored as operation pattern information 122. 12.

The operation pattern information 122 includes first operation pattern information 122a shown in FIG. 12 and second operation pattern information 122b shown in FIG. The first operation pattern information 122a is a list of types of extracted operation patterns, and includes a pattern ID for identifying each operation pattern and a sub-group corresponding to the same operation sequence included in the group corresponding to the operation pattern. A subgroup ID for identifying a group, one operation representing the subgroup, the start page displayed when the operation sequence of the subgroup starts, and the first and second pages constituting the operation sequence It is data in table format that associates subsequent operations with. Here, the first and second and subsequent operations are respectively indicated by a combination of page ID and part ID.

The second operation pattern information 122b is, as shown in FIG. 13, data indicating an operation pattern appearing in the operation log and a time of appearance in association with each other. Specifically, the second operation pattern information 122b includes the start time and end time of appearance of the operation pattern, the subgroup ID indicating the operation sequence that appeared, the model of the product manufactured by the operated device 21, and the operator. is data in a table format that associates . For example, from 13:00:00 on September 28, 2020 to 13:00:07, an operation sequence with the subgroup ID "SUB01-01-01" appears. It can be seen that it belongs to the operation pattern with ID "PTN01-02". In detecting the operation pattern from the operation log in step S5 described above, if a similar pattern is detected instead of a perfect match, the distance or similarity is also recorded in the second operation pattern information 122b of FIG. Furthermore, the second operation pattern information 122b may further indicate the first, second and subsequent operations that constitute the operation sequence that has appeared.

Returning to FIG. 7, subsequent to step S6, the creation unit 14 creates display data for displaying the operation patterns together with the layout of the operation components (step S7), and the display unit 15 displays the created display data based on the created display data. to display the layout of the operation parts and the operation pattern (step S8). After that, the display data creation process ends.

FIG. 14 shows an example of the display screen of the display data creation device 10. As shown in FIG. On the display screen 401 of FIG. 14, the designer displays the operation pattern extraction conditions after specifying the period of the operation log, specifying the model, specifying the operator, and selecting the state of the operated device 21 . A button 402 is pressed. As a result, operation logs satisfying the designated conditions are extracted from the operation log information 121, and operation patterns are extracted from the extracted operation logs. Note that the display data creation device 10 may call an operation pattern that satisfies a specified condition from the created operation pattern information 122 .

When the display button 402 is pressed, the operation pattern extraction result is displayed at the bottom of the display screen 401 . The operation pattern extraction results are displayed in a tabular form, and the number of occurrences and the average time taken to input the operation pattern are displayed for each pattern ID. As a result, the designer can easily determine the operation pattern with high frequency and the operation pattern that takes a long time to input, and consider the configuration of the operation screen based on this determination. Note that this table may indicate the subgroup ID of the operation sequence that appears instead of the pattern ID, or may indicate the subgroup ID together with the pattern ID. Further, in this table, a representative operation of the operation pattern may be shown, and rows corresponding to the operation pattern may be sorted in descending order of frequency of appearance or in descending order of average time.

In addition, among the operation patterns displayed in the table, for a predetermined number of operation patterns that appear frequently, the number of appearances per hour is totaled, and the transition of the number of appearances is shown in a line graph. may be displayed. In addition to this line graph, the model manufactured by the operated device 21 or the operator may be displayed like a Gantt chart.

When the "details" button 403 included in one of the rows forming the table of FIG. 14 is pressed, information indicating the details of the operation pattern is displayed on the display screen 501 as shown in FIG. be. The display screen 501 shows the details of the operation pattern, and displays a list of the operation sequences of the subgroups included in the operation pattern. In the example of FIG. 15, three types of operation sequences are included in the operation pattern. , indicates. As a result, the designer can easily determine the operation sequence with high frequency and the operation sequence in which the input takes a long time, and consider the configuration of the operation screen based on this determination. In addition, the designer can easily find an exceptional operation sequence that may include an operation error by comparing a typical operation sequence as an operation pattern and an exceptional operation sequence that differs from the typical operation sequence. be able to.

When the designer presses the display switching button 502, the sequence of operations indicated by the page ID and the part ID is changed to the operation screen equivalent to the operation screen displayed on the user interface 201 of the display device 20, as shown in FIG. Switch to a series of thumbnail images. In each of these reduced images, the operation component that is the operation target is highlighted. In the example of FIG. 16, the operation components are highlighted by being blacked out. This allows the designer to recognize the actual operation screen of the user interface 201 and easily recognize in what arrangement of operation components an exceptional operation sequence occurs. Further, by pressing the display switching button 502, the designer can easily associate and confirm the operation indicated by the page ID and the part ID and the operation screen when the operation is performed. In order to facilitate such association, it is desirable to display the page ID and the part ID at the same position as the reduced image of the operation screen.

As described above, the creation unit 14 creates display data for displaying the operation pattern together with the arrangement of the operation components. If the operation patterns are displayed together with the arrangement of the operation components by this display data, the designer can easily recognize the operation components corresponding to the operation patterns. Therefore, it is possible to easily design an appropriate operation screen.

The operation log information 121 indicates the operation components used in the operation, and the display data is data for emphasizing and displaying the operation components used in the operations forming the operation pattern. As a result, the designer can visually recognize the execution procedure of the operation that constitutes the operation pattern in the image that reproduces the configuration of the operation screen. By comparing the operation pattern and the layout of the operation components, the designer can easily consider the layout of the operation components by examining whether the layout of the operation components is easy for the user to operate. In addition, it is possible to easily obtain a diagram that can be used for the procedure manual of the operation screen.

In addition, the operation log information 121 indicates operations performed in sequence in association with the times at which the operations were performed. Operation patterns were extracted by dividing the operation sequences based on the length of time up to the time of , and classifying the operation sequences. If the operation screen is fixed in advance, it is relatively easy to divide the operation log into operation sequences. makes it difficult to obtain a suitable sequence of operations. On the other hand, according to the extracting unit 13, since an operation sequence is obtained based on the time interval between operations, it is possible to obtain an appropriate operation sequence to some extent even for various operation screens in various sites.

Further, the extraction unit 13 extracts operation patterns by classifying the operation sequences, detects the appearance of the extracted operation patterns in the operation log, and the display data is for displaying the detection result by the extraction unit 13. data. This makes it possible to detect an appropriate operation pattern even if the time interval between operations does not correspond to the operation pattern.

Further, as shown in FIG. 14, the operator is specified as a condition of the log of the operation from which the operation pattern is to be extracted. This makes it possible to analyze the operation pattern and the average time required for operation for each operator and estimate the degree of proficiency in the operation. For example, an operation pattern with a large difference in time depending on the operator may differ in ease of operation between veterans and newcomers. Such improvements can be considered.

Also, the state of the operated device 21 including an error is specified as a condition. This makes it possible to identify the operation pattern input to the user interface 201 when an error occurs, and create a procedure manual based on the identified operation pattern. Specifically, it is possible to grasp which error causes the recovery procedure to be difficult to understand, and to support the designer who considers possible improvement by, for example, creating a procedure manual or a shortcut function.

Also, as in the graph shown in FIG. 17, an object 601 indicating related information related to the operated device 21 may be arranged and displayed on the time axis. The related information is, for example, memo information input to a smartphone by an operator who operates the operated device 21 or an image of the operated device 21 captured. Specifically, the related information includes text information such as ``September 28, 2020, 13:15:20, device D1, ``XX happened near device D1'', image.jpg'', and `` image.jpg” is image information. When such related information is acquired by the acquisition unit 11 and the creation unit 14 creates display data including the related information, the related information can be displayed in association with the time axis on the graph. In the example of FIG. 17, the details of the related information and the contents of the image file are displayed by mouseover, clicking or tapping on the object 601 . In this way, by linking with external related information, it is possible to present to the designer the changes in the number of operations and what has happened at that time in association with each other.

When related information is displayed, the acquisition unit 11 corresponds to an example of an acquisition unit that acquires related information related to the user interface in association with time. Also, the display data corresponds to an example of data for displaying the appearance of the operation pattern in the operation log and the related information in association with the time.

Embodiment 2.
Next, the second embodiment will be described, focusing on differences from the first embodiment described above. It should be noted that the same or equivalent configurations as those of the first embodiment are denoted by the same reference numerals, and the explanations thereof are omitted or simplified. The present embodiment differs from the first embodiment in that the display data creation device 10 includes a proposal unit 16 that proposes a new arrangement of operation components.

As shown in FIG. 18 , the display data creation device 10 has a proposal unit 16 that proposes a new arrangement of operation components based on operation log information 121 and operation pattern information 122 . The proposal unit 16 is mainly implemented by the processor 31 . The content of the proposal by the proposal unit 16 is displayed, for example, by pressing a proposal display button (not shown) on a detailed display screen 501 as shown in FIG. The content of the proposal by the proposal unit 16 includes, for example, creation of shortcut buttons and rearrangement of operation components. Further, the contents of the proposal may be customized by the designer, and if the designer permits, the proposal unit 16 generates new operation component layout information 202 that adopts the proposal and sets it in the display device 20 . may This makes it possible to easily improve the arrangement of operation components displayed on the user interface 201 .

Specific examples of the contents of proposals made by the proposal unit 16 will be described below in order.

FIG. 19 shows an example of proposing creation of a shortcut button. A shortcut button is an operation component for collectively inputting a plurality of operations. For example, the proposing unit identifies, in the operation pattern information 122, an operation pattern that includes consecutive operations equal to or greater than a threshold, calculates the number of operations and an average time required for the operations, and calculates the number of operations equal to or greater than the predetermined threshold. A pattern or an operation pattern having a larger calculation result than other operation patterns among the identified operation patterns is selected. For example, N times or more per hour, M times or more per day, the average time required for operation is S seconds or more, the number of operations per hour is P times or more than other operation patterns, or other An operation pattern is selected that satisfies the condition that the number of operations per hour is Q% or more greater than that of the operation pattern. Then, addition of a new shortcut button corresponding to collective input of the selected operation pattern is proposed.

Operations grouped by shortcut buttons are not limited to sequential operations of operation components displayed on a single page, and may include operations of operation components on transitioned pages. Also, the proposal unit 16 may use the operational component layout information 202 . For example, the proposing unit 16 may suggest creation of a shortcut button when the consecutive operations are sequential operations of operation components arranged side by side. Further, the proposing unit 16 may calculate the distance between operation components, and propose creation of a shortcut button when the positions of the operation components on the screen are separated from each other by a threshold value.

FIG. 20 shows the order of operation components to be operated that constitute the operation pattern. In the order shown in the upper part of FIG. 20, the operation components to be operated are far apart, making it difficult for the user to specify the operation component to be operated next, and the distance for moving the finger is long. Therefore, the proposing unit 16 integrates the distance on the screen from the operation component corresponding to each operation constituting the operation pattern to the operation component corresponding to the next operation, and arranges the operation components so that the integration result becomes small. Suggest.

Specifically, the proposal unit 16 identifies from the operation pattern information 122 an operation pattern including consecutive operations equal to or greater than a threshold, and selects an operation pattern with a large number of operations or a long operation time from the identified operation patterns. . The proposing unit 16 then calculates the coordinates of the central position of each operational component based on the operational component layout information 202 . For example, if the position of the upper left corner point of an operational component is (100, 100) and the size is (200, 50), the coordinates of the central position of this operational component are (200, 125).

The proposing unit 16 obtains the coordinates of the central position of each of the operation components corresponding to the operations constituting the selected operation pattern, and sequentially adds the distances to the operation components to be operated next, thereby obtaining the distance in the current operation pattern. to obtain the integrated value of Then, the proposing unit 16 tries to change the arrangement of the operation parts, and similarly obtains the integrated value of the distance when the arrangement is exchanged. If the difference in the distance between the operation component placements before and after replacement is equal to or greater than a predetermined threshold value, the proposal unit 16 proposes the operation component placement after replacement, as shown in FIG. 21 .

Also, as shown in FIG. 22, when the page transitions to another page and then returns to the original page in the operation pattern, the user can easily perform the same operation on the same page. For this reason, the proposal unit 16 identifies from the operation pattern information 122 an operation pattern in which only one operation on a different page is interposed in the course of operations on the same page. If the number of appearances of this operation pattern is greater than the threshold value, or if the operation time is longer than a certain period of time, the proposing unit 16 copies the operation component to another page, as shown in FIG. Or suggest a move. Here, the proposing unit 16 may propose a new layout of the duplicated or moved operational components based on the operational component layout information 202 .

As described above, if there is a proposal by the proposal unit 16, it is possible to assist the designer in examining the arrangement of new operation components. The proposing unit 16 corresponds to an example of proposing means for proposing a new arrangement of operation components in the display data creation device 10 .

Note that the proposal unit 16 may propose a new arrangement of operation components based on the operation log information 121 without using the operation pattern information 122 . For example, the proposal unit 16 may propose deletion of an operation component that has never been used in the operation log information 121 . Further, the proposal unit 16 may compare operation logs before and after application of the new layout of the operational components, and present the result of evaluating the new layout to the user based on this comparison. For example, it is conceivable that, due to the replacement of the arrangement as shown in FIG. 20, the user neglects to check the operation items one by one and simply operates the adjacent operation items one by one. In such a case, if errors occur frequently in the operated device 21, it can be said that such a change of arrangement is undesirable. For this reason, the proposing unit 16 may propose to restore the arrangement of the operation components.

Although the embodiments of the present disclosure have been described above, the present disclosure is not limited to the above embodiments.

For example, an example in which the display data generation device 10 has the display unit 15 has been described, but the present invention is not limited to this. For example, an operation pattern extraction device, which is a cloud server, may transmit display data to an external display device. This operation pattern extraction device corresponds to a device provided with a transmission section for transmitting display data to a display device instead of the display section 15 in the display data generation device 10 described above. Also, the operation pattern extraction device may output display data to the display device via a cable connected thereto without via a network.

Moreover, although an example in which the display data creation device 10 and the display device 20 are configured as separate devices has been described, the display data creation device 10 and the display device 20 may be configured integrally.

Further, although an example in which the acquisition unit 11 directly acquires information from the display device 20 has been described, the acquisition unit 11 may acquire information by reading information stored outside from the display device 20, or may be acquired by the user. The information may be obtained by reading the information from a recording medium such as a memory card that is inserted and removed.

Further, the display device 20 may be a UI terminal that is temporarily connected to the operated device 21 as necessary, or may be constantly connected to the operated device 21 . The display device 20 may have a UI function that utilizes the computational resources of the operated device 21 , or may be a UI unit configured integrally with the operated device 21 .

Moreover, the form in which the device information is provided from the operated device 21 to the display data creation device 10 is arbitrary. For example, as shown in FIG. 24, the operated device 21 may store the device information in the device information storage device 22, and the acquisition unit 11 may acquire the device information by reading the device information from the device information storage device 22. FIG. Further, as shown in FIG. 25, the display device 20 has a device information acquisition unit 23 that acquires device information from the operated device 21, and the acquisition unit 11 acquires the device information from the device information acquisition unit 23. good too.

Also, an example has been described in which the time interval between operations is focused in order to divide the operation sequence from the operation log, but the present invention is not limited to this. For example, the extraction unit 13 may separate the operation sequence at the timing when the state of the operated device 21 is changed, or the operation screen of the user interface 201 starts from the main page until it returns to the main page. It may be cut as an operation sequence.

Further, although the examples in which the operations on the user interface 201 are performed using operation components have been mainly described, operations that do not use operation components are also conceivable. For example, if a user taps or clicks an area in which no buttons and windows are arranged, operation components such as buttons and windows are not used when returning to the previous menu. However, such an operation may be handled as if information had been input to an operation component corresponding to the entire background.

Also, the functions of the display data creation device 10 can be realized by dedicated hardware or by a normal computer system.

For example, the program P1 executed by the processor 31 is stored in a computer-readable non-temporary recording medium, distributed, and the program P1 is installed in the computer to configure the device that executes the above process. be able to. Examples of such recording media include flexible discs, CD-ROMs (Compact Disc Read-Only Memory), DVDs, and MOs (Magneto-Optical Discs).

Alternatively, the program P1 may be stored in a disk device of a server device on a communication network such as the Internet, superimposed on a carrier wave, and downloaded to a computer.

The above processing can also be achieved by starting and executing the program P1 while transferring it via a communication network.

Furthermore, the above processing can also be achieved by causing all or part of the program P1 to be executed on a server device and executing the program while the computer transmits and receives information regarding the processing via a communication network.

In addition, when the above-mentioned functions are realized by an OS (Operating System) sharing responsibility or by cooperation between the OS and an application, only the parts other than the OS may be stored in a medium and distributed. , or you may download it to your computer.

Further, the means for realizing the functions of the display data generation device 10 is not limited to software, and part or all of it may be realized by dedicated hardware including circuits.

This disclosure is capable of various embodiments and modifications without departing from the broader spirit and scope of this disclosure. In addition, the embodiments described above are for explaining the present disclosure, and do not limit the scope of the present disclosure. In other words, the scope of the present disclosure is indicated by the claims rather than the embodiments. Various modifications made within the scope of the claims and within the scope of equivalent disclosure are considered to be within the scope of the present disclosure.

The present disclosure is well suited to assist in user interface improvement efforts.

100 operation system 10 display data creation device 11 acquisition unit 12 storage unit 121 operation log information 122 operation pattern information 122a first operation pattern information 122b second operation pattern information 13 extraction unit 14 creation unit 15 display unit 16 proposal unit 20 display device 201 user interface 202 operation component layout information 203 page information 204 component information 21 operated device 22 device information storage device 23 device information acquisition unit 31 processor 32 main storage unit 33 auxiliary storage unit 34 input unit 35 output unit 36 communication unit 37 internal bus 401, 501 display screen 402 display button 403 button 502 display switching button 601 object P1 program.

Claims (16)

Acquisition means for acquiring operation log information indicating a log of operations on the user interface and operation component layout information indicating the layout of the operation components displayed on the user interface when the operation is performed;
extracting means for extracting an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information;
display means for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information;
with
The operation log information indicates the operation component used in the operation,
The display means displays a sequence of images showing an operation screen by emphasizing one of the operation components used in the operations constituting the operation pattern.
support equipment. The operation log information indicates the sequentially performed operations in association with the times at which the operations were performed;
The extraction means divides the operation log information into operation sequences based on the length of time from the time of each operation to the time of the next operation, and classifies the operation sequences to extract the operation patterns. ,
The support device according to claim 1 . The extracting means extracts the operation pattern by classifying the operation sequence, and detects appearance of the extracted operation pattern in the operation log information without being based on the time length ;
The display means displays a result of detection by the extraction means.
3. A support device according to claim 2 . the operation patterns correspond to groups of the operation sequences;
The extraction means extracts the operation pattern by classifying the operation sequence, and updates the operation pattern by further classifying the operation pattern appearing in the operation log information as a new operation sequence.
3. A support device according to claim 2 . a support device according to any one of claims 1 to 4;
an operated device that operates according to the operation on the user interface;
the user interface;
Operation system including. Acquisition means for acquiring operation log information indicating a log of operations on the user interface and operation component layout information indicating the layout of the operation components displayed on the user interface when the operation is performed;
extracting means for extracting an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information;
creation means for creating display data for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information;
with
The acquisition means acquires related information related to the user interface in association with time,
The operation log information indicates the sequentially performed operations in association with the times at which the operations were performed;
The display data is data for displaying the occurrence of the operation pattern in the operation log information and the related information in association with time.
Display data creation device. Acquisition means for acquiring operation log information indicating a log of operations on the user interface and operation component layout information indicating the layout of the operation components displayed on the user interface when the operation is performed;
extracting means for extracting an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information;
creation means for creating display data for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information;
proposal means for proposing a new arrangement of the operation components based on at least one of the operation log information and the operation pattern;
A display data creation device comprising: The suggestion by the proposing means is to add a new operation component corresponding to the input of the operation pattern, and to add the operation component corresponding to the operation next to the operation component corresponding to each of the operations constituting the operation pattern. exchanging the arrangement of the plurality of operation components based on the sum of distances on the user interface up to and including the operation components when a page displayed including the operation components changes in the user interface; including at least one of copying or moving to another page;
The display data creation device according to claim 7. The proposing means outputs a result of evaluating the new arrangement based on a comparison of the operation log information before and after application of the new arrangement.
The display data creation device according to claim 7 . a display data creation device according to any one of claims 6 to 9;
an operated device that operates according to the operation on the user interface;
the user interface;
Operation system including. Acquisition means acquires operation log information indicating an operation log,
the acquisition means acquires operational component layout information indicating the layout of operational components displayed on a user interface when the operation is performed;
extracting means for extracting an operation pattern that is a plurality of consecutive operations that appear repeatedly in the operation log information;
display means for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information ;
including
The operation log information indicates the operation component used in the operation,
The display means displays a series of images showing an operation screen by emphasizing one of the operation components used in the operations constituting the operation pattern.
how to help . Acquisition means acquires operation log information indicating an operation log,
the acquisition means acquires operational component layout information indicating the layout of operational components displayed on a user interface when the operation is performed;
extracting means for extracting an operation pattern that is a plurality of consecutive operations that appear repeatedly in the operation log information;
creating means for creating display data for displaying the operation pattern extracted by the extracting means together with the arrangement of the operation components indicated by the operation component arrangement information;
including
The acquisition means acquires related information related to the user interface in association with time,
The operation log information indicates the sequentially performed operations in association with the times at which the operations were performed;
The display data is data for displaying the occurrence of the operation pattern in the operation log information and the related information in association with time.
Display data creation method. Acquisition means acquires operation log information indicating an operation log,
the acquisition means acquires operational component layout information indicating the layout of operational components displayed on a user interface when the operation is performed;
extracting means for extracting an operation pattern that is a plurality of consecutive operations that appear repeatedly in the operation log information;
creating means for creating display data for displaying the operation pattern extracted by the extracting means together with the arrangement of the operation components indicated by the operation component arrangement information;
a proposing means proposing a new arrangement of the operation components based on at least one of the operation log information and the operation pattern;
display data creation method including the computer,
Acquisition means for acquiring operation log information indicating an operation log and operation component arrangement information indicating the arrangement of operation components displayed on the user interface when the operation is performed;
Extraction means for extracting an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information;
display means for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information;
function as
The operation log information indicates the operation component used in the operation,
The display means displays a series of images showing an operation screen by emphasizing one of the operation components used in the operations constituting the operation pattern.
support program. the computer,
Acquisition means for acquiring operation log information indicating an operation log and operation component arrangement information indicating the arrangement of operation components displayed on the user interface when the operation is performed;
Extraction means for extracting an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information;
creation means for creating display data for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information;
function as
The acquisition means acquires related information related to the user interface in association with time,
The operation log information indicates the sequentially performed operations in association with the times at which the operations were performed;
The display data is data for displaying the occurrence of the operation pattern in the operation log information and the related information in association with time.
Display data creation program. the computer,
Acquisition means for acquiring operation log information indicating an operation log and operation component arrangement information indicating the arrangement of operation components displayed on the user interface when the operation is performed;
Extraction means for extracting an operation pattern, which is a plurality of consecutive operations that appear repeatedly in the operation log information;
creation means for creating display data for displaying the operation patterns extracted by the extraction means together with the arrangement of the operation components indicated by the operation component arrangement information;
proposal means for proposing a new arrangement of the operation components based on at least one of the operation log information and the operation pattern;
Display data creation program for functioning as

Images