JP2014149641A - Information processing device, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device, an information processing method, and a program that enable confirmation of whether a worker is performing operations required by a content creator without omission.SOLUTION: An information processing device comprises: an operation information storage unit that stores area information which is generated each time a displayed area in a content is changed, and represents the area; and an operation determination information generation unit that calculates an index indicating a degree of attention of an operator for a partial area of the content with reference to the information stored in the operation information storage unit.

Description

  The present invention relates to an information processing apparatus, an information processing method, and a program.

In recent years, an information terminal having a display with a touch panel, for example, a client PC such as a smartphone or a tablet PC (Personal Computer, personal computer) has been used for browsing a document (content) such as a work procedure manual by an operator. However, there are cases where the worker does not work according to the content, or performs an unauthorized work without reading the content.
In order to suppress this unauthorized work, information such as page expansion information requested by the worker from the client PC to the server is collected to the server storing the content via a network such as the Internet or a mobile communication network. The technique to do is known (for example, refer patent document 1).

JP 2008-123379 A

  By the way, the technique described in the above-mentioned patent document 1 is a catalog or the like, and it is possible to analyze detailed information such as what part the operator was interested in, what order the operator worked in the procedure manual, and the like. There is a problem that you can not.

  The present invention has been made in view of such circumstances, and provides an information processing apparatus, an information processing method, and a program capable of confirming whether an operator has performed an operation requested by a content creator without omission. There is to do.

(1) Referring to the operation information storage unit that stores the region information that represents the region generated each time the displayed region in the content is changed, and the information stored in the operation information storage unit, An information processing apparatus comprising: an operation determination information generation unit that calculates an index indicating a degree of attention of an operator for a partial region of content.
(2) The operation information storage unit stores time information indicating a time when the area is displayed in association with the area information indicating the displayed area, and the operation determination information generation unit is configured to store the partial information. (1) wherein the index indicating the degree of attention is calculated by integrating the time indicated by the time information stored in the operation information storage unit in association with the area information indicating the area including the area. Information processing apparatus.
(3) The operation determination information generation unit counts the number of region information indicating the region including the partial region stored in the operation information storage unit, and serves as an index indicating the degree of attention. The information processing apparatus according to (1).
(4) The operation information storage unit stores first time information indicating a time at which the region information is generated in association with the region information, and a plurality of the operation information storage units are included in the content. In association with each input item that can be input by the operator, second time information indicating a time when the input is input is stored, and the operation determination information generation unit is configured to store the two second times The index indicating the degree of attention is calculated by referring to the area information stored in the operation log storage unit in association with the first time information included in the time zone represented by the information (1) It is an information processing apparatus as described in.
(5) a determination information storage unit that stores information indicating a predetermined area and a threshold value of an index indicating the degree of attention; and an index indicating the degree of attention of the partial area included in the predetermined area, It is determined whether or not the attention level is higher than the threshold value, and when the operation determination unit determines that the attention level is not higher than the threshold value, an operation determination unit that notifies that the attention level is insufficient The information processing apparatus according to claim 1, further comprising:
(6) A display area display unit that generates an image indicating an index indicating the degree of attention of an operator of the area is provided for each area into which the content is divided, and the operation determination information generation unit divides the content The information processing apparatus according to claim 1, wherein an index indicating the degree of attention of the operator is calculated for each region.
(7) Referring to the first process of storing area information representing the area generated each time the displayed area in the content is changed, and the information stored in the operation information storage unit, A second process of calculating an index indicating the degree of attention of the operator for a partial area of the content.
(8) A program for causing a computer to function as the information processing apparatus according to any one of claims 1 to 6.

  According to the present invention, it is possible to provide an information processing apparatus, an information processing method, and a program capable of confirming whether an operator has performed an operation requested by a content creator without omission.

It is a block diagram which shows the structure of the content display system which concerns on one Embodiment of this invention. It is an example of the table showing the content information which the content storage part in this embodiment memorize | stores. It is an example of the table showing the determination information in this embodiment. It is an example of the table showing the operation log in this embodiment. It is an example of the table showing the check information in this embodiment. It is a flowchart explaining operation | movement of each part until the request | requirement of warning information generation is performed during the operation | work to the information terminal in this embodiment. It is a flowchart explaining operation | movement of each part until the warning information production | generation request | requirement is performed after completion | finish of the operation | work to the information terminal in this embodiment. It is an example of the table showing the operation determination information in this embodiment. It is a flowchart explaining operation | movement of the operation determination information generation part in this embodiment. It is a flowchart explaining operation | movement of the operation determination part in this embodiment. It is an example showing the heat map with respect to the whole content in this embodiment. It is an example showing the heat map for every item in this embodiment. It is a flowchart explaining operation | movement of the heat map production | generation part in this embodiment.

<First Embodiment>
Hereinafter, an embodiment according to the present invention will be described in detail with reference to the drawings.
FIG. 1 is a schematic block diagram showing the configuration of the content display system 10 of the present embodiment.
In the content display system 10, an information terminal 100 (information processing apparatus) and a center server 200 (information processing apparatus) are connected via a network 300.
The contents in the present embodiment are an electronic manual, a work procedure manual, a check sheet, and the like. The content is an electronic document created in the PDF form format in which a check box is set for each work item and confirmation item.

  In the present embodiment, the content is drawn with a dedicated viewer as an image to be displayed on the first display 105. Further, in the present embodiment, in the initial state before the enlargement / reduction of the content, the horizontal width and vertical width of the content match the horizontal width and vertical width of the display area of the first display 105. However, it is not limited to this.

  The information terminal 100 displays the content. In addition, the information terminal 100 displays a plurality of selection targets such as hyperlinks to each content, and accepts selection input to the selection targets by the touch panel unit 101. The information terminal 100 may be a portable terminal capable of communication via a mobile communication network such as a tablet PC (Personal Computer), or a notebook PC with a touch panel, but is not limited thereto. .

The information terminal 100 includes a touch panel unit 101, a viewer unit 102, a first content storage unit 103, a first display 105, a first display image composition unit 106, a warning generation unit 107, and a communication unit 108. A first determination information storage unit 141, a first operation information storage unit 142, an operation determination unit 143, an operation determination information generation unit 144, and a first operation determination information storage unit 145.
The touch panel unit 101 is pasted so as to cover the display area of the first display 105, and detects the position coordinates touched with a finger or the like. When the touch panel unit 101 detects the position coordinates, the touch panel unit 101 outputs the position coordinates to the viewer unit 102.

When the viewer unit 102 receives the position coordinates from the touch panel unit 101, the viewer unit 102 determines an operation type or the like such as tap, flick, pinch in, and pinch out from the position coordinates. The viewer unit 102 changes the displayed area in the content using the position coordinates, the information indicating the determined operation type and the like, and the area information indicating the displayed area in the content as an operation log. Each time, the information is output to the operation information storage unit 142. Details of the operation log will be described later.
The viewer unit 102 detects check information for content check boxes, for example, information indicating the presence or absence of a check, information indicating a check time, and the like, and outputs the detected information to the operation information storage unit 142 in an XML format.

  The viewer unit 102 reads content stored in the first content storage unit 103. When the viewer unit 102 reads the content from the first content storage unit 103, the viewer unit 102 converts the content into a BMP (bitmap) format image (hereinafter referred to as a content image). Based on the touch information, the viewer unit 102 changes the area where the content is displayed for each touch operation. Based on the changed display area, the viewer unit 102 generates a content image area corresponding to the area as a display image. When the display unit 102 generates the display image, the viewer unit 102 outputs the display image to the first display image synthesis unit 106.

  The first content storage unit 103 is a recording medium capable of long-term storage of information such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), but is not limited thereto. The first content storage unit 103 acquires and stores the content stored in the center server 200 from the communication unit 108 via the network 300. Upon receiving a content acquisition request from the viewer unit 102, the first content storage unit 103 outputs the content to the viewer unit 102. Further, upon receiving a content acquisition request from the operation determination information generation unit 144, the first content storage unit 103 outputs the content to the operation determination information generation unit 144.

  The first operation information storage unit 142 acquires an operation log from the viewer unit 102. When receiving the check information from the viewer unit 102, the operation information storage unit 142 converts the XML format into the database table format. Thereafter, the operation information storage unit 142 stores the operation log and check information converted into the table format (hereinafter referred to as a check information table) as operation information. The first operation information storage unit 142 outputs the operation information to the communication unit 108 in response to a registration operation by the operator or a request for obtaining operation information at any time by the communication unit 108. When receiving the operation information acquisition request from the operation determination information generation unit 144, the first operation information storage unit 142 outputs the operation information to the operation determination information generation unit 144.

  The operation determination information generation unit 144 reads content from the first content storage unit 103. When the operation determination information generation unit 144 reads the content from the first content storage unit 103, the operation determination information generation unit 144 converts the content into a content image. In addition, when the operation determination information generation unit 144 reads the operation information from the first operation information storage unit 142, the operator's attention level is selected for a partial area of the content image based on the content image and the operation information. Is calculated and generated as operation determination information.

  The operation determination information is information representing an index indicating the degree of attention of the operator for each pixel constituting the partial area. For example, the operation determination information is information indicating the time when each pixel is displayed for each pixel constituting the partial area, but is not limited thereto, and the area including the partial area The number of area information to be represented may be counted and used as an index indicating the degree of attention. Details of the operation determination information will be described later. When the operation determination information is generated, the operation determination information generation unit 144 outputs the operation determination information and the operation information check information table to the first operation determination information storage unit 145 to be stored therein.

  The first operation determination information storage unit 145 is a recording medium capable of long-term storage of information such as an HDD (Hard Disk Drive) and an SSD (Solid State Drive), but is not limited thereto. The first operation determination information storage unit 145 acquires the operation determination information and the check information table from the operation determination information generation unit 144 and stores them. When receiving a request for obtaining operation determination information from the operation determination unit 143, the first operation determination information storage unit 145 outputs the operation determination information to the operation determination unit 143. When the first operation determination information storage unit 145 receives a check information table acquisition request from the operation determination unit 143, the first operation determination information storage unit 145 outputs the check information table to the operation determination unit 143.

The first determination information storage unit 141 is a recording medium capable of long-term storage of information such as an HDD or an SSD, but is not limited thereto. When the first determination information storage unit 141 receives a determination information acquisition request from the operation determination unit 143, the first determination information storage unit 141 outputs the determination information to the operation determination unit 143. The first determination information storage unit 141 acquires and stores determination information stored in the center server 200 from the communication unit 108 via the network 300. The first determination information storage unit 141 acquires the determination information from the communication unit 108 at the same time when the communication unit 108 outputs the content to the first content storage unit 103.
The determination information is information including a mandatory display area (hereinafter referred to as a display mandatory area) and a request display time (hereinafter referred to as a display mandatory time) associated with each check item. Details of the determination information will be described later.

  The operation determination unit 143 reads determination information from the first determination information storage unit 141. The operation determination unit 143 reads operation determination information from the first operation determination information storage unit 145. The operation determination unit 143 compares the determination information with the operation determination information to determine whether there is a requested operation omission. Details of the determination will be described later. When there is a requested operation omission, the operation determining unit 143 outputs information indicating the type of the requested operation omission and information indicating the location where the requested operation omission is present to the warning generation unit 107, and information indicating the type And a warning image based on the information indicating the location is generated.

  The operation determination unit 143 outputs null information to the warning generation unit 107 when there is no request operation omission. The types of requested operation omissions are omissions in the check boxes, incorrect check order in the check boxes, and insufficient display time of the display required area. Information indicating the location where the requested operation omission is included, including information indicating an item associated with the check omission where the check omission is present, information indicating the check order, and a display mandatory area where the display time is insufficient It is the information which shows.

  Upon receiving the information indicating the type, the information indicating the location, and the request for generating the warning image from the operation determining unit 143, the warning generation unit 107 receives the information indicating the type, the information indicating the location, Based on the above, the warning image is generated. When the warning generation unit 107 generates the warning image, the warning generation unit 107 outputs the warning image to the first display image synthesis unit 106. When receiving the null information from the operation determination unit 143, the warning generation unit 107 outputs the null information to the first display image synthesis unit 106.

  The first display image synthesizing unit 106 synthesizes a plurality of inputted images and generates one image to be displayed on the first display 105. The first display image composition unit 106 acquires a display image from the viewer unit 102. The first display image synthesis unit 106 acquires a warning image or null information from the warning generation unit 107. When the warning image is acquired from the warning generation unit 107, the first display image synthesis unit 106 synthesizes the warning image on the display image and displays it on the first display 105. When acquiring the null information from the warning generation unit 107, the first display image synthesis unit 106 causes the first display 105 to display the display image acquired from the viewer unit 102.

The first display 105 is a display of the information terminal 100. When the first display 105 receives an image to be displayed in the display area of the first display 105 from the first display image synthesis unit 106, the first display 105 displays the image.
The communication unit 108 reads content from the Web function unit 201 of the center server 200 via the network 300. When the communication unit 108 reads content from the Web function unit 201, the communication unit 108 outputs the content to the first content storage unit 103.

The communication unit 108 reads determination information from the Web function unit 201 of the center server 200 via the network 300. When the communication unit 108 reads the determination information from the Web function unit 201, the communication unit 108 outputs the determination information to the first determination information storage unit 141. Note that when the communication unit 108 outputs the content, the communication unit 108 outputs the determination information at the same time.
Upon receiving the operation information from the first operation information storage unit 142, the communication unit 108 outputs the operation information to the web function unit 201 of the center server 200 via the network 300.

  Next, the center server 200 will be described. The center server 200 outputs information stored in each storage unit to the information terminal 100 via the network 300 in accordance with a request from the information terminal 100. The center server 200 stores operation information of the information terminal 100 provided from the information terminal 100. The center server 200 also has a function for the operator's administrator to confirm an area where the operator's attention is high with respect to the content displayed on the information terminal 100.

  The center server 200 includes a Web function unit 201, a second content storage unit 203, a second determination information storage unit 241, a second operation information storage unit 242, an operation determination unit 143, and operation determination information generation. Unit 144, second operation determination information storage unit 245, second display 205, second display image composition unit 206, warning generation unit 107, and heat map generation unit 202. The operation determination unit 143, the operation determination information generation unit 144, the display 105, and the warning generation unit 107 are the same as the respective units of the information terminal 100, and thus detailed description thereof is omitted.

  When receiving a content information acquisition request from the communication unit 108, the Web function unit 201 reads content from the second content storage unit 203. When the web function unit 201 reads content from the second content storage unit 203, the web function unit 201 outputs the content to the communication unit 108. When receiving the determination information acquisition request from the communication unit 108, the web function unit 201 reads the determination information from the second determination information storage unit 241. When the Web function unit 201 reads the determination information from the second determination information storage unit 241, the Web function unit 201 outputs the determination information to the communication unit 108. When receiving the operation information from the communication unit 108, the Web function unit 201 outputs the operation information to the second operation information storage unit 242. Further, the Web function unit 201 outputs and stores the determination information created by the content creator in the second determination information storage unit 241.

  The second content storage unit 203 has the same function as the first content storage unit 103, but the input / output destination is different. The second content storage unit 203 acquires the content prepared by the content provider from the Web function unit 201 and stores it. Upon receiving a content acquisition request from the Web function unit 201, the second content storage unit 203 outputs the content to the Web function unit 201. Upon receiving a content acquisition request from the operation determination information generation unit 144, the second content storage unit 203 outputs the content to the operation determination information generation unit 144. Upon receiving a content acquisition request from the heat map generation unit 202, the second content storage unit 103 outputs the content to the heat map generation unit 202.

  The second operation information storage unit 242 has the same function as the first operation information storage unit 142, but the input / output destination is different. The second operation information storage unit 242 acquires operation information from the Web function unit 201 and stores it. When receiving the operation information acquisition request from the operation determination information generation unit 144, the second operation information storage unit 242 outputs the operation information to the operation determination information generation unit 144. When the second operation information storage unit 242 receives a request for operation information acquisition from the heat map generation unit 202, the second operation information storage unit 242 outputs the operation information to the heat map generation unit 202.

  The second operation determination information storage unit 245 has the same function as the first operation determination information storage unit 145, but the output destination is different. The second operation determination information storage unit 245 acquires the operation determination information from the operation determination information generation unit 144 and stores it. When the second operation determination information storage unit 245 receives an operation determination information acquisition request from the operation determination unit 143, the second operation determination information storage unit 245 outputs the operation determination information to the operation determination unit 143. The second operation determination information storage unit 245 outputs the operation determination information to the heat map generation unit 202 when receiving a request for acquiring operation determination information from the heat map generation unit 202.

  The second determination information storage unit 241 has the same function as the first determination information storage unit 141, but the input / output destination is different. When the second determination information storage unit 241 receives a determination information acquisition request from the operation determination unit 143, the second determination information storage unit 241 outputs the determination information to the operation determination unit 143. When the second determination information storage unit 241 receives a determination information acquisition request from the Web function unit 201, the second determination information storage unit 241 outputs the determination information to the Web function unit 201. When receiving the determination information created by the content creator from the Web function unit 201, the second determination information storage unit 241 stores the determination information.

  The second display image composition unit 206 has the same function as the first display image composition unit 106, but the input destination is different. The second display image composition unit 206 acquires a heat map and a sequence diagram from the heat map generation unit 202. The second display image synthesis unit 206 synthesizes a sequence diagram on the heat map. Further, when the warning image is acquired from the warning generation unit 107, the second display image synthesis unit 206 synthesizes the warning image on the heat map obtained by synthesizing the sequence diagram and displays the warning image on the display 105. When the second display image synthesis unit 206 acquires null information from the warning generation unit 107, the second display image synthesis unit 206 displays a heat map obtained by synthesizing the sequence diagram on the display 105.

The heat map generation unit 202 reads content from the second content storage unit 203. When the heat map generation unit 202 reads the content from the second content storage unit 203, the heat map generation unit 202 converts the content into a content image. The heat map generation unit 202 reads operation determination information from the second operation determination information storage unit 245. The heat map generation unit 202 reads operation information from the second operation information storage unit 242. The heat map generation unit 202 generates a heat map based on the content image and the operation determination information. When generating the heat map, the heat map generating unit 202 outputs the heat map to the second display image combining unit 206.
In the heat map, each pixel of the image represented by the BMP content information is color-coded by the display time, the number of times of drawing, and the like based on the operation determination information. Details of the heat map will be described later.

In addition, the heat map generation unit 202 generates a sequence diagram based on the operation information. When the heat map generation unit 202 generates a sequence diagram, the heat map generation unit 202 outputs the sequence diagram to the second display image synthesis unit 206 and synthesizes it on the heat map.
Since the content display area is associated with the display time, the sequence diagram is an image in which the outer frame of the content display area is drawn on the content image in the order of display time of the display area. The outer frame is given a number indicating the order of the display time order in the order of the display time. Details of the sequence diagram will be described later.

In this embodiment, the network 300 is a network such as the Internet or a mobile communication network, but is not limited thereto. For example, an intranet or a dedicated line may be used.
The second display 205 has the same function as the first display 105, but the input destination is different. The second display 205 is a display of the center server 200. When the second display 205 receives an image to be displayed in the display area of the second display 105 from the second display image synthesis unit 206, the second display 205 displays the image.

  FIG. 2 shows a content information table t 401 stored in the first content storage unit 103 and the second content storage unit 203. The content information table t401 includes a content ID t113, a content name t411, a page number t412 indicating the total number of pages of content, a file path t413 to the storage area where the content is stored, and a determination ID t111. . The content storage unit 103 can output the content in response to the content acquisition request from each unit of the information terminal 100 by using the content information table t401.

FIG. 3 shows two tables representing the determination information stored in the first determination information storage unit 141 and the second determination information storage unit 241.
t101 represents a determination information table, and includes a determination ID t111, a determination name t112, and a content ID t113. The content ID t113 is a number assigned to each piece of content information so that each piece of content information can be identified.

The determination ID t111 is associated with the content ID, and in this embodiment, the same number as the content ID is assigned. The determination name t112 is information of a name that is given for each determination ID and indicates what kind of content is determined, for example, a procedure manual or a catalog. It is. The operation determination unit 143 identifies what kind of determination is performed on which content based on the determination information table t101, and performs an operation determination.
t102 represents a display-required area table, and for each display-required area, a plurality of conditions for determining whether there is a requested operation omission is shown.

  The coordinates of the four corners of the display essential area (hereinafter referred to as display essential area coordinates) t125 are four coordinate values for representing the display essential area set in the content. The display-required area is an area that the operator is requested to display for at least the display-required time t121. In the present embodiment, a rectangular area in which these coordinates are connected by a line is set as a display essential area, but the present invention is not limited to this. For example, the display essential area may be another shape such as a circle. The display-required time t121 is a time that the operator must display the display-required area associated with each display-required area. However, the case where it is determined that the requested operation omission is a case where a predetermined area ratio of the total area of the display essential area is not displayed during the display essential time. The area display rate t122 is a value representing the predetermined area rate.

The page number t123 is a value indicating how many pages of the content identified by the content ID t113 the display-required area exists. The check number t124 is a check box number set for each item in the content including the display-required area.
In summary, in the example of the determination information shown in FIG. 2, the content of the content ID1 in which the display essential area identified by the determination ID1 is set has three display essential areas set on the second page, and the check number is For each item including the display essential area, 1, 2, and 3 are assigned in order from the top.

  The display mandatory time t121 is set to 3 seconds, 3 seconds, and 4 seconds in the order of the check numbers for each display mandatory area. Further, the area display rate t122 set for each display-required region is set to 90%, 90%, and 100%, respectively. Therefore, the operation determination unit 143 can determine under what conditions each determination is performed based on the display-required area table t102, and can determine whether there is a requested operation omission by comparing with the operation determination information.

FIG. 4 shows two tables representing operation logs in the operation information stored in the first operation information storage unit 142 and the second operation information storage unit 242, and are a work table t201 and an operation log table t202. It is.
First, the work table t201 will be described. The work ID t211 is a value automatically assigned for each work performed by the operator.

  In the present embodiment, the work is a single work from the time the content is opened until the content is closed. However, the present invention is not limited to this. Therefore, the work start time t215 and the work end time t216 respectively correspond to the time when the content is opened and the time when the content is closed. The user ID is a value for identifying an individual that is input by the operator through the viewer unit 102 when the operator performs work. The work name is name information indicating what kind of work the operator inputs through the viewer unit 102 at the end of the work.

  The operation log table t202 is a table in which information indicating what kind of operation is performed for the work corresponding to each work ID. T202 in FIG. 4 represents a part of the details of the work whose work ID is 10. The touch log ID t221 is a value for identifying the order of operations by assigning integers in order from the earliest time for touch operations on the touch panel performed for each work. The operation time t224 (first time information) represents the time when the touch operation corresponding to the touch log ID t221 is performed. The touch type t225 uses an alphabet to indicate which operation is a tap operation, such as a tap, flick, pinch-in, or pinch-out. In FIG. 4, the touch type t225 represents scrolling by flicking by the alphabet S.

  The magnification t226 indicates, as a percentage, how much the display image displayed on the first display 105 has been enlarged or reduced from the initial value by pinch-in / pinch-out during the touch operation. It is the value. In FIG. 3, since the magnification t226 is 0.99, the display image displayed on the first display 105 is reduced to 99% of the initial value. In the present embodiment, the initial value is set in advance for each content, but is not limited to this.

  The base point coordinate t227 is a coordinate used to calculate the position of the position where the content is displayed in the entire content. The coordinates indicate the coordinates on the content image of the upper left corner of the surface area where the content is displayed. However, the initial value of the coordinates of the upper left corner is the coordinates of the upper left corner for each content image. In this embodiment, the coordinates of the upper left corner are (0, 0), that is, the origin. Since the base point coordinate t227 changes every moment by scrolling, it is possible to calculate which region in the content image the content display area is for each operation log by following the movement of the base point coordinate t227.

Here, calculation of a region in the content image (hereinafter referred to as a display range) will be described. In the initial state, the vertical width and horizontal width of the content image match the vertical width and horizontal width of the display area in the initial state. Therefore, the vertical width and horizontal width of the display range after enlargement / reduction are values obtained by dividing the vertical width and horizontal width of the content image by the magnification. That is, the vertical width dispH of the display range after enlargement / reduction and the horizontal width dispW of the display range are based on the vertical width Height, the horizontal width Width, and the magnification zoom of the content image in the initial state.
dispH = Height / zoom
dispW = Width / zoom
Is calculated.

These values are the coordinates of the lower right end of the rectangle representing the display range having the base point coordinate t227 at the upper left end (hereinafter referred to as end point coordinates). However, this is the case where the base point coordinate t227 is at the origin, and when scrolling with a flick or the like, the base point coordinate t227 moves from the initial value (0, 0), so the display range also moves accordingly. become.
Therefore, when the base point coordinate t227 is moved, the values of the end point coordinates are respectively set as x coordinate of the base point coordinate t227 x and y coordinate y.
dispH = y + Height / zoom
dispW = x + Width / zoom
It becomes.

In this way, the display range can be obtained by using the base point coordinates t227, the magnification t226, and the vertical and horizontal widths of the content image in the initial state.
FIG. 5 is a check information table t203 in the operation information stored in the first operation information storage unit 142 and the second operation information storage unit 242. The check information table t203 includes a check number t124, a check presence / absence t232, a page number t123, a check time t233, and a content ID t113. In the present embodiment, the presence / absence of a check t232 is information indicating the presence / absence of a check on a check box set for each item including a display-required area in the content. The presence / absence of check t232 is assigned 1 when the check box is checked, and a null value when the check box is not checked. The check time t233 (second time information) is a value indicating the time when the check box is checked, and is assumed to contain a null value until the check box is checked.

  By using the check information table t203, the operation determination unit 143 can detect in what order the operator has read each item including the display-required area. Further, the operation determination information generation unit 144 can calculate the display time for each item (hereinafter, item display time) by using the check time t233. Specifically, the item display time can be obtained as a time difference between check times of two consecutive items. The item display time is an index representing the operator's attention level for each item.

  FIG. 6 shows a first determination information storage unit 141, a first operation information storage unit 142, an operation determination unit 143, and an operation determination information generation unit during the time when the operator is operating the information terminal 100. 144 is a flowchart for explaining the operation of 144 and the first operation determination information storage unit 145. Each of these units executes the processing of steps ST501 to ST507 while the content is displayed on the information terminal 100 by the operator and at the same time the operation on the content is being performed.

(Step ST501)
The first determination information storage unit 141 acquires and stores determination information. Thereafter, the operation determination information generation unit 144 performs the process of step ST502.
(Step ST502)
The first operation information storage unit 142 acquires operation information. Thereafter, the operation determination information generation unit 144 executes the process of step ST503.

(Step ST503)
The operation determination information generation unit 144 acquires content. The operation determination information generation unit 144 acquires operation information from the first operation information storage unit 142. The operation determination information generation unit 144 generates operation determination information based on the content information and the operation information, and stores the operation determination information in the first operation determination information storage unit 145. Thereafter, the operation determination information generation unit 144 executes the process of step ST504.

(Step ST504)
The operation determination information generation unit 144 determines whether or not the check box is checked based on the operation information check information table. When the check box is not checked, that is, when the check information table has not been generated and the check information table has not been acquired (step ST504-No), the operation determination information generation unit 144 proceeds to step ST502. Transition. When the check information table can be acquired (step ST504—Yes), the operation determination unit 143 executes the process of step ST505.

(Step ST505)
The operation determination unit 143 acquires operation determination information and a check information table from the first operation determination information storage unit 145. The operation determination unit 143 acquires determination information from the first determination information storage unit 141. Based on the check information table, the operation determination information, and the determination information, the operation determination unit 143 determines whether or not there has been a requested operation omission by the latest time when the check is performed. When there is a requested operation omission (step ST505-Yes), the first operation information storage unit 142 executes the process of step ST507. When there is no requested operation omission (step ST505-No), the operation determination unit 143 transitions to step ST507.

(Step ST506)
The operation determination unit 143 causes the warning generation unit 107 to generate warning information. Thereafter, the first operation determination storage unit 142 transitions to the process of step ST502.
(Step ST507)
The first operation information storage unit 142 acquires operation information and determines whether or not the operator's work has been completed. The first operation information storage unit 142 ends the process when the operator's work ends (step ST507-Yes). The first operation information storage unit 142 transitions to step ST502 when the operator's work is not completed (step ST507-No).

  FIG. 7 shows the first determination information storage unit 141, the first operation information storage unit 142, the operation determination unit 143, and the operation determination after the operator finishes the work on the content displayed on the information terminal 100. 5 is a flowchart for explaining operations of an information generation unit 144 and a first operation determination information storage unit 145. FIG. 7 illustrates a second determination information storage unit 241, a second operation information storage unit 242, an operation determination unit 143, an operation determination information generation unit 144, and a second operation determination information storage unit 245. In the following, the first determination information storage unit 141, the first operation information storage unit 142, the operation determination unit 143, the operation determination information generation unit 144, and the first operation will be described. The operation with the determination information storage unit 145 will be described. Each of these units performs the processing of steps ST101 to ST107 when the operation on the content displayed on the information terminal 100 by the operator is completed.

(Step ST101)
The first operation information storage unit 142 acquires an operation log and a check information table and stores them as operation information. Thereafter, the first determination information storage unit 141 executes the process of step ST102.
(Step ST102)
The first determination information storage unit 141 acquires and stores determination information. Thereafter, the operation determination information generation unit 144 executes the process of step ST103.

(Step ST103)
The operation determination information generation unit 144 acquires content. The operation determination information generation unit 144 acquires operation information from the first operation information storage unit 142. The operation determination information generation unit 144 generates operation determination information for each item including the display essential area in the content based on the content information, the operation determination information, and the determination information, and stores the first operation determination information storage. Stored in the unit 145. Thereafter, the operation determination unit 143 repeatedly executes the processing of steps ST104 to ST107 for each item.

(Step ST105)
The operation determination unit 143 acquires determination information from the first determination information storage unit 141. The operation determination unit 143 acquires operation determination information for each item from the first operation determination information storage unit 145. Based on the determination information and the operation determination information for each item, the operation determination unit 143 determines whether there is a requested operation omission for each item. When there is a requested operation omission (step ST105-Yes), the operation determination unit 143 transitions to step ST106. When there is no request operation omission (No in Step ST105), the operation determining unit 143 transitions to Step ST107 and ends the process.
(Step ST106)
The operation determination unit 143 causes the warning generation unit 107 to generate warning information for each item.

  FIG. 8 is a part of a table example representing the operation determination information. The operation determination information table t300 is a content image, and is a table composed of an index representing the degree of attention of the operator of each pixel constituting the content image. In the present embodiment, the index representing the attention level of the operator is the display time accumulated for the pixel or the number of times the pixel is drawn, but is not limited thereto. Here, as an example, the index representing the attention level of the operator is the display time in which the pixels are integrated. In the operation determination information table t300, one cell corresponds to one pixel of the content image. The value displayed in each cell is the accumulated display time of the pixels corresponding to the cell. The operation determination information generation unit 144 generates an operation determination information table t300 as the operation determination information.

  Furthermore, the operation determination information generation unit 144 acquires two consecutive check times t233 in the check information table t203 as the operation start time for each item associated with the check number and the operation end time for each item. However, since the check on the check box is performed when the operator has finished referring to each item of the content, the operation start time for the first item is the work start time t215. The operation determination information generation unit 144 extracts an operation log at a time included in the range between the operation start time for each item and the operation end time for each item as operation information for each item from the operation log table t202. Thus, operation determination information for each item can be generated.

  In addition, the operation determination unit 143 displays the value displayed for each pixel cell of the operation determination information table t300 based on the determination information table t102 for each display essential area indicated by the display essential area coordinates t125. It is determined whether or not t121 is exceeded. In addition, the operation determination unit 143 calculates a ratio (hereinafter referred to as a display ratio) in which pixels that have exceeded the display-required time t121 in the area represent some percentage of all the pixels in the area. The operation determination unit 143 determines whether there is a requested operation omission by comparing the calculated ratio with the area display rate t102. This determination is also performed on the operation determination information for each item.

FIG. 9 is a flowchart for explaining the operation of the operation determination information generation unit 144. The flowchart of FIG. 9 is a flowchart of the process of step ST103 of FIG.
(Step ST200)
The operation determination information generation unit 144 reads the content and converts it into a content image. Thereafter, the operation determination information generation unit 144 executes the process of step ST201.

(Step ST201)
The operation determination information generation unit 144 generates a table having cells for displaying the accumulated display time for each pixel of the content image. 0 is input to all cells as an initial value. Thereafter, the operation determination information generation unit 144 repeats the processing from step ST202 to step ST206 for all operation logs (step ST202, step ST206).

(Step ST204)
The operation determination information generation unit 144 calculates a display range corresponding to the selected operation log. Thereafter, the operation determination information generation unit 144 performs the process of step ST204.
(Step ST205)
The operation determination information generation unit 144 calculates the displayed time for the display range of the selected operation log. The time during which each display range is displayed is calculated by the time difference between the operation times t224 associated with the two consecutive touch log IDs 221.

  For example, in the present embodiment, when the selected operation log is an operation log having a touch log ID t221 of 1, the display time of the display range associated with the selected log is 1 for the touch log ID t221. The difference between the operation time t224 and the operation time t224 when the touch log ID t221 is 2. When the operation determination information generation unit 144 calculates the display time of the display range associated with the selected operation log, the operation determination information generation unit 144 executes the process of step ST206.

(Step ST206)
The operation determination information generation unit 144 adds the calculated display time to the cell associated with each pixel in the display range associated with the selected operation log, thereby obtaining the operation determination information. Is generated.
The operation determination information generation unit 144 ends the process when executing the processes of steps ST203 to ST205 for all the operation logs (step ST206).

FIG. 10 is a flowchart for explaining the operation of the operation determination unit 143. The flowchart of FIG. 10 is a flowchart of the process of step ST105 of FIG.
(Step ST301)
The operation determination unit 143 reads operation determination information. Thereafter, the operation determination unit 143 executes the process of step ST302.

(Step ST302)
The operation determination unit 143 reads determination information. Thereafter, the operation determination unit 143 performs the process of step ST303.
(Step ST303)
The operation determination unit 143 reads the check information table. Thereafter, the operation determination unit 143 performs the process of step ST304.

(Step ST304)
The operation determining unit 143 reads the check presence / absence t232 in the check information table t203, and checks the presence / absence of null information to detect the presence / absence of the check omission. When there is a check omission (step ST304—Yes), the operation determination unit 143 transitions to step ST305. When there is no check omission (step ST304-No), the operation determination unit 143 transitions to step ST306.

(Step ST305)
The operation determination unit 143 outputs information indicating check omission to the warning generation unit 107 as information indicating the type of requested operation omission. In addition, the operation determination unit 143 detects the check number t124 associated with the null information, and displays information indicating an item in the content in which the check indicated by the check number t124 is set, where the requested operation is missing Is output to the warning generation unit 107, and the warning generation unit 107 generates a warning image for warning that there is a check omission. Thereafter, the operation determination unit 143 performs the process of step ST306.

(Step ST306)
The operation determination unit 143 reads the check time t233 in the check information table t203, and determines whether the time order of each check time t233 matches the number order of the check number t124 associated with each check time. However, in the present embodiment, when the check time t233 is null information, the order in which the check indicated by the check number t124 associated with the check time is made to match the number indicated by the check number t124. It is not limited to this. When there is a discrepancy between the time order and the number order (step ST306-Yes), the operation determining unit 143 transitions to step ST307. When there is no mismatch (No in Step ST306), the operation determining unit 143 transitions to Step ST308.

(Step ST307)
The operation determination unit 143 outputs information indicating a check order error to the warning generation unit 107 as information indicating the type of requested operation omission. Further, the operation determination unit 143 generates information in which the numbers indicated by the check numbers t124 associated with the respective check times t233 are arranged in the order of the times based on the order of the times, and the location where the requested operation omission is found. Information to be output is output to the warning generation unit 107 to generate a warning image for warning that there is an error in the check order. Thereafter, the operation determination unit 143 executes the process of step ST308.

(Step ST308)
The operation determination unit 143 calculates a display ratio for each display-required area. Thereafter, the operation determining unit 143 executes the process of step ST309.
(Step ST309)
The operation determination unit 143 compares the area display rate t122 of the determination information table t101 with the display ratio operation determination information for each display essential region for each display essential region, and thus the display time is insufficient for each display essential region. Determine presence or absence. When there is no shortage of display time (step ST309-No), the operation determination unit 143 ends the process. The operation determination unit 143 transitions to step ST310 when there is a shortage of display time (step ST309-No).

(Step ST310)
The operation determination unit 143 outputs information indicating insufficient display time to the warning generation unit 107 as information indicating the type of requested operation omission. In addition, the operation determination unit 143 outputs information indicating an item including the display-required area where the display time is insufficient as information indicating a location where the requested operation is omitted to the warning generation unit 107, and there is a shortage of display time. A warning image is generated to warn that this is the case.

Next, the heat map will be described with reference to FIG.
FIG. 10 is an example in which the sequence diagram s201 is drawn on the heat map m101 by the second display image composition unit 206.
The heat map m101 is an image in which each pixel of the content image is color-coded with a display time associated with each pixel based on the operation determination information table t300. In the present embodiment, the brighter the part, the longer it has been displayed.

  In the present embodiment, the heat map m101 is drawn based on the operation determination information table t300 that displays the display time accumulated for each cell, but the value displayed for each cell is an index that represents the degree of attention of the operator. For example, the number of times of drawing may be used. When the index is represented by the number of times of drawing, when generating the operation determination information table t300, the operation determination information generation unit 144 adds 1 to the cell representing each pixel in the display range every time the display range is displayed. Will do.

In addition, when the index is expressed in display time, there are two display methods for drawing the heat map m101, relative time display and absolute time display.
In the relative time display, for example, the minimum display time portion of the display target page is displayed in blue, and the maximum display time portion is displayed in red. The absolute time display is performed according to a predetermined color coding rule corresponding to the display time.

The display area sequence s201 is a diagram in which a display range frame s202, a number s203 indicating the display order, and an arrow s204 indicating the movement of the center point of the display area are drawn.
An administrator who is in a position to manage the operator can check whether there is a requested operation omission by looking at the heat map m101 and the display area sequence s201. Further, when the displayed document is a catalog or the like, the administrator can easily grasp which area in the catalog has a high degree of operator's attention.

  12 is a sequence diagram by the second display image composition unit 206 on the heat map m401 drawn based on the operation determination information for each item generated by the operation determination information generation unit 144 based on the check information. This is an example in which s501 is drawn. The administrator can not only confirm in detail for each item whether or not the operator has requested operation by looking at the sequence diagram i301 for each item, but also where the operator's attention is high for each item. You can easily grasp in detail what happened.

FIG. 13 is a flowchart for explaining the operation of the heat map generator 202.
(Step ST401)
The heat map generation unit 202 acquires content. Thereafter, the heat map generating unit 202 executes the process of step ST402.
(Step ST402)
The heat map generator 202 converts the content into a content image. Thereafter, the heat map generation unit 202 performs the process of step ST403.

(Step ST403)
The heat map generation unit 202 acquires operation determination information. Since the operation determination information includes information for the entire content and information for each item, the operations from step ST404 to ST409 are repeatedly executed for each operation determination information (steps ST404 and ST409).
(Step ST405)
The heat map generation unit 202 acquires operation information. Thereafter, the heat map generation unit 202 performs the process of step ST406.

(Step ST406)
The heat map generation unit 202 generates a heat map based on the content image and the operation determination information. Thereafter, the heat map generation unit 202 performs the process of step ST407.
(Step ST407)
The heat map generation unit 202 draws a sequence diagram on the heat map based on the operation information.

  Thus, in this embodiment, the operation information of the information terminal 100 is stored in the first operation information storage unit 142 and the second operation information storage unit 242. Further, the operation determination information generated by the operation determination information generation unit 144 and stored in the first operation determination information storage unit 145 and the second operation determination information storage unit 245, and the first determination information storage unit 141 By comparing the determination information stored in the second determination information storage unit 241 with the operation determination unit 143, the information terminal 100 may warn when the operator has caused a requested operation omission. it can. In addition, the administrator can not only confirm the operation status of the operator satisfactorily by the heat map on which the sequence diagram generated by the heat map generation unit 202 is drawn, and lead to improvement of the requested operation omission. It is possible to create a catalog or the like with a higher degree of attention of the person.

The heat map generation unit 202 may be included in the information terminal 100. In this case, the operator can not only check the operator's own work by the operator himself, but also the administrator can easily check the operation information of the operator by the information terminal 100 without going to the center server 200. can do.
In the present embodiment, the viewer unit 102 does not display the heat map. However, the viewer unit 102 may display the heat map by reading from the center server 200 through the communication unit 108.
In addition, the determination information stored in the first determination information storage unit 141 and the second determination information storage unit 241 is predetermined for each content in the present embodiment, but is not limited thereto. Absent. For example, the determination information may be reset later by the administrator.

<Second Embodiment>
In the first embodiment, the first determination information storage unit 141, the first operation information storage unit 142, the operation determination unit 143, the operation determination information generation unit 144, and the first operation determination information storage unit. 145 is provided in the information terminal 100, and includes a second determination information storage unit 241, a second operation information storage unit 242, an operation determination unit 143, an operation determination information generation unit 144, and a second operation. The determination information storage unit 245 is provided in the center server 200, but is not particularly limited thereto.

  For example, the information terminal 100 includes only the touch panel unit 101, the viewer unit 102, the first content storage unit 103, the display 105, and the communication unit 108, and the second determination information storage unit 241. Second operation information storage unit 242, operation determination unit 143, operation determination information generation unit 144, second operation determination information storage unit 245, warning generation unit 107, and second display image composition unit 206 May be included in the center server 200.

In this case, the viewer unit 102 stores operation information from the communication unit 108 to the center server 200 as needed via the network 300. In addition, the operator uses the center server 200 as cloud computing.
As described above, the second embodiment can provide the same effects as those of the first embodiment.
<Third Embodiment>
In the first embodiment and the second embodiment, one aspect of the present invention is configured as hardware, but is not limited thereto, and may be configured as software.

For example, it has functions of a first determination information storage unit 141, a first operation information storage unit 142, an operation determination unit 143, an operation determination information generation unit 144, and a first operation determination information storage unit 145. Installed in the information terminal 100 as an operation analysis application, the second determination information storage unit 241, the second operation information storage unit 242, the operation determination unit 143, the operation determination information generation unit 144, and the second operation determination It may be installed in the center server 200 as an operation analysis application having a function with the information storage unit 245.
Similarly, the heat map generation unit 202 may be installed on both the information terminal 100 and the center server 200 as a display area display application having the function of the heat map generation unit 202.
Therefore, in the third embodiment, the same effect as in the first embodiment and the second embodiment can be obtained.

  Although this invention is used suitably for information terminals, such as a tablet PC, it is not restricted to this.

DESCRIPTION OF SYMBOLS 10 ... Content display system 100 ... Information terminal 101 ... Touch panel part 102 ... Viewer part 103 ... 1st content memory | storage part 105 ... 1st display 106 ... 1st Display image synthesizing unit 107 ... warning generating unit 108 ... communication unit 141 ... first determination information storage unit 142 ... first operation information storage unit 143 ... operation determination unit 144 ... Operation determination information generation unit 145 ... first operation determination information storage unit 200 ... center server 201 ... Web function unit 202 ... heat map generation unit 203 ... second content storage unit 205 .. second display 206 ... second display image composition unit 241 ... second determination information storage unit 242 ... second operation information storage unit 245 ... second operation determination information storage Part 30 ... network

Claims (8)

An operation information storage unit that stores area information representing the area generated each time the displayed area in the content is changed;
An operation determination information generating unit that calculates an index indicating an operator's attention level for a partial area of the content with reference to information stored in the operation information storage unit. apparatus. The operation information storage unit stores time information indicating the time when the area is displayed in association with the area information indicating the displayed area,
The operation determination information generation unit calculates an index indicating the degree of attention by integrating the time represented by the time information stored in the operation information storage unit in association with the region information representing the region including the partial region. The information processing apparatus according to claim 1, wherein: The operation determination information generation unit counts the number of area information representing an area including the partial area stored in the operation information storage unit, and sets the number as the index indicating the degree of attention. The information processing apparatus described in 1. The operation information storage unit stores first time information indicating a time when the region information is generated in association with the region information,
Furthermore, the operation information storage unit stores second time information indicating a time when an input is input to the input item in association with each input item that is included in the content and can be input by the operator.
The operation determination information generation unit refers to the area information stored in the operation log storage unit in association with the first time information included in the time zone represented by the two second time information, and The information processing apparatus according to claim 1, wherein an index that indicates is calculated. A determination information storage unit that stores information indicating a predetermined area and a threshold value of an index indicating the degree of attention;
The index indicating the degree of attention of the partial area included in the predetermined area determines whether or not the degree of attention is higher than the threshold, and the operation determination unit does not have the degree of attention higher than the threshold. The information processing apparatus according to claim 1, further comprising: an operation determination unit that notifies that the degree of attention is insufficient. For each of the areas into which the content is divided, a display area display unit that generates an image indicating an index indicating the degree of attention of the operator of the area,
The information processing apparatus according to claim 1, wherein the operation determination information generation unit calculates an index indicating a degree of attention of the operator for each region into which the content is divided. A first step of storing area information representing the area generated each time the displayed area in the content is changed;
A second step of referring to information stored in the operation information storage unit and calculating an index indicating the degree of attention of the operator for a partial area of the content. .   The program for functioning a computer as an information processing apparatus as described in any one of Claims 1-6.