JP4408920B2 - Terminal management apparatus and terminal management program - Google Patents

Description

  The present invention relates to a terminal management technique for acquiring an operation log and an operation image associated with the operation log from a client terminal and displaying the operation image on a monitor screen.

  As a technique for acquiring an operation log and an operation image associated with the operation log from a client terminal and displaying the operation image on a monitor screen, for example, a remote control system disclosed in Patent Document 1 is known. This remote control system is configured by connecting a remote control server and a client terminal via a communication network. The client terminal includes operation command specifying information for specifying each operation command input to the terminal and a display unit. The captured images obtained by acquiring the displayed screens at predetermined intervals are transmitted to the remote control server, and the remote control server sequentially displays the received captured images on the display unit up to a predetermined number.

  By sequentially displaying up to a predetermined number of captured images thus received on the display unit of the remote control server, the operator of the remote control server can view the screens of a plurality of client terminals at a time. Also, if you record the operation commands and screens entered at the client terminal, you can play back the recorded screen at a later date, so you can grasp the operating status of the operator of the client terminal by this playback, It is possible to monitor an unauthorized operation by an operator of the client terminal.

JP 2006-108947 A (paragraphs [0005], [0020], [0051], [0057])

  Since the above-described remote control system can display a plurality of client terminal screens connected via a network on the display unit of the remote control server, the operator of the remote control server can operate the plurality of client terminal operators. It is convenient to monitor the operation status of

  However, since the captured images of the operation screens of a plurality of client terminals are displayed in a list on the display unit, the display size of each captured image is reduced, and what operation the operator of each client terminal performs on the operation screen. There is a problem that it is difficult to grasp easily. In particular, when grasping the operation status on the client terminal, the user often pays attention to the operation on the window. However, when many windows are opened, it becomes difficult to see individual windows, and what kind of operation is performed on the window on the back side. There is a problem that it is difficult to understand whether or not Furthermore, the display state of the window on the operation screen of each client terminal changes from moment to moment, and this can be easily grasped on the captured image list display screen of the operation screen of each client terminal such as the remote control system described above. There is room for improvement.

  The present invention has been made paying attention to such a problem, and an object of the present invention is to provide a terminal management technique capable of easily grasping an operation state in a client terminal.

  In a terminal management apparatus that acquires an operation log and an operation image associated with the operation log from a client terminal, in order to solve the above problem, in the present invention, window display information describing a display state of a window in the operation image In the operation log, and based on the window display information, a window image cutout unit that cuts out the display area of each window from the operation image as a window image, and the window image associated with the corresponding client terminal, A window image classifying unit that classifies the window image according to attribute information included in the window image; and a display control unit that displays a list of window images associated with the client terminal on the monitor screen according to the attribute information.

  According to this configuration, the window image is cut out from the operation image acquired from each client terminal based on the window display information included in the operation log. Then, the clipped window image is associated with the corresponding client terminal, classified according to attribute information of the window image, and the classified window image is displayed as a list on the monitor screen according to the attribute information. Here, as the attribute information, application information for operating the window, client terminal information corresponding to the window, or the like can be used. As a result, the operation status of each client can be viewed on a monitor screen in units of windows, and can be displayed in a list by common attribute information such as for each application operating the window. It is possible to easily grasp the operation status at the client terminal, such as easily discovering the client terminal that is operating the external purpose application.

  Note that the window cut out from the operation image of the client terminal may be the active window that is the operation target of the client terminal, or may be the entire window displayed in the operation image, depending on the purpose of use. Various forms can be adopted.

  Further, depending on the window to be cut out, the entire area may not be displayed and a hidden area may exist. In such a case, a displayed area other than the hidden area may be cut out and displayed. However, in one preferred embodiment of the terminal management apparatus according to the present invention, the operation image is stored. When the operation image storage unit and at least a part of the window in the operation image are hidden by another window, an operation for extracting the latest operation image in which the window is displayed in the entire area from the operation image storage unit An image extraction unit, and a display area of the window is cut out from the extracted latest operation image and used as the window image.

  According to this configuration, even if a hidden area exists in the window to be cut out and the entire area is not displayed, the window image is cut out from the latest operation image in which the window is displayed in the entire area. This can be displayed on the monitor screen. Replacing the window image in which the hidden area exists in this way with the window image displayed in the most recent all area makes it easy to grasp the operation state although a time shift occurs.

  In addition to such replacement, a window image is generated by combining an area other than the hidden area cut out from the operation image and an area corresponding to the hidden area cut out from the latest operation image. You may do it. Therefore, in one preferred embodiment of the terminal management apparatus according to the present invention, the operation image storage unit that stores the operation image and at least a part of the window in the operation image are hidden by another window. An operation image extraction unit that extracts the latest operation image in which the window is displayed in the entire area from the operation image storage unit, and a hidden area of the window is included in the latest operation image in the operation image storage unit. A cut-out image of the window generated by replacing with the corresponding area of the window is used as the window image.

  Furthermore, in order to make it easier to grasp the operation status of each client terminal in the list display on the monitor screen, in one preferred embodiment of the terminal management apparatus according to the present invention, the operation time for the window in the client terminal is An operation time calculation unit for calculating based on the operation log is provided, and an arrangement position of the list display on the monitor screen is determined based on the operation time.

  According to this configuration, the list display form on the monitor screen can be determined based on the operation time for the window. Here, as the operation time for the window, a time during which the window is opened, a window active state duration, or the like can be used. Therefore, for example, it is possible to preferentially display in order of long active state duration in the display for each application, thereby making it easy to find a client terminal that has been operating a specific application for a long time. It is possible to make it easier to grasp the operation status.

  Furthermore, a program implemented in the above-described terminal management apparatus is also included in the scope of rights of the present invention. That is, a terminal management program for a terminal management apparatus that acquires an operation log and an operation image associated with the operation log from a client terminal is a window that describes a display state of a window in the operation image included in the operation log. Based on display information, a function of cutting out the display area as a window image for each window from the operation image, a function of associating the window image with a corresponding client terminal, and classifying the window image by attribute information, A computer realizes a function of displaying a list of window images associated with a client terminal on a monitor screen according to the attribute information. Of course, this terminal management program also has the same operational effects as the terminal management apparatus according to the present invention, and can be provided with the various additional features described above.

Embodiments of a terminal management apparatus according to the present invention will be described below with reference to the drawings.
As shown in FIG. 1, a plurality of client terminals 1 and a terminal monitoring server 2 (an example of a terminal management apparatus) that monitors the client terminals 1 are connected via a network 3 to construct a terminal monitoring system. . The computer of the client terminal 1a includes a GUI unit 11 for controlling output to the monitor 51 and input from the operation input device 61 such as a keyboard and a mouse, as functions related to the present invention, in software and / or hardware. A data processing unit 12 that performs data processing by a user including various file processing such as file creation, an operation management unit 13 that manages various operations in the client terminal 1a, a network interface 14 as a transmission / reception unit that performs data transmission to the network 3, and the like. Has been built. The same applies to the other client terminals 1.

  Among these, the operation management unit 13 has functions such as login / logoff processing, and also generates an operation log that describes operation contents according to a predetermined operation performed on the client terminal 1a. Unit 13a, and an operation screen capture unit 13b that captures an operation screen in the client terminal 1a and generates a capture image as an operation image.

  An example of the data structure of the operation log and the captured image generated in the operation log generation unit 13a or the operation screen capture unit 13b and transmitted to the terminal monitoring server 2 is schematically illustrated in FIG. As shown in FIG. 2A, this operation log is based on a terminal ID that identifies the client terminal 1, and a user ID (or login name) that identifies the login user of the terminal, and date / time data that generated the operation log. The execution contents of the operation by the user are linked. Furthermore, as the window display information describing the display state of the window on the operation screen, the name of the running application, the file name of the window being executed, the arrangement data on the screen of the window, and the use state thereof are linked. . In FIG. 2A, two types of applications are activated, and one window is being executed for each application. The window arrangement data includes the arrangement order as well as the window arrangement position and display size on the operation screen. With regard to the arrangement order, “0” is assigned when the window is not overlapped with another window (see the client terminal 1b in FIG. 3 to be described later), and the window is overlapped with another window (described later). “1”, “2”,... Are assigned to the client terminal 1a in FIG. That is, the entire area of the window whose allocation order assignment data is “0” or “1” is displayed on the screen. In addition, the usage state includes information indicating whether the window is active or inactive.

  Further, as shown in FIG. 2B, the captured image is linked to the date / time data with the terminal ID as a base point. The generated operation log and the captured image of the operation screen are associated with each other based on the date / time data. Thereby, the display state of the window in the captured image can be grasped from the window display information of the operation log. When the capture image generation interval is shorter than the operation log, that is, when the number of capture image generations is larger, for example, the captured image acquired between the operation log s1 and the subsequent operation log s2 is You may estimate and associate with the display state of the window described in the window display information of operation log s1.

  On the other hand, the computer of the terminal monitoring server 2 includes a client terminal 1 via a terminal management unit 21 that manages the client terminal 1 and a network interface 32 as a function related to the present invention in software and / or hardware. An operation log acquisition unit 22 that acquires an operation log from the window, a window display information reading unit 23 that reads window display information from the acquired operation log, an operation log storage unit 24 that stores the acquired operation log, and a client terminal via the network interface 32 The captured image acquisition unit 25 that acquires a captured image from 1, the captured image management unit 26 that performs various management of the acquired captured image, and the acquired captured image or a captured image that has undergone predetermined processing are stored in time series. Image storage unit 27, after A window image display unit 28 that performs display control of the window image to be performed, a target window image setting unit 29 that performs various settings relating to the window image, and an operation time calculation unit 30 that calculates an operation time for the window in the client terminal 1 based on the operation log. Etc. are built.

  The capture image management unit 26 includes a window for cutting out the display area of each capture window as a window image from the capture image acquired by the capture image acquisition unit 25 based on the window display information read by the window display information reading unit 23. An image cutout unit 26a, a window image classification unit 26b that associates the cutout window image with the corresponding client terminal, and classifies the image by attribute information of the window image, and a captured image having a predetermined condition is extracted from the image storage unit 27. A capture image extracting unit 26c that performs the above processing and a window image combining unit 26d that combines the cut-out images. The window images classified by the window image classification unit 26b and associated with the client terminal are displayed as a list on the screen of the monitoring monitor 52 by the window image display unit 28 according to the attribute information (see FIG. 4 described later). . In the present embodiment, application information operating a window is used as the attribute information. Therefore, the window images associated with the client terminal are displayed in a list on the screen of the monitor monitor 52 for each application.

  Here, the “target window”, which is a window to be cut out from the captured image by the window image cutout unit 26 a, its “cutout condition”, and the like are set by the target window setting unit 29. The setting information of the target window setting unit 29 can be input / changed by the operation input device 62 via the GUI unit 31. In the present embodiment, all windows displayed in the captured image are set as “target windows”. Further, as the “cutout condition”, when the window in the captured image is not displayed in the entire area, the window image of the window is extracted from the latest (latest) captured image in which the window is displayed in the entire area. Is set to

  The extraction and classification of the window image will be described with reference to the schematic explanatory diagram of FIG. In addition, when a plurality of windows are displayed on the screen, the display form includes an overlapping display pattern as shown in the client terminal 1a in FIG. 3, a parallel display pattern as shown in the client terminal 1b, or a mixture thereof. A pattern is considered.

  Below, the case where a window image is cut out from the captured image of each client terminal at time t1 and displayed on the screen of the monitoring monitor 52 will be described. At this time, the windows of the parallel display pattern can be cut out as they are. That is, in FIG. 3, from the captured image of the client terminal 1b at time t1, the window image APL. X, APL. Each Z is cut out.

  On the other hand, for windows with overlapping display patterns, the window image that is displayed in the entire area is cut out, and the window that is not displayed in the entire area (the window in which the hidden area exists) is the most recently displayed window in which the entire area is displayed. The window image of the window is cut out from the (latest) captured image. That is, in FIG. 3, from the captured image of the client terminal 1a at time t1, first, the window image APL. X is cut out. Here, the window image APL. Since Y has a hidden area at time t1 and the entire area is not displayed, the latest captured image in which the window of application Y is displayed in the entire area, here, the captured image at time t0 is extracted and the captured image is displayed. From the image, the window image APL. Y is cut out. Although the overlap display pattern and the parallel display pattern have been described here, the same applies to these mixed patterns.

  Each window image cut out in this way is associated with the corresponding client terminal 1a (CLa) and client terminal 1b (CLb), and is classified according to the applications X, Y, and Z that are operating the window. Each window image classified in this way is displayed in a list on the screen of the monitor 52 with information about the client terminal attached to each application X, Y, and Z. That is, on the screen of the monitor 52 that displays the captured image (window image) at time t1, the application name: X column is cut out from the captured images at time t1 of the client terminal 1a (CLa) and the client terminal 1b (CLb). The window image of the application X is displayed, the window image of the application Y cut out from the captured image at the time t0 of the client terminal 1a (CLa) is displayed in the application name: Y column, and the application name: Z column. Displays the window image of the application Z cut out from the captured image at time t1 of the client terminal 1b (CLb).

  In addition, the arrangement position of the window image displayed as a list on the screen of the monitoring monitor 52 is determined based on the operation time for the window in each client terminal. In this embodiment, the window open time, that is, the window open time is used as the window operation time. The operation time for the window in the client terminal 1 can be calculated by the operation time calculation unit 30 based on the operation log. For example, if the window is in the open state time, the elapsed time may be counted from the time when the window is opened with reference to the operation content of the operation log.

  A specific example of the terminal monitoring screen of the monitoring monitor 52 displayed in this way is shown in FIG. On this terminal monitoring screen 100, a PC information button 101, a log browsing button 102, a remote control button 103, an alert setting button 104, a setting button 105, an end button 106, and the like are arranged in the upper position in the form of icons. At the bottom of the screen 100, a window image display unit 110, a terminal list display unit 111, a window image setting button 112, and the like are formed. The window image display unit 110 displays a plurality of window image display areas 120 surrounded by a frame 121 in a matrix form, and an attribute display unit 122 indicating the attribute of the window image is arranged below the frame 121. Has been.

  As described above, in the present embodiment, window images cut out from the captured images of the client terminals are displayed in a list for each application on the window image display unit 110. That is, an application-specific display field 130 is formed, and corresponding window images are displayed in a list in association with the client terminal in the display field 130. In this embodiment, this association is performed by attaching and displaying a terminal name (CLa or the like) corresponding to the attribute display unit 122.

  In the present embodiment, the application-specific display fields 130 are arranged in order from the top position in ascending order of the window images 120 to be displayed. Further, in each application display column 130, window images 120 having a long window open state time are arranged in order from the left position. Further, the frame 121 of the window in the active state is highlighted, for example, displayed with a red thick frame. Note that by double-clicking the window image 120, only the window image 120 can be enlarged and displayed. Furthermore, if necessary, operation log information such as window display information linked to the displayed window image can be displayed in another operation log display window.

  Operation logs and captured images are sent from the respective client terminals 1 to the terminal monitoring server 2 in the present embodiment in real time, and therefore the terminal monitoring screen 100 changes from moment to moment. That is, after 5 seconds from the state of the terminal monitoring screen 100 in FIG. 4A, for example, the state of the terminal monitoring screen 100 as shown in FIG. Here, as described above, the application-specific display column 130 is arranged in order from the top position in the order of few window images to be displayed, so that it is easy to find a client terminal that is operating an application different from other client terminals. it can. For example, as shown in FIG. 4B, the client terminal 1f (CLf) grasps at a glance that the application W is activated and operated during the period from FIG. 4A to FIG. 4B. Can do.

  The setting of the window image 120 of the client terminal displayed on the window image display unit 110 can be performed by operating the window image setting button 112. FIG. 5 shows an example of a window image setting screen 200 displayed by operating the window image setting button 112. The window image setting screen 200 is provided with a target window selection unit 210 and a window display form selection unit 220. The target window selection unit 210 is a column for selecting a target window to be cut out from the captured image. As described above, in the present embodiment, “all display windows” of the captured image is selected as the target window. In addition, the window display form selection unit 220 displays a window image that is displayed in the entire area in another captured image when the window in the captured image to be cut out is not displayed in the entire area (when a hidden area exists). It is a choice such as performing a replacement. In this embodiment, “replacement” is selected, and accordingly, the window image of the window is set to be cut out from the latest captured image in which the window is displayed in the entire area.

  Next, the flow of terminal monitoring processing by this terminal monitoring server will be described with reference to FIG. As described above, in the present embodiment, the image acquired from the client terminal is displayed on the monitor screen in real time. First, the terminal monitoring server 2 acquires an operation log from the client terminal 1 by the operation log acquisition unit 22 and a capture image associated with the operation log by the capture image acquisition unit 25 (# 01). From the acquired operation log, the window display information reading unit 23 reads the window display information describing the display state of the window in the captured image (# 02). The acquired operation log and captured image are stored in the operation log storage unit 24 and the image storage unit 27.

  Next, based on the read window display information, a window to be cut out from the acquired captured image is determined (# 03). As described above, in the present embodiment, all displayed windows are set as targets, and there are windows that are not displayed in the entire area (windows where hidden areas exist) in the target window to be cut out (windows with hidden areas) ( (# 04 Yes branch), the latest captured image in which the window is displayed in the entire area is extracted from the image storage unit 27 (# 05). This extraction is performed by the captured image extraction unit 26c with reference to date / time data and window display information included in the operation log.

  When there is a window that is not displayed in the entire area (a window in which a hidden area exists) in the window to be cut out (# 04 Yes branch), from the captured image extracted in this way, on the other hand, When the entire window is displayed (# 04 No branch), the window image cutting unit 26b cuts out the window image of the window from the captured image (# 06).

  The clipped window image is associated with the corresponding client terminal, and is classified by the application operating the window by the window image classification unit 26b (# 07). Then, the window images classified in this way and associated with the client terminal are displayed as a list on the screen of the monitoring monitor 52 by the window image display unit 28 as shown in FIG. 4 (# 08).

  Thus, in this embodiment, a window image is cut out from the captured image acquired from each client terminal based on the window display information included in the operation log. The clipped window image is associated with the corresponding client terminal, classified according to the application operating the window, and the classified window image is displayed in a list on the monitor screen for each application. As a result, the operation status of each client can be viewed on a monitor monitor screen in window units, and can be displayed in a list by application. For example, a client terminal operating a non-business purpose application is easy. It is possible to easily grasp the operation status at the client terminal. In addition, even when a hidden area exists in the window to be cut out and the entire area is not displayed, the window image is cut out from the latest operation image in which the window is displayed in the entire area and displayed. can do. Replacing the window image in which the hidden area exists in this way with the window image displayed in the most recent all area makes it easy to grasp the operation state although a time shift occurs. Furthermore, in the display by application, the application with few window images to be displayed is placed in the upper position, and the specific application is used for a long time by displaying the windows in the longest open state time in the display column for each application. It is easier to find the client terminal that is continuing, and it is possible to more easily grasp the operation status of each client terminal.

[Another embodiment]
(1) In the above-described embodiment, application information for operating a window is used as attribute information. However, for example, client terminal information corresponding to the window is used, and a window image is classified for each client terminal. A list may be displayed. By displaying in this way, the window image can be viewed for each client, and monitoring for each client is facilitated. Further, it is preferable that attribute information such as application information and client terminal information can be selected, so that display can be performed by application or by client according to usage.

(2) In the above-described embodiment, the windows to be cut out are all windows displayed in the captured image. Of course, other windows may be designated. For example, the active window may be designated as the target window, or the window located in the foreground when multiple windows are displayed in duplicate or the window displayed in the entire area may be designated. May be. In this way, it is preferable to designate a window with display conditions that are likely to be viewed by the operator of the client terminal. These designations can be made by the target window selection unit 210 of the window image setting screen 200 of FIG.

  In the above-described embodiment, the window to be cut out from the captured image is a window displayed in an area other than the task bar. Of course, a window that is minimized on the task bar may be cut out. . In this case, even if there is a window whose entire area is hidden on the back of a certain window, the window displayed on the taskbar is minimized as a window image, and illegal operations such as game operations are performed on the back of the window. The client terminal that is performing the operation can be found more easily. If the window displayed in the area other than the task bar of the operation image is the same as the window displayed on the task bar, the window displayed on the task bar should not be cut out. Duplication can be avoided.

  For a window whose entire area is hidden behind a certain window, the operation image extraction unit extracts the latest operation image in which the window is displayed in the entire area from the operation image storage unit. The display area of the window may be cut out from the operation image and used as the window image.

(3) In the above-described embodiment, when the window to be cut out is not displayed in the entire area in the captured image (when there is a hidden area), the latest captured image in which the window is displayed in the entire area However, only the hidden area may be replaced with the corresponding area of the window image of the window in the latest captured image.

  This will be described with reference to FIG. In the captured image of the client terminal 1a at time t1, the window image APL. Y is a window image APL. There is a region GYu hidden by X. Therefore, first, a window image GY1 including this hidden area GYu is cut out. Next, the latest captured image in which the window of the application Y is displayed in the entire area, here, the captured image at time t0 is extracted, and the window image APL. From Y, an image GY0 of a region corresponding to the hidden region GYu is cut out. A window image to be displayed on the monitor screen 52 is generated by replacing the image GY0 cut out in this way with the hidden area GYu of the image GY1. Note that these combining processes can be performed by the window image combining unit 26d.

  Further, without performing such replacement or replacement, only the displayed area other than the hidden area may be cut out and displayed. These displays can be set by selecting “Replace” or “Display other than hidden area” in the window display form selection unit 220 of the window image setting screen 200 of FIG.

(4) In the above-described embodiment, the client terminal is associated with the window image when the list is displayed on the monitor screen by displaying the terminal name (CLa or the like) corresponding to the attribute display unit 122. However, of course, it may be configured to display the user name in addition to this. Note that such association between the terminal ID and the terminal name to be displayed and the user ID and the user name to be displayed can be performed with reference to a terminal information storage unit (not shown) in which the correspondence is recorded.

(5) In the above-described embodiment, the open state time of the window is adopted as the window operation time, and the longer the open state time is, the more preferential position (left position) is. In addition to this, the window active time duration may be adopted as the window operation time. Also, starting from a certain time, the window open state time and the accumulated time of the active state duration from that time may be calculated as the operation time, and the arrangement position of the window image may be determined based on this. Further, the display size of the window image may be changed according to the operation time of such a window, and for example, the longer the window open state time, the larger the display may be.

(6) In the embodiment described above, the frame 121 of the window image in the active state is highlighted with a red thick frame so as to alert the person watching the monitoring monitor. As the highlighting, blinking display of the frame 121 may be performed.

(7) Further, an unauthorized operation determination unit is provided, and it is determined whether an unauthorized operation is performed based on the operation content included in the operation log, and when it is determined that the unauthorized operation is performed, the window The image display form may be highlighted. Examples of such unauthorized operations include out-of-work operations such as game operations and access operations to an access-prohibited homepage, and operations that lead to information leakage such as browsing confidential files.

  This unauthorized operation determination can be performed, for example, by referring to an operation content and an unauthorized operation table (not shown) provided separately. In addition to this, an operation time such as the open state time or the active state duration time of the window or the accumulated time from a predetermined time may be used, and the operation time and the unauthorized operation table are determined together. You may do it. For example, an operation time of an allowable range for the window is set according to the operation content, and it is determined that the operation is illegal when the operation is performed exceeding the allowable range. As described above, since the operation log and the captured image are associated with each other, it is possible to specify a captured image, that is, a window image when an unauthorized operation is performed. Then, the subsequent display of the window image specified in this way may be made to be highlighted such as enlarged display.

  In addition to such highlighting, the reason for determining the fraud may be displayed in a form such as a pop-up from a window image, and in addition to or instead of such visual alerting, a voice may be displayed. You may make it perform alerting by. Further, the terminal management unit 21 may transmit an operation restriction command such as a warning message or forced logoff to the client terminal.

(8) In the above-described embodiment, the display fields for each application on the monitor monitor screen are arranged from the top position in the order of few window images to be displayed. It is good also as a form which arranges in order. Moreover, it is good also as a structure which provides an application selection part and selects and displays a specific application. Further, a display field without a window may be provided so as to display an operation screen of a terminal in which no window is displayed (including a terminal in which the window is displayed only on the task bar here).

(9) In the above-described embodiment, the case where there is one window corresponding to the activated application has been described, but even when two or more windows are open, the display area is set for each window. What is necessary is just to cut out and display as a window image. At this time, it is preferable to display the file name together. Further, when the application is a browser, the name of the site to be accessed may be displayed in association with the window image.

(10) In the above-described embodiment, the operation log and operation image are acquired from the client terminal in the form of real-time processing. However, the operation log and operation image are recorded by acquiring in the form of batch processing. Of course, it is possible to adopt the display form as described above when reproducing. At this time, the window image may be cut out and classified in advance, and the window image may be stored in the image storage unit. In addition, it is not limited to the case where it acquires via a network, The form which acquires via a recording medium etc. may be sufficient.

  Further, a window image cutout unit may be provided in the client terminal, and the cut window image may be transmitted to the terminal monitoring server. Furthermore, the client terminal may be provided with a window image segmentation / classification / display function provided in the terminal monitoring server. Thus, the present invention can be applied to a stand-alone type terminal.

(11) In the above-described embodiment, the terminal management apparatus is used in the form of a terminal monitoring server. However, the terminal management apparatus according to the present invention is used not only for monitoring purposes but also for other purposes such as browsing and confirmation of windows. be able to.

Functional block diagram of the terminal monitoring system in this embodiment The figure which shows the data structure of an operation log and a capture image The figure explaining the process from clipping of a window image to display Terminal monitoring screen displayed on the monitoring monitor connected to the terminal monitoring server Window image setting screen for various settings related to windows Flow chart showing the flow of terminal monitoring processing The figure explaining the process from clipping of a window image to display in another embodiment

Explanation of symbols

1 Client terminal 2 Terminal monitoring server (terminal management device)
3 Network 21 Terminal management unit 22 Operation log acquisition unit 23 Window display information reading unit 24 Operation log storage unit 25 Capture image acquisition unit 26 Capture image management unit 26a Window image cutout unit 26b Window image classification unit 26c Capture image extraction unit (operation Image extraction unit)
26d Window image composition unit 27 Image storage unit (operation image storage unit)
28 Window image display unit (display control unit)
29 Target window setting unit 30 Operation time calculation unit 31 GUI unit

Claims (5)

In a terminal management device that acquires an operation log and an operation image associated with the operation log from a client terminal,
The operation log includes window display information describing a display state of the window in the operation image,
Based on the window display information, a window image cutout unit that cuts out the display area as a window image for each window from the operation image;
A window image classification unit that associates the window image with a corresponding client terminal and classifies the window image according to attribute information of the window image;
The terminal management apparatus provided with the display control part which displays the window image linked | related with the said client terminal as a list on a monitor screen according to the said attribute information. An operation image storage unit for storing the operation image;
An operation image extraction unit that extracts, from the operation image storage unit, the latest operation image in which the window is displayed in the entire area when at least part of the window in the operation image is hidden by another window; ,
The terminal management apparatus according to claim 1, wherein a display area of the window is cut out from the extracted latest operation image and used as the window image. An operation image storage unit for storing the operation image;
An operation image extraction unit that extracts, from the operation image storage unit, the latest operation image in which the window is displayed in the entire area when at least part of the window in the operation image is hidden by another window; ,
The terminal management apparatus according to claim 1, wherein a cut-out image of the window generated by replacing a hidden area of the window with a corresponding area of the window in the latest operation image is used as the window image. An operation time calculation unit for calculating an operation time for the window in the client terminal based on the operation log;
The terminal management apparatus according to any one of claims 1 to 3, wherein an arrangement position of a list display on the monitor screen is determined based on the operation time. In a terminal management program for a terminal management device that acquires an operation log and an operation image associated with the operation log from a client terminal,
Based on window display information describing the display state of the window in the operation image included in the operation log, a function of cutting out the display area for each window from the operation image,
A function of associating the window image with a corresponding client terminal and classifying the window image according to attribute information of the window image;
The terminal management program which makes a computer implement | achieve the function which displays the window image linked | related with the said client terminal on the monitor screen according to the said attribute information.

Images