JP6545439B2 - Operation recording apparatus, operation recording and reproducing system, and program - Google Patents

Description

  The present invention relates mainly to a technique for recording an operation screen on a terminal and reproducing the recorded operation screen in order to monitor an unauthorized operation or the like on the terminal such as a PC.

  As a method to monitor and confirm that an unauthorized operation has been performed on the terminal, the operation screen displayed on the terminal is recorded (captured) at fixed time intervals, and the image data of the recorded screen is transmitted to the management server etc. There is a method of reproducing an operation screen by a monitoring terminal or the like to check the operation status.

Japanese Patent Application Publication No. 2004-110096

  In the above-described method, as a method of capturing a screen, a moving image recording method of recording a display screen of a terminal as a moving image and a still image recording method of recording a display screen as a continuous still image can be considered.

  When the operation screen is recorded for monitoring of an unauthorized operation or the like, the recording needs to be performed without making the user who performs the operation be aware of the recording. Under such a premise, in the moving picture recording method, for example, the moving picture recording is started when the user starts the terminal or logs in to the terminal, and ends the moving picture recording when the user logs out or ends the terminal It can be considered to be a recording method such as However, in the moving image recording method which is such a recording method, since the moving image (moving image file) is not completed until the operation on the terminal is completed, the operation screen can not be viewed during recording. In addition, when moving picture recording is ended by termination of the terminal, the image data can be sent to the server when the terminal is started next time, and there is a problem that the time until the acquired moving picture can be viewed becomes indefinite. .

  In the still image recording method, it is possible to separately record one still image and transmit it to the server, so that it is possible to prevent the problem as in the above-mentioned moving image recording method. However, the data size is much larger than that of a moving image, and there is a problem that the server requires a large storage area and consumes a large number of NW bands. Further, due to the data size, it is difficult to increase the frame rate as in the case of a moving image, and there is also a problem that the acquisition of the record may occur.

  The above problems may occur not only in the technical field such as unauthorized operation monitoring but also in the case of recording an operation screen for checking the operation log of its own PC, for example.

  The present invention has been made in view of the above points, and in the technology of recording an operation screen and reproducing the recorded operation screen, the data size is increased as in the still image recording method even when recorded at a high frame rate It is an object of the present invention to provide a technology that enables reproduction of an operation screen at an arbitrary time position without causing an operation.

According to an embodiment of the present invention, there is provided an operation recording apparatus which displays a screen according to an operation by a user and records an operation content by capturing the displayed screen,
Capturing means for capturing the screen at predetermined time intervals and acquiring still image data of the screen;
The process of creating moving image data of a broken moving image from a plurality of still image data acquired by the capture means and creating meta information of the moving image data of the broken moving image is performed every predetermined period corresponding to the time length of the thin moving image Means for creating video information to
And transmitting means for transmitting the moving picture data created by the moving picture information creating means and the meta information to the management apparatus .
The moving image data of a plurality of small moving images created by the moving image information creating means is moving image data reproduced so that the plurality of small moving images appear as continuous moving images based on the meta information. An operation recording device is provided.

Further, according to the embodiment of the present invention, the screen is displayed according to the operation by the user, and the operation content is recorded by capturing the displayed screen, and the operation recording and reproducing is performed to display the screen. A system,
Capturing means for capturing the screen at predetermined time intervals and acquiring still image data of the screen;
The process of creating moving image data of a broken moving image from a plurality of still image data acquired by the capture means and creating meta information of the moving image data of the broken moving image is performed every predetermined period corresponding to the time length of the thin moving image Means for creating video information to
Storage means for storing the video data and meta information created by the video information creation means;
An operation screen for reproducing the moving image data based on the meta information, and reproduction control means for reproducing the moving image data according to an operation performed on the operation screen ;
The reproduction control means is characterized by reproducing the moving image data of the plurality of small moving images created by the moving image information generating means so that the plurality of small moving images can be seen as a continuous moving image based on the meta information. An operation recording and reproducing system is provided.

  According to the embodiment of the present invention, in the technology of recording the operation screen and reproducing the recorded operation screen, even if the recording is performed at a high frame rate, it is optional without increasing the data size as in the still image recording method. It is possible to provide a technology that enables the reproduction of the operation screen at the time position of.

FIG. 1 is an overall configuration diagram of a system according to an embodiment of the present invention. FIG. 2 is a functional configuration diagram of an operation recording device 100. FIG. 2 is a functional configuration diagram of an operation information management device 200. It is a figure which shows the image of operation | movement of the operation recording device 100. FIG. 5 is a flowchart for explaining the operation of the operation recording apparatus 100. It is a figure for demonstrating the outline | summary of video reproduction. FIG. 7 is a sequence diagram for describing a moving image (operation screen) reproduction operation in the operation information management device 200 and the operation screen reproduction device 20. It is a figure which shows the example of the information displayed on a reproduction | regeneration operation screen. It is a figure for demonstrating the modification 1. FIG. It is a figure for demonstrating the modification 2. FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. Note that the embodiments described below are merely examples, and the embodiments to which the present invention is applied are not limited to the following embodiments.

(Example of overall system configuration)
FIG. 1 shows an example of the overall configuration of an operation monitoring system according to an embodiment of the present invention. As shown in FIG. 1, the operation monitoring system according to the present embodiment includes an operation recording device 100, a display operation device 10, an operation information management device 200, and an operation screen reproduction device 20.

  The operation recording device 100 displays a screen on the display operation device 10 based on an operation performed by the operator in the display operation device 10 and captures a screen to be displayed as an image, and as described later, moving image data and meta information This is an apparatus (computer) that creates (all together referred to as moving image information) and transmits the moving image information to the operation information management device 200. The display operation device 10 is, for example, a terminal having a display and an input device (keyboard, mouse, etc.). The operation recording device 100 and the display operation device 10 may be connected by a network such as a LAN, or the operation recording device 100 and the display operation device 10 may be configured as an integrated device.

  The operation information management device 200 has a function of storing moving image information received from the operation recording device 100 and providing the operation screen reproduction device 20 with an operation screen for moving image reproduction, moving image data, and the like. The operation screen reproduction device 20 can display the screen displayed on the display operation device 10 as a moving image by reproducing the moving image data received from the operation information management device 200.

(Device configuration)
Next, the configurations of the operation recording apparatus 100 and the operation information management apparatus 200 will be described.

<Operation recording apparatus 100>
FIG. 2 is a diagram showing a functional configuration of the operation recording apparatus 100. As shown in FIG.

  As shown in FIG. 2, the operation recording apparatus 100 includes a display information generation unit 110, an image memory 111, a screen capture unit 120, an operation monitoring unit 130, a moving image information generation unit 140, a moving image data storage unit 150, and a meta information storage unit 160. , Moving image information transmission unit 170.

  The display information creation unit 110 is an application to be operated by the display operation device 10 and a functional unit corresponding to the function of the OS related to the operation or screen display, and the operation performed on the display operation device 10 (keyboard depression, mouse Create image information (still image data, also referred to as display information) of a screen to be displayed on the display operation device 10 based on movement, mouse button depression), and transmit the display information to the display operation device 10 Has a function to display this.

  The display information is stored in the image memory 111, and by acquiring the data stored in the image memory 111, the screen displayed on the display operation device 10 can be captured.

  The screen capture unit 120 captures the screen by acquiring the display information stored in the image memory 111 as described above. The still image data obtained by the capture is passed to the moving image information creation unit 140.

  The operation monitoring unit 130 acquires the information of the operation performed in the display operation device 10 from the display information creating unit 110, and delivers the operation information to the moving image information creating unit 140 based on the request from the moving image information creating unit 140. Have. The operation information includes, for example, information indicating pressing of a keyboard, information indicating movement of a mouse, information indicating pressing of a mouse button, and the like, but is not limited thereto. The operation monitoring unit 130 acquires and holds operation information from the display information creation unit 110 periodically (for example, every 1 second), for example.

  The moving image information creation unit 140 creates moving image data by encoding a plurality of still image data acquired by the screen capture unit 120 every predetermined period (for example, 20 seconds). For encoding, an existing method such as MPEG can be used. The created moving image data is stored in the moving image data storage unit 150.

  Also, the moving picture information creation unit 140 has a function of creating meta information related to moving picture data, and stores the created meta information in the meta information storage unit 160. The meta information includes information such as acquisition start time of still image data relating to moving image data and presence / absence of operation. Details of the meta information will be described later.

  The moving image information transmission unit 170 transmits the moving image data stored in the moving image data storage unit 150 and the meta information stored in the meta information storage unit 160 to the operation information management apparatus 200 as moving image information. The frequency of transmitting moving image data and meta information to the operation information management apparatus 200 may be every time moving image data is created, that is, every predetermined period described above, or collectively transmitted for each period longer than the predetermined period. It may be

  The operation recording apparatus 100 according to the present embodiment can be realized by causing one or a plurality of computers to execute a program in which the processing content described in the present embodiment is described. That is, the functions of the operation recording apparatus 100 are realized by executing a program corresponding to the processing performed by the operation recording apparatus 100 using hardware resources such as a CPU, a memory, and a hard disk built in the computer. It is possible. In addition, the program can be recorded in a computer readable recording medium (portable memory or the like), and can be stored or distributed. Moreover, it is also possible to provide the above program through a network such as the Internet or e-mail. As described above, the modification examples 1 and 2 are similar to the point that can be realized by the program.

<Operation Information Management Device 200>
FIG. 3 is a functional block diagram of the operation information management device 200. As shown in FIG. As shown in FIG. 3, the operation information management device 200 includes a moving image information receiving unit 210, a meta information storage unit 220, a moving image data storage unit 230, and a moving image data provision control unit 240.

  The moving image information receiving unit 210 receives moving image information (moving image data and meta information) from the operation recording apparatus 100. The moving image data is stored in the moving image data storage unit 230, and the meta information is stored in the meta information storage unit 220.

  The moving picture data provision control unit 240 creates screen information for operation screen reproduction based on the meta information stored in the meta information storage unit 220, and transmits the information of the screen to the operation screen reproduction device 20. In addition, it has a function of causing the operation screen reproduction device 20 to reproduce a moving image by transmitting the moving image data to the operation screen reproduction device 20 based on an instruction from the operation screen reproduction device 20 on which the screen is displayed.

  The operation information management apparatus 200 according to the present embodiment can be realized by causing one or more computers to execute a program in which the processing content described in the present embodiment is described. That is, the function possessed by the operation information management device 200 is to execute a program corresponding to the processing performed by the operation information management device 200 using hardware resources such as a CPU, a memory, a hard disk, etc. built in the computer. It is possible to realize by In addition, the program can be recorded in a computer readable recording medium (portable memory or the like), and can be stored or distributed. Moreover, it is also possible to provide the above program through a network such as the Internet or e-mail.

(Operation of each device)
<Operation of Operation Recording Device 100>
The outline of the operation of the operation recording apparatus 100 will be described with reference to FIG. Here, for example, it is assumed that the display operation device 10 logs in to the operation recording device 100, and the display operation device 10 performs some work using the operation recording device 100. Of course, during work, there is also a period in which no operation is performed on the operation recording apparatus 100, and there is also a period in which work such as keyboard input is performed.

  The display information creation unit 110 of the operation recording device 100 performs screen display by transmitting display information (image of screen) to the display operation device 10. As shown in step 1 of FIG. 4, the screen capture unit 120 of the operation recording apparatus 100 captures a screen by acquiring display information in the image memory 111 and sequentially acquires still image data. Although the interval for acquiring still image data may be determined arbitrarily, for example, acquisition is performed at an interval of 200 ms so that five sheets can be acquired in one second.

  As shown in step 2, the moving image information creation unit 140 of the operation recording apparatus 100 creates moving image data from a plurality of still image data acquired in the predetermined period, for each predetermined period (for example, 20 seconds). Also, each time moving image data is created, meta information corresponding to the moving image data is created.

  Next, the operation of the operation recording apparatus 100 will be described in more detail with reference to FIG. For example, the user first logs in by inputting a user ID / password from the display operation device 10 to the operation recording device 100. In response to this login, the display information creation unit 110 starts creation of various display information (image of the screen) based on the operation from the display operation device 10, and starts recording of the operation screen related to the operation by the user. Be done.

  Further, in the present example, the operation monitoring unit 130 periodically (eg, every 1 second) acquires operation information from the display information creation unit 110 and holds the operation information. Further, when there is no operation information (when the operation is not performed), information indicating that nothing is held or no operation information is held is held. The information held is updated each time the operation information is obtained (including the case where it is not present).

  First, the screen capture unit 120 captures display information by acquiring display information from the image memory 111, acquires still image data, and passes the still image data to the moving image information creation unit 140 (step 101).

  The moving image information creation unit 140 inquires the operation monitoring unit 130 whether or not there is operation information at the time of obtaining the still image data (step 102), and if the operation information is present (Yes in step 102), the operation information is present Is added to the still image data, and the information and the still image data are stored in the buffer (step 103). If there is no operation information (No in step 102), only still image data (or still image data and information indicating no operation information) is stored in the buffer (step 104). Further, for example, when still image data is stored, the time at which the still image data was acquired is also stored for each still image data.

  The moving image information creation unit 140 determines whether a predetermined time (for example, 20 seconds) has elapsed since the first still image data acquisition or the previous moving image data creation (step 105), and if it has not, step 101 , And if it has elapsed, the process proceeds to step 106.

  If the process returns to step 101, the process as described above is repeated. When the process proceeds to step 106, the moving image information creation unit 140 creates the moving image data (encoded data) of the predetermined time length by encoding the still image data stored in the buffer during the predetermined time. The resulting moving image data is stored in the moving image data storage unit 150 (step 106). In this example, the buffer for still image data is cleared after moving image data is created. Here, it is shown that moving image data is created when still image data for a predetermined period is stored, but moving image data creation is sequentially performed each time still image data is obtained, and the predetermined period has elapsed. Sometimes, it may be a processing method of completing one moving image data (moving image file).

  Also, the moving picture information creation unit 140 creates meta information corresponding to the moving picture data, and stores the created meta information in the meta information storage unit 160 (step 107). In this example, each time moving image data and meta information are created, the moving image data and meta information are to be transmitted to the operation information management apparatus 200, and the transmission is performed in step S108.

  An example of meta information is as shown in FIG. 4, and the meta information in the example of FIG. 4 is identification information of moving image data corresponding to the meta information (e.g. moving image 1, moving image 2), start time of moving image, moving image (For example, 20 seconds), session ID, and operation presence / absence information. It may include the end time of the video.

  The identification information of the moving image data is, for example, the file name of the corresponding moving image data. The file name of the meta information may include identification information of the moving image data. The start time of the moving image is, for example, the acquisition time of the first still image data of the still image data that is the source of the moving image data. The time length of the moving image is, for example, the time from the acquisition time of the first still image data of the still image data that is the source of the moving image data to the acquisition time of the last still image data. The session ID is information for identifying a series of moving image data. For example, when it is desired to record an operation for each user, the user ID input at login can be used as the session ID. That is, in this case, it is possible to identify moving image data in a time from login to logoff by the user ID as the session ID. As described above, using a user ID as a session ID is only an example, and any other information can be used as a session ID. Usually, a plurality of session IDs exist for the user ID.

  The operation presence / absence information is information indicating "operation present" or "operation not present". More specifically, the moving image information creation unit 140 operates the operation presence / absence information when there is even one still image data to which information on operation is added among the still image data buffered at the time of moving image creation. If there is no still image data to which the information on the operation is attached, the operation presence / absence information is "no operation".

  In the above operation example, at the stage of capturing a still image, the presence or absence of the operation is confirmed to add information, but this is merely an example. In addition, for example, after creating moving image data from still image data, the operation monitoring unit 130 confirms the presence or absence of operation within the moving image creation time (the predetermined time above), and adds operation information to corresponding meta information. May be

<Operation of Operation Information Management Device 200 and Operation Screen Reproduction Device 20>
Next, with reference to FIGS. 6 and 7, an example of a moving image (operation screen) reproduction operation performed by the operation information management device 200 and the operation screen reproduction device 20 will be described. As a premise of the following operation, the operation information management device 200 has already received the moving image information (moving image data and meta information) from the operation recording device 100, and the meta information is stored in the meta information storage unit 220. The storage unit 230 stores moving image data.

  First, the outline of the moving image reproduction will be described with reference to FIG. As shown in FIG. 6, based on the moving image data and the meta information acquired by the operation recording apparatus 100, a plurality of small moving images (moving image 1, moving image 2,... In FIG. 6) are reproduced It looks like it's a continuous movie. Such moving image reproduction control is performed by the moving image data provision control unit 240. Further, in the first and second modifications, the moving image reproduction control unit 250 is also shown in FIG. 6 because it is performed by the moving image reproduction control unit 250.

  Next, with reference to FIG. 7, a sequence example of the reproduction operation will be described. When the operation screen reproduction device 20 (for example, a PC having a moving image decoding function) accesses the operation information management device 200 (step 201), the moving image data provision control unit 240 in the operation information management device 200 operates in the operation screen reproduction device 20. Information of a reproduction operation screen to be an interface screen for reproduction of the operation screen is created (step 202), and the information is transmitted to the operation screen reproduction apparatus 20 (step 203). The operation screen reproducing apparatus 20 having received the information of the reproduction operation screen displays the reproduction operation screen (step 204). For example, at the time of access in step 201, by transmitting a specific user ID, collation with the session ID in the meta information is performed, moving image data corresponding to the user ID is extracted, and the user corresponding to the user ID It is possible to play back only the operation screen.

  FIG. 8 shows an example of display information in the reproduction operation screen. In the example shown in FIG. 8, on the time axis, a time interval in which the operation recording device 100 is not used, a time interval in which the operation recording device 100 is used (= a time interval in which recording of a screen is made), Among them, the time interval in which the operation was performed and the time interval in which the operation was not performed are shown in different colors. In the example of FIG. 8, although the presence or absence of the operation is indicated, not only the presence or absence of the operation but also the operation violation or the like can be added by acquiring information indicating the operation content (for example, the type of command) as meta information. Is possible.

  The information shown in FIG. 8 can be created using the time information and operation presence information in the meta information (identifiable by the session ID) corresponding to the corresponding user. For example, the time section in the meta information with the operation information may be displayed as the time section in which the operation was performed.

  For example, when it is desired to reproduce only the time section in which the operation has been performed, the user of the operation reproduction apparatus 20 clicks (or inputs a desired reproduction start time) a time section indicating that the operation has been performed. Then, for example, a reproduction instruction including the designated time (for example, the first time of the time section, the input time) and the information of "operation present" is transmitted to the operation information management device 200 (step 205).

  The moving image data provision control unit 240 in the operation information management apparatus 200 having received the reproduction instruction, for example, uses the meta information to determine moving image data of the “operation present” time section including the designated time, and the moving image data Are extracted from the moving image data storage unit 230 (step 206) and transmitted to the operation reproduction apparatus 20 (step 207). The operation screen reproduction apparatus 20 reproduces a moving image (operation screen) by sequentially decoding the received moving image data (step 208).

  Although the above example is an example of specifying a specific "operation present" time interval, this is merely an example, and for example, all "exception" is continuously reproduced, all "operations" It is also possible to reproduce only the "presence" section continuously.

(Modification 1)
In the system described so far, the side that reproduces a moving image is divided into the operation information management device 200 and the operation reproduction device 20 having a decoding function, but the operation information management device 200 has a decoding function, and the operation information management By displaying an operation screen on the device 200 and giving an instruction on the operation screen, moving image reproduction display may be performed on the operation information management device 200.

  A configuration example of the operation information management device 200 in this case is shown in FIG. As shown in FIG. 9, in the operation information management apparatus 200 of the first modification, the moving image data provision control unit 240 in the operation information management apparatus 200 shown in FIG. 3 is replaced with a moving image reproduction control unit 250 shown in FIG. It corresponds to

  The moving image reproduction control unit 250 displays the operation screen displayed on the operation screen reproduction device 20 by the above-described moving image data provision control unit 240 on the display of the operation information management device 200, and as described above, according to the instruction on the operation screen. Video data is acquired, and the video data is decoded and displayed.

(Modification 2)
In the system described above, the operation recording apparatus 100 and the operation information management apparatus 200 are separated and connected to a network, but the functions of these apparatuses may be in one apparatus. Such an apparatus is called an operation recording and reproducing apparatus 300.

  A configuration example of the operation recording and reproducing apparatus 300 is shown in FIG. As shown in FIG. 10, the operation recording / reproducing apparatus 300 includes a display information generation unit 110, an image memory 111, a screen capture unit 120, an operation monitoring unit 130, a moving image information generation unit 140, a moving image data storage unit 150, and a meta information storage unit. 160, the video playback control unit 250 is provided.

  The functions of each functional unit are the same as described above. In the second modification, the moving image data generated by the moving image information generating unit 140 is stored in the moving image data storage unit 150, and the meta information is stored in the meta information storage unit 160 without being transmitted to another device. The video playback control unit 250 is used for video playback.

  The apparatus of the second modification can also be used, for example, for the purpose of later confirming the contents of the operation performed by itself, in addition to performing moving image recording / reproduction for the operation monitoring as described above.

  Note that the system shown in FIG. 1, the system in which the reproduction side of the system shown in FIG. 1 is replaced with the first modification, and the system of the second modification are all examples of the operation recording and reproduction system.

(Summary of the embodiment, effects, etc.)
As described above, according to the present embodiment, the present invention is an operation recording apparatus that displays a screen according to an operation by a user and records the operation content by capturing the displayed screen, wherein the screen is specified Processing for capturing moving image data from a plurality of still image data captured by the capturing means for capturing still image data of the screen and capturing at a time interval of An operation recording apparatus is provided, which comprises: moving image information creating means for performing each of the predetermined periods; and transmitting means for transmitting the moving image data created by the moving image information creating means and the meta information to the management device.

  The meta information includes, for example, identification information of moving image data, a capture start time of the moving image data, and a time length of capturing.

  The operation recording apparatus may further include operation monitoring means for monitoring an operation by the user, and the moving image information generating means detects that the operation is present within a predetermined time when the moving image data is generated. The meta information corresponding to the moving image data may include information indicating that there is an operation.

  Further, according to the present embodiment, the operation recording and reproducing system displays the screen according to the operation by the user, records the operation content by capturing the displayed screen, and reproduces and displays the screen. Capture means for capturing the screen at predetermined time intervals and acquiring still image data of the screen, and creating moving image data from a plurality of still image data obtained by the capturing means; A moving image information creating unit that performs processing of creating information at predetermined intervals, a storing unit that stores the moving image data and meta information created by the moving image information creating unit, and reproduces the moving image data based on the meta information Operation control screen for displaying the moving image data according to the operation performed based on the operation screen. Operation recording and reproducing system and means are provided.

  The present embodiment can be called a small moving picture method because moving pictures are created in small pieces, not long moving pictures. By adopting the small moving picture method, it is possible to enjoy the merits of both collecting the operation record as a moving picture and as a still picture.

  That is, since the moving image is a moving image, it is possible to perform a leak-free recording at a high frame rate. In addition, since the moving image compression function can be used, the storage size and the inter-server communication bandwidth (bps) can be saved. In addition, since moving images of short intervals are sequentially transmitted to the server, browsing can be performed as needed from the completed transmission (real-time monitoring can be performed with a delay of about one minute). In addition, since the moving image is divided into fine time units, even when the operation time of the recording target is long, browsing (heading up) of the recording at any time can be performed at a high speed at the time of browsing. In addition, even if the target frame rate is lowered due to load fluctuation of the target terminal (recording device) at the time of moving image acquisition, the reproduction time can be corrected in units of fragmentation, so errors in reproduction time do not accumulate even if recording for a long time There is also an effect.

(Section 1)
An operation recording apparatus that displays a screen according to an operation by a user and records an operation content by capturing the displayed screen.
Capturing means for capturing the screen at predetermined time intervals and acquiring still image data of the screen;
A moving image information generating unit that generates moving image data from a plurality of still image data acquired by the capturing unit and performs processing of generating meta information of the moving image data at predetermined intervals;
A transmitting unit for transmitting the moving image data and the meta information generated by the moving image information generating unit to a management apparatus;
An operation recording apparatus comprising:
(Section 2)
The operation recording apparatus according to claim 1, wherein the meta information includes identification information of moving image data, a capture start time of the moving image data, and a time length of capturing.
(Section 3)
The operation recording device further includes operation monitoring means for monitoring the operation by the user,
The moving image information creation means includes information indicating the presence of the operation in the meta information corresponding to the moving image data when it is detected that the operation is present within a predetermined time when the moving image data is created.
The operation recording apparatus according to any one of the items 1 and 2, characterized in that:
(Section 4)
A program for causing a computer to function as each means of the operation recording device according to any one of the items 1 to 3.
(Section 5)
An operation recording and reproducing system that displays a screen according to an operation by a user, records an operation content by capturing the displayed screen, and reproduces and displays the screen.
Capturing means for capturing the screen at predetermined time intervals and acquiring still image data of the screen;
A moving image information generating unit that generates moving image data from a plurality of still image data acquired by the capturing unit and performs processing of generating meta information of the moving image data at predetermined intervals;
Storage means for storing the video data and meta information created by the video information creation means;
A reproduction control unit that displays an operation screen for reproducing the moving image data based on the meta information, and reproduces the moving image data according to an operation performed based on the operation screen;
An operation recording and reproducing system comprising:
The present invention is not limited to the above embodiment, and various modifications and applications are possible within the scope of the claims.

DESCRIPTION OF SYMBOLS 10 display operation apparatus 100 operation recording apparatus 20 operation screen reproduction apparatus 200 operation information management apparatus 110 display information creation part 111 image memory 120 screen capture part 130 operation monitoring part 140 moving image information creation part 150 moving image data storage part 160 meta information storage part 170 Movie information transmission unit 210 Movie information reception unit 220 meta information storage unit 230 movie data storage unit 240 movie data provision control unit 250 movie reproduction control unit 300 operation recording and reproduction apparatus

Claims (5)

An operation recording apparatus that displays a screen according to an operation by a user and records an operation content by capturing the displayed screen.
Capturing means for capturing the screen at predetermined time intervals and acquiring still image data of the screen;
The process of creating moving image data of a broken moving image from a plurality of still image data acquired by the capture means and creating meta information of the moving image data of the broken moving image is performed every predetermined period corresponding to the time length of the thin moving image Means for creating video information to
And transmitting means for transmitting the moving picture data created by the moving picture information creating means and the meta information to the management apparatus .
The moving image data of a plurality of small moving images created by the moving image information creating means is moving image data reproduced so that the plurality of small moving images appear as continuous moving images based on the meta information. Operation recording device.   The operation recording apparatus according to claim 1, wherein the meta information includes identification information of moving image data, a capture start time of the moving image data, and a time length of capturing. The operation recording device further includes operation monitoring means for monitoring the operation by the user,
The moving image information creation means includes, when it is detected that there is an operation within a predetermined time when the moving image data was created, the meta information corresponding to the moving image data includes information indicating the presence of the operation. The operation recording device according to claim 1 or 2 . The program for functioning a computer as each means of the said operation recording device of any one of Claim 1 thru | or 3 . An operation recording and reproducing system that displays a screen according to an operation by a user, records an operation content by capturing the displayed screen, and reproduces and displays the screen.
Capturing means for capturing the screen at predetermined time intervals and acquiring still image data of the screen;
The process of creating moving image data of a broken moving image from a plurality of still image data acquired by the capture means and creating meta information of the moving image data of the broken moving image is performed every predetermined period corresponding to the time length of the thin moving image Means for creating video information to
Storage means for storing the video data and meta information created by the video information creation means;
An operation screen for reproducing the moving image data based on the meta information, and reproduction control means for reproducing the moving image data according to an operation performed on the operation screen ;
The reproduction control means is characterized by reproducing the moving image data of the plurality of small moving images created by the moving image information generating means so that the plurality of small moving images can be seen as a continuous moving image based on the meta information. Operation recording and playback system.

Images