JP4429349B2 - Recording device and program for the recording device - Google Patents

Description

  The present invention relates to a recording apparatus that records a captured image generated by capturing an operation screen, and a program for such a recording apparatus.

  In recent years, with the widespread use of networks such as intranets and local area networks, the number of cases in which the operation status of remote computer terminals is checked for the purpose of monitoring computer terminals connected to the network or for classes using the network has increased. Yes. As one technique for achieving such an object, there is a technique for grasping the operation status of a computer terminal by capturing an operation screen of the computer terminal and confirming the captured image (for example, Patent Document 1). In the remote control system according to Patent Document 1, a remote control server and a client terminal are connected via a communication network, and the remote control server is configured to receive access request information from the client terminal. The client terminal transmits the image data displayed on the monitor to the remote control server, and the remote control server displays the received image data on the monitor, and the captured image recording means of the remote control server captures the screen of the client terminal. The image is recorded in the operation log at a predetermined interval, and after this recording, the log reproduction processing unit of the remote control server reproduces the captured image recorded in the operation log. However, in the technique according to Patent Document 1, the captured image is simply reproduced. For example, when the mouse cursor is in the reproduction screen and the mouse cursor moves quickly, the person who is viewing the reproduction screen Had the problem of losing sight of the mouse cursor.

JP 2006-108947 A (paragraph number 0051, etc.)

  SUMMARY OF THE INVENTION In view of the above problems, an object of the present invention is to provide a recording apparatus for recording so that the user's eyes can easily follow the movement of the cursor of the pointing device when reproducing a recorded captured image, and for such a recording apparatus. Is to provide a program.

  According to the present invention for achieving this object, a characteristic configuration of a recording apparatus that records a captured image generated by capturing an operation screen includes cursor position information indicating a cursor position of the pointing device on the operation screen. A cursor movement distance calculation unit that calculates a movement distance of the cursor based on the movement distance, a movement distance integration unit that counts an integrated movement distance based on the movement distance, and each time the integrated movement distance reaches a set target movement distance A capture signal output unit that outputs a capture signal, and a capture image generation unit that generates a capture image from the operation screen based on the capture signal.

  With such a characteristic configuration, since the capture image can be generated every time the cursor of the pointing device advances a certain distance, the capture image can be recorded so that the movement distance of the cursor is constant. . Therefore, even if the movement of the cursor is irregular on the operation screen, it is possible to reproduce the cursor so that the movement of the cursor is constant just by reading and reproducing the recorded captured image. You can easily follow the eye without losing sight of the cursor.

  In addition, it is preferable that the recording apparatus includes an operation screen dividing unit that divides the operation screen for each section, and the target moving distance is set for each section.

  With such a configuration, the operation screen is divided into sections by the operation screen dividing unit, and every time the cumulative movement distance of the pointing device cursor reaches the target movement distance set for each of the divided sections. Since the capture image is generated from the operation screen, the timing for generating the capture image can be changed according to the position of the cursor.

  In the recording apparatus, it is preferable that the target moving distance is changed according to a display object displayed in a section divided for each section.

  With such a configuration, when there is an icon to be watched as an operation target, an application window, or the like as a display object in a predetermined section, by setting the target moving distance to be small, the cursor is set in the section. If it is located, more captured images can be generated. Therefore, the movement of the cursor can be reproduced in detail during reproduction, and the movement of the cursor can be viewed more carefully.

  Another feature of the recording apparatus for recording a captured image generated by capturing an operation screen according to the present invention for achieving this object is an operation screen dividing unit for dividing the operation screen into sections. A cursor movement distance calculation unit that calculates a movement distance of the cursor based on cursor position information indicating a cursor position of the pointing device on the operation screen; and a movement distance coefficient that determines a movement distance coefficient for each section A determination unit; a movement point calculation unit that calculates a movement point based on the movement distance and the movement distance coefficient; and a signal output of a capture signal that is output each time the movement point reaches a preset generation point And a capture image generation unit that generates a capture image from the operation screen based on the timing.

  With such a characteristic configuration, it is possible to easily generate a capture image according to the movement point calculated based on the movement distance and the movement distance coefficient of the cursor. Therefore, even if the movement of the cursor on the operation screen is irregular, it is possible to reproduce the movement of the cursor according to the movement distance coefficient set for each section by simply reading from the captured image storage unit as it is. This makes it easier to follow the eye without losing sight of the cursor. In addition, since a movement distance coefficient is set for each section, for example, in a section with low importance, it is possible to reduce the number of captured images to be generated by setting a large movement distance coefficient. Therefore, the recording capacity can be reduced.

  Furthermore, in the present invention, a program suitably used for a recording apparatus for recording a captured image generated by capturing an operation screen is also included in the scope of rights, and the characteristic configuration of the computer program is a pointing device on the operation screen. A cursor movement distance calculation function for calculating the movement distance of the cursor based on cursor position information indicating the position of the cursor, a movement distance integration function for counting an integrated movement distance based on the movement distance, and the integrated movement distance. The point is to cause the computer to execute a capture signal output function that outputs a capture signal each time a set target movement distance is reached, and a capture image generation function that generates a capture image from the operation screen based on the capture signal. .

  In the present invention, another program for the recording apparatus is also included in the scope of rights. The computer program includes an operation screen dividing function for dividing the operation screen into sections, and a pointing device cursor on the operation screen. A cursor movement distance calculation function for calculating the movement distance of the cursor based on cursor position information indicating the position of the cursor, a movement distance coefficient determination function for determining a movement distance coefficient for each section, the movement distance and the movement distance coefficient Based on the above, based on the movement point calculation function for calculating the movement point and the capture signal signal output timing that is output every time the movement point reaches a preset generation point, capture images from the operation screen The capture image generation function to be generated is executed by a computer.

  The programs for these recording apparatuses can also obtain the above-described operational effects, similarly to the recording apparatus as the object of the present invention described above.

1. First Embodiment Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a diagram illustrating a configuration of a recording apparatus 1 according to the present embodiment. The recording apparatus 1 includes a monitor 1A and a pointing device 1B, and an operation screen associated with a user operation is displayed on the monitor 1A. Further, the cursor Cu of the pointing device 1B is also displayed on this operation screen, and the movement of the cursor Cu moves fast, moves slowly or stops according to the user's operation. The recording apparatus 1 has a function of generating a capture image from an operation screen displayed on the monitor 1A so that the movement of the cursor Cu that does not move at a constant speed is constant. The function will be described below.

  FIG. 2 is a block diagram schematically showing a schematic configuration of the recording apparatus 1 according to the present embodiment. The recording apparatus 1 includes a display object information storage unit 10 that stores display object information, a cursor position information acquisition unit 11 that acquires cursor position information, and an operation log information storage unit 12 that stores operation log information. The recording apparatus 1 includes a position evaluation value calculation unit 14, a cursor movement distance calculation unit 15, a target movement distance setting unit 17, a movement distance comparison unit 18, a movement distance integration unit 19, an operation log determination unit 20, and a capture signal output unit. 21, the captured image generation unit 22 and the captured image storage unit 23 are also provided. Hereinafter, the configuration of each unit of the recording apparatus 1 will be described.

1-1. Display Item Information Storage Unit The display item information storage unit 10 stores display item information. The display objects are icons, taskbars, application windows, and the like included in the operation screen displayed on the monitor 1A. The display object information is information indicating the position of the display object on the operation screen. That is, it consists of icon information representing the coordinates of the icon, task bar information representing the coordinates of the task bar including the start button, and window information representing the coordinates of the application window. In addition to the information indicating the position of the display object described above, the display object information includes information regarding the content, importance, etc. of the display object. The content of the display object indicates the type of the display object, and specifically indicates the type of an icon, a task bar, a window, or the like. The importance level defines how important the display object is on the operation screen. Whether the importance is important may be indicated in two stages, or may be expressed in stages in three or more stages.

1-2. Cursor position information acquisition unit The cursor position information acquisition unit 11 acquires cursor position information. The cursor position information is information (position information) indicating the position of the cursor Cu of the pointing device 1B on the operation screen, and is generated based on the user's cursor operation in the recording apparatus 1. The cursor position information includes an acquisition time when the position information of the cursor Cu is acquired, and coordinate information including the x coordinate and the y coordinate of the cursor Cu at the acquisition time.

1-3. Operation log information storage unit The operation log information storage unit 12 stores operation log information. The operation log information includes an operation log recorded based on the operation content, operation time, and the like of the user who uses the recording device 1. Therefore, the recording apparatus 1 can recognize the operation status of the user from the operation log information.

1-4. Position Evaluation Value Calculation Unit The position evaluation value calculation unit 14 calculates the position evaluation value of the cursor Cu based on the cursor position information and the display object information. The position evaluation value is a value that defines the relationship between the position of the cursor Cu and the position of the display object. Specifically, the position evaluation value becomes high if the cursor Cu is on a display object such as an icon, a task bar, or an application window. . For example, when the cursor Cu is positioned on the icon, there is a high possibility that it is a previous stage such as application startup or folder opening operation, and when it is positioned on the taskbar, it may be a previous stage such as application startup. High nature. Further, when the cursor Cu is positioned on the application window, it is highly likely that the application is being operated. As described above, if the cursor Cu is positioned on a predetermined position (display object) set in advance, that is, if the cursor position coincides with the predetermined position, an important operation may be performed. Is possible. Therefore, such an operation can be predicted in advance based on the position evaluation value. On the other hand, if the cursor Cu is not positioned on the icon, task bar, or window, is the cursor Cu stationary on other areas or moved on other areas? Therefore, it can be predicted that no application or file operation has been performed. Such a position evaluation value is output to the capture signal output unit 21 described later.

1-5. Cursor movement distance calculation unit The cursor movement distance calculation unit 15 calculates the movement distance of the cursor Cu based on the cursor position information indicating the position of the cursor Cu of the pointing device 1B on the operation screen. As described above, the cursor position information including the position information of the cursor Cu is acquired by the cursor position information acquisition unit 11. Therefore, the cursor movement distance calculation unit 15 calculates the movement distance of the cursor Cu using the cursor position information acquired by the cursor position information acquisition unit 11. The movement distance of the cursor Cu is a value indicating the distance that the cursor Cu has moved, and is calculated from the x and y coordinates of the cursor Cu included in the cursor position information.

1-6. Moving distance integrating unit The moving distance integrating unit 19 counts the integrated moving distance based on the moving distance of the cursor Cu. The integrated movement distance is obtained by integrating the movement distance of the cursor Cu, and is continuously integrated until a capture signal is input from the capture signal output unit 21 described later to the movement distance integration unit 19. When the capture signal is input to the moving distance integrating unit 19, the integrated moving distance is cleared and accumulated from zero.

1-7. Target movement distance setting unit The target movement distance setting unit 17 sets a target movement distance. The target moving distance is a value used when the recording apparatus 1 determines the timing for generating the captured image. Although details will be described later, in this recording apparatus 1, the capture image generation unit 22 generates a capture image from the operation screen every time at least the cumulative movement distance of the cursor Cu reaches the target movement distance. In the present embodiment, the target movement distance is set uniformly within the operation screen.

1-8. Moving Distance Comparing Unit The moving distance comparing unit 18 compares the target moving distance set by the target moving distance setting unit 17 with the integrated moving distance counted by the moving distance integrating unit 19. This comparison result is output to the capture signal output unit 21 described later every time the integrated movement distance reaches the target movement distance.

1-9. Operation Log Determination Unit The operation log determination unit 20 determines an operation performed on the recording device 1 based on operation log information stored in the operation log information storage unit 12. The operation log determination unit 20 determines an operation in accordance with the timing at which the operation log information is stored in the operation log information storage unit 12. When it is determined that a specific operation such as activation of an application has been performed by the user, a determination signal indicating that the specific operation has been performed is output to the capture signal output unit 21.

1-10. Capture signal output unit The capture signal output unit 21 outputs a capture signal every time the integrated movement distance reaches the set target movement distance. The capture signal is a signal that is a timing at which a capture image generation unit 22 described later generates a capture image. In addition, when the total travel distance reaches the set target travel distance, the travel distance integration section 19 is cleared to clear the total travel distance counted by the travel distance integration section 19 as described above. A capture signal is also output. On the other hand, also when the position evaluation value calculation unit 14 calculates that the cursor Cu is positioned on the display object, or when the operation log determination unit 20 determines that the user has performed a specific operation such as activation of the application. The capture signal output unit 21 outputs a capture signal. In such a case, since the capture signal is an additional output, it is not necessary to clear the accumulated moving distance, and therefore the capture signal is not output to the moving distance integrating unit 19.

1-11. Capture Image Generation Unit The capture image generation unit 22 generates a capture image from the operation screen based on the capture signal. The capture signal is output from the capture signal output unit 21 to the capture image generation unit 22. Here, an image based on image data generated by a display screen generation unit (not shown) is displayed on the monitor 1A. The VRAM 25 transmits and receives image data between the display screen generation unit and the monitor 1A. Therefore, in practice, the operation screen handled by the VRAM 25 is operation screen data. However, since it is not necessary to distinguish between the two in the present invention, the operation screen data is also the operation screen data unless otherwise specified. Will be treated as As described above, the VRAM 25 is set with an operation screen indicating the user's operation status displayed on the monitor 1A. From this operation screen, the capture image generation unit 22 captures an operation screen corresponding to the time when the capture signal is output, and generates a capture image. The generation of the captured image is preferably performed using various known techniques.

1-12. Capture Image Storage Unit The capture image storage unit 23 records the capture image generated by the capture image generation unit 22. In the captured image storage unit 23, various processes are performed by the functional units included in the recording apparatus 1 as described above, and the captured image generated at a timing at which the moving distance of the cursor Cu is constant is recorded. The Therefore, the user can reproduce the captured image recorded in the captured image storage unit 23 sequentially and reproduce it so that the movement of the cursor Cu is constant. It is easy to follow.

1-13. Next, a generation process in which the recording apparatus 1 generates a capture image from the operation screen will be described with reference to the drawings. FIG. 3 is an operation screen displayed on the monitor 1A. Note that FIG. 3 shows a frame advance image from acquisition times t1 to t12 from (a) to (l), but the actual operation screen is not a frame advance image like this, but a continuous image. Here, as an example, the operation screen is illustrated as an image temporarily recorded every second. The cursor Cu is moved from the screen (a) to the screen (d) acquired during the acquisition time t1 to t4, but from the screen (d) to the screen (e) during the acquisition time t4 to t5. The movement of the cursor Cu is not seen as shown in FIG. Similarly, during the acquisition time t5 to t12, the cursor Cu moves from the screen (e) to the screen (l).

  FIG. 4 shows an example of the cursor position information acquired by the cursor position information acquisition unit 11. The cursor position information is information indicating the position of the cursor Cu on the operation screen, and includes the acquisition time when the position information of the cursor Cu is acquired, and coordinate information including the x coordinate and the y coordinate at the acquisition time. . In the example of FIG. 4, the acquisition time is t1 to t12. The acquisition interval is set to one second as an example, but actually, the cursor position information is sequentially acquired by the cursor position information acquisition unit 11 in real time. In the present embodiment, the area of the operation screen is a 1024 × 768 (dot) area, the lower left x coordinate is 0, the y coordinate is 0, the upper right x coordinate is 1024, and the y coordinate is 768. However, the present invention is not limited to this, and the present invention can be applied to an operation screen in a different area, and it is naturally possible to use a position other than the lower left of the area as a reference coordinate.

  Next, FIG. 4 will be described. At 15:15:30 (acquisition time t1), it is indicated that the cursor Cu is at the position of the x coordinate 740 and the y coordinate 221. At 15:15:31 (acquisition time t2), it is indicated that the cursor Cu is at the position of the x coordinate 575 and the y coordinate 262. Therefore, it can be seen that the cursor Cu moves during this time. Hereinafter, the cursor position information acquisition unit 11 acquires the position information of the cursor Cu in real time in accordance with the operation of the pointing device 1B performed by the user. Note that, as described in the screen of FIG. 3D to the screen of (e), the cursor Cu is between 15:15:33 (acquisition time t4) and 15:15:34 (acquisition time t5). Position information (x coordinate 190, y coordinate 452) is not changed. Therefore, it can be seen from this cursor position information that there is no movement of the cursor Cu during this period.

  FIG. 5 shows the calculation result of the movement distance of the cursor Cu. In accordance with the timing at which the cursor position information shown in FIG. 4 is acquired by the cursor position information acquisition unit 11, the cursor movement distance calculation unit 15 calculates the movement distance of the cursor Cu. Specifically, in FIG. 4, when the cursor position information at the acquisition times t1 and t2 is acquired, the movement distance “x1−x2” and the y coordinate of the x coordinate from the acquisition time t1 to t2 as shown in FIG. Are moved as “−165” dot and “41” dot, respectively, and the moving distance at this time is obtained as “170” dots. Next, when the cursor position information at the acquisition time t3 is acquired, the x-coordinate movement distance “x2-x3” and the y-coordinate movement distance “y2-y3” from the acquisition time t2 to t3 are “−115”, respectively. “Dot”, “60” dots, and the moving distance at this time is obtained as “130” dots. Hereinafter, similarly, it is performed in accordance with the acquisition of the cursor position information, and the moving distance of the cursor Cu is calculated. The negative sign of the movement distance in the present embodiment indicates movement from right to left in the operation screen at the x coordinate, and movement from top to bottom within the operation screen at the y coordinate. It is determined by the setting and is not limited to this.

  FIG. 6 shows the accumulated movement distance count result obtained by integrating the movement distances from the movement distance calculation results shown in FIG. 5 and the output timing of the corresponding capture signal. Here, since the coordinate information is acquired in units of dots, the unit of the movement distance and the integrated movement distance is also “dot”. Note that this unit is not limited to “dot”, and the length (for example, inches or cm) on the screen can also be used.

  In the present embodiment, an example in which the target moving distance is set as “300” dots will be described. The integrated movement distance from the acquisition time t1 to t2 is “170” dots because the movement distance from the acquisition time t1 to t2 is “170” dots. At this stage, since the integrated movement distance has not reached the target movement distance, the capture signal is not output from the capture signal output unit 21. That is, the capture signal is “Low”. Here, when the cursor Cu moves “130” dots from this state, the integrated movement distance reaches the target movement distance “300” dots. When the cursor Cu moves “130” dots from the integrated movement distance (“170” dots) at the acquisition time t2, the acquisition time t3 is obtained. That is, since the integrated movement distance has reached “300” dots at the acquisition time t3, the capture signal The output unit 21 outputs a capture signal to the capture image generation unit 22. That is, the capture signal becomes “High”. When the capture signal is output to the capture image generation unit 22, the capture image generation unit 22 generates a capture image from an operation screen corresponding to the timing at which the capture signal is output among the operation screens in the VRAM 25. The captured image generated at this time is as shown in FIG. FIG. 7A shows a captured image recorded in the captured image storage unit 23 as an operation screen at the start time. The capture signal is also output to the travel distance integrating unit 19 and the integrated travel distance of the travel distance integrating unit 19 is cleared according to the capture signal. Therefore, the cumulative movement distance count after the acquisition time t3 starts from “0”.

  As shown in FIG. 6, after the acquisition time t3, the moving distance integrating unit 19 continues to count the accumulated moving distance of the cursor Cu from “0”, and then the accumulated moving distance of the cursor Cu becomes “300” dots. "High" is output as the capture signal at the acquisition time t4. In response to the capture signal, the capture image generation unit 22 generates a capture image from the operation screen corresponding to the timing at which the capture signal is output among the operation screens in the VRAM 25, and captures as shown in FIG. An image is recorded in the captured image storage unit 23. Thereafter, the integrated movement distance is similarly counted based on the cursor position information.

  Here, in FIG. 6, the integrated movement distance from the acquisition time t5 to t6 is “145” dots. However, “High” is output as the capture signal. This is because, on the operation screen corresponding to the acquisition time t6, the cursor Cu is positioned on the display object (icon), so the position evaluation value calculation unit 14 calculates a high position evaluation value of the cursor Cu at the time (t6). Due to that. Thus, even if the integrated movement distance does not reach the target movement distance, if the position evaluation value calculation unit 14 calculates that the position evaluation value is high, the capture signal output unit 21 outputs a capture signal. Therefore, the capture image generation unit 22 generates a capture image as shown in FIG. 7D from the operation screen corresponding to the acquisition time t6 and records it in the capture image storage unit 23. In this case, since the capture signal is additionally output because the cursor Cu is positioned on the display object, the capture signal is not output to the movement distance integrating unit 19. Therefore, the accumulated movement distance is not cleared and is continuously counted.

  Hereinafter, processing is performed in the same manner, and every time the integrated movement distance reaches the target movement distance, every time the position evaluation value is calculated high, or although not shown, it is specified by the user based on the determination result of the operation log determination unit 20 Each time this operation is performed, the captured image is recorded in the captured image storage unit 23. The captured image recorded in the captured image storage unit 23 in this way is shown in FIG. By using the reproduction function (not shown) provided in the recording apparatus 1, the captured images recorded in the captured image storage unit 23 are sequentially read and reproduced so that the user's eyes can easily follow the movement of the cursor Cu. It can be played back.

1-14. Capture Image Generation Method Next, a procedure of capture image generation processing executed in the recording apparatus 1 according to the present embodiment will be described. FIG. 8 is a flowchart showing an overall procedure of the captured image generation processing according to the present embodiment. The procedure of the capture image generation process described below is executed by hardware, software (program), or a combination of both constituting each functional unit of the recording apparatus 1 described above.

  First, a target moving distance is set by the target moving distance setting unit 17 (step # 01). The target moving distance can be set in advance to a predetermined value, or can be set by inputting a value desired by the user with an input device (for example, a keyboard). Next, the position evaluation value calculation unit 14 extracts the cursor position information acquired by the cursor position information acquisition unit 11 (step # 02), and an icon, a task bar, an application window, etc., on which the cursor Cu is displayed on the operation screen. It is calculated whether it is on the display item. Information indicating the coordinates of the display object is stored in the display object information storage unit 10 as display object information.

  Then, the cursor movement distance calculation unit 15 calculates the movement distance of the cursor Cu based on the cursor position information (step # 03). Next, the travel distance integrating unit 19 counts the accumulated travel distance based on the travel distance calculation result (step # 04), and the travel distance comparing unit 18 sets the obtained accumulated travel distance and the target travel distance setting unit 17. Comparison with the target movement distance thus made is performed (step # 05). If the integrated movement distance has reached the target movement distance (step # 06: Yes), the capture signal output unit 21 outputs a capture signal to the movement distance integration unit 19 (step # 07). Upon receipt of this capture signal, the movement distance integrating unit 19 clears the counted integrated movement distance (step # 08).

  When the capture signal is output from the capture signal output unit 21 to the capture image generation unit 22 (step # 09), the capture image generation unit 22 performs an operation corresponding to the cursor position information that causes the capture signal to be output from the VRAM 25. The screen is captured to generate a captured image and recorded in the captured image storage unit 23 (step # 10). If the process is not continued (step # 11: Yes), the process ends.

  In step # 06, if the integrated movement distance has not reached the target movement distance (step # 06: No), the position evaluation value calculation unit 14 determines that the cursor Cu is on the display object from the display object information and the cursor position information. Calculate whether or not there is. If the cursor Cu is on a predetermined position such as a display object (step # 12: No), the capture signal output unit 21 outputs a capture signal to the capture image generation unit 22 (step # 09). On the other hand, if the cursor Cu is not on the predetermined position (step # 12: Yes), the operation log determination unit 20 extracts the operation log information stored in the operation log information storage unit 12 (step # 13), and the program is It is confirmed whether or not it has been activated, and the determination result is output to the capture signal output unit 21. If the program is activated (step # 14: No), the capture signal output unit 21 outputs a capture signal to the captured image generation unit 22 (step # 09). On the other hand, if the program is not activated (step # 14: Yes), the processing is continued from step # 11.

  In step # 11, when the process is continued (step 11: No), it is confirmed whether or not to change the target moving distance. When the target moving distance is not changed (step # 15: Yes), the processing is continued from step # 02. On the other hand, when the target moving distance is changed (step # 15: No), the target moving distance desired by the user is changed (step # 16), and the processing is continued from step # 01. According to the above flow, it is possible to record the captured image so that the movement of the cursor Cu is constant, and it is possible to prevent the problem that the user loses sight of the cursor Cu when reproducing the recorded captured image. it can.

  Here, when the program is not started (step # 14: Yes) and the process is not continued (step # 11: Yes), the operation screen corresponding to the cursor position information that was finally determined. From the above, a captured image may be generated and recorded in the captured image storage unit 23.

2. Second Embodiment Next, a second embodiment according to the present invention will be described. FIG. 9 is a diagram schematically illustrating a schematic configuration of the recording apparatus 1 according to the second embodiment. In the first embodiment, the target moving distance is described as being set uniformly in the operation screen. However, in the second embodiment, the operation screen is divided into sections, and the target moving distance is set for each section. This is different from the first embodiment. Position evaluation values calculated by the position evaluation value calculation unit 14 according to the second embodiment, target movement distances set by the target movement distance setting unit 17, functional units other than the operation screen division performed by the operation screen division unit 26, etc. The configuration is the same as in the first embodiment. For this reason, the following description will focus on the position evaluation value calculation unit 14, the target movement distance setting unit 17, and the operation screen division unit 26. In addition, the code | symbol described in this description demonstrates using the thing similar to the code | symbol used for description in 1st embodiment.

2-1. Position Evaluation Value Calculation Unit The position evaluation value calculation unit 14 calculates the position evaluation value of the cursor Cu based on the cursor position information and the display object information, as in the first embodiment. The position evaluation value is a value that defines the relationship between the position of the cursor Cu and the position of the display object, as in the first embodiment. Specifically, the cursor Cu is an icon, a task bar, an application window, or the like. It will be higher if it is on the display. In the present embodiment, the position evaluation value calculation unit 14 also calculates the operation screen importance in addition to the position evaluation value. The operation screen importance is a value indicating the importance of the operation screen based on the display object information. Specifically, the importance of the operation screen in the operation screen area where the display object is present increases and changes according to the display object information. The target moving distance setting unit 17 can also change the setting of the target moving distance for each section according to the importance of the operation screen. Details will be described later.

2-2. Operation screen dividing unit The operation screen dividing unit 26 divides the operation screen into sections. An example in which the operation screen is divided into sections is shown in FIG. In FIG. 10, the x coordinate and the y coordinate of the operation screen are each divided into four parts and divided into 16 sections. However, the present invention is not limited to this and is equally divided. It is not limited to.

2-3. Target Movement Distance Setting Unit The target movement distance setting unit 17 sets a target movement distance for each section divided by the operation screen dividing unit 26. An example of the target movement distance set for each section by the target movement distance setting unit 17 is shown in FIG. The target moving distance is set for all the sections as shown in FIG. The target movement distance setting unit 17 can also change the setting of the target movement distance of the section according to the importance of the operation screen calculated by the position evaluation value calculation unit 14. As shown in FIG. 11, when there are icons or the like as display objects in the sections (for example, section 1, section 5, and section 9 in FIG. 10) divided by the operation screen dividing unit 26, the display objects exist. The operation screen importance of the operation screen to be increased becomes high. Therefore, the target moving distance setting unit 17 sets the target moving distance short according to the importance of the operation screen. Here, since the coordinate information is acquired in units of dots, the unit of the movement distance and the integrated movement distance is also “dot”. Note that this unit is not limited to “dot”, and the length (for example, inches or cm) on the screen can also be used.

2-4. Capture Image Generation Method Next, a procedure of capture image generation processing executed in the recording apparatus 1 according to the present embodiment will be described. FIG. 12 is a flowchart showing an overall procedure of the captured image generation processing according to the present embodiment. The procedure of the capture image generation process described below is executed by hardware, software (program), or a combination of both constituting each functional unit of the recording apparatus 1 described above.

  First, the operation screen dividing unit 26 divides the area for displaying the operation screen on the monitor 1A for each section (step # 01). Then, the target movement distance setting unit 17 sets a target movement distance for each divided section (step # 02). At this time, it is also possible to set a target movement distance desired by the user by a target movement distance input unit (not shown).

  Next, the position evaluation value calculation unit 14 extracts the cursor position information acquired by the cursor position information acquisition unit 11 (step # 03). And based on the said cursor position information, it is confirmed whether the movement of cursor Cu is a movement to another division. If the movement of the cursor Cu is not a movement to another section (step # 04: Yes), the processing of the subsequent steps is continued. On the other hand, if the movement of the cursor Cu is a movement to another section (step # 04: No), the target movement distance of the section to which the cursor Cu is moved is read and set as the target movement distance (step #). 05). Then, the processing of the subsequent steps is continued. Then, the cursor movement distance calculation unit 15 calculates the movement distance of the cursor Cu based on the cursor position information acquired by the cursor position information acquisition unit 11 (step # 06).

  Next, the travel distance integrating unit 19 counts the accumulated travel distance based on the travel distance calculation result (step # 07), and the travel distance comparing unit 18 uses the obtained accumulated travel distance and the target travel distance setting unit 17. Comparison with the set target movement distance is performed (step # 08). If the integrated movement distance has reached the target movement distance (step # 09: Yes), the capture signal output unit 21 outputs a capture signal to the movement distance integration unit 19 (step # 10). Upon receiving this capture signal, the movement distance integrating unit 19 clears the counted integrated movement distance (step # 11) and continues the process.

  When the capture signal is output from the capture signal output unit 21 to the capture image generation unit 22 (step # 12), the capture image generation unit 22 displays an operation screen corresponding to the cursor position information to which the capture signal is output from the VRAM 25. The captured image is generated by capturing and recorded in the captured image storage unit 23 (step # 13). If the process is not continued (step # 14: Yes), the process ends.

  In step # 09, when the integrated movement distance has not reached the target movement distance (step # 09: No), the position evaluation value calculation unit 14 determines that the cursor Cu is determined from the display object information and the cursor position information. Calculate whether it is on the display. If the cursor Cu is on a predetermined position such as a display object (step # 15: No), the capture signal output unit 21 outputs a capture signal to the capture image generation unit 22 (step # 12). On the other hand, if the cursor Cu is not on the predetermined position (step # 15: Yes), the operation log determination unit 20 extracts the operation log information stored in the operation log information storage unit 12 (step # 16), and the program It is confirmed whether or not it has been activated, and the determination result is output to the capture signal output unit 21. If the program is activated (step # 17: No), the capture signal output unit 21 outputs a capture signal to the captured image generation unit 22 (step # 12). On the other hand, if the program is not activated (step # 17: Yes), the processing is continued from step # 14.

  Here, when the program is not started (step # 17: Yes) and the process is not continued (step # 14: Yes), the operation screen corresponding to the cursor position information that has been finally determined. From the above, a captured image may be generated and recorded in the captured image storage unit 23.

3. Other Embodiments In the above-described embodiment, the display object information has been described as including icon information indicating the coordinates of the icon, task bar information indicating the coordinates of the task bar, and window information indicating the coordinates of the window of the application. However, the scope of application of the present invention is not limited to this. In addition to these, it is naturally possible for the user to specify an arbitrary location on the screen. Even in such a configuration, when the cursor Cu is at the designated position, the capture signal output unit 21 outputs the capture signal according to the position evaluation value calculated by the position evaluation value calculation unit 14. Is possible.

  In the above embodiment, the operation log determination unit 20 checks whether or not there is an operation log indicating the start of the program in the operation log information extracted from the operation log information storage unit 12, and captures the operation log if it exists. It has been described that the signal output unit outputs a capture signal. However, the scope of application of the present invention is not limited to this. In addition to starting the program, it is naturally possible to output a capture signal even when there is an operation log indicating a specific operation such as a file operation such as file deletion, movement or copying.

  In the above embodiment, when the position evaluation value calculation unit 14 calculates that the cursor Cu is positioned on the display object, the operation log determination unit 20 determines that a specific operation such as activation of the application has been performed by the user. In this case, it has been described that a capture signal is additionally output. In this case, since the capture signal is an additional output, it has been described that the accumulated movement distance is not cleared. However, the scope of application of the present invention is not limited to this. Even when it is calculated that the cursor Cu is positioned on the display object, or when it is determined that a specific operation such as activation of the application is performed by the user, the capture signal is output to the movement distance integrating unit 19 and integrated movement is performed. Of course, it is possible to adopt a configuration that clears the distance.

  In the above embodiment, the capture image generation unit 22 has been described as capturing an operation screen in the VRAM 25 and generating a capture image. However, the scope of application of the present invention is not limited to this. For example, instead of the VRAM 25, it is naturally possible to construct a RAM or a storage unit equivalent thereto, and capture the operation screen temporarily stored therein to generate a captured image.

  In the second embodiment described above, the target movement distance setting unit 17 sets the target movement distance to be shorter when there is an icon as a display object in the section divided by the operation screen division unit 26. However, the scope of application of the present invention is not limited to this. For example, it is naturally possible to change the target movement distance according to the number of icons located in the section. Further, the division for each section is not limited to a quadrangle as shown in FIG. 10, but can be performed by a polygon, a circle, or the like.

  In the second embodiment described above, the capture signal is output every time the integrated movement distance reaches the target movement distance set for each section. However, the scope of application of the present invention is not limited to this. For example, it is naturally possible to configure the capture signal to be output when the cursor Cu crosses the section.

  In step # 04 of the flowchart in the second embodiment, it has been described that it is determined whether or not the cursor Cu is moving to another section based on the cursor position information. However, the scope of application of the present invention is not limited to this. For example, it is possible to identify the section from the cursor position information and acquire the target movement distance of the section.

  In the second embodiment, the operation screen dividing unit 26 has been described as dividing the operation screen into a plurality of sections based on the display object. However, the scope of application of the present invention is not limited to this. For example, it can be divided into a display information area where a display object is displayed and an area other than the display information area in the operation screen. As shown in FIG. 13, the area is divided into an area where icons are arranged (referred to as an icon area) and an area excluding the icon area (referred to as a non-icon area). When the cursor Cu is positioned in the icon area, the application or file operation is likely to be performed. Therefore, the target moving distance can be set short, and the non-icon area is divided. A target moving distance can be set for each section. Furthermore, when the icon area becomes larger as shown in FIG. 14 from the state set as shown in FIG. 13, the target moving distance can be reset in the non-icon area. Alternatively, when the area where the display object is displayed changes due to the activation of the application or the like, it is possible to change the section to be divided and the target movement distance accordingly.

  In the second embodiment, it has been described that the target movement distance setting unit 17 changes the setting of the target movement distance of the section according to the operation screen importance. However, the target movement without using the operation screen importance is used. It is also possible to set the distance.

  In the second embodiment described above, the capture image is generated based on the movement distance of the cursor Cu. However, the scope of application of the present invention is not limited to this. For example, the moving distance of the cursor Cu may be replaced with a point value (moving point: P), and a captured image may be generated according to the point value. In such a case, the movement distance coefficient determination unit sets the movement distance coefficient K for each section, and the movement point calculation unit calculates the movement distance coefficient K and the movement distance of the cursor Cu calculated by the cursor movement distance calculation unit 15. Accordingly, for example, a movement point P as indicated by P = K × movement distance is calculated. The value of the movement distance coefficient K may be varied for each section so that the capture signal output unit 21 outputs a capture signal each time a predetermined generation point set in advance is reached. Here, the generation point is an index used for determining the timing for generating the captured image, and corresponds to the target movement distance according to the first embodiment described above. Further, the generation point can be set in advance so as to be constant in the operation screen, and the timing for generating the captured image can be changed by setting the movement distance coefficient K as a parameter for each section. For example, when the movement distance coefficient K = 0.5 is set for a section with low importance, the movement distance coefficient K = 1 is set for a section with high importance, and the generation point is set to 100, the movement point P = When the captured image is generated when the value reaches 100, a captured image is generated every movement distance = 100 in the high importance section, whereas a captured image is generated every movement distance = 200 in the low section. If comprised in this way, the production | generation of a capture image can be decreased compared with a division with low importance in the division with low importance at the same movement distance. Therefore, the recording capacity can be reduced.

  In the second embodiment described above, in step # 14 of the flowchart of FIG. 12, when the process is continued (step # 14: No), the process is continued from step # 03. However, the scope of application of the present invention is not limited to this. For example, it is naturally possible to adopt a configuration in which the processing is continued from step # 01 when the section is changed by starting an application or the like.

The figure which showed the structure of the recording device based on this invention typically 1 is a block diagram schematically showing a schematic configuration of a recording apparatus according to a first embodiment. The figure which showed an example of the operation screen which concerns on 1st embodiment The figure which showed an example of the cursor position information which concerns on 1st embodiment The figure which showed an example of the calculation result of the movement distance of the cursor which concerns on 1st embodiment The figure which showed an example of the counting result of the total movement distance which concerns on 1st embodiment, and the output timing of a capture signal The figure which shows an example of the capture image produced | generated from the operation screen which concerns on 1st embodiment. The flowchart figure for producing | generating a captured image according to the movement distance of the cursor which concerns on 1st embodiment. The block diagram which showed typically the schematic structure of the recording device which concerns on 2nd embodiment. The figure which shows an example which divided | segmented the operation screen for every division The figure which shows an example of the target moving distance set for every division The flowchart figure for producing | generating a captured image according to the movement distance of the cursor which concerns on 2nd embodiment. The figure which shows an example divided | segmented for every division except the icon area | region which concerns on other embodiment. The figure which shows an example which re-divided for every division when the icon area became large

Explanation of symbols

1: recording device 10: display object information storage unit 11: cursor position information acquisition unit 12: operation log information storage unit 14: position evaluation value calculation unit 15: cursor movement distance calculation unit 17: target movement distance setting unit 18: movement distance Comparison unit 19: Movement distance integration unit 20: Operation log determination unit 21: Capture signal output unit 22: Capture image generation unit 23: Capture image storage unit 25: VRAM

Claims (6)

In a recording device that records a captured image generated by capturing an operation screen,
A cursor movement distance calculation unit for calculating a movement distance of the cursor based on cursor position information indicating a cursor position of the pointing device on the operation screen; and a movement distance integration for counting the total movement distance based on the movement distance A capture signal output unit that outputs a capture signal each time the integrated movement distance reaches a set target movement distance, a capture image generation unit that generates a capture image from the operation screen based on the capture signal, A recording apparatus comprising: An operation screen dividing unit that divides the operation screen into sections is provided,
The recording apparatus according to claim 1, wherein the target moving distance is set for each of the sections.   The recording apparatus according to claim 2, wherein the target moving distance is changed according to a display object displayed in a section divided for each section. In a recording device that records a captured image generated by capturing an operation screen,
An operation screen dividing unit that divides the operation screen into sections; a cursor movement distance calculating unit that calculates a movement distance of the cursor based on cursor position information indicating a cursor position of the pointing device on the operation screen; A movement distance coefficient determination unit that determines a movement distance coefficient for each section, a movement point calculation unit that calculates a movement point based on the movement distance and the movement distance coefficient, and a generation in which the movement point is set in advance A capture apparatus comprising: a capture image generation unit configured to generate a capture image from the operation screen based on a signal output timing of a capture signal that is output each time a point is reached. In a program for a recording device for recording a captured image generated by capturing an operation screen,
A cursor movement distance calculation function for calculating a movement distance of the cursor based on cursor position information indicating a cursor position of the pointing device on the operation screen; and a movement distance integration for counting the total movement distance based on the movement distance A capture signal output function for outputting a capture signal each time the integrated travel distance reaches a set target travel distance, a capture image generation function for generating a capture image from the operation screen based on the capture signal, A program for a recording device that causes a computer to execute. In a program for a recording device for recording a captured image generated by capturing an operation screen,
An operation screen dividing function for dividing the operation screen into sections, a cursor movement distance calculating function for calculating a movement distance of the cursor based on cursor position information indicating a cursor position of the pointing device on the operation screen, and A moving distance coefficient determining function for determining a moving distance coefficient for each section, a moving point calculating function for calculating a moving point based on the moving distance and the moving distance coefficient, and generation of the moving point set in advance A program for a recording apparatus that causes a computer to execute a capture image generation function for generating a capture image from the operation screen based on a signal output timing of a capture signal that is output each time a point is reached.

Images