JP2009169530A - Viewer software program and viewer device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a viewer software program and a viewer device for playing back desired screen data more speedily. <P>SOLUTION: Data on the number of key operations for capturing respective captured screen data in sequence, are stored in a key operation count storage unit 205B in association with the respective screen data. A jump processing unit 212 instructs a reproduction unit 211 to reproduce desired screen data based upon data on the number of key operations. If an error occurs, a user is apt to recognize that key operation is not accepted and then the key is operated relatively many times in a short time. When screen data are reproduced so as to verify the cause of the error, screen data to which key is operated relatively frequently is reproduced, and then the desired screen data can be reproduced more speedily. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a viewer software program and a viewer apparatus for reproducing screen data sequentially fetched from a screen displayed on a display means.

  2. Description of the Related Art Conventionally, a photographic print processing system in which a photographic processing apparatus for creating a photographic print and a controller are connected via a network is known. In such a system, image data received at a store reception terminal or a network reception terminal is stored in a mass storage device in units of orders. Similarly, image data read from the developed negative film by the scanner is also stored in the mass storage device in order units. The stored order-unit image data is managed by the controller. The controller transmits the image data to the photo processing apparatus in units of orders in accordance with a print processing order based on an order reception order or a delivery date to a customer. The controller can perform various correction processes on the image data. Examples of the various correction processes include color correction, density correction, red-eye correction, special correction such as backlight correction, and the like. The photo processing apparatus processes image data in order units transmitted from the controller, and creates a photo print. The controller may be configured by a dedicated device, but may be configured by a general-purpose personal computer.

  By the way, in the photo print processing system as described above, a method of acquiring the operation history in the controller by the screen capturing method for the purpose of verifying the operation history of the operator later, the purpose of verifying the cause of the error, the maintenance purpose, etc. Has been proposed. Currently known screen capture software is configured to capture all screen data displayed on a monitor.

  The following Patent Document 1 is known as a data processing device that acquires an operation history. The apparatus disclosed in Patent Document 1 is an operation for accepting an operation history using input means such as a mouse or a keyboard for various software such as basic software for managing basic functions of a computer and application software such as word processing software and a WEB browser. A history acceptance unit, an operation trend data processing unit for performing a predetermined process for knowing a user's operation tendency with respect to the software based on the operation history received by the operation history reception unit, and a predetermined one of the operation trend data processing unit And an operation tendency data output means for outputting operation tendency data indicating the user's operation tendency obtained by the above process. In the case of such an apparatus, an operation history using an input unit such as a mouse or a keyboard is acquired, and an operation history based on screen data displayed on a monitor is not acquired.

JP 2003-177847 A

  As an example of a method of reproducing the screen data captured by the screen capture software, a method of sequentially reproducing each screen data for a predetermined time according to the captured order is conceivable. However, when screen data is played back for the purpose of verifying the cause of the error as described above, each screen data that is played back sequentially is checked one by one, even though only the screen data at the time of the error is to be checked. Must. Therefore, there is a problem that desired screen data cannot be reproduced quickly.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a viewer software program and a viewer apparatus that can reproduce desired screen data more quickly.

  A viewer software program according to the first aspect of the present invention is a viewer software program that reproduces screen data sequentially fetched from a screen displayed on a display means, and that reproduces screen data sequentially. A storage unit that stores data related to the number of key operations performed when sequentially capturing screen data in association with each captured screen data, and a predetermined number based on the data related to the number of key operations. It is made to function as a jump process part which instruct | indicates to the said reproduction | regeneration part to jump and reproduce | regenerate to this screen data.

  According to such a configuration, it is possible to jump to the predetermined screen data and reproduce it based on the data related to the number of key operations performed when the screen data is sequentially fetched. When an error occurs, the user recognizes that the key operation is not accepted, and there is a tendency that the key operation is performed relatively frequently in a short time. Therefore, when playing back screen data for the purpose of verifying the cause of the error, jump to the screen data when the frequency of key operations is relatively high, and play it back to reach the desired screen data more quickly. Can be played.

  Here, the jump means that the screen is not reproduced continuously in order, but the intermediate screen is skipped and skipped to another screen.

  The storage unit includes a screen data storage unit that stores each screen data in association with time, and a key operation frequency data storage unit that stores data related to the number of key operations in association with time. Is preferred.

  According to a second aspect of the present invention, there is provided a viewer software program that causes the computer to function as a key operation display processing unit that displays data related to key operations in association with time on the display means.

  According to such a configuration, by confirming the data related to the key operation displayed on the display means in association with the time, the time when the desired key operation is performed is specified, and the screen data corresponding to the time is displayed. You can jump and play. Therefore, the desired screen data can be reached and reproduced more quickly.

  A viewer software program according to a third aspect of the present invention causes the computer to function as a usage rate data display processing unit that displays usage rate data of a CPU and / or memory in association with time on the display means. It is characterized by.

  According to such a configuration, the CPU and / or memory usage data displayed on the display means in association with the time can be confirmed, and the screen data can be jumped and reproduced based on the result. . When an error occurs, the CPU and / or memory usage rate tends to increase. Therefore, by confirming the usage rate data as described above, specifying a time when the usage rate is relatively high, jumping to the screen data corresponding to the time and playing it, the desired screen data is reached more quickly. Can be played. In particular, not only the data related to the number of key operations performed when screen data is fetched sequentially, but also CPU and / or memory usage data is referenced, so that the desired screen data can be reached more quickly and accurately. Can be played.

  A viewer device according to a fourth aspect of the present invention is a viewer device that reproduces screen data sequentially fetched from the screen displayed on the display means, a playback unit that sequentially reproduces screen data, and each Corresponding to the screen data, a storage unit for storing data related to the number of key operations performed when the screen data is sequentially fetched, and jumping to predetermined screen data based on the data related to the number of key operations And a jump processing unit that instructs the reproduction unit to perform reproduction.

  According to such a configuration, it is possible to provide a viewer device that exhibits the same effect as the viewer software program according to the first aspect of the present invention.

  A viewer device according to a fifth aspect of the present invention includes a key operation display processing unit that causes data related to key operations to be displayed on the display unit in association with time.

  According to such a configuration, it is possible to provide a viewer device that exhibits the same effect as the viewer software program according to the second aspect of the present invention.

  A viewer device according to a sixth aspect of the present invention includes a usage rate data display processing unit that displays usage rate data of a CPU and / or memory in association with time on the display means.

  According to such a configuration, it is possible to provide a viewer device that exhibits the same effects as the viewer software program according to the third aspect of the present invention.

An example of a photographic print processing system suitably applied to the present invention will be described with reference to the drawings.
<Overall system configuration>
FIG. 1 is a schematic diagram showing an example of the overall configuration of a photo print processing system. In the present embodiment, one or more photo processing apparatuses 100 are connected to the controller 200 via a network such as a LAN. The controller 200 is composed of a general-purpose personal computer, and is installed with an application software program for the photo print processing system. This application software program is composed of a combination of an image processing program module, an order management program module, a pre-judge program module described later, and other various modules. Various application software such as word processing software, spreadsheet software, accounting software, and WEB browser software are installed in the controller 200.

  The controller 200 is connected to a scanner 300 that reads image data from a negative film. In addition, a reception terminal 400, a recording device 500, and a network reception terminal 600 are connected to the controller 200 via a network. The number of reception terminals 400, recording devices 500, and net reception terminals 600 is not limited to one each, and a plurality can be installed as necessary. Further, the scanner 300 may be installed in the photo processing apparatus 100.

  The photo processing apparatus 100 has a function of creating a photo print based on the image data transmitted from the controller 200. Examples of the image data include image data of a developed negative film frame image acquired from the scanner 300, image data transmitted from the reception terminal 400 or the like via a network, and the like.

  The reception terminal 400 is installed at a store, for example, and can receive image data stored in a recording medium of a digital camera or other recording media. Examples of the recording medium include CompactFlash (registered trademark), SmartMedia (registered trademark), Memory Stick (registered trademark), CD-R, and DVD-R. The reception terminal 400 is mainly operated by a customer, and may insert a recording medium brought by the customer to select image data to be created as a photo print or set the number of prints. it can. The recording apparatus 500 has a function of writing image data, order data, and the like transmitted from the controller 200 to a recording medium.

  The net reception terminal 600 is constituted by a personal computer and has a function of receiving an online print order via the Internet. Such a print order is accepted via a server 610 installed on the Internet. That is, image data relating to a print order is uploaded from the customer's personal computer 620 to the server 610, downloaded to the network reception terminal 600 at an appropriate timing, and used for print processing. Such systems that accept print orders online are well known.

<Functional block configuration of photo print processing system>
First, main functions of the controller 200 will be described below. The controller 200 is installed with an application software program (hereinafter sometimes referred to as a photo print processing system program) of a photo print processing system used in the photo print processing system.

  As shown in FIG. 1, the photo print processing system program mainly receives order information including image data and order data related to photo print orders from a scanner 300, a reception terminal 400, a recording device 500, a net reception terminal 600, and the like. Data reception processing step (data reception processing unit), order information storage processing step (order information storage processing unit) that stores the received order information in a storage medium (HDD), and addition, change, and deletion of this order information Created in an order management processing step (order management processing unit) that performs management processing such as order order, a pre-judge processing step (pre-judge processing unit) that pre-judges image data in order information, and a pre-judge processing step Based on the pre-judge correction data, An image processing step (image processing unit) for image processing to generate image data for print creation, and a data transmission step (data for transmitting the image data for print creation to the photo processing apparatus side in order units in accordance with the print processing order. And a transmission processing unit). Also, the photo print processing system program includes a processing step for inquiring about the operating status of the photo processing device, a processing step for receiving the operating status of the photo processing device and displaying it on the screen, a step for setting various setting values of the photo processing device, etc. It also has a program function. This photo print processing system program works in cooperation with hardware resources such as the CPU and memory of the installed personal computer, and exhibits its functions.

  Further, as another embodiment, the image processing step is not performed by the controller 200, and the pre-judge correction data and the image data created in the pre-judge processing step are transmitted to the photo processing apparatus side, and are incorporated in the photo processing apparatus. Image processing can also be performed on an image processing board formed of a circuit. Further, the pre-judge processing step is not essential for the image data of all orders, and there is a configuration in which the pre-judge process is omitted. Further, the image data received from the scanner 300 may be data after pre-judge processing.

  In the present embodiment, the pre-judgment process determines whether or not a photo print having an appropriate image quality is created before creating a photo print based on the image data. Provides functionality to do.

  Specifically, the pre-judge process provides a function of inputting correction data for correcting color and density, and the input of such correction data is set as necessary. Examples of other correction data settings include special correction settings such as red-eye correction and backlight correction.

  Also, as the setting of the number of prints, 1 is set by default for the image data acquired from the scanner 300, but it can be changed by an operator's input operation.

  Further, the image data of the order information may be composed of one frame image data or a plurality of frame image data. The order data may include an order ID, orderer identification information, the number of prints for each frame image, print size information for each frame image, and the like.

  Further, the controller 200 includes an input operation unit 230 for various settings, operation instruction inputs, and the like, and a monitor 240 for various setting operation instruction displays. The input operation unit 230 includes a keyboard 231 and a mouse 232. The keyboard 231 includes a large number of keys, and key input can be performed by operating these keys. The mouse 232 is a coordinate input device having a left key and a right key, and the coordinate data on the screen of the monitor 240 is input by moving the mouse 232 to a desired position and operating the left key or the right key. be able to. At this time, the left key and the right key of the mouse 232 function as coordinate input keys selected for inputting coordinate data on the screen of the monitor 240. By using the input operation unit 230 including the keyboard 231 and the mouse 232, it is possible to perform an input operation by selecting from a plurality of keys. Details of the capture software program will be described later, and the configurations of the scanner 300 and the photo processing apparatus 100 will be described below.

  The scanner 300 has a function of acquiring digital image data by scanning a frame image formed on a developed negative film. The read image data is transmitted to the controller 200. There are two scanning methods: press scanning and main scanning. In press scanning, the entire negative film is read once at a low resolution (pre-judgment resolution), and this scanning is performed based on the image data of the press scanning. This is performed after the judgment process, and is read at a high resolution (photo resolution). In this case, the scanner 300 is configured to be connected to a pre-judge processing unit that provides a pre-judge processing function.

  The photo processing apparatus 100 includes a receiving unit 101 that receives print creation image data from the controller 200, and an exposure unit 105 that exposes the received print creation image data to the photographic paper 104 fed out from the magazine 103. The developing unit 106 for developing the exposed photographic paper 104, the drying unit 107 for drying the developed photographic paper 104, and discharging the dried photographic paper 104 while sorting the dried photographic paper 104 And a sorting / discharging unit 108 to be configured. A main control unit 120 for controlling the overall operation of the photo processing apparatus 100 is also provided.

  In the magazine 103, photographic paper 104, which is a photographic photosensitive material, is accommodated in a roll shape. Two magazines 103 can be installed. For example, printing papers having different widths can be set in advance. The long photographic printing paper 104 drawn out from the magazine 103 is cut by a cutting means such as a cutter so as to have a set print size.

  The exposure unit 105 has an exposure engine, receives print creation image data transmitted from the development memory of the image processing board 220, and prints an image on the emulsion surface of the photographic paper based on the print creation image data. Exposure. The exposure engine is not limited to a specific type, and for example, a laser engine, a CRT engine, a PLZT engine, or the like can be used.

  The developing unit 106 performs a developing process on the photographic paper 104 on which the image is printed and exposed, and the drying unit 107 performs a drying process on the developed photographic paper 104. In the sorting discharge unit 108, the finished photographic print is discharged to the outside of the main body of the apparatus, and can be stacked in order units by a predetermined stacking apparatus.

  The photographic paper sensor 109 detects the photographic paper 104 discharged from the sorting discharge unit 108, and detects whether or not all photo prints of a certain order have been discharged. The sensor control unit 110 controls driving of the photographic paper sensor 109 and receives and analyzes a signal from the photographic paper sensor 109. When the sensor control unit 110 detects that all photographic prints for an order have been discharged, the main control unit 120 notifies the controller 200 of the order and sets the order information for the order to the processed management state. Further, it may be configured to be deleted from the storage medium. The photographic processing apparatus 100 is not limited to the above-described configuration, and various configurations such as an inkjet printer and a thermal printer (sublimation printer) can be employed.

(Capture software program)
The function of the capture software program installed in the controller 200 will be described below. This program is recorded in a storage medium, can be provided as a storage medium, and may be provided (provided by downloading) via a communication line. When provided via a communication line, only a part of the functions may be provided, and the other part may remain in the server device.

  FIG. 1 is a functional block diagram showing processing functions of the capture software program.

  Specifically, a count unit 201 that counts a predetermined period, a screen data information acquisition unit 202 that acquires information of active screen data in the screen data displayed on the screen when the predetermined period has arrived, Based on the acquired screen data information, the determination unit 203 determines whether the active screen data is that of the application software to be captured, and the determination unit 203 determines whether the active screen data is to be captured. And a capture unit 204 that captures the active screen data when it is determined that the application software is of the type. The storage unit 205 functions by executing the capture software program or a viewer software program described later, and stores the screen data captured by the capture unit 204. The storage unit 205 is, for example, a large capacity storage medium.

  The captured screen data is preferably compressed and stored. A known compression algorithm can be applied, and examples thereof include a run length compression method, a PIC compression method, JPEG compression, PNG compression, and GIF compression. In such a case, the capture software program has a compression processing function (compression unit 207) and causes the computer to execute the compression processing step.

  In addition, a capture condition setting unit 206 for setting capture conditions is provided. The capture condition setting unit 206 can set various capture conditions. Examples of the capture conditions include setting a capture pattern, specifying a folder for outputting capture data, the number of files to be output, and the output size of one file. Examples are the designation (capacity for storing capture data based on the number of files and the file size), the timing of capture processing, and the like. Details of these will be described later.

(Capture method)
The processing method of the capture unit 204 will be described below. As a first method, there is a method of acquiring the image data in the active window screen as it is. In this method, only the image data of the active window screen is cut out and acquired from the desktop screen displayed on the monitor, and other image data is not acquired. In this case, it is preferable to store the relative position coordinates of the active window screen with respect to the desktop screen. By storing the relative position coordinates, the position of the screen captured during playback can be accurately reproduced.

As a second method, only the difference data from the previously captured screen data is captured. Since only the difference data is captured, the amount of data stored in the storage unit 205 can be reduced when there is no change in the screen data or when there is little change. In this case, it is necessary to expand the difference data during reproduction. The following method is illustrated as a method of taking in difference data.
(1) At the first capture, the color of the monitor display portion (desktop screen, inactive window screen, icon, task bar, etc.) other than the active window screen is set to black as shown in FIG. Capture the display area. The captured display area is defined as frame 1.
(2) At the second and subsequent captures, the color of the monitor display portion other than the active window screen is set to black as shown in FIG. 11, and the entire display area displayed on the monitor is captured. Let the captured display area be frame 2. Then, the difference between the image data acquired this time (frame n) and the image data acquired last time (frame (n−1)) is taken, and only the difference data is associated with the previous image data and stored. By repeating the above processing, difference data based on the screen data captured immediately before can be accumulated. The difference is an image change point. As shown in FIG. 11, when the difference between frame 1 and frame 2 is taken, the shaded portion is the change point of the image, and the white portion is the portion where the image does not change. Difference data that is a hatched portion is stored in association with the immediately preceding image data.

(Operation flowchart)
Next, the processing flow of the capture software program will be described below with reference to FIG. The controller 200 is composed of a personal computer, and this personal computer is an environment that operates on a Microsoft (registered trademark) window system (for example, Microsoft Windows (registered trademark) 2000, XP, VISTA (registered trademark)). It goes without saying that other window systems such as Mac OS and X Window System may be used.

  When the OS is started by the controller 200, a desktop screen 300 is displayed as shown in FIG. On this desktop screen 300, startup file icons of various application software are displayed. The activation file icon 301 of the capture software program is selected and executed (S1). When executed, an icon 302 is displayed on the task bar, for example, as shown in FIG. The capture state can be identified by the color of the icon. For example, if the icon background color is light blue, it is temporarily stopped, if it is red, it is being captured, and if it is orange, it indicates that a capture error has occurred. When a capture error occurs, for example, a file may not be output to a storage medium (for example, a hard disk) for storing captured screen data. As an initial setting, the capture function may be automatically started by executing the startup file, or may be paused.

  After execution of the startup file (S1), it is determined whether or not the capture function is in an ON state (S2). When not in the ON state, the capture function is in the primary stop state. In order to turn on the capture function, by clicking the icon 302 on the task bar shown in FIG. 3A, the menu 303 is displayed as shown in FIG. You can start the capture function by selecting. In this menu 303, in addition to “capture start”, for example, “capture end” (capture stop function), “setting” (capture condition setting function), “software end” (capture software program This is a function to end, and can be executed only after the capture ends).

  Further, it is determined whether or not “setting” is selected in the primary stop state (S10). If “SETTING” is selected, the capture condition can be set in step S11. “Setting” is a function of the capture condition setting unit 206, and is configured so that a condition can be set when capturing is not in progress. Note that although there are cases where recommended conditions are set in advance, the capture conditions can be set as appropriate depending on the convenience of the photo shop where the photo print processing system is installed, the processing capacity of the personal computer used as the controller 200, the hard disk capacity, and the like. It is the structure which can be customized to various user conditions.

(Capture condition setting)
The setting of capture conditions will be described below. FIG. 4 shows an example of the capture condition setting screen 400. “Capture pattern selection 401” is a box for setting a pattern to be used. Already set patterns are displayed in the combo box. When a new pattern is set, a new name is input and saved. Saving is confirmed by pressing “Regist 418”.

  In the “output folder 402” in the file setting column, a destination folder for storing captured image data (hereinafter sometimes referred to as captured image data) is designated. The folder list can be displayed and selected with the button on the right side of the box. In “number of output files 403”, the number of files to be output is set. In “Output file size 404”, the output size of one file is designated. When the size specified here is exceeded, the file is switched to the next file and output. A value obtained by multiplying “number of output files 403” and “output file size 404” is a capacity for storing the captured image data. Therefore, it is possible to make settings according to the capacity of the large-capacity storage medium (for example, hard disk) of the storage unit 205.

  By checking the “automatic capture start 405” check box, the capture processing can be automatically started when the capture software program is started. Various modes are set in “capture mode 406” in the capture information column.

  “Cycle 407” in the capture information column is a setting for controlling the cycle timing of the capture process. It is determined whether or not processing is necessary for each numerical value designated here. In “capture level 408”, the number of parent screens of active windows to be captured is set.

  In “timing 409” of the screen capture column, a sampling count value for capture processing is set. Screen data is captured at a time timing of a value obtained by multiplying the numerical value set in the “cycle 407” by the sampling count value set here. In the case of the setting shown in FIG. 4, the screen data is captured every 1 second, which is a value obtained by multiplying 100 ms by 10. Further, the screen data can be sampled at a timing other than the above timing. For example, the screen data can be obtained by pressing a mouse button or a keyboard.

  In “storage size 410” of the screen capture column, a size to be stored when the acquired screen data is stored is set. If the image is saved with a large screen, the image at the time of reproduction is beautiful, but the amount of data to be saved increases, so the period that can be retained as a log is shortened. The image data is compressed according to the designated storage size. In “color number setting 411”, the number of colors to be stored when the acquired screen data is stored is set. The larger the number, the more the original color number is retained, but the more data is stored.

  When the “mouse 412” check box is checked, a mouse operation log is saved. The mouse operation log is linked to the acquired image data. When the “keyboard 413” check box is checked, a keyboard operation log is saved. The keyboard operation log is linked to the acquired image data. When the check box of “drive 414” is checked, the drive change log is saved. The drive change log is linked to the acquired image data.

  When the “CPU / MEMORY 415” check box is checked, a CPU usage log (recording of usage rate data) and a memory usage log (recording of usage rate data) are saved. Sampling is performed at a time timing of a value obtained by multiplying the numerical value (100 ms) set in the “cycle 407” and the numerical value (10) set here. When the check box of “Network 416” is checked, the network status log is saved. Sampling is performed at a time timing of a value obtained by multiplying the numerical value (100 ms) set in the “cycle 407” and the numerical value (600) set here. If the check box of “Process 417” is checked, the process status log is saved. Sampling is performed at a time timing of a value obtained by multiplying the numerical value (100 ms) set in the “cycle 407” and the numerical value (600) set here.

  Next, the capture process will be described. When the capture function is started, in step S3, a predetermined period is counted using a timer function in the personal computer (S3, count step). The period of the capture timing is set by the above capture condition setting.

  Next, when the predetermined period has arrived (S4), information on active screen data is acquired (S5, screen data information acquisition processing step). For example, the window handle of the active screen is acquired. The execution module name is acquired from the acquired window handle. This is because the window handle and the execution module name are linked by the CPU. The window handle includes the title name of the screen, and the title name is read from the acquired window handle and stored in the storage unit 205 in association with each screen data.

  Next, it is determined whether or not the acquired screen data information (execution module name here) is for the application software to be captured (S6, determination processing step). The application software to be captured is stored in advance in a memory or the like, and here are various execution modules of the above-described photo print processing system program.

  When it is determined that the acquired screen data information is for the application software to be captured, the active screen data is captured (S7, capture processing step). The above-described method can be applied as a specific capture method. If it is determined in step S6 that the application software is not to be captured, the capture process is not performed and the process returns to step S4. That is, at this timing, screen data is not captured, and capture screen data does not exist.

  Note that “the screen is active” means that an input operation is possible only on that screen. FIG. 5 shows an example in which the screen of the photo print processing system program is active. The window screen in the center of the screen is a screen example (pre-judge screen example) of the photo print processing system program and indicates that it is active. The screen of other application software is inactive and is only displayed on the task bar in the lower area of the screen or hidden behind the pre-judge screen background.

  FIG. 5 shows an active pre-judge screen 51. When this pre-judge screen 51 is captured, other screen data other than this pre-judge screen in the desktop screen is captured as black, the difference (image change point) from the immediately preceding frame is taken, and the difference data is captured immediately before the screen. Link with data. Next, when the active order management screen 61 as shown in FIG. 6 is fetched, the screen data other than this order management screen in the desktop screen is also taken in as black, and the frame immediately before that (the pre-order of FIG. 5) is taken. A difference is obtained from the desktop screen including the judge screen 51), and the difference data is linked to the previous screen data. Thereby, it is possible to capture only data in an image area different from the immediately preceding image area.

  The captured screen data is compressed by the compression unit 207 and stored in the storage unit 205 (S8, storage processing step). At this time, the time when each screen data is captured is stored in the storage unit 205 in association with each screen data. Although the compression process is not essential, it is preferable to perform the compression process from the viewpoint of securing the capacity of the storage medium.

  In the present embodiment, the storage unit 205 stores not only screen data but also the number of key operations, usage rate data, and the like in association with each time. The number of key operations is the number of operations of a plurality of keys provided in the input operation unit 230, and is associated with each period (each time range) when a period during which capture is performed is divided into a plurality of periods. The number of key operations during the period is stored. At this time, the sum of the number of times of operation of all keys in each period may be stored, or the number of times of key operations may be stored separately for each type of key.

  The configuration is not limited to the configuration in which the number of operations is stored for all the keys provided in the operation input unit 230, but the configuration is such that the number of operations only for a specific key such as the left key of the mouse 232 is stored. Also good. The time range may be a time range in which adjacent screen data is captured. In this case, the number of key operations can be stored in association with the time when each screen data is captured.

  The usage rate data is usage rate data of a CPU or a memory included in the controller 200. These usage rate data are useful data for grasping the operation status of the controller 200. Of these usage data, a configuration in which only one of the CPU usage data or the memory usage data may be stored, or a configuration in which both usage data is stored. It may be.

  Here, although the usage rate data is stored, the usage rate data is stored in accordance with the timing of storing the screen data. However, instead of always saving the usage rate data when saving the screen data, the screen data may be saved once every several times. Further, the usage rate data may be stored at a predetermined timing, for example, every predetermined time, regardless of the timing at which the screen data is captured. Further, the CPU usage rate data and the memory usage rate data may be stored at the same time, or may be selected and stored. In that case, the timing for storing the usage rate data may be set to be different.

  As the storage medium of the storage unit 205, a hard disk capable of storing a large amount of data is preferable. The amount of saved data that can be saved in the storage medium is set in advance. When the amount of saved screen data reaches that saved data amount, the old screen data is deleted, and the amount of saved data in the storage medium is kept constant. It is preferable to maintain the following so as not to cause a problem that the capture screen data is not saved. Further, when the capture screen data amount reaches the storage data amount, the capture screen data stored in the storage medium can be transferred to a medium (CD-ROM, MO, etc.) to secure a storage area of the storage medium.

  As described above, the capture process can be stopped by displaying a menu from the icon on the task bar and selecting “pause”. In addition, it is possible to set a capture process start time and an end time in advance, automatically start from the start time, and automatically stop temporarily when the end time arrives. In addition, it is possible to set a capture process end period and automatically stop after a certain period from the capture start time.

  According to the above embodiment, when the application software to be captured is active and the screen is active, the screen data can be captured, and the screen data of other application software can be captured. Absent. Therefore, even if personal information and trade secrets are included in the screen data of other application software, such information will not be captured, so there will be no legal issues, and operation history acquisition using screen capture will not occur. Is possible.

  Further, as shown in FIG. 7, when capturing screen data set in a parent-child relationship such as a pre-judge screen and a message screen, both screen data may be captured. When it is determined that the message screen is active, the pre-judge screen of the parent screen is also captured at the same time. The parent-child relationship can be set as appropriate, and is not limited to the pre-judge screen and the message screen. As the setting of the parent-child relationship, for example, an order management screen and a message screen, an order management screen and an error message screen, various operation screens and a message screen, various operation screens and an error message screen can be appropriately set.

  However, the capture method by the capture software program is not limited to the above method, and various methods other than the above method can be adopted. For example, the configuration is not limited to capturing image data of an active window screen from within the desktop screen, but may be configured to capture image data of the entire desktop screen.

(Capture screen data playback process)
Image data captured by the capture software program can be displayed by the viewer software program. When the viewer software program is activated, a window in the simple display mode shown in FIG. 8 is displayed. By selecting “display mode switching” from the menu item “window”, the detailed display mode window shown in FIG. 9 can be displayed. In the detailed display mode, two windows are displayed: a view window for displaying image data and a playback function operation / various log display screen window.

  Next, a reproduction method will be described. First, FIG. 10 shows an example of screen data reproduced in the simple display mode. The item “file” in the menu of FIG. 8 is selected to display the menu. Select "Open File" in the menu, and select the file you want to play from the list of files that store the captured screen image data. When a file is selected, the file is read from the storage medium into the main memory, and playback is started. The screen at the center of the window in FIG. 10 shows the captured screen that has been reproduced. The mouse cursor is also captured. If the captured image data is compressed, it is decompressed and played back. If stored as difference data, a process of expanding the difference data is performed.

  In FIG. 10, a bar 81 at the bottom of the display window and an inverted triangle mark on the bar 81 indicate which position of the file being reproduced is displayed. In the lower part of the bar 81 at the bottom of the window, a time 82 (local time of the captured computer) when the currently displayed screen data is captured and its date 83 are displayed. On the right side of the time 82, a playback / primary stop button (a function button that switches between playback and pause when the button is pressed), a button 84 for moving a predetermined amount from the current position, a playback speed setting bar 85, and the like are displayed. .

(Viewer software program)
The functions of the viewer software program installed in the controller 200 will be described below. This program is recorded in a storage medium, can be provided as a storage medium, and may be provided (provided by downloading) via a communication line. When provided via a communication line, only a part of the functions may be provided, and the other part may remain in the server device.

(Embodiment 1)
In the first embodiment, the screen data sequentially acquired by the method of acquiring the image data in the active window screen as it is by the function of the capture software program (the first method) is used as the viewer software program according to the first embodiment. A configuration for reproducing by function will be described. FIG. 1 is a functional block diagram showing processing functions of the viewer software program. Specifically, a scene jump is performed by instructing the playback unit 211 to sequentially jump to a predetermined screen data and play based on data related to the number of key operations based on the playback unit 211 that sequentially plays back screen data. , A key operation display processing unit 215 that displays data related to key operations in association with time on the monitor 240, and a usage rate data display that displays usage rate data in association with the time on the monitor 240. And a processing unit 216. The scene jump means that the screen is not reproduced continuously in order, but the intermediate screen is skipped and skipped to another screen. The scene jump function is a function for thinning out and displaying screen data that is sequentially fetched, and can also be called a cueing function.

  In the following description, the case where a scene jump is executed by directly using the value of the number of key operations as the data regarding the number of times of the key operations will be described. However, the present invention is not limited to such a configuration. It is also possible to execute a scene jump using other data relating to the number of times. In this case, instead of the number of key operations, other data regarding the number of key operations such as the frequency of key operations may be stored in the storage unit 205 in association with the time. Note that the frequency of the key operation means the number of key operations per predetermined time.

(Scene jump method)
FIG. 12 is a diagram showing in more detail functional blocks regarding processing functions of the viewer software program in the first embodiment. This example shows a case in which screen data is sequentially captured from the screen displayed on the monitor 240 by the method of saving the image data in the active window screen as it is (the first method described above). Each screen data captured in this way is stored in the screen data storage unit 205A that constitutes a part of the storage unit 205 in association with the time when the screen data was captured. The time may be an absolute time or a relative time.

  In addition to the screen data storage unit 205A, the storage unit 205 includes a key operation frequency storage unit 205B that stores key operation frequency in association with time, and a usage rate that stores usage data in association with time. A data storage unit 205C is assigned. In this example, the key operation count storage unit 205B stores the key operation count in association with the time when each screen data was captured. The usage rate data storage unit 205C stores usage rate data of both the CPU and the memory in association with the time when each screen data is captured. As described above, the number of key operations stored in the key operation count storage unit 205B and the usage rate data stored in the usage rate data storage unit 205C are stored in the screen data storage unit 205A via the time. Corresponding to each stored screen data.

  The reproduction unit 211 reproduces the screen data by switching each screen data stored in the screen data storage unit 205 </ b> A to a window on the monitor 240 at regular intervals and sequentially displaying the screen data according to the associated time. To do. The predetermined time can be changed by operating the playback speed setting bar 85.

  The jump processing unit 212 includes a jump point determination unit 212B and a jump instruction unit 212C, and starts a scene jump based on the operation of the input operation unit 230. The jump point determination unit 212B determines screen data (jump point) to be reproduced after a scene jump based on the number of key operations stored in the key operation number storage unit 205B. More specifically, the number of key operations stored in the key operation count storage unit 205B in association with each time is used as the jump point threshold value stored in advance in the threshold storage unit 205D constituting a part of the storage unit 205. The screen data at the time corresponding to the specific number of key operations is determined as a jump point.

  As the jump point threshold, the ratio (%) of the screen data occupying the top in the order of the number of key operations at each time among the screen data corresponding to each time, or the key at each time among the screen data corresponding to each time For example, the number of screen data that occupies the upper order in the descending order of the number of operations. When the ratio (%) of the screen data occupying the upper order in the descending order of the number of key operations at each time among the screen data corresponding to each time is adopted as the jump point threshold value, it is within the preset ratio. The number of key operations corresponding to the screen data located at the lowest position is determined as the reference operation number, and the screen data corresponding to the number of key operations equal to or higher than the reference operation number is determined as the jump point. On the other hand, when the number of screen data that occupies the upper order in the descending order of the number of key operations at each time among the screen data corresponding to each time is adopted as the jump point threshold, it is within the range of the number set in advance. The key operation count corresponding to the screen data located at the lowest position is determined as the reference operation count, and the screen data corresponding to the key operation count equal to or higher than the reference operation count is determined as the jump point.

  The jump point threshold value can be changed by the user operating the input operation unit 230. However, the jump point threshold value is not limited to the above value, and for example, it is possible to directly set the reference operation count.

  The jump instruction unit 212C instructs the reproducing unit 211 to reproduce the screen data from the jump point determined by the jump point determining unit 212B. When the reproducing unit 211 reproduces the screen data based on the instruction from the jump instruction unit 212C, it is possible to jump to the screen data corresponding to the jump point and reproduce it without reproducing one or more screens.

  The key operation display processing unit 215 associates information related to key operations (hereinafter referred to as “key operation information”) with the time based on the number of times each key is operated at each time stored in the key operation number storage unit 205B. In addition, it is displayed on the monitor 240. Therefore, by confirming the key operation information displayed on the monitor 240 and inputting the time corresponding to the desired key operation using the input operation unit 230, the screen data corresponding to the time is jumped to be reproduced. Can do.

  In this example, when key operation information is displayed on the monitor 240 by the key operation display processing unit 215, the usage rate data display processing unit 216 uses the CPU and memory stored in the usage rate data storage unit 205C. The rate data is displayed on the monitor 240 in association with the time. Therefore, by confirming the usage rate data displayed on the monitor 240 and inputting the time corresponding to the desired usage rate data using the input operation unit 230, the screen data corresponding to the time is jumped to be reproduced. You can also.

  In the present embodiment, it is possible to jump to the predetermined screen data and reproduce it based on the data related to the number of key operations performed when the screen data is sequentially fetched. When an error occurs, the user recognizes that the key operation is not accepted, and there is a tendency that the key operation is performed relatively frequently in a short time. Therefore, when playing back screen data for the purpose of verifying the cause of the error, jump to the screen data when the frequency of key operations is relatively high, and play it back to reach the desired screen data more quickly. Can be played.

  FIG. 13 is a diagram illustrating an example of a display mode of information related to key operations displayed on the monitor 240. In this example, a graph in which the horizontal axis is time and the vertical axis is a key code is displayed on the monitor 240. That is, in association with each time, a point is displayed at a position corresponding to the type information (key code) of the key operated at that time, thereby confirming which key is operated at which time. It can be done. Further, for example, if there is a point at a random position on the graph, it can be estimated that the key is pressed at random due to a screen lock or the like. If the color of the point displayed on the graph is changed between the key provided on the keyboard 231 and the key provided on the mouse 232, confirmation of the key operation becomes easier.

  According to such a configuration, by confirming the data related to the key operation displayed on the monitor 240 in association with the time, the time when the desired key operation is performed is specified, and the screen data corresponding to the time is displayed. You can jump and play. Therefore, the desired screen data can be reached and reproduced more quickly. However, the data related to the key operation is not limited to the key code of the operated key, and may be other data.

  FIG. 14 is a diagram illustrating an example of a display mode of usage rate data displayed on the monitor 240. In this example, the CPU usage rate is displayed in the display area 90 and the memory usage rate is displayed in the display area 91. In either case, the horizontal axis represents time, and the vertical axis represents the usage rate.

  The usage rate of the CPU is displayed in the form of a graph as shown in the figure, and the bar 92 corresponds to the display position of the current screen data (the screen displayed in the view window). The vertical axis is displayed as%, and the usage rate at the current position is displayed as 47%. The usage rate is also displayed by the bar 94.

  The memory usage rate is also displayed in the form of a graph as shown in the figure, and the bar 93 corresponds to the display position of the current screen data. The vertical axis is displayed in MB, and the usage rate at the current position is displayed as a number of 215 MB. The usage rate is also displayed by a bar 95.

  According to such a configuration, it is possible to check the CPU and memory utilization data displayed on the monitor 240 in association with the time, and to jump and reproduce the screen data based on the result. When an error occurs, the CPU or memory usage rate tends to increase. Therefore, by confirming the usage rate data as described above, specifying a time when the usage rate is relatively high, jumping to the screen data corresponding to the time and playing it, the desired screen data is reached more quickly. Can be played. However, the present invention is not limited to the configuration in which the usage rate data of both the CPU and the memory is displayed on the monitor 240, and may be a configuration in which only one usage rate data is displayed on the monitor 240.

  FIG. 15 is a flowchart illustrating an example of processing when a scene jump is executed by an operation of the input operation unit 230. When the scene jump is executed, first, key operation information as shown in the example of FIG. 13 is displayed on the monitor 240 based on the key operation frequency of each key stored in the key operation frequency storage unit 205B in association with the time. Is displayed as a graph (step S101). Further, based on the usage rate data stored in association with the time in the usage rate data storage unit 205C, usage rate data as shown in the example of FIG. 14 is displayed in a graph on the monitor 240 (step S102).

  Thereafter, the number of key operations corresponding to the next screen data is referred to the screen data when the scene jump is executed (step S103), and whether or not the number of key operations is within a range corresponding to the jump point threshold value. That is, it is determined whether or not the number of key operations is equal to or greater than the reference number of operations (step S104). At this time, if the number of key operations is not equal to or greater than the reference number of operations (NO in step S104), the number of key operations corresponding to the next screen data is referred to (step S103). Until it is determined that the number of operations is equal to or greater than the number of operations (YES in step S104), the processes in steps S103 to S104 are repeated.

  If it is determined that the number of key operations is equal to or greater than the reference number of operations (YES in step S104), screen data corresponding to the number of key operations is determined as a jump point (step S105), and screen data up to the jump point is determined. The reproduction unit 211 is instructed to reproduce from the screen data corresponding to the jump point without reproducing (step S106). The processes in steps S103 to S106 are repeated until the reproduction by the reproducing unit 211 is completed (until YES in step S107).

  In this example, the configuration in which the reference operation count based on the jump point threshold is determined as a relative value in relation to the key operation count at each time has been described. The configuration may be determined as an absolute value. For example, a configuration in which the value of the reference operation count is directly set as the jump point threshold value may be used.

(Embodiment 2)
In the first embodiment, the screen data sequentially acquired by the method of acquiring the image data in the active window screen as it is (the first method described above) by the function of the capture software program is used as the viewer software program according to the first embodiment. The configuration for reproducing by function has been described. On the other hand, in the second embodiment, the screen data sequentially captured by the method of saving the difference data between the screen data (the second method described above) by the function of the capture software program is used as the viewer according to the second embodiment. The difference is that a configuration is adopted in which playback is performed according to the function of the software program.

  FIG. 16 is a diagram showing in more detail functional blocks regarding processing functions of the viewer software program in the second embodiment. In the second embodiment, screen data (initial screen data) is saved at the time of the first capture and is captured at the time of the second and subsequent captures to the screen data storage unit 205A constituting a part of the storage unit 205. Difference data between the image data (frame n) and the previously captured image data (frame (n-1)) is sequentially stored. The initial screen data and the difference data are stored in association with the time when each screen data is captured. The time may be an absolute time or a relative time.

  The reproduction unit 211 displays the initial screen data stored in the screen data storage unit 205A in a window on the monitor 240, and then sequentially expands each difference data according to the associated time and is already displayed. Each difference data developed on the screen data is sequentially added. As a result, different screen data can be switched at regular time intervals and displayed sequentially to reproduce the screen data. The predetermined time can be changed by operating the playback speed setting bar 85. Other configurations and functions such as the jump processing unit 212 are the same as those of the first embodiment, and the processing performed at the time of scene jump is also the same as the example of FIG.

(Embodiment 3)
The viewer software program of the present invention is not limited to a form installed in the controller 200 and activated by the operator on the controller 200. For example, starting the viewer software program from a computer (including a portable computer, a general-purpose personal computer, a workstation, and a server device) connected to the controller 200 via a network (including Internet connection). it can. Further, the screen data or difference data stored in the storage unit 205 can be transmitted to the computer via a network. Further, instead of transmitting screen data or difference data to the computer via a network, a storage medium storing the screen data or difference data is received by a delivery service such as mail, or directly received at a store, and stored in the store. Processing by a viewer software program can also be performed using screen data or difference data read from a medium into the computer.

  The viewer software program can also be configured as a module constituting the photo print processing system program. In such a case, the photo print processing system program can be started and the viewer software program can be started from the operation screen. Other components can be realized by the same components as described above.

(Embodiment 4)
(Viewer device)
The viewer device according to the fourth embodiment stores a data relating to the number of key operations performed when sequentially capturing screen data in association with each captured screen data and a playback unit that sequentially reproduces screen data. A storage unit; and a jump processing unit that instructs the reproduction unit to jump to and reproduce the predetermined screen data based on the data related to the number of key operations. Moreover, you may further have the key operation display process part which matches the data regarding key operation with time, and displays it on the said display means. Moreover, you may have further the utilization rate data display process part which matches the utilization rate data of CPU and / or memory with a time, and displays it on the said display means. These details are as described above.

  The viewer device can be incorporated as a dedicated circuit board board in a personal computer in which application software for the photo print processing system is installed, or can be connected to the personal computer via a network. The viewer device or dedicated circuit board can be configured with dedicated circuits as described above, or can be configured with the cooperation of hardware resources such as CPU and memory and various software programs, and is configured with firmware. You can also

  Further, the screen data reproduced by the viewer device can be captured by the capture software program as described above, and the viewer device may have this capture software function. Further, the captured image data can be transmitted to a computer connected to a network and reproduced on the computer using viewer software.

  In the above embodiment, the configuration has been described in which the capture software program and the viewer software program are executed in the photo print processing system, or the capture device and the viewer device are provided in the photo print processing system. The present invention is not limited to this, and can be applied to various systems and apparatuses other than the photo print processing system.

Diagram for explaining the functional configuration of the photo print processing system Operation flowchart of capture processing Diagram for explaining the capture software execution screen Illustration for explaining the capture condition setting screen Diagram for explaining the capture software execution screen Diagram for explaining capture screen data Diagram for explaining the capture software execution screen Diagram for explaining the execution screen of the viewer software Diagram for explaining the execution screen of the viewer software Diagram for explaining the execution screen of the viewer software Diagram for explaining the capture method The figure which showed further in detail the functional block about the processing function of the viewer software program in Embodiment 1. The figure which showed an example of the display mode of the information regarding the key operation displayed on a monitor The figure which showed an example of the display mode of the usage rate data displayed on the monitor The flowchart which showed an example of the process when a scene jump is performed by operation of an input operation part The figure which showed the functional block about the processing function of the viewer software program in Embodiment 2 in more detail

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Photo processing apparatus 200 Controller 201 Count part 202 Screen data information acquisition part 203 Judgment part 204 Capture part 205 Storage part 206 Capture condition setting part 207 Compression part 211 Playback part 212 Jump process part 215 Key operation display process part 216 Usage rate data display Processing part

Claims (6)

A viewer software program for playing back screen data captured sequentially from the screen displayed on the display means,
Computer
A playback unit for sequentially playing back screen data;
A storage unit that stores data relating to the number of key operations performed when sequentially capturing screen data in association with each captured screen data;
A viewer software program that functions as a jump processing unit that instructs the reproduction unit to jump to and reproduce predetermined screen data based on data relating to the number of key operations. The computer,
The viewer software program according to claim 1, wherein the viewer software program functions as a key operation display processing unit that displays data related to key operations in association with time on the display means. The computer,
3. The viewer software program according to claim 1, wherein the viewer software program functions as a usage rate data display processing unit that causes the usage rate data of the CPU and / or memory to be displayed on the display unit in association with time. A viewer device that reproduces screen data sequentially fetched from a screen displayed on a display means,
A playback unit for sequentially playing back screen data;
A storage unit that stores data relating to the number of key operations performed when sequentially capturing screen data in association with each captured screen data;
A viewer apparatus, comprising: a jump processing unit that instructs the playback unit to jump to a predetermined screen data for playback based on data relating to the number of times of key operations.   The viewer apparatus according to claim 4, further comprising a key operation display processing unit that causes the display unit to display data related to key operations in association with time.   6. The viewer apparatus according to claim 4, further comprising a usage data display processing unit that displays usage data of the CPU and / or memory in association with time on the display means.

Images