JP2009169529A - Capture software program, capture device, viewer software program, and viewer device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a capture software program, a capture device, a viewer software program, and a viewer device for playing back desired screen data more speedily. <P>SOLUTION: Selection order of a plurality of keys selected in sequence until respective captured screen data are displayed in association with the screen data, is stored in a screen data storage unit 205A. An input reception unit 213 receives input of selection order of a plurality of keys, screen data stored in the screen data storage unit 205A are retrieved based upon the input selection order, and a reproduction unit 211 receives an instruction to reproduce predetermined screen data based upon the retrieval results. Thus, desired selection order is input and desired screen data can be played back more speedily. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a capture software program and a capture device for sequentially capturing screen data from the screen displayed on the display means, and a viewer software program for reproducing the screen data sequentially captured from the screen displayed on the display means, and The present invention relates to a viewer device.

  2. Description of the Related Art Conventionally, a photographic print processing system in which a photographic processing apparatus for creating a photographic print and a controller are connected via a network is known. In such a system, image data received at a store reception terminal or a network reception terminal is stored in a mass storage device in units of orders. Similarly, image data read from the developed negative film by the scanner is also stored in the mass storage device in order units. The stored order-unit image data is managed by the controller. The controller transmits the image data to the photo processing apparatus in units of orders in accordance with a print processing order based on an order reception order or a delivery date to a customer. The controller can perform various correction processes on the image data. Examples of the various correction processes include color correction, density correction, red-eye correction, special correction such as backlight correction, and the like. The photo processing apparatus processes image data in order units transmitted from the controller, and creates a photo print. The controller may be configured by a dedicated device, but may be configured by a general-purpose personal computer.

  By the way, in the photo print processing system as described above, a method of acquiring the operation history in the controller by the screen capturing method for the purpose of verifying the operation history of the operator later, the purpose of verifying the cause of the error, the maintenance purpose, etc. Has been proposed. Currently known screen capture software is configured to capture all screen data displayed on a monitor.

  The following Patent Document 1 is known as a data processing device that acquires an operation history. The apparatus disclosed in Patent Document 1 is an operation for accepting an operation history using input means such as a mouse or a keyboard for various software such as basic software for managing basic functions of a computer and application software such as word processing software and a WEB browser. A history acceptance unit, an operation trend data processing unit for performing a predetermined process for knowing a user's operation tendency with respect to the software based on the operation history received by the operation history reception unit, and a predetermined one of the operation trend data processing unit And an operation tendency data output means for outputting operation tendency data indicating the user's operation tendency obtained by the above process. In the case of such an apparatus, an operation history using an input unit such as a mouse or a keyboard is acquired, and an operation history based on screen data displayed on a monitor is not acquired.

JP 2003-177847 A

  As an example of a method of reproducing the screen data captured by the screen capture software, a method of sequentially reproducing each screen data for a predetermined time according to the captured order is conceivable. However, when screen data is played back for the purpose of verifying the cause of the error as described above, each screen data that is played back sequentially is checked one by one, even though only the screen data at the time of the error is to be checked. Must. Therefore, there is a problem that desired screen data cannot be reproduced quickly.

  The present invention has been made in view of the above circumstances, and provides a capture software program and a capture device, and a viewer software program and a viewer device for enabling desired screen data to be reproduced more quickly. For the purpose.

  A capture software program according to a first aspect of the present invention is a capture software program that sequentially captures screen data from a screen displayed on a display means, and selects a computer from a plurality of keys to perform an input operation. And an input operation unit and a storage unit that stores the selection order of the plurality of keys that are sequentially selected until the screen data is displayed in association with each captured screen data. And

  According to such a configuration, it is possible to save the selection order of a plurality of keys that are sequentially selected until the screen data is displayed in association with each captured screen data. If the screen data is reproduced based on the selection order stored in this manner, desired screen data can be reproduced more quickly by inputting the selection order.

  A capture device according to a second aspect of the present invention is a capture device that sequentially captures screen data from a screen displayed on a display means, and an input operation unit for selecting and performing an input operation from a plurality of keys A storage unit that stores the selection order of the plurality of keys that are sequentially selected until the screen data is displayed in association with each screen data that has been captured.

  According to such a configuration, it is possible to provide a capture device that has the same effect as the capture software program according to the first aspect of the present invention.

  A viewer software program according to a third aspect of the present invention is a viewer software program that reproduces screen data sequentially fetched from a screen displayed on a display means, and that reproduces screen data sequentially. A storage unit that stores the selection order of a plurality of keys that are sequentially selected until the screen data is displayed in association with each captured screen data, and the selection order of the plurality of keys. An input receiving unit that receives input, a search unit that searches for screen data based on the input selection order, and instructs the playback unit to jump to predetermined screen data for playback based on the search result It is characterized by functioning as a jump processing unit.

  According to such a configuration, it is possible to search for screen data based on a selection order of a plurality of inputted keys, and to jump to predetermined screen data for reproduction based on the search result. When playing back screen data for the purpose of verifying the cause of error occurrence, the selection order of keys to be selected when an error occurs can be predicted to some extent, so by entering such a selection order, Desired screen data can be retrieved and reproduced more quickly.

  Here, the jump means that the screen is not reproduced continuously in order, but the intermediate screen is skipped and skipped to another screen.

  In the viewer software program according to the fourth aspect of the present invention, the plurality of keys include a coordinate input key selected for inputting coordinate data on the screen, and the storage unit is captured. The coordinate data input by selecting the coordinate input key when the screen data is displayed in association with each screen data is stored, and the input receiving unit receives the input of the coordinate data, and the search The unit searches screen data based on the input coordinate data.

  According to such a configuration, for example, when a coordinate input key provided in a mouse or the like is selected, the coordinate data input by the selection of the coordinate input key is stored in association with each captured screen data. The screen data can be searched based on the input of the coordinate data, and can be reproduced by jumping to the predetermined screen data based on the search result. Thereby, since screen data can be searched more accurately based on the coordinate data, desired screen data can be searched and reproduced more quickly.

  A viewer device according to a fifth aspect of the present invention is a viewer device that reproduces screen data sequentially fetched from a screen displayed on a display means, a playback unit that sequentially reproduces screen data, and each A storage unit that stores the selection order of a plurality of keys that are sequentially selected until the screen data is displayed in association with the screen data; and an input reception unit that receives an input of the selection order of the plurality of keys. A search unit that searches for screen data based on the input selection order, and a jump processing unit that instructs the playback unit to jump to and play back the predetermined screen data based on the search result It is characterized by.

  According to such a configuration, it is possible to provide a viewer device that exhibits the same effects as the viewer software program according to the third aspect of the present invention.

  In the viewer device according to a sixth aspect of the present invention, each of the plurality of keys includes a coordinate input key selected for inputting coordinate data on the screen, and Corresponding to the screen data, when the screen data is displayed, the coordinate data input by the selection of the coordinate input key is stored, the input receiving unit receives the input of the coordinate data, the search unit The screen data is searched based on the input coordinate data.

  According to such a configuration, it is possible to provide a viewer device that exhibits the same effect as the viewer software program according to the fourth aspect of the present invention.

An example of a photographic print processing system suitably applied to the present invention will be described with reference to the drawings.
<Overall system configuration>
FIG. 1 is a schematic diagram showing an example of the overall configuration of a photo print processing system. In the present embodiment, one or more photo processing apparatuses 100 are connected to the controller 200 via a network such as a LAN. The controller 200 is composed of a general-purpose personal computer, and is installed with an application software program for the photo print processing system. This application software program is composed of a combination of an image processing program module, an order management program module, a pre-judge program module described later, and other various modules. Various application software such as word processing software, spreadsheet software, accounting software, and WEB browser software are installed in the controller 200.

  The controller 200 is connected to a scanner 300 that reads image data from a negative film. In addition, a reception terminal 400, a recording device 500, and a network reception terminal 600 are connected to the controller 200 via a network. The number of reception terminals 400, recording devices 500, and net reception terminals 600 is not limited to one each, and a plurality can be installed as necessary. Further, the scanner 300 may be installed in the photo processing apparatus 100.

  The photo processing apparatus 100 has a function of creating a photo print based on the image data transmitted from the controller 200. Examples of the image data include image data of a developed negative film frame image acquired from the scanner 300, image data transmitted from the reception terminal 400 or the like via a network, and the like.

  The reception terminal 400 is installed at a store, for example, and can receive image data stored in a recording medium of a digital camera or other recording media. Examples of the recording medium include CompactFlash (registered trademark), SmartMedia (registered trademark), Memory Stick (registered trademark), CD-R, and DVD-R. The reception terminal 400 is mainly operated by a customer, and may insert a recording medium brought by the customer to select image data to be created as a photo print or set the number of prints. it can. The recording apparatus 500 has a function of writing image data, order data, and the like transmitted from the controller 200 to a recording medium.

  The net reception terminal 600 is constituted by a personal computer and has a function of receiving an online print order via the Internet. Such a print order is accepted via a server 610 installed on the Internet. That is, image data relating to a print order is uploaded from the customer's personal computer 620 to the server 610, downloaded to the network reception terminal 600 at an appropriate timing, and used for print processing. Such systems that accept print orders online are well known.

<Functional block configuration of photo print processing system>
First, main functions of the controller 200 will be described below. The controller 200 is installed with an application software program (hereinafter sometimes referred to as a photo print processing system program) of a photo print processing system used in the photo print processing system.

  As shown in FIG. 1, the photo print processing system program mainly receives order information including image data and order data related to photo print orders from a scanner 300, a reception terminal 400, a recording device 500, a net reception terminal 600, and the like. Data reception processing step (data reception processing unit), order information storage processing step (order information storage processing unit) that stores the received order information in a storage medium (HDD), and addition, change, and deletion of this order information Created in an order management processing step (order management processing unit) that performs management processing such as order order, a pre-judge processing step (pre-judge processing unit) that pre-judges image data in order information, and a pre-judge processing step Based on the pre-judge correction data, An image processing step (image processing unit) for image processing to generate image data for print creation, and a data transmission step (data for transmitting the image data for print creation to the photo processing apparatus side in order units in accordance with the print processing order. And a transmission processing unit). Also, the photo print processing system program includes a processing step for inquiring about the operating status of the photo processing device, a processing step for receiving the operating status of the photo processing device and displaying it on the screen, a step for setting various setting values of the photo processing device, etc. It also has a program function. This photo print processing system program works in cooperation with hardware resources such as the CPU and memory of the installed personal computer, and exhibits its functions.

  Further, as another embodiment, the image processing step is not performed by the controller 200, and the pre-judge correction data and the image data created in the pre-judge processing step are transmitted to the photo processing apparatus side, and are incorporated in the photo processing apparatus. Image processing can also be performed on an image processing board formed of a circuit. Further, the pre-judge processing step is not essential for the image data of all orders, and there is a configuration in which the pre-judge process is omitted. Further, the image data received from the scanner 300 may be data after pre-judge processing.

  In the present embodiment, the pre-judgment process determines whether or not a photo print having an appropriate image quality is created before creating a photo print based on the image data. Provides functionality to do.

  Specifically, the pre-judge process provides a function of inputting correction data for correcting color and density, and the input of such correction data is set as necessary. Examples of other correction data settings include special correction settings such as red-eye correction and backlight correction.

  Also, as the setting of the number of prints, 1 is set by default for the image data acquired from the scanner 300, but it can be changed by an operator's input operation.

  Further, the image data of the order information may be composed of one frame image data or a plurality of frame image data. The order data may include an order ID, orderer identification information, the number of prints for each frame image, print size information for each frame image, and the like.

  Further, the controller 200 includes an input operation unit 230 for various settings, operation instruction inputs, and the like, and a monitor 240 for various setting operation instruction displays. The input operation unit 230 includes a keyboard 231 and a mouse 232. The keyboard 231 includes a large number of keys, and key input can be performed by operating these keys. The mouse 232 is a coordinate input device having a left key and a right key, and the coordinate data on the screen of the monitor 240 is input by moving the mouse 232 to a desired position and operating the left key or the right key. be able to. At this time, the left key and the right key of the mouse 232 function as coordinate input keys selected for inputting coordinate data on the screen of the monitor 240. By using the input operation unit 230 including the keyboard 231 and the mouse 232, it is possible to perform an input operation by selecting from a plurality of keys. Details of the capture software program will be described later, and the configurations of the scanner 300 and the photo processing apparatus 100 will be described below.

  The scanner 300 has a function of acquiring digital image data by scanning a frame image formed on a developed negative film. The read image data is transmitted to the controller 200. There are two scanning methods: press scanning and main scanning. In press scanning, the entire negative film is read once at a low resolution (pre-judgment resolution), and this scanning is performed based on the image data of the press scanning. This is performed after the judgment process, and is read at a high resolution (photo resolution). In this case, the scanner 300 is configured to be connected to a pre-judge processing unit that provides a pre-judge processing function.

  The photo processing apparatus 100 includes a receiving unit 101 that receives print creation image data from the controller 200, and an exposure unit 105 that exposes the received print creation image data to the photographic paper 104 fed out from the magazine 103. The developing unit 106 for developing the exposed photographic paper 104, the drying unit 107 for drying the developed photographic paper 104, and discharging the dried photographic paper 104 while sorting the dried photographic paper 104 And a sorting / discharging unit 108 to be configured. A main control unit 120 for controlling the overall operation of the photo processing apparatus 100 is also provided.

  In the magazine 103, photographic paper 104, which is a photographic photosensitive material, is accommodated in a roll shape. Two magazines 103 can be installed. For example, printing papers having different widths can be set in advance. The long photographic printing paper 104 drawn out from the magazine 103 is cut by a cutting means such as a cutter so as to have a set print size.

  The exposure unit 105 has an exposure engine, receives print creation image data transmitted from the development memory of the image processing board 220, and prints an image on the emulsion surface of the photographic paper based on the print creation image data. Exposure. The exposure engine is not limited to a specific type, and for example, a laser engine, a CRT engine, a PLZT engine, or the like can be used.

  The developing unit 106 performs a developing process on the photographic paper 104 on which the image is printed and exposed, and the drying unit 107 performs a drying process on the developed photographic paper 104. In the sorting discharge unit 108, the finished photographic print is discharged to the outside of the main body of the apparatus, and can be stacked in order units by a predetermined stacking apparatus.

  The photographic paper sensor 109 detects the photographic paper 104 discharged from the sorting discharge unit 108, and detects whether or not all photo prints of a certain order have been discharged. The sensor control unit 110 controls driving of the photographic paper sensor 109 and receives and analyzes a signal from the photographic paper sensor 109. When the sensor control unit 110 detects that all photographic prints for an order have been discharged, the main control unit 120 notifies the controller 200 of the order and sets the order information for the order to the processed management state. Further, it may be configured to be deleted from the storage medium. The photographic processing apparatus 100 is not limited to the above-described configuration, and various configurations such as an inkjet printer and a thermal printer (sublimation printer) can be employed.

(Capture software program)
The function of the capture software program installed in the controller 200 will be described below. This program is recorded in a storage medium, can be provided as a storage medium, and may be provided (provided by downloading) via a communication line. When provided via a communication line, only a part of the functions may be provided, and the other part may remain in the server device.

  FIG. 1 is a functional block diagram showing processing functions of the capture software program.

  Specifically, a count unit 201 that counts a predetermined period, a screen data information acquisition unit 202 that acquires information of active screen data in the screen data displayed on the screen when the predetermined period has arrived, Based on the acquired screen data information, the determination unit 203 determines whether the active screen data is that of the application software to be captured, and the determination unit 203 determines whether the active screen data is to be captured. And a capture unit 204 that captures the active screen data when it is determined that the application software is of the type. The storage unit 205 functions by executing the capture software program or a viewer software program described later, and stores the screen data captured by the capture unit 204. The storage unit 205 is, for example, a large capacity storage medium.

  The captured screen data is preferably compressed and stored. A known compression algorithm can be applied, and examples thereof include a run length compression method, a PIC compression method, JPEG compression, PNG compression, and GIF compression. In such a case, the capture software program has a compression processing function (compression unit 207) and causes the computer to execute the compression processing step.

  In addition, a capture condition setting unit 206 for setting capture conditions is provided. The capture condition setting unit 206 can set various capture conditions. Examples of the capture conditions include setting a capture pattern, specifying a folder for outputting capture data, the number of files to be output, and the output size of one file. Examples are the designation (capacity for storing capture data based on the number of files and the file size), the timing of capture processing, and the like. Details of these will be described later.

(Capture method)
The processing method of the capture unit 204 will be described below. As a first method, there is a method of acquiring the image data in the active window screen as it is. In this method, only the image data of the active window screen is cut out and acquired from the desktop screen displayed on the monitor, and other image data is not acquired. In this case, it is preferable to store the relative position coordinates of the active window screen with respect to the desktop screen. By storing the relative position coordinates, the position of the screen captured during playback can be accurately reproduced.

As a second method, only the difference data from the previously captured screen data is captured. Since only the difference data is captured, the amount of data stored in the storage unit 205 can be reduced when there is no change in the screen data or when there is little change. In this case, it is necessary to expand the difference data during reproduction. The following method is illustrated as a method of taking in difference data.
(1) At the first capture, the color of the monitor display portion (desktop screen, inactive window screen, icon, task bar, etc.) other than the active window screen is set to black as shown in FIG. Capture the display area. The captured display area is defined as frame 1.
(2) At the second and subsequent captures, the color of the monitor display portion other than the active window screen is set to black as shown in FIG. 11, and the entire display area displayed on the monitor is captured. Let the captured display area be frame 2. Then, the difference between the image data acquired this time (frame n) and the image data acquired last time (frame (n−1)) is taken, and only the difference data is associated with the previous image data and stored. By repeating the above processing, difference data based on the screen data captured immediately before can be accumulated. The difference is an image change point. As shown in FIG. 11, when the difference between frame 1 and frame 2 is taken, the shaded portion is the change point of the image, and the white portion is the portion where the image does not change. Difference data that is a hatched portion is stored in association with the immediately preceding image data.

(Operation flowchart)
Next, the processing flow of the capture software program will be described below with reference to FIG. The controller 200 is composed of a personal computer, and this personal computer is an environment that operates on a Microsoft (registered trademark) window system (for example, Microsoft Windows (registered trademark) 2000, XP, VISTA (registered trademark)). It goes without saying that other window systems such as Mac OS and X Window System may be used.

  When the OS is started by the controller 200, a desktop screen 300 is displayed as shown in FIG. On this desktop screen 300, startup file icons of various application software are displayed. The activation file icon 301 of the capture software program is selected and executed (S1). When executed, an icon 302 is displayed on the task bar, for example, as shown in FIG. The capture state can be identified by the color of the icon. For example, if the icon background color is light blue, it is temporarily stopped, if it is red, it is being captured, and if it is orange, it indicates that a capture error has occurred. When a capture error occurs, for example, a file may not be output to a storage medium (for example, a hard disk) for storing captured screen data. As an initial setting, the capture function may be automatically started by executing the startup file, or may be paused.

  After execution of the startup file (S1), it is determined whether or not the capture function is in an ON state (S2). When not in the ON state, the capture function is in the primary stop state. In order to turn on the capture function, by clicking the icon 302 on the task bar shown in FIG. 3A, the menu 303 is displayed as shown in FIG. You can start the capture function by selecting. In this menu 303, in addition to “capture start”, for example, “capture end” (capture stop function), “setting” (capture condition setting function), “software end” (capture software program This is a function to end, and can be executed only after the capture ends).

  Further, it is determined whether or not “setting” is selected in the primary stop state (S10). If “SETTING” is selected, the capture condition can be set in step S11. “Setting” is a function of the capture condition setting unit 206, and is configured so that a condition can be set when capturing is not in progress. Note that although there are cases where recommended conditions are set in advance, the capture conditions can be set as appropriate depending on the convenience of the photo shop where the photo print processing system is installed, the processing capacity of the personal computer used as the controller 200, the hard disk capacity, and the like. It is the structure which can be customized to various user conditions.

(Capture condition setting)
The setting of capture conditions will be described below. FIG. 4 shows an example of the capture condition setting screen 400. “Capture pattern selection 401” is a box for setting a pattern to be used. Already set patterns are displayed in the combo box. When a new pattern is set, a new name is input and saved. Saving is confirmed by pressing “Regist 418”.

  In the “output folder 402” in the file setting column, a destination folder for storing captured image data (hereinafter sometimes referred to as captured image data) is designated. The folder list can be displayed and selected with the button on the right side of the box. In “number of output files 403”, the number of files to be output is set. In “Output file size 404”, the output size of one file is designated. When the size specified here is exceeded, the file is switched to the next file and output. A value obtained by multiplying “number of output files 403” and “output file size 404” is a capacity for storing the captured image data. Therefore, it is possible to make settings according to the capacity of the large-capacity storage medium (for example, hard disk) of the storage unit 205.

  By checking the “automatic capture start 405” check box, the capture processing can be automatically started when the capture software program is started. Various modes are set in “capture mode 406” in the capture information column.

  “Cycle 407” in the capture information column is a setting for controlling the cycle timing of the capture process. It is determined whether or not processing is necessary for each numerical value designated here. In “capture level 408”, the number of parent screens of active windows to be captured is set.

  In “timing 409” of the screen capture column, a sampling count value for capture processing is set. Screen data is captured at a time timing of a value obtained by multiplying the numerical value set in the “cycle 407” by the sampling count value set here. In the case of the setting shown in FIG. 4, the screen data is captured every 1 second, which is a value obtained by multiplying 100 ms by 10. Further, the screen data can be sampled at a timing other than the above timing. For example, the screen data can be obtained by pressing a mouse button or a keyboard.

  In “storage size 410” of the screen capture column, a size to be stored when the acquired screen data is stored is set. If the image is saved with a large screen, the image at the time of reproduction is beautiful, but the amount of data to be saved increases, so the period that can be retained as a log is shortened. The image data is compressed according to the designated storage size. In “color number setting 411”, the number of colors to be stored when the acquired screen data is stored is set. The larger the number, the more the original color number is retained, but the more data is stored.

  When the “mouse 412” check box is checked, a mouse operation log is saved. The mouse operation log is linked to the acquired image data. When the “keyboard 413” check box is checked, a keyboard operation log is saved. The keyboard operation log is linked to the acquired image data. When the check box of “drive 414” is checked, the drive change log is saved. The drive change log is linked to the acquired image data.

  When the “CPU / MEMORY 415” check box is checked, a CPU usage log and a memory usage log are saved. Sampling is performed at a time timing of a value obtained by multiplying the numerical value (100 ms) set in the “cycle 407” and the numerical value (10) set here. When the check box of “Network 416” is checked, the network status log is saved. Sampling is performed at a time timing of a value obtained by multiplying the numerical value (100 ms) set in the “cycle 407” and the numerical value (600) set here. If the check box of “Process 417” is checked, the process status log is saved. Sampling is performed at a time timing of a value obtained by multiplying the numerical value (100 ms) set in the “cycle 407” and the numerical value (600) set here.

  Next, the capture process will be described. When the capture function is started, in step S3, a predetermined period is counted using a timer function in the personal computer (S3, count step). The period of the capture timing is set by the above capture condition setting.

  Next, when the predetermined period has arrived (S4), information on active screen data is acquired (S5, screen data information acquisition processing step). For example, the window handle of the active screen is acquired. The execution module name is acquired from the acquired window handle. This is because the window handle and the execution module name are linked by the CPU. The window handle includes the title name of the screen, and the title name is read from the acquired window handle and stored in the storage unit 205 in association with each screen data.

  Next, it is determined whether or not the acquired screen data information (execution module name here) is for the application software to be captured (S6, determination processing step). The application software to be captured is stored in advance in a memory or the like, and here are various execution modules of the above-described photo print processing system program.

  When it is determined that the acquired screen data information is for the application software to be captured, the active screen data is captured (S7, capture processing step). The above-described method can be applied as a specific capture method. If it is determined in step S6 that the application software is not to be captured, the capture process is not performed and the process returns to step S4. That is, at this timing, screen data is not captured, and capture screen data does not exist.

  Note that “the screen is active” means that an input operation is possible only on that screen. FIG. 5 shows an example in which the screen of the photo print processing system program is active. The window screen in the center of the screen is a screen example (pre-judge screen example) of the photo print processing system program and indicates that it is active. The screen of other application software is inactive and is only displayed on the task bar in the lower area of the screen or hidden behind the pre-judge screen background.

  FIG. 5 shows an active pre-judge screen 51. When this pre-judge screen 51 is captured, other screen data other than this pre-judge screen in the desktop screen is captured as black, the difference (image change point) from the immediately preceding frame is taken, and the difference data is captured immediately before the screen. Link with data. Next, when the active order management screen 61 as shown in FIG. 6 is fetched, the screen data other than this order management screen in the desktop screen is also taken in as black, and the frame immediately before that (the pre-order of FIG. 5) is taken. A difference is obtained from the desktop screen including the judge screen 51), and the difference data is linked to the previous screen data. Thereby, it is possible to capture only data in an image area different from the immediately preceding image area.

  The captured screen data is compressed by the compression unit 207 and stored in the storage unit 205 (S8, storage processing step). At this time, the time when each screen data is captured, the selection key data indicating the type of key selected when each captured screen data is displayed on the monitor 240, and the like are associated with each screen data. Are stored in the storage unit 205. As described above, the selection key data is stored in association with the time, so that the selection order of a plurality of keys that are sequentially selected until the captured screen data is displayed on the monitor 240 is the screen data. Are stored in the storage unit 205 in association with each other (S9). That is, until the captured screen data is displayed on the monitor 240, the selection order of a plurality of keys sequentially selected and operated from the input operation unit 230 (such as the keyboard 231 and the mouse 232) is displayed on each screen data. Correspondingly, they are compressed and stored in the storage unit 205. In steps S8 and S9, compression processing is not essential, but compression processing is preferable from the viewpoint of securing the capacity of the storage medium.

  In step S9, not only the selection key data as described above but also various other data can be stored in the storage unit 205 in association with each screen data. The various data is selected when the coordinate data input from the mouse 232 when the screen data is displayed by operating the mouse 232, the screen number of each displayed screen data, and each screen data is displayed. Key numbers (button numbers) can be exemplified. However, not only these data, but the name of each displayed screen data (screen name), the number of the resource used when each screen data was displayed (resource number), and the identification number of the dialog (dialog ID) Data such as the name of the executed process (process name) may be stored in the storage unit 205 in association with each screen data.

  As the storage medium of the storage unit 205, a hard disk capable of storing a large amount of data is preferable. The amount of saved data that can be saved in the storage medium is set in advance. When the amount of saved screen data reaches that saved data amount, the old screen data is deleted, and the amount of saved data in the storage medium is kept constant. It is preferable to maintain the following so as not to cause a problem that the capture screen data is not saved. Further, when the capture screen data amount reaches the storage data amount, the capture screen data stored in the storage medium can be transferred to a medium (CD-ROM, MO, etc.) to secure a storage area of the storage medium.

  As described above, the capture process can be stopped by displaying a menu from the icon on the task bar and selecting “pause”. In addition, it is possible to set a capture process start time and an end time in advance, automatically start from the start time, and automatically stop temporarily when the end time arrives. In addition, it is possible to set a capture process end period and automatically stop after a certain period from the capture start time.

  According to the above embodiment, when the application software to be captured is active and the screen is active, the screen data can be captured, and the screen data of other application software can be captured. Absent. Therefore, even if personal information and trade secrets are included in the screen data of other application software, such information will not be captured, so there will be no legal issues, and operation history acquisition using screen capture will not occur. Is possible.

  Further, as shown in FIG. 7, when capturing screen data set in a parent-child relationship such as a pre-judge screen and a message screen, both screen data may be captured. When it is determined that the message screen is active, the pre-judge screen of the parent screen is also captured at the same time. The parent-child relationship can be set as appropriate, and is not limited to the pre-judge screen and the message screen. As the setting of the parent-child relationship, for example, an order management screen and a message screen, an order management screen and an error message screen, various operation screens and a message screen, various operation screens and an error message screen can be appropriately set.

  However, the capture method by the capture software program is not limited to the method described above, and a plurality of keys that are sequentially selected when the screen data is displayed in association with each captured screen data. Various methods other than the above method can be adopted as long as the method includes a method for storing the selection order in the storage unit 205. For example, the configuration is not limited to capturing image data of an active window screen from within the desktop screen, but may be configured to capture image data of the entire desktop screen.

(Capture screen data playback process)
Image data captured by the capture software program can be displayed by the viewer software program. When the viewer software program is activated, a window in the simple display mode shown in FIG. 8 is displayed. By selecting “display mode switching” from the menu item “window”, the detailed display mode window shown in FIG. 9 can be displayed. In the detailed display mode, two windows are displayed: a view window for displaying image data and a playback function operation / various log display screen window.

  Next, a reproduction method will be described. First, FIG. 10 shows an example of screen data reproduced in the simple display mode. The item “file” in the menu of FIG. 8 is selected to display the menu. Select "Open File" in the menu, and select the file you want to play from the list of files that store the captured screen image data. When a file is selected, the file is read from the storage medium into the main memory, and playback is started. The screen at the center of the window in FIG. 10 shows the captured screen that has been reproduced. The mouse cursor is also captured. If the captured image data is compressed, it is decompressed and played back. If stored as difference data, a process of expanding the difference data is performed.

  In FIG. 10, a bar 81 at the bottom of the display window and an inverted triangle mark on the bar 81 indicate which position of the file being reproduced is displayed. In the lower part of the bar 81 at the bottom of the window, a time 82 (local time of the captured computer) when the currently displayed screen data is captured and its date 83 are displayed. On the right side of the time 82, a playback / primary stop button (a function button that switches between playback and pause when the button is pressed), a button 84 for moving a predetermined amount from the current position, a playback speed setting bar 85, and the like are displayed. .

(Viewer software program)
The functions of the viewer software program installed in the controller 200 will be described below. This program is recorded in a storage medium, can be provided as a storage medium, and may be provided (provided by downloading) via a communication line. When provided via a communication line, only a part of the functions may be provided, and the other part may remain in the server device.

(Embodiment 1)
In the first embodiment, the screen data sequentially acquired by the method of acquiring the image data in the active window screen as it is by the function of the capture software program (the first method) is used as the viewer software program according to the first embodiment. A configuration for reproducing by function will be described. FIG. 1 is a functional block diagram showing processing functions of the viewer software program. Specifically, a reproduction unit 211 that sequentially reproduces screen data, a jump processing unit 212 that executes a scene jump by instructing the reproduction unit 211 to jump to and reproduce predetermined screen data, a plurality of An input receiving unit 213 for receiving an input such as a key selection order (hereinafter referred to as “key selection order”) and a search unit 214 for searching for screen data based on the input key selection order. Yes. The scene jump means that the screen is not reproduced continuously in order, but the intermediate screen is skipped and skipped to another screen. The scene jump function is a function for thinning out and displaying screen data that is sequentially fetched, and can also be called a cueing function.

(Scene jump method)
FIG. 12 is a diagram showing in more detail functional blocks regarding processing functions of the viewer software program in the first embodiment. This example shows a case in which screen data is sequentially captured from the screen displayed on the monitor 240 by the method of saving the image data in the active window screen as it is (the first method described above). Each screen data captured in this way is stored in the screen data storage unit 205A that constitutes a part of the storage unit 205, in addition to the time when the screen data was captured. , Screen number, button number, screen name, resource number, dialog ID, process name, etc.). The time may be an absolute time or a relative time.

  The reproduction unit 211 reproduces the screen data by switching each screen data stored in the screen data storage unit 205 </ b> A to a window on the monitor 240 at regular intervals and sequentially displaying the screen data according to the associated time. To do. The predetermined time can be changed by operating the playback speed setting bar 85.

  The input receiving unit 213 gives input data such as a key selection order input using the input operation unit 230 to the search unit 214. The input data received by the input receiving unit 213 includes at least the key selection order. In addition to the key selection order, the coordinate data, the screen number, the button number, the screen name, the resource number, the dialog, and the like. An ID, a process name, and the like can be input as appropriate.

  The search unit 214 searches the screen data corresponding to the input key selection order and other data by comparing the data input from the input receiving unit 213 with the data stored in the screen data storage unit 205A. That is, a series of screen data selected in the same order as the input key selection order is specified based on the time and selection key data associated with the screen data, and data other than the key selection order If (coordinate data, screen number, button number, screen name, resource number, dialog ID, process name, etc.) are also input, a series of screen data that satisfies these conditions is specified.

  The jump processing unit 212 includes a jump point determination unit 212B and a jump instruction unit 212C, and starts a scene jump based on the operation of the input operation unit 230. The jump point determination unit 212B determines screen data (jump point) to be reproduced after a scene jump based on the search result input from the search unit 214. More specifically, among the series of screen data identified by the search unit 214, the screen data (start position) with the earliest capture time or the screen data (end position) with the latest capture time is the jump point. As determined.

  The jump instruction unit 212C instructs the reproducing unit 211 to reproduce the screen data from the jump point determined by the jump point determining unit 212B. That is, the jump instruction unit 212C reads the time corresponding to the screen data determined as the jump point by the jump point determination unit 212B from the screen data storage unit 205A, and causes the playback unit 211 to play back the screen data corresponding to the time. Instruct. When the reproducing unit 211 reproduces the screen data based on the instruction from the jump instruction unit 212C, it is possible to jump to the screen data corresponding to the jump point and reproduce it without reproducing one or more screens.

  As described above, the desired screen data can be easily reproduced by jumping to the time corresponding to the screen data retrieved based on the data input to the input receiving unit 213 and reproducing the screen data. However, the configuration is not limited to the configuration in which the time is input from the jump instruction unit 212C to the reproduction unit 211 as described above, and information other than the time is input to the reproduction unit 211 as information for identifying screen data corresponding to the jump point. Based on this information, the reproducing unit 211 may read and reproduce the screen data from the screen data storage unit 205A.

  FIG. 13 is a diagram illustrating an example of a search condition setting screen displayed on the monitor 240 when data is input to the input receiving unit 213. The search condition setting screen can be displayed on the monitor 240 by operating the input operation unit 230. The search screen includes a search condition input area 91 for inputting a search condition including a combination of data such as a key selection order, coordinate data, a screen number, and a button number, and the above start in a series of screen data satisfying the search condition. A start position search key 92 for determining a position as a jump point, an end position search key 93 for determining the end position in a series of screen data satisfying the search condition as a jump point, and for stopping the execution of the search The cancel key 94 is included.

  The search condition input area 91 in this example includes an area 91A for inputting a screen number, an area 91B for inputting a button number, an area 91C for inputting coordinate data, and an area 91D for inputting selection key data. These are assigned for each order displayed in the order area 91E. The search condition can be set by operating the input operation unit 230 and appropriately inputting data to each of the regions 91A to 91D. The selection key data is input to at least the area 91D among the areas 91A to 91D, whereby the key selection order is set as a search condition. For the other areas 91A to 91C, data can be input as appropriate, but it is not always necessary to input data. In the example of FIG. 13, “*” is displayed in the areas 91 </ b> A to 91 </ b> C where data is not input, that is, the areas 91 </ b> A to 91 </ b> C where no search condition is set.

  The data input to the search condition input area 91 may be configured such that numerical values and characters are directly input to the areas 91A to 91D using the input operation unit 230, or the monitor 240 using the input operation unit 230. A configuration may be adopted in which data corresponding to the operation is automatically input to each of the areas 91 </ b> A to 91 </ b> D by performing an operation for actually displaying the screen. Further, by storing a specific key selection order in advance, the key selection order may be read and easily searched.

  The search performed by the search unit 214 using each data input to each of the areas 91A to 91D as a condition is performed by using the data (condition) input to each of the areas 91A to 91C excluding the area 91D as an or condition. A series of screen data satisfying the above conditions may be output as a search result, or a series of data satisfying all of the conditions (conditions) input to the areas 91A to 91C excluding the area 91D. Only screen data may be output as a search result.

  FIG. 14 is a flowchart for explaining an example of the search method. When the input operation unit 230 is operated to give an instruction to start setting search conditions, a search condition setting screen as shown in FIG. 13 is displayed on the monitor 240 (step S101). In this search condition setting screen, after data (conditions) is input to each of the areas 91A to 91D, the start position search key 92 or the end position search key 93 is selected to instruct the start of search (step) The search by the search unit 214 is performed under the input conditions.

  At this time, when the start position search key 92 is selected (YES in step S103), the screen data (start position) having the earliest time taken in among the series of screen data specified by the search unit 214 is selected. A jump point is determined (step S104). On the other hand, when the end position search key 93 is selected (NO in step S103), the screen data (end position) with the latest captured time among the series of screen data specified by the search unit 214 jumps. A point is determined (step S105).

  Then, the reproduction unit 211 is instructed to reproduce from the screen data corresponding to the jump point without reproducing the screen data up to the determined jump point (step S106). When the start position search key 92 or the end position search key 93 is selected again, the closest time later than the screen data is associated with the screen data after the jump, based on the screen data after the jump. The starting or ending position is determined as the jump point. The processes in steps S101 to S106 are performed until the search is completed (for example, YES in step S107) by selecting the cancel key 94 on the search condition setting screen of FIG.

  In the present embodiment, it is possible to search for screen data based on a selection order of a plurality of input keys, and to jump to predetermined screen data for reproduction based on the search result. When playing back screen data for the purpose of verifying the cause of error occurrence, the selection order of keys selected when an error occurs can be predicted to some extent, so by entering such a selection order, Desired screen data can be retrieved and reproduced more quickly.

  For example, when a coordinate input key (left key or right key) provided on the mouse 232 or the like is selected, the coordinate data input by the selection of the coordinate input key is stored in association with each captured screen data. At the same time, the screen data can be searched based on the input of the coordinate data, and can be reproduced by jumping to the predetermined screen data based on the search result. Thereby, since screen data can be searched more accurately based on the coordinate data, desired screen data can be searched and reproduced more quickly.

(Embodiment 2)
In the first embodiment, the screen data sequentially acquired by the method of acquiring the image data in the active window screen as it is (the first method described above) by the function of the capture software program is used as the viewer software program according to the first embodiment. The configuration for reproducing by function has been described. On the other hand, in the second embodiment, the screen data sequentially captured by the method of saving the difference data between the screen data (the second method described above) by the function of the capture software program is used as the viewer according to the second embodiment. The difference is that a configuration is adopted in which playback is performed according to the function of the software program.

  FIG. 15 is a diagram showing in more detail functional blocks regarding processing functions of the viewer software program in the second embodiment. In the second embodiment, screen data (initial screen data) is saved at the time of the first capture and is captured at the time of the second and subsequent captures to the screen data storage unit 205A constituting a part of the storage unit 205. Difference data between the image data (frame n) and the previously captured image data (frame (n-1)) is sequentially stored. In the initial screen data and the difference data, various data such as the selection key data and the coordinate data are stored in association with each other in addition to the time when each screen data is captured. The time may be an absolute time or a relative time.

  The reproduction unit 211 displays the initial screen data stored in the screen data storage unit 205A in a window on the monitor 240, and then sequentially expands each difference data according to the associated time and is already displayed. Each difference data developed on the screen data is sequentially added. As a result, different screen data can be switched at regular time intervals and displayed sequentially to reproduce the screen data. The predetermined time can be changed by operating the playback speed setting bar 85. The configurations and functions of the jump processing unit 212, the input receiving unit 213, and the search unit 214 are the same as those in the first embodiment, and the processing performed at the time of the scene jump is also the same as the example in FIG. It will be omitted.

(Embodiment 3)
The viewer software program of the present invention is not limited to a form installed in the controller 200 and activated by the operator on the controller 200. For example, starting the viewer software program from a computer (including a portable computer, a general-purpose personal computer, a workstation, and a server device) connected to the controller 200 via a network (including Internet connection). it can. Further, the screen data or difference data stored in the storage unit 205 can be transmitted to the computer via a network. Further, instead of transmitting screen data or difference data to the computer via a network, a storage medium storing the screen data or difference data is received by a delivery service such as mail, or directly received at a store, and stored in the store. Processing by a viewer software program can also be performed using screen data or difference data read from a medium into the computer.

  The viewer software program can also be configured as a module constituting the photo print processing system program. In such a case, the photo print processing system program can be started and the viewer software program can be started from the operation screen. Other components can be realized by the same components as described above.

(Embodiment 4)
(Viewer device)
The viewer device of the fourth embodiment selects a plurality of keys that are sequentially selected until the screen data is displayed in association with each of the captured screen data, and a playback unit that sequentially plays back the screen data. A storage unit that stores the order; an input receiving unit that receives input of a selection order of the plurality of keys; a search unit that searches for screen data based on the input selection order; and a predetermined unit based on the search result A jump processing unit for instructing the playback unit to jump to the screen data for playback. The plurality of keys include coordinate input keys that are selected to input coordinate data on the screen, and the storage unit associates the captured screen data with each of the captured screen data. When the screen data is displayed, the coordinate data input by the selection of the coordinate input key is stored, the input receiving unit receives the input of the coordinate data, and the search unit is based on the input coordinate data The screen data may be searched. These details are as described above.

  The viewer device can be incorporated as a dedicated circuit board board in a personal computer in which application software for the photo print processing system is installed, or can be connected to the personal computer via a network. The viewer device or dedicated circuit board can be configured with dedicated circuits as described above, or can be configured with the cooperation of hardware resources such as CPU and memory and various software programs, and is configured with firmware. You can also

  Further, the screen data reproduced by the viewer device can be captured by the capture software program as described above, and the viewer device may have this capture software function. Further, the captured image data can be transmitted to a computer connected to a network and reproduced on the computer using viewer software.

  In the above embodiment, the configuration has been described in which the capture software program and the viewer software program are executed in the photo print processing system, or the capture device and the viewer device are provided in the photo print processing system. The present invention is not limited to this, and can be applied to various systems and apparatuses other than the photo print processing system.

Diagram for explaining the functional configuration of the photo print processing system Operation flowchart of capture processing Diagram for explaining the capture software execution screen Illustration for explaining the capture condition setting screen Diagram for explaining the capture software execution screen Diagram for explaining capture screen data Diagram for explaining the capture software execution screen Diagram for explaining the execution screen of the viewer software Diagram for explaining the execution screen of the viewer software Diagram for explaining the execution screen of the viewer software Diagram for explaining the capture method The figure which showed further in detail the functional block about the processing function of the viewer software program in Embodiment 1. The figure which showed an example of the search condition setting screen displayed on the monitor when inputting data into the input reception part Flow chart for explaining an example of a search method The figure which showed the functional block about the processing function of the viewer software program in Embodiment 2 in more detail

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Photo processing apparatus 200 Controller 201 Count part 202 Screen data information acquisition part 203 Judgment part 204 Capture part 205 Storage part 206 Capture condition setting part 207 Compression part 211 Playback part 212 Jump process part 213 Input reception part 214 Search part

Claims (6)

A capture software program that sequentially captures screen data from the screen displayed on the display means,
Computer
An input operation unit for performing input operation by selecting from a plurality of keys;
A capture software program characterized by being associated with each captured screen data and functioning as a storage unit that stores the selection order of the plurality of keys that are sequentially selected until the screen data is displayed. A capture device that captures screen data sequentially from the screen displayed on the display means,
An input operation unit for selecting from a plurality of keys and performing an input operation;
A capture device, comprising: a storage unit that stores the selection order of the plurality of keys that are sequentially selected until the screen data is displayed in association with each captured screen data. A viewer software program for playing back screen data captured sequentially from the screen displayed on the display means,
Computer
A playback unit for sequentially playing back screen data;
A storage unit that stores the selection order of a plurality of keys that are sequentially selected until the screen data is displayed in association with each captured screen data;
An input receiving unit for receiving an input of a selection order of the plurality of keys;
A search unit for searching for screen data based on the input selection order;
A viewer software program that functions as a jump processing unit that instructs the playback unit to jump to and play back predetermined screen data based on the search result. The plurality of keys include a coordinate input key selected to input coordinate data on the screen,
The storage unit stores the coordinate data input by selecting the coordinate input key when the screen data is displayed in association with each captured screen data,
The input receiving unit receives input of coordinate data;
The viewer software program according to claim 3, wherein the search unit searches screen data based on input coordinate data. A viewer device that reproduces screen data sequentially fetched from a screen displayed on a display means,
A playback unit for sequentially playing back screen data;
A storage unit that stores the selection order of a plurality of keys sequentially selected until the screen data is displayed in association with each captured screen data;
An input receiving unit for receiving an input of a selection order of the plurality of keys;
A search unit for searching for screen data based on the input selection order;
A viewer apparatus comprising: a jump processing unit that instructs the playback unit to jump to and play back predetermined screen data based on the search result. The plurality of keys include a coordinate input key selected to input coordinate data on the screen,
The storage unit stores the coordinate data input by selecting the coordinate input key when the screen data is displayed in association with each captured screen data,
The input receiving unit receives input of coordinate data;
The viewer device according to claim 5, wherein the search unit searches the screen data based on the input coordinate data.

Images