JP2002312154A - Screen-recording/reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a screen-recording/reproducing device, capable of recording and reproducing information excluding extra information therefrom, without having to perform troublesome operations for resetting the area of recording, even if the position or size of a window is changed. SOLUTION: This device is characterized by having a means for recording screen information along with existing window information, when the screen information is recorded, a means for automatically changing record domains in response to changes in the window information, and a means for extracting a sequence of domains displayed by application as screen information from the recorded window information and screen information to create screen information to be reproduced.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a computer system in which an application having various functions operates, in which information displayed by a running application on a display screen is recorded as screen information, and the recorded screen information is recorded. The present invention relates to a screen recording / reproducing apparatus that reproduces a.

[0002]

2. Description of the Related Art In a computer system in which various applications operate, for example, when a function of each application is demonstrated, it takes time and is inefficient to show all screen information output by a target application. Therefore, a screen recording / reproducing apparatus that records screen information output by a focused application and reproduces only characteristic information among the recorded screen information is used. In such a screen recording / reproducing apparatus, conventionally, which area on the display screen is to be recorded at the start of recording, only information displayed in the specified fixed area is recorded. In this case, if the information displayed on the display screen by the application is out of the recording range, the protruding portion is not recorded. In order to prevent such a situation, the entire display area is designated in advance as the recording range, or the screen recording is ended when the recording range is exceeded, and the recording range is set again and recording is newly started. There is a need. The recorded screen information can be reproduced for each recorded unit. However, when a series of screen information is divided and recorded at a plurality of timings, the screen information is connected in an arbitrary order to form one screen for reproduction. Combine as information,
You can also play it.

[0003]

By the way, an application is a certain area (window) on a display screen.
Display the required information in. The size and position of this window can be changed at any time, and may change every moment during execution of the application due to the balance with the window created by another application or the circumstances of the application itself. Further, a case where information is displayed using a plurality of windows in one application may be considered.

[0004] In order to record all the information that needs to be recorded using the conventional technique for the information display mode of such an application, two methods are conceivable. One is a method in which the entire area of the display screen is designated as a recording target range, and all information is recorded. In this method, the information to be recorded is not leaked, but the window in which the application displays the information is a partial area on the display device, and the recorded information includes a lot of unnecessary information. Problem occurs. Such unnecessary information may cause an increase in the file size when the screen information is stored in a reproducible state, which may hinder distribution and storage of the file. In this case, it is possible to extract only the necessary information from all the displayed information and create it as a playback file, but to do so, specify the necessary information from a series of screen information and cut it out. There is a problem that the work occurs as extra work.

Another method is to set an area to be recorded according to the size and position of a window in which an application displays information so as not to record extra information. Even with this method, extra information can be minimized, but each time the application window changes, recording must be interrupted and the recording range must be reset manually, which is a tedious operation in the recording operation itself. There is a problem that it takes. Further, if the information to be recorded is continuous information requiring real-time properties, the recording operation cannot be interrupted one by one, so that the recording operation is frequently interrupted, which is not practical.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a screen capable of recording and reproducing information excluding extra information without performing a troublesome operation of resetting a recording range even when the position or size of a window changes. An object of the present invention is to provide a recording and reproducing device.

[0007]

SUMMARY OF THE INVENTION In order to solve the above-mentioned problems, the present invention provides a means for recording window information existing when recording screen information together with the screen information, and a method for responding to a change in the window information. Means for automatically changing the recording area, and means for extracting a series of areas displayed by the application from the recorded window information and screen information as screen information and creating screen information for reproduction. . The information processing apparatus further comprises means for automatically recording all screen information output by the designated recording target application program. In addition, there is provided a means for automatically recording all screen information for a window specified as a recording target and another window to which the window is related. The information processing apparatus further comprises means for automatically recording all screen information of a window on which a user operation has been performed and another window related to the window. In addition, the information processing apparatus further includes means for automatically extracting screen information output by a specific application and necessary screen information from screen information in which a plurality of pieces of information output by various applications are recorded.

[0008]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, the present invention will be described in detail based on embodiments shown in the drawings. FIG. 1 is a block diagram showing an embodiment of a screen recording / reproducing apparatus to which the present invention is applied. The screen recording / reproducing apparatus 101 of the present embodiment includes a display apparatus 111 for displaying screen information and a display apparatus 111 for displaying screen information in a system environment including a target application 109 for generating screen information to be recorded in response to an input operation from a user. An OS screen output control unit 110 manages an output range of the display device 111, and a screen information recording unit 104 records screen information generated by each application. Further, a screen information file 105 as a recording destination of screen information, a window information recording unit 102 for recording window information as a management unit of the screen information of each application, a window information table 103 as a recording destination of window information, and Screen information editing unit 1 for extracting only necessary screen information from information
06, a file 107 of reproduction screen information composed only of necessary screen information taken out, and a screen information reproduction unit 108 for outputting the recorded screen information to the display device 111.

FIG. 2 is a flowchart showing an outline of the process transition in this embodiment. First, the user designates an entire output area of the display device 111 or a recording target window of an application for outputting screen information to be recorded (step 201). Next, when the user instructs to start recording, the window information recording unit 102
Records window information included in the designated recording target range or window information of the application designated as the recording target (step 202). During the recording operation, the window information recording unit 102 records information on the change (or change) of the window to be recorded in the window information table 103, and the window information recording unit 102 calculates from the position and size of the recording target window. The screen information included in the recording range is recorded in the screen information file 105 (Step 203). After recording the necessary screen information, the user instructs the end of the recording (step 204). After the recording, the screen information editing unit 106 selects the window information table 103 from among many pieces of image information already recorded in the screen information file 105.
Using the window information in the window, reproduction screen information in which only necessary screen information is collected is created (step 205). The screen information recorded by the user at any time and at any place desired by the user by the reproduction screen information file 107 and the screen information reproduction unit 108 at any time.
1 (step 206).

Hereinafter, each processing described in FIG. 2 will be described in detail. First, the operation of designating the recording target window in step 201 will be described with reference to FIG. FIG. 3 is a flowchart showing a recording target designation operation performed by a user at the start of recording. First, when the recording range is not specified, the recording of all windows is designated (step 301). In this case, during recording, screen information and window information of all areas on the display device 111 are recorded. When only a part of the windows is to be recorded, it is designated to record only the window which is the operation target during the recording operation (step 302), or the window to be recorded is directly designated from the existing windows. (Step 303). In this case, since only necessary screen information is recorded, a smaller storage area is required than when all windows are recorded. If the recording target application has not been executed at the start of recording, an application for displaying the recording target screen is specified (step 304). In this case, by executing the target application after the start of recording, all screen information and window information can be recorded from the start of the target application.

Next, the recording start operation in step 202 will be described with reference to FIG. FIG. 4 is a flowchart showing the operation immediately after the start of recording. Information is recorded according to the type of the recording target window specified by the user in FIG. Step 401 of initial window information recording
In the case where full-screen recording is designated, all window information existing at this time is recorded with the recording target attribute. When the recording of a specific recording target window is instructed, the information of the specified recording target window and the window having a parent-child relationship with the specified window are recorded with the recording target attribute, and all other windows are recorded. Record with the attribute of outside. Next, when the recording target application is designated, step 3 in FIG.
The application designated at 04 is executed, and a process number, which is information in the computer for recognizing the application, is stored (step 402).

Next, the operation during recording in step 203 will be described with reference to FIGS. 5 and 6
5 is a flowchart showing the operation of the window information recording unit 102. First, the window information table 103
It is checked whether there is an unconfirmed new window which is not recorded in (step 501). If a new window exists, it is evaluated whether the new window is to be recorded or not to be recorded (steps 502 to 506). When recording of all windows is designated (step 50)
2) Alternatively, if the new window matches the specified existing recording target window or matches the related window (step 503), the window information is recorded with the recording target attribute (step 505). Also,
Even if they do not match, if the unconfirmed window is a window related to the recording target program (step 504), the window information is recorded with the recording target attribute (step 505). However, if the windows do not match and are not related, the new window information is recorded in the window information table 103 with the window attribute not to be recorded (step 506).

Next, when it is instructed to record the window on which the operation has been performed (step 507), it is checked whether the currently operated window has the recording target attribute in the window information table 103 (step 507). Step 50
8) If it is recorded outside the recording target, the attribute is changed to the recording target attribute (step 509). At this point, all windows to be recorded are stored in the window information table 103 as recording target attributes. If you are instructed to record the window in which you performed the action,
It is checked whether there is a window whose position or size has been changed (step 510). If it exists, it is determined whether the changed window is a window of the recording target attribute (step 511). If it is a window of the recording target attribute, the window with the new position and size is displayed together with the time of the change. The information is recorded in the information table 103 (step 512). After updating the information of all the windows to be recorded, the minimum screen area on the display device 111 including all the recording target windows is calculated, and the position and size of the screen area are reported to the screen information recording unit 104 ( Step 513).

FIG. 7 is a flowchart showing the operation of the screen information recording unit 104. In the screen information recording unit 104,
The screen information in the latest recording target screen area received from the window information recording unit 102 is recorded in the screen information file 105 together with the time information (step 701).

FIG. 8 is a diagram showing details of the window information table 103. All information on the windows that existed during the recording operation is recorded in the window information table 103. One piece of window information includes a window name 802 for distinguishing windows, and a window handle 80 managed by the system for distinguishing windows.
3. A recording attribute 80 which is a result of discriminating a recording target
4. The recording target window is composed of detailed information 806 in which position and size information of each window is recorded together with the change time. In the initial window information recording process in step 401 in FIG. 4, it is determined whether or not all windows existing at that time are to be recorded, and are recorded in the window information table 103. In the case of a recording target window, the window position 808 and the size 809 at that time are recorded together with the time 807 as detailed information.
Similarly, when a new window is created during recording, it is recorded in the window information table 103 together with the information of the window. If an instruction to record an operation target window is given, the window is excluded from the recording target until immediately before the operation.
3 may be recorded, and this is confirmed, and the recording attribute 804 is updated. When the position or size of the recording target window is updated during the recording operation, only the detailed information 810 is additionally recorded.

FIG. 9 is a diagram showing details of the screen information 105A. Recording time 902 and recording range 90 at that time
3. It is composed of detailed screen information 904 within the recording range, and is recorded at regular intervals until a recording end command is issued. In the recording termination process in step 204 in FIG. 2, recording in the window information table 103 and the screen information file 105 is terminated in accordance with a recording termination command from the user.

Next, the screen information editing process shown in FIG.
The operation 05) will be described with reference to FIGS. FIG. 10 is a flowchart showing the operation of the screen information editing unit 106. Here, the recorded screen information 10
The necessary screen information is extracted from 5A, and the screen information for reproduction 1
07A is created. First, the user confirms the recorded information in window units (step 1001). here,
Information about the recorded window is extracted from the window information table 103, and a list of recorded window information is displayed on a window selection screen as shown in FIG. When a window to be checked is selected, for example, FIG.
As shown in FIG. 13, when the window name = AAA is selected, the content recorded there is extracted from the screen information file 105 based on the time, position and size information, and displayed on the screen as shown in FIG.

When the recorded contents on the screen are confirmed, necessary screen information is selected (step 1002). Here, from the window selection screen as shown in FIG.
Each window required or a recording element in each window can be selected (1401, 1402). In the process of creating the reproduction screen information in the subsequent step 1003, the screen information 105A is extracted from the screen information file 105 based on the time, position, and size information according to the specified contents.
The reproduction screen information 107 is created.

Here, the specified elements are extracted to the reproduction screen information file 107 in ascending order of recording time. As an example, the two elements (14
01, 1402) will be described.
First, of the two elements 1401 and 1402, the information of the window AAA whose time is old is extracted first (FIG. 1).
5). Since the position and size of the window AAA do not change until “time 90” indicated by reference numeral 1403 in FIG. 14, the position (200, 200) and size (400, 200) screens remain until “time 30” when the window BBB is displayed. Continue to retrieve information. Next, from "time 30",
The screen information of both the window BBB and the window AAA is extracted (FIG. 16). At this time, a range including all the elements to be extracted is calculated from the position and the size, and the screen information 105A is extracted from the screen information file 105. Information about the window information BBB is denoted by reference numeral 140 in FIG.
The window AAA is extracted until "time 50", and the window AAA is extracted until "time 90".

As described above, according to the present embodiment, the user records the window information by recording the window information at the time of recording the screen or automatically changing the recording range using the window information during the recording. It is possible to easily extract the really necessary screen information from the image information by using the recorded window information, and to create optimized reproduction screen information without editing complicated screen information.

[0021]

As is apparent from the above description, according to the present invention, even if the position or size of the window changes, unnecessary information is removed without performing a troublesome operation of resetting the recording range. Information can be recorded and reproduced.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating an embodiment of a screen recording / reproducing apparatus to which the present invention has been applied.

FIG. 2 is a flowchart showing an outline of a process transition in the embodiment.

FIG. 3 is a flowchart illustrating a recording target designation operation performed by a user at the start of recording.

FIG. 4 is a flowchart illustrating an operation immediately after recording is started.

FIG. 5 is a flowchart showing an operation of a window information recording unit.

FIG. 6 is a flowchart showing a continuation of FIG. 5;

FIG. 7 is a flowchart illustrating an operation of a screen information recording unit.

FIG. 8 is a diagram showing details of a window information table.

FIG. 9 is a diagram showing details of screen information.

FIG. 10 is a flowchart showing the operation of the screen information editing unit.

FIG. 11 is a diagram showing an example of a window selection screen displaying a list of recorded window information.

FIG. 12 is a diagram showing a state where window name = AAA is selected on the window selection screen of FIG. 11;

FIG. 13 is a diagram showing an example of screen information displayed when window name = AAA is selected on the window selection screen of FIG. 11;

FIG. 14 is a diagram illustrating an example of a window selection screen for selecting necessary screen information.

FIG. 15 is a diagram illustrating a state in which information of a window AAA whose time is old is extracted first.

FIG. 16 is a diagram showing a state of extracting information of two windows AAA and BBB.

[Explanation of symbols]

Reference numeral 101: screen recording / reproducing device, 102: window information recording unit, 103: window information table, 104: screen information recording unit, 105: screen information file, 106: screen information editing unit, 107: reproduction screen information file, 108
... Screen information reproducing unit, 109 ... Target application, 1
10 ... OS screen output control unit, 111 ... Display device.

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B069 AA01 BA01 BA04 BB16 CA15 FA01

Claims (5)

[Claims] 1. A screen recording / reproducing apparatus for recording information displayed on a display screen by a running application as screen information and reproducing the recorded screen information is present when recording the screen information. Means for recording window information together with screen information; means for automatically changing the recording area in response to changes in window information; and taking out a series of areas displayed by the application as screen information from the recorded window information and screen information. And a means for creating screen information for reproduction. 2. The screen recording / reproducing apparatus according to claim 1, further comprising means for automatically recording all screen information output from the designated recording target application program. 3. The screen recording / reproducing apparatus according to claim 1, further comprising means for automatically recording all screen information for a window specified as a recording target and another window to which the window is related. 4. The screen recording / reproducing apparatus according to claim 1, further comprising means for automatically recording all screen information for a window on which a user operation has been performed and another window associated with the window. . 5. A method for automatically extracting screen information output by a specific application and necessary screen information from screen information in which a plurality of pieces of information output by various applications are recorded. The screen recording / reproducing apparatus according to claim 1.