JPH0981713A - Recording method and reproducing method for screen data - Google Patents

Abstract

PROBLEM TO BE SOLVED: To record data displayed on a screen from an arbitrary point of time by recording management data for displaying image data to be displayed on the screen at each specific recording point of time including recording start request time according to a recording start request and recording display output requests after the request time. SOLUTION: When the data recording start request is inputted to an input part 1, a window server 2 starts recording data, the recording start request is sent to a screen display data recording part 46 through an input event processing part 41 of a dummy server 4 and registered in a time control part 47 from the recording point of time. When the recording is started, a screen display data recording part 46 informs a screen display data acquisition part 44 and an image data acquisition part 45 of the start of the recording. Then an event request part 43 sends an acquisition request to the window server 2, and the contents of an image data holding part 23 and the contents of a management data holding part 24 are acquired and sent from an input event transmission part 21 to the dummy server 4, and sent to the screen display data recording part 46 and recorded in a recording part 6.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a screen data recording method and a reproducing method for recording / reproducing data displayed on a screen.

[0002]

2. Description of the Related Art Conventionally, a window server program for controlling an input device such as a keyboard and a mouse and an output device such as a bitmap display is communicated with an application program as a window system such as an X window system. However, in such a system, the following two methods are known as a method of recording and reproducing the change of the data displayed on the display screen of the output device.

(A) All the image dumps of the screen at each time are recorded, and this recorded data is
A method of reproducing changes in the screen by playing in the order of recording. (B) A method in which the screen input event and display output request from the time of creating the screen are also recorded, and the recorded data can be reproduced from the beginning to reproduce the screen. In other words, by recording all the data related to screen management while recording from the time of creating the screen, it is possible to duplicate the screen using the data related to this screen management when the recorded data is played back from the beginning. By reproducing the subsequent input event and display output request and reflecting the data on the creation screen, it is possible to reproduce the screen change.

[0004]

In this way, conventionally, in order to record and reproduce the data displayed on the screen,
Record an image dump of the screen at each time and reproduce it in the order in which it was recorded, or reproduce the changes in the screen, or
The method of recording the screen input event and the display output request from the time of creating the screen and reproducing the recorded data from the beginning to reproduce the change of the screen has been adopted.

However, in the former method, since all the image dumps of the screen at each time are recorded, an extremely large storage capacity is required for the storage means, which is not practical.

In the latter method, if the screen input event and the display output request from the time when the screen is created are not recorded, the data relating to the screen management will be lost. The screen cannot be created and the screen display cannot be played. Even if a screen input event and a display output request are recorded from the time of creating a screen, if the recorded data is to be reproduced from any time, a large amount of data related to screen management will be created at the time of creating the screen. Since there is not enough data for screen management in the recorded data after recording,
The screen cannot be created and the recorded data cannot be played back from any time.

The present invention has been made in view of the above circumstances, and when recording and reproducing a change in data displayed on a screen, the data is displayed on the screen from an arbitrary time, not from a time when the screen is created. It is an object of the present invention to provide a recording method and a reproducing method of image data that can record data and can reproduce the recorded data from an arbitrary time point.

[0008]

According to the first aspect of the present invention,
In the method of recording the data displayed on the screen, the recording start request records the image data to be displayed on the screen and the management data to be displayed on the screen at each predetermined recording time including the recording start request time. In addition, the display output request after the request time is recorded.

According to a second aspect of the invention, in response to a recording start request, image data to be displayed on the screen and management data to be displayed on the screen are recorded at predetermined recording times including the recording start request time. Further, for the screen display data in which the display output request after the request time point is recorded, if there is a recording time point matching the reproduction request time point by the reproduction request, the image data and the management data recorded at the recording time point are used. While creating the screen, the display output request recorded after the reproduction request time point is reflected in the creation screen,
If there is no recording time point that coincides with the reproduction request time point, a screen is created with the image data and management data at the closest recording time point before that, and between the recording time point of these image data and management data and the reproduction request time point. The display output request is reflected on the creation screen, and the display output request recorded after the reproduction request time is reflected on the creation screen.

According to a third aspect of the present invention, in the method of recording / reproducing the data displayed on the screen, a recording start request causes a recording start time at the recording start request time among predetermined recording times including the recording start request time. The image data to be displayed on the screen and the management data to be displayed on the screen are recorded respectively, and only the image data to be displayed on the screen at other recording points are recorded. The data regarding the data is recorded separately.

According to a fourth aspect of the present invention, in response to a recording start request, the image data to be displayed on the screen at the recording start request time among the predetermined recording times including the recording start request time and the image data to be displayed on the screen. In addition to recording management data, record only the image data to be displayed on the screen at other recording times, and further display output requests after the request time are recorded separately for the data related to image management. If there is a recording time point corresponding to the reproduction request time point by the reproduction request, the image data recorded at the recording time point, the management data recorded at the recording start time point, the recording start time point and the reproduction request time point are recorded. A screen is created from the data related to screen management among the displayed output requests, and the display output requests recorded after the reproduction request time are copied to the created screen. If there is no recording time point coincident with the reproduction request time point, the image data at the closest recording time point before that, the management data recorded at the recording start time point, the reproduction request time point and the image data are recorded. A screen is created from data relating to screen management among display output requests between the closest recording time point and a display output request between the closest recording time point at which the image data is recorded and the reproduction request time point is created. The display output request recorded after the reproduction request time is reflected on the creation screen.

As a result, according to the first and second aspects of the invention, the image data to be displayed on the screen and the image data to be displayed on the screen at each predetermined recording time point including the recording start request time point by the recording start request. The management data is recorded, and the display output request after the request time is recorded. Then, if there is a recording time point that coincides with the reproduction request time point by the reproduction request, a screen is created from the image data and management data recorded at the recording time point, and the display output request recorded after the reproduction request time point is generated. It is reflected on the creation screen. Further, if there is no recording time point that matches the reproduction request time point, a screen is created with the image data and management data of the closest recording time point before that, and the recording time point of these image data and management data and the reproduction request time point are set. The display output request during the period is reflected on the creation screen, and the display output request recorded after the reproduction request time is reflected on the creation screen. This allows the data displayed on the screen to be recorded from any time, not when the screen is created, to record and reproduce changes in the data displayed on the screen. The screen changes can be played from any time.

According to the third and fourth aspects of the present invention, the image data and the screen to be displayed on the screen at the recording start request time among the predetermined recording times including the recording start request time by the recording start request. In addition to recording management data to be displayed on the screen, only the image data to be displayed on the screen at other recording times are recorded, and the display output request after the request time is recorded. Then, if there is a recording time point that coincides with the reproduction request time point by the reproduction request, the image data recorded at the recording time point, the management data recorded at the recording start time point, the recording start time point, and the reproduction request time point are A screen is created from data relating to screen management of the recorded display output requests, and the display output requests recorded after the reproduction request time point are reflected on the creation screen. If there is no recording time point that coincides with the reproduction request time point, the image data at the closest recording time point before that, the management data recorded at the recording start time point, the reproduction request time point and the image data are recorded. A screen is created from data relating to screen management among display output requests between the closest recording time point and a display output request between the closest recording time point at which the image data is recorded and the reproduction request time point is created. The display output request recorded after the reproduction request time is reflected on the creation screen. This minimizes the recorded data,
To record and reproduce changes in the data displayed on the screen, it is possible to record the data displayed on the screen from any time, not from the time when the screen is created. You can play the changes on the screen from the point in time.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. (First Embodiment) FIG. 1 shows an example of the configuration in the case of recording the data displayed on the screen in the first embodiment. In the figure, reference numeral 1 is an input unit, and the input unit 1 is composed of a keyboard, a mouse and the like for receiving an input from a user.

A window server 2 is connected to the input unit 1. The window server 2 processes an input from the input unit 1 as an event, receives an output request, processes the output request, and outputs the output request to the output unit 3. An input event transmission unit 21 processes an input from the input unit 1 as an event. ,
It has an output request processing unit 22 for outputting to the output unit 3, an image data holding unit 23 for holding image data to be displayed on the screen, and a management data holding unit 24 for holding management data to be displayed on the screen. . Here, the output unit 3 includes a display or the like that displays the processing result.

An application 5 is connected to the window server 2 via a pseudo server 4. The application 5 calculates the application and requests the window server 2 to perform processing such as drawing characters and lines and displaying windows based on the calculation result.

The pseudo server 4 mediates the communication between the window server 2 and the application 5, and transmits an input event to the application 5 or generates a display output request and transmits it to the display output request processing section 42. An event for sending an event request from the section 41, the application 5 or the display output request transmitted from the input event processing section 41 to the output request processing section 22, and the event request from the pseudo server 4 to the window server 2. A request unit 43, an image data acquisition unit 44 that requests acquisition of the contents of the image data holding unit 203, a management data acquisition unit 45 that requests acquisition of the contents of the screen management data holding unit 204, and time-related data and image data. Holding part 23
And a content of the management data holding unit a24, an input event and a display output request are recorded in the recording unit 6, and a screen display data recording unit 46 and a time control unit 47 for controlling the time are provided.

Next, the operation for recording data in such a structure will be described with reference to FIG. When the user inputs a data recording start request using the keyboard or mouse of the input unit 1, the window server 2 starts recording in step 201, and the input event transmission unit 201 inputs the pseudo server 4 in step 202. A recording start request is sent to the screen display data recording unit 46 via the event processing unit 41, and the recording time point is registered in the time control unit 47.

Here, the recording time means a fixed time interval (eg: 1
Every minute), it is assumed that there is a certain number of events on the screen, there is no event on the screen for a certain period of time, and the writing color or font is changed. The system may determine which method is used, or the user may set the method using the input unit 1. Also, the recording start time includes the recording start time.

When recording is started, step 20
At 3, the screen display data recording unit 46 notifies the screen display data acquisition unit 44 and the image data acquisition unit 45 of the start of recording. Then, the screen display data acquisition unit 44 and the image data acquisition unit 45 transmit an acquisition request to the window server 2 from the event request unit 43 via the screen display data recording unit 46, and the input event transmission unit 21 transmits the image data holding unit. The contents of 23 and the contents of the management data holding unit 24 are acquired and sent to the pseudo server 4, and the contents acquired by the input event processing unit 41 of the pseudo server 4 are displayed on the screen display data recording unit 4.
6 and is recorded in the recording unit 6.

When the screen display data recording unit 46 receives an interrupt in step 204, step 205
Then, it is judged whether it is a timer interrupt. If it is a timer interrupt, it is judged in step 206 whether the interrupt is the recording time.
In 07, the same processing as step 203 described above is executed, and the process proceeds to the next step 208. If it is not the recording time,
The process immediately proceeds to step 208. That is, if the timer interrupt is at the recording time, step 207
Then, the time control unit 47 informs the screen display data recording unit 46 of the recording time point, and the screen display data recording unit 46 outputs an acquisition request to the image data acquisition unit 44 and the management data acquisition unit 45. Then, these screen display data acquisition unit 44
From the image data acquisition unit 45, the screen display data recording unit 46
The event request unit 43 sends an acquisition request to the window server 2 via the input event transmission unit 21, and the input event transmission unit 21 acquires the contents of the image data holding unit 23 and the contents of the management data holding unit 24 and sends them to the pseudo server 4. The contents acquired from the input event processing unit 41 of the server 4 are sent to the screen display data recording unit 46 and recorded in the recording unit 6.

On the other hand, if it is determined in step 205 that the timer interrupt has not occurred, it is determined in step 209 whether it is an input event or a display output request. In either case, in step 210, the input event of the pseudo server 4 is determined. The input event and the display output request mediated by the processing unit 41 and the display output request processing unit 42 are sent to the screen display data recording unit 46 and recorded in the recording unit 6, and the process proceeds to step 208, while the input event and the display output request are made. If neither of the above, immediately proceed to step 208.

In step 208, it is determined whether the user inputs a recording end request or a screen end request from the input unit 1, and here, until YES is determined, step 204
Then, when an interrupt is received, the processing for a timer interrupt and the processing for a timer interrupt are repeatedly executed.

The data recorded in the recording unit 6 by the screen display data recording unit 46 by the execution of such a series of processes is configured as shown in FIG. In this case, the recording data a is time data at each recording time t1.
, T2, t3, ... Between the contents of the image data holding unit 23 and the management data holding unit 24 and the recording time points t1, t2, t3, ... Which mediate between the input event processing unit 41 and the display output request processing unit 42. Input event and display output request of each recording area b1, b2, b3,
... will be recorded in.

Next, FIG. 4 shows an example of the configuration for reproducing a screen in the first embodiment.
The same reference numerals are given to the same portions as. In this case, the pseudo server 4 has, in the configuration described in FIG. 1, a reproduction receiving unit 48 that further receives a time point to be reproduced, a screen display data reproducing unit 49 that reproduces from the received reproduction time point, and a recorded data search. A data search unit 50 for performing the search is added.

Next, the operation of reproducing recorded data in such a configuration will be described with reference to FIG. Now, when the user inputs a reproduction request from the input unit 1, step 5
01, the input event transmission unit 21 of the window server 2
Then, a reproduction request is sent to the screen display data reproducing unit 49 via the input event processing unit 41 of the pseudo server 4.

Then, in step 502, the screen display data reproducing unit 49 notifies the reproduction time point reception unit 48 of the reproduction time point, and the data retrieval unit 50 determines whether or not the recorded data has a recording time point that matches the reproduction time point. Somehow is searched.

If there is a recording time point that coincides with the reproduction time point, in step 503, the screen display data reproducing section 4
9, the recording unit 6 is searched through the data search unit 50 for a record of the contents of the image data holding unit 23 and the contents of the management data holding unit 24 at the recording time that coincides with the reproduction time,
This search result is sent to the window server 2 by the display output request processing unit 42 via the screen display data reproducing unit 49.

As a result, the output request processing unit 22 of the window server 2 creates a screen in step 504 and outputs it from the output unit 3. At the same time, in step 505, the screen display data reproducing unit 49 searches the input event and the display output request after the reproduction time point through the data searching unit 50, and the input event and the display output request are the screen display data. It is sent from the reproducing unit 49 to the window server 2 via the display output request processing unit 42, and step 5
In 06, it is reflected in the screen creation by the output request processing unit 22 of the window server 2.

On the other hand, if there is no recording time point that coincides with the reproduction time point in step 502, in step 507 the contents of the image data holding section 23 and the management data retention time at the recording time point before the reproduction time point and closest to the reproduction time point. The record of the contents of the section 24 is searched, and the search result is the image display data reproducing section 49.
Is sent to the window server 2 by the display output request processing unit 42 via.

As a result, in step 504, the screen is created by the output request processing unit 22 of the window server 2 and is output from the output unit 3. Also, step 508
Then, the data search unit 50 searches for the input event and the display output request from the recording time point to the reproducing time point, and the step 5
At 09, it is reflected on the screen created by the display output request processing unit 42 via the screen display data reproducing unit 49, and at step 505, after the reproduction time point via the data searching unit 50 by the screen display data reproducing unit 49. Of the input event and the display output request, and the input event and the display output request are sent from the screen display data reproducing section 49 to the window server 2 via the display output request processing section 42, and in step 506, the window server 2 This is reflected in the screen creation by the output request processing unit 22.

Therefore, in this way, as shown in FIG. 6, when there is a recording start request a, image data is held at each recording time t1, t2, t3, ... Including the recording start request a. Contents b1 of the section 23 and the management data holding section 24
, B2, b3, ... Are recorded together with the input events and the display output request data c1, c2, c3, ... Between the recording times t1, t2, t3 ,. However, for example, if there is a reproduction request d1 that coincides with the recording time point t2 among the recording time points t1, t2, t3, ..., The contents b2 of the image data holding section 23 and the management data holding section 24 recorded at that time point.
While creating a screen, the input event and the data c2, c3, ... Of the display output request after that time are reflected on the creation screen and reproduced, while, for example, the recording time t3, t4.
If there is a reproduction request d2 that does not match the recording time,
A screen is created from the content b3 of the image data holding unit 23 and the management data holding unit 24 at the recording time t3 closest to this time before the time of the reproduction request d2, and the recording time t3 and the time of the reproduction request d2 are set. Between the input event and the display output request data c3 'are reflected on the created screen, and the input event and the display output request data c3'', c4, ... after the reproduction request d2 are reflected on the created screen. This allows the recorded data to be played back without changing the data displayed on the screen even if the change in the data displayed on the screen is recorded and played back. It is possible to reproduce the change of the screen by reproducing the generated data from an arbitrary time point. (Second Embodiment) FIG. 7 shows a configuration example in which data displayed on the screen is recorded in the second embodiment, and the same parts as those in FIG. Attached.

In this case, when the data is recorded in the pseudo server 4, the data identification section 5 records the data separately for each type of data.
1 is added. Further, as the recording unit 6, a recording unit 61 that records the contents of the image data holding unit and the management data holding unit.
In addition, a recording unit 62 that records data relating to screen management when recording an input event and a display output request and a recording unit 63 that records other data are separately provided.

Next, the operation for recording data in such a structure will be described with reference to FIG. Now, when the user inputs a data recording start request using the keyboard or mouse of the input unit 1, recording is started by the window server 2 in step 801, and input to the pseudo server 4 by the input event transmission unit 801 in step 802. A recording start request is sent to the screen display data recording unit 46 via the event processing unit 41, and the recording time point is registered in the time control unit 47.

When recording is started, step 80
At 3, the screen display data recording unit 46 notifies the screen display data acquisition unit 44 and the image data acquisition unit 45 of the start of recording. Then, the screen display data acquisition unit 44 and the image data acquisition unit 45 transmit an acquisition request to the window server 2 from the event request unit 43 via the screen display data recording unit 46, and the input event transmission unit 21 transmits the image data holding unit. The contents of 23 and the contents of the management data holding unit 24 are acquired and sent to the pseudo server 4, and the contents acquired by the input event processing unit 41 of the pseudo server 4 are displayed on the screen display data recording unit 4.
6 and is recorded in the recording unit 6 in step 804.

When the screen display data recording section 46 receives an interrupt in step 805, step 806
Then, it is judged whether it is a timer interrupt. If it is a timer interrupt, it is judged in step 807 whether or not the interrupt is the recording time. If it is the recording time, step 8
08, the screen display data recording unit 46 from the time control unit 47.
The recording time is notified to the screen display data recording unit 46, and the acquisition request is output to the image data acquisition unit 44. Then, the image data acquisition unit 45 causes the screen display data recording unit 4 to
From the event requesting unit 43 via the window server 2
To the pseudo server 4, the contents of the image data holding unit 23 are acquired from the input event transmission unit 21, and the contents acquired from the input event processing unit 41 of the pseudo server 4 are transmitted to the screen display data recording unit 46. And is recorded in the recording unit 61 in step 809. Then, the process proceeds to step 810. On the other hand, if it is not the recording time in step 807, the process immediately proceeds to step 810.

On the other hand, if it is determined in step 806 that it is not a timer interrupt, it is determined in step 811 whether it is an input event or a display output request. In either case, in step 212, the input event of the pseudo server 4 is determined. The input event and the display output request mediated by the processing unit 41 and the display output request processing unit 42 are sent to the screen display data recording unit 46, and the data identification unit 51 divides the screen management data and other data into a recording unit 62. , 63, and proceeds to step 810. On the other hand, if neither an input event nor a display output request, then immediately proceed to step 8
I will proceed to 10.

In step 810, it is determined whether the user has input a recording end request or a screen end request from the input section 1, and step 805 until a YES determination is made here.
Then, when an interrupt is received, the processing for a timer interrupt and the processing for a timer interrupt are repeatedly executed.

By the execution of such a series of processing, the screen display data recording unit 46 causes the recording units 61, 6
The data recorded in Nos. 2 and 63 are configured as shown in FIG.

In this case, the recording data a is time data, and the contents of the image data holding unit 23 and the management data holding unit 24 are recorded in the recording area b at the recording time t1 at the start of recording.
In addition to being recorded in 1 and c, the data related to the screen management of the input event and the display output request and the other data are recorded in the storage areas d1 and e1. For the respective recording time points t2, t3, ... Image data holding unit 23
Of the contents of the management data holding unit 24 and the management data holding unit 24, only the contents of the image data holding unit 23 are recorded in the recording areas b2, b3 ,. Is the recording area d2,
, d3, ..., E2, e3 ,. That is, regarding the contents of the image data holding unit 23 and the management data holding unit 24, only the contents of the image data holding unit 23 are recorded at the recording time point t1 at the recording start time and the other recording time points t2, t3, .... Is recorded. Further, regarding the data relating to the screen management data of the input event and the display output request and the other data, the data between each recording time point and the next recording time point are collectively recorded.

Next, FIG. 10 shows an example of the configuration for reproducing a screen in the second embodiment.
The same reference numerals are given to the same portions as. In this case, the pseudo server 4 further records in the configuration described in FIG. 7, a reproduction control unit 52 having a reproduction reception unit that receives a reproduction time and a screen display data reproduction unit that reproduces from the received reproduction time. A data search unit 50 for searching data is added.

Next, the operation of reproducing recorded data in such a configuration will be described with reference to FIG. Now
When the user inputs a reproduction request from the input unit 1, in step 1101, the input event transmission unit 21 of the window server 2 reproduces the screen display data reproduction unit of the reproduction control unit 52 via the input event processing unit 41 of the pseudo server 4. Request is sent.

Then, in step 1102, the screen display data reproducing unit of the reproduction control unit 52 notifies the reproducing time point to the reproducing time point receiving unit, and the data searching unit 50 causes
It is searched whether or not the recorded data has a recording time that matches the reproduction time.

If there is a recording time point that coincides with the reproduction time point, in step 1103, the image at the recording time point that coincides with the reproduction time point by the screen display data reproducing section of the reproduction control section 52 via the data searching section 50. The contents of the data holding unit 23, the contents of the management data holding unit 24 recorded at the recording start time, and the data related to screen management among the input event and the display output request recorded between the recording start time and the reproduction time are searched. The search result is sent to the window server 2 by the display output request processing unit 42 via the screen display data reproduction unit of the reproduction control unit 52.

As a result, in the output request processing unit 22 of the window server 2, a screen is created and output from the output unit 3 in step 1104. At the same time, in step 1105, the screen display data reproducing unit of the reproduction control unit 52 retrieves the input event and the display output request after the reproduction time point via the data retrieval unit 50, and the input event and the display output request are Is transmitted from the screen display data reproducing unit of the reproduction control unit 52 to the window server 2 via the display output request processing unit 42, and is reflected in the screen creation by the output request processing unit 22 of the window server 2 in step 1106.

On the other hand, if there is no recording time point that coincides with the reproduction time point in step 1102, the contents of the image data holding unit 23 at the recording time point before the reproduction time point and closest to the reproduction time point and the recording start time in step 1107. The content of the management data holding unit 24 recorded at the time point, the data related to the screen management among the input event and the display output request recorded between the recording start time point and the reproduction time point are searched, and the search result is searched. It is sent to the window server 2 by the display output request processing unit 42 via the image display data reproducing unit.

As a result, in step 1104, the screen is created by the output request processing unit 22 in the window server 2 and is output from the output unit 3. Also, step 110
In step 8, the input event and the display output request from the recording time to the reproduction time are searched by the data search unit 50, and in step 1109, the display output request processing unit 42 via the screen display data reproduction unit of the reproduction control unit 52. This is reflected on the created screen, and in step 1105, the screen display data reproducing unit of the reproduction control unit 52 searches through the data searching unit 50 for the input event and the display output request after the reproduction time,
These input event and display output request are sent to the reproduction control unit 52.
Is sent to the window server 2 from the screen display data reproduction unit of the display output request processing unit 42 in step 1106.
Then, it is reflected in the screen creation by the output request processing unit 22 of the window server 2.

Therefore, in this way, when there is a recording start request a as shown in FIG. 12, the content b1 of the image data holding unit 23 at the recording time t1 which is the recording start request a.
And the content c of the management data holding unit 24 is recorded,
At the subsequent recording time points t2, t3, ..., The contents b2, b3, ... Of the image data holding section 23 are recorded, and together with these, input events and display output requests between the recording time points t1, t2, t3 ,. , Screen management data d11, d1
2, d13, ... And other data d21, d22, d23 ,.
The recording is performed separately at, for example, the recording time t
When there is a reproduction request e1 that coincides with the recording time point t2 among 1, 1, t2, t3, ..., The contents b2 of the image data holding section 23 recorded at that time point and the management data holding section 24 at the time point of the recording start request a. A screen is created by the data d11 relating to the screen management of the input event and the display output request between the content c and the recording start request a to the reproduction request e1, and the input event and the display output request data d12 after that time, , and d22, d23, ... Are reflected on the creation screen and reproduced, while, for example, recording time points t3, t4.
If there is a reproduction request e2 that does not match the recording time,
Before the reproduction request e1, the content b3 of the image data holding unit 23 at the recording time t3 closest to this time, the content c of the management data holding unit 24 at the recording start request a, and the reproduction request from the recording start request a Data d11, d1 relating to screen management in the input event and display output request between the time point e2
2. Create a screen with d13 'and record time t3
And the data d13 'and d23' of the display output request between the input event and the time of the reproduction request e2 are reflected on the creation screen, and the input event and the data of the display output request d13 '' after the time of the reproduction request e2, d14, ... and d23 '', d2
4 and so on are reflected on the created screen and reproduced. Even in this case, even if the change in the data displayed on the screen is recorded and reproduced, it is possible to record the recorded data without recording from the time of creating the screen. It is possible to reproduce the change of the screen by reproducing the recorded data from an arbitrary time point, and it is also possible to reproduce the change of the screen without recording a large amount of data.

In the above description, the window server 2, the pseudo server 4, and the application 5 communicate with each other independently, and the screen display data recording section 46 is stored in the pseudo server 4.
Although the case of including the
The configuration shown in (a) to (d) is also conceivable.

FIG. 7A shows the case where the window server 2, the screen display data recording section 46 and the application 5 communicate with each other independently.
Is not in the pseudo server. FIG. 2B shows that the screen display data recording unit 46 and the application 5 are integrated with each other, and the window server 2 communicates with each other. In FIG. 6C, the window server 2 and the screen display data recording unit 46 are integrated with each other, and the application 5 is used for communication. In FIG. 3D, the window server 2, the screen display data recording unit 46, and the application 5 are all integrated into 0.

Further, in the configuration shown in FIG. 13, instead of the screen display data recording unit 42, the screen display data reproducing unit 4
The present invention can be similarly applied to each of the systems described above.

Further, in the above-mentioned embodiment, the pseudo server 4 is used to record and reproduce the image data, but these operations can also be realized in the window server.

[0053]

As described above, according to the present invention, when the change of the data displayed on the screen is recorded / reproduced, the data displayed on the screen is displayed from an arbitrary time, not from the time of creating the screen. Can be recorded, and the change of the screen can be reproduced from an arbitrary point of time of the recorded data, and the change of the screen can be reproduced by minimizing the recorded data.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration example when a screen is recorded according to a first embodiment of this invention.

FIG. 2 is a flowchart for explaining screen recording according to the first embodiment.

FIG. 3 is a diagram showing a configuration of recording data used in the first embodiment.

FIG. 4 is a diagram showing a configuration example when a screen is reproduced according to the first embodiment.

FIG. 5 is a flowchart for explaining screen reproduction according to the first embodiment.

FIG. 6 is a diagram for explaining recording / reproduction of a screen according to the first embodiment.

FIG. 7 is a diagram showing a configuration example when recording a screen according to the second embodiment of the present invention.

FIG. 8 is a flowchart for explaining screen recording according to the second embodiment.

FIG. 9 is a diagram showing a configuration of recording data used in the second embodiment.

FIG. 10 is a diagram showing a configuration example when a screen is reproduced according to the second embodiment.

FIG. 11 is a flowchart for explaining screen reproduction according to the second embodiment.

FIG. 12 is a diagram for explaining recording / reproduction of a screen according to the second embodiment.

FIG. 13 is a diagram for explaining another embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Input part, 2 ... Window server, 21 ... Input event transmission part, 22 ... Output request processing part, 23 ... Image data holding part, 24 ... Management data holding part, 3 ... Output part, 4 ... Pseudo server, 41 ... Input event processing unit, 42 ... Display output request processing unit, 43 ... Event request unit, 44 ... Image data acquisition unit, 45 ... Management data acquisition unit, 46 ... Screen display data recording unit, 47 ... Time control unit, 48 ... Reproduction Receiving unit, 49 ... Screen display data reproducing unit, 50 ... Data searching unit, 51 ... Data identifying unit, 52 ... Reproduction control unit, 5 ... Application, 6, 61, 62, 63 ... Recording unit.

Claims (4)

[Claims] 1. A method of recording data displayed on a screen, comprising: a recording start request, image data to be displayed on the screen, and image data to be displayed on the screen at predetermined recording time points including the recording start request time point. A method for recording screen data, characterized in that management data is recorded respectively, and further, a display output request after the request time is recorded. 2. The recording start request records image data to be displayed on the screen and management data to be displayed on the screen at each predetermined recording time point including the recording start request time point, and further after the request time point. For the screen display data in which the display output request is recorded, if there is a recording time point that coincides with the reproduction request time point by the reproduction request, a screen is created with the image data and management data recorded at the recording time point, and A display output request recorded after the reproduction request time is reflected on the creation screen, and if there is no recording time that matches the reproduction request time, a screen is created by the image data and management data of the closest recording time before that. In addition, the display output request between the recording time of these image data and management data and the reproduction request time is reflected on the creation screen, and The method of reproducing screen data, characterized in that to reflect the display output request that is recorded after the raw request time to the creation screen. 3. A method of recording data displayed on a screen, wherein image data to be displayed on the screen at the recording start request time among predetermined recording times including the recording start request time by a recording start request. The management data to be displayed on the screen are recorded respectively, and only the image data to be displayed on the screen at other recording points are recorded, and the display output request after the request point is related to the image management data and other data. A method of recording screen data, characterized by separately recording and. 4. The recording start request records the image data to be displayed on the screen and the management data to be displayed on the screen at a predetermined recording time point including the recording start request time point. Along with the screen display data, only the image data to be displayed on the screen at the other recording time is recorded, and the display output request after the request time is recorded separately for the image management data and other data. If there is a recording time point corresponding to the reproduction request time point by the reproduction request, the image data recorded at the recording time point, the management data recorded at the recording start time point, the recording start time point and the reproduction request time point are recorded. A screen is created from the data related to screen management among the displayed output requests, and the display output requests recorded after the reproduction request time are copied to the created screen. If there is no recording time point coincident with the reproduction request time point, the image data at the closest recording time point before that, the management data recorded at the recording start time point, the reproduction request time point and the image data are recorded. A screen is created from data relating to screen management among display output requests between the closest recording time point and a display output request between the closest recording time point at which the image data is recorded and the reproduction request time point is created. A method for reproducing screen data, characterized by reflecting on a screen, and further reflecting a display output request recorded after the reproduction request time on the creation screen.