JPH11203002A - Input data recording and reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reproduce the state of a computer at an optional time by recording the input data and the information acquired by a sensor, a network, etc., and then reproducing the recorded input data. SOLUTION: The time base user's operating activities are recorded by a user input recording means 1, and at the same time the sensor information and the network information are recorded by a sensor information recording means 2 and a network information recording means 3 respectively. Then these input data sequences are related with each other by a recorded data associating means 4 and made to retrieve by a keyword. A computer state reproducing means 6 reproduces the input data sequence recorded by the means 2 against the computer state that is recorded by a computer state recording means 5 at a designated time to reproduce the state of a computer at a designated time or a time that is related by the keyword.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention records, as input data, an operation performed by a user using an input device such as a mouse or a keyboard when using a computer, and information obtained by a sensor or a network. The present invention also relates to an input data recording / reproducing apparatus for reproducing a state of a computer at an arbitrary time by reproducing input data recorded thereafter.

[0002]

2. Description of the Related Art In recent years, computers have become more and more popular due to increasingly sophisticated functions and low prices, and many work activities performed by humans have been performed using computers. Work activities using computers include writing texts, making charts, numerical calculations, creating programs, creating and using databases,
Information exchange via network (e-mail and WWW)
Although it is still very diverse, it is expected that more and more work activities will be performed using computers in the future.

FIG. 12 is a diagram showing a flow of information when a user performs a work activity using a computer. FIG.
As shown in FIG. 2, when a certain work activity is started by the user, work data (including intermediate products and finished products) is generated in the memory of the computer, and this work data is stored in the memory through the work process. Will be retained. The user gradually updates the work data by applying various processes to the work data in the memory via an input device such as a keyboard and a mouse, thereby creating work data satisfying the purpose of the work.

[0004] In a conventional computer, work data temporarily stored in a memory due to factors such as a limitation of a storage capacity of an external storage device, a limitation of a data writing / reading speed, and a limitation of a processing speed of a CPU. Was not always written to an external storage device for long-term recording. For this reason, when the user wants to record work data in the memory in an external storage device or the like in order to retain the work data for a long time, a special operation (for example, execution of a command such as “save” or “save”) is explicitly performed. It was necessary to run.

That is, while the work data in the memory is updated in real time according to the operation of the user, the work data recorded in the external storage device is updated at a relatively large time interval. There is a gap. Due to the above-mentioned causes, in the conventional computer, when the computer suddenly becomes abnormal (so-called "the computer has fallen"), the work data in the memory is lost and the user's work is wasted. It can happen.
Conventional techniques for this problem include regular (eg, 10
There is a method of automatically recording the work data in the memory to the external storage device every minute), a method of simultaneously performing the same processing by a plurality of computers and always backing up the data.

In an X window system or the like, a graphical user interface (GU)
An input event recording / reproducing apparatus has been devised in which an input event input by a user via I) is recorded in a file, and thereafter, the input event is read from the file at a necessary time, and the input event is reproduced. . However, in the related art, although work data updated periodically is recorded in the external storage device, work data at an arbitrary time during the update interval cannot be reproduced. In the prior art, the work data on the current memory is maintained in a computer in which no abnormality has occurred among a plurality of computers, but the work data at an arbitrary time in the past cannot be reproduced similarly to the related art. Also, using multiple computers for one task is not efficient.

On the other hand, the prior art is originally a technique for testing a computer program, automatic demonstration, or converting a command into a macro. Therefore, the recording of the event is performed only between the designated start time and the end time, and there is no record of the computer state as the initial state, so that the work data at an arbitrary time cannot be reproduced. Furthermore, since the time series of events recorded in the file is recorded in a format such as time and event name, the keyword for specifying a specific event in the recorded event series is only the event name or the time. Only available. For this reason, when the event series becomes enormous, it becomes very difficult to search / designate a certain event on the event series.

[0008]

As described above, when a user performs a work activity using a conventional computer, the work data stored in a memory is updated and the work data recorded in an external storage device is updated. Is not performed synchronously, so that the user needs to consciously execute a special operation in order for the user to synchronize the work data on the memory with the work data on the external storage device. In order to solve the above problem, as described above, a method of periodically recording work data in a memory to an external storage device, as described above,
There is a method of performing the same processing at the same time by a plurality of computers at the same time and always backing up the data.

Further, as described above, the input event recording / reproducing apparatus such as the X window system records only the time series of the input events within the designated period, so that the work data outside the designated period can be reproduced. Can not.
In addition, searching for a specific event in a recorded event series involves only a time and an event name, and it is difficult to search when the event series becomes enormous. The present invention
It is made in order to solve the above problems, the operation performed by the user on the computer, and various types of information obtained by sensors, networks, etc. are recorded as input data, and the recorded input data The purpose of this is to reproduce the state of the computer at an arbitrary time by reproducing. It is another object of the present invention to provide a search keyword other than a time or an event name as a keyword for searching for certain data on the recorded input data, thereby facilitating the search.

[0010]

FIG. 1 is a block diagram showing the principle of the present invention. In order to achieve the above object, according to the present invention, as shown in FIG.
A user input recording means 1 for recording computer operations performed at various stages via a computer, a sensor information recording means 2 for recording sensor data obtained by various sensors 10a connected to a computer 10, and a computer network A network information recording means 3 for recording information obtained through 10c, and a record for enabling a user to search an input data sequence recorded in association with a user input record, a sensor information record, and a network information record with various keywords. Data association means 4, computer state recording means 5 for recording the state of the computer at a specified time,
An input data recording / reproducing means comprising a recorded input data sequence and a computer state reproducing means 6 for reproducing a state of the computer 10 at an arbitrary time from the recorded computer state is provided in the computer system.

[0011] The user input recording means 1 records in detail the time series (history) of user operation activities when the user uses the computer 10 to perform work, and also changes the computer state at a specified time. The state of the computer 10 is reproduced at an arbitrary time by recording by the state recording means 5 and reproducing the input data time series recorded with respect to the recorded computer state at the designated time by the computer state reproducing means 6. Also provided is a record data association means 4 for associating the input data sequences recorded by the user input recording means 1, the sensor information recording means 2, and the network information recording means 3 with each other using the time as a key so as to be able to search by a keyword, By specifying a keyword, a time associated with the keyword can be searched and reproduced in the computer state at that time.

In the present invention, since the above-mentioned configuration is adopted, the user can reproduce the computer state at an arbitrary time, and it becomes unnecessary for the user to perform a special operation such as "save". . In addition, it is possible to freely perform the operation again (so-called "undo"). When searching for the recorded input data time series or work history, the recorded data association means 6 uses input data other than time and event names, sensor data, and information obtained via a network as search keywords. As a result, the search can be executed efficiently.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS One embodiment of the input data recording / reproducing apparatus of the present invention will be described with reference to the drawings. FIG. 2 is a block diagram showing a configuration of an embodiment of the present invention, and FIG. 3 is a block diagram of a conventional computer system shown corresponding to FIG. Generally, as shown in FIG. 3, a computer system includes a CPU 11, an output device 12 such as a display device, a memory 13, an external storage device 1 such as a hard disk, a CD, and an MO.
4, an input device 15 such as a keyboard and a mouse. Further, a WWW page, NetNews, electronic mail, and the like are connected to the CPU 11 via the network 17, and various information is taken into the CPU 11 from these. Further, various sensors 16 such as a microphone and a camera are connected to the CPU 11 as necessary, and the external environment data measured by the sensor 18 is taken into the CPU 11.

In the above system, when a user operates an input device 15 such as a keyboard or a mouse to perform a task, a device signal output from the input device 15 is given to an event generating means 18 and an event signal corresponding to the input operation is sent to the CPU 11. Sent to As a result, the operating system (hereinafter referred to as OS) and various application programs (hereinafter referred to as applications)
Is executed, and work data is generated on the memory 13 as described above, and this work data is held on the memory 13. The user gradually updates the work data by applying various processes to the work data on the memory 13 via the input device 15 such as a keyboard and a mouse, thereby creating work data satisfying the purpose of the work.

In the above computer system, in the present embodiment, as shown in FIG.
A user input recording unit 1 for recording an event signal, a sensor information recording unit 2 for recording sensor information, a network information recording unit 3 for recording network information, and a recording data association unit 4 for associating these recording signals are provided. . A computer state recording means 5 for recording the state of the computer at a certain point in time;
Computer state reproducing means 6 for reproducing the computer state from the various recording signals and the computer state at a certain point in time is provided. When it is necessary to reproduce the state of the computer at a certain point in time, the computer state reproducing means 6 reproduces the computer state recorded in the computer state recording means 5 and then stores the user state in the reproduced computer state. 1. The time series of the input data recorded in the sensor information recording means 2 and the network information recording means 3 is operated to reproduce a computer state at a certain point in time.

Hereinafter, each of the above means will be described in order. (1) User Input Recording Means, Sensor Information Recording Means, and Network Information Recording Device The user input recording means 1 is an input device 15 (mouse, mouse, A device signal obtained from a keyboard, a pen input device, a microphone, etc.) and an event obtained from the event generating means 18 are recorded in various stages as a time series. For example, as shown in FIG. 4, when the computer state at time m changes to the computer state at time n due to the work performed by the user, the user input recording means 1 causes the above-described change. All user operations are recorded. Here, m and n represent time, and m <n.

The user input data recorded in the user input recording means 1 includes, for example, a time series of an input event generated by a mouse operation or a keyboard operation, and a time series of a device signal flowing through a mouse cable, a keyboard cable, or the like. , Time series of typed keys, time series of execution commands, time series of used application programs, and the like. In addition, a keyword (such as a keyword such as a noun expressed in kanji or katakana or a URL) that characterizes a specific time from the time series of the input typed keys.
Etc.) automatically and record them.

As described above, the user input recording means 1
A user computer system configured by a user and a computer is characterized by recording various information transmitted in the system at various stages. As shown in FIG. 5, the sensor information recording means 2 records data obtained by various sensors 2 connected to a computer as time-series data. As the sensor, for example, a thermometer, a hygrometer, a light meter, a radio wave antenna, a camera, a microphone, or the like can be used as a device for measuring the state of the external environment. A table thermometer, an electroencephalograph, a heart rate meter, a weight scale, a sphygmomanometer and the like can be used. The sensor information recording unit 2 extracts and records information serving as a keyword from information obtained by various sensors. For example, if the temperature and humidity are abnormally high, a keyword such as "high temperature / humidity" is recorded. If the user's body temperature detected by the sensor is higher than normal heat, a keyword such as "poor physical condition" is recorded.

As shown in FIG. 6, the network information recording device 3 records various information obtained through a computer network as time-series data. The data to be recorded includes information on the network such as net news and a WWW page accessed by the user via the network (title, creator name, text, URL, keyword, etc.), a specific WWW page (for example, a newspaper company). Page, etc.) (e.g., periodically and automatically collecting keywords from top news, etc.), the content of received e-mails, and the like.

FIG. 7 is a diagram showing an example of data recorded in the user input recording means 1, the sensor information recording means 2, and the network information recording device 3. As shown in the figure, the user input, sensor information recording means 2, and network information recording device 3 record user input, sensor information, and network information at time intervals corresponding to the respective data types. You. For example, an input event of the user input data is recorded for each event processing time in the computer, and sensor information is recorded at a designated time (for example, every hour) or a time when a change occurs. The network information is also recorded at the time of accessing the network or at a specified time.

(2) Recording data association means As shown in FIG. 8, the recording data association means 4 comprises the above-mentioned input data recording means 1, sensor information recording means 2, and
Various types of information data obtained by the network information recording means 3 are associated with each other using time as a key as shown in FIG. For example, when a user prepares a sentence on the theme of Hawaii on a typhoon day, data “Hawaii” is recorded as an input keyword by the input data recording means 1, and the WWW of a newspaper company is recorded by the network information recording means 3. Since the data “typhoon” is collected and recorded from the top news on the page, the recorded data association means 4 associates “Hawaii” on the input data sequence with “Typhoon” on the network information record 3. If the user wants to reproduce the sentence at a later date, "Hawaii" is used as a key to search and specify the user input record.
Not only can you use "typhoons".

(3) Computer status recording means The computer status recording means 5, as shown in FIG.
The state of the computer at the designated time (the state of the CPU, the data stored in the memory, the data stored in the external storage device, the state of the input device, the state of the sensor,
Network status). In order to periodically record the computer status, for example, the status of the computer immediately after being started every day may be recorded. Also, the computer status at several times in the entire usage period of the computer may be recorded. This makes it possible to reproduce the computer state at an arbitrary point in time as described later.

(4) Computer state reproducing means The computer state reproducing means 6, as shown in FIG.
The computer state at the time m recorded by the computer state recording means 5 is reproduced, and then the computer state is recorded by the user input recording means 1, the sensor information recording means 2, and the network information recording means 3 for this computer. The state of the computer at an arbitrary time n is reproduced by applying a computer input after the time m. However,
m <n.

For example, if the computer suddenly becomes abnormal during the operation, the operation data on the memory may be lost. In such a case, after restarting the computer, the time immediately before the abnormality is designated and the computer state reproducing means 6 is started. The computer state reproducing means 6
After reproducing the computer state at the time recorded by the computer state recording means 5 (for example, the first computer state in the morning), the computer input time series recorded in the user input recording means 1 or the like is made to act on the computer, Reproduce the computer state at the time. Further, as described above, when it is necessary to reproduce a sentence created by the user in the past, even if the time at which the sentence was created is unknown, for example, a keyword in the sentence or the sentence is created. The above sentence can be reproduced if the user remembers the incident that occurred when he was doing, the weather conditions (for example, high temperature / humidity, etc.) at that time, and the user's condition (healthy condition, etc.).

In such a case, the user inputs a keyword in the text or an incident that occurred while the text was being created, a weather condition, and the like, and activates the computer state reproducing means 6. The computer state reproducing means 6 searches for the keyword recorded in the user input recording means 1, the temperature and humidity recorded in the sensor information recording means 2, or the news information recorded in the network information recording means 3, and Keywords, incidents, or
Find out weather conditions. Then, by associating the various information data and the time shown in FIG. 9 with the time, the time when the above-mentioned text was created is obtained, and the computer state before that time is reproduced. Reproduce the computer state at the time of creating.

After the computer state at a certain time is reproduced on the computer as described above, the user operation, sensor information, network information, and the like after the time are applied to the computer again, The state of the computer at any time after the above time can be reproduced. For example, if it is necessary to reproduce the text at the next time after reproducing the text at one point as described above, the user operation and the like recorded in the user input recording means 1 as described above are transmitted to the computer. Act again and reproduce the text at any later point.

[0027]

As described above, in the present invention,
The computer state at the time designated by the computer state recording means is recorded, and then the input data added to the computer after the designated time is recorded by the input data recording means, the sensor information recording means, and the network information recording means. Since these three types of records are processed by the computer state reproducing means, the state of the computer at any time after the designated time can be reproduced. In addition, if the computer state at several times during the entire period of use of the computer is recorded by using the computer state recording means, the computer state at any time during the entire period of use can be reproduced by the above effect. it can. For this reason, it becomes unnecessary for the user to perform a special operation such as “save”, and it is possible to arbitrarily perform the operation again (so-called “undo”).

Further, by associating the user input data, various sensor information, and the information obtained through the network with the time by using the time data as a key, the recorded data association means of the present invention can obtain the data by the three kinds of means. It is possible to efficiently search and refer to the information on the obtained data time series, and it is possible to efficiently search for the time to be reproduced.

[Brief description of the drawings]

FIG. 1 is a principle configuration diagram of the present invention.

FIG. 2 is a block diagram showing a configuration of an embodiment of the present invention.

FIG. 3 shows a conventional computer shown in FIG.
It is a block diagram of a system.

FIG. 4 is an explanatory diagram of a user input recording unit.

FIG. 5 is an explanatory diagram of a sensor information recording unit.

FIG. 6 is an explanatory diagram of a network information recording unit.

FIG. 7 is a diagram illustrating an example of data recorded in each recording device.

FIG. 8 is an explanatory diagram of recording data association means.

FIG. 9 is a diagram for explaining data association by a recorded data association unit.

FIG. 10 is an explanatory diagram of a computer status recording unit.

FIG. 11 is a diagram illustrating the reproduction of a computer state at a certain time by a computer state reproduction unit.

FIG. 12 is a flow of information when a user performs a work activity using a computer.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 User input recording means 2 Sensor information recording means 3 Network information recording means 4 Recording data association means 5 Computer state recording means 6 Computer state reproduction means

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Kuniharu Takayama 4-1-1, Kamiodanaka, Nakahara-ku, Kawasaki-shi, Kanagawa Prefecture Inside Fujitsu Limited (72) Inventor Hirohisa Naito 4-1-1, Kamiodanaka, Nakahara-ku, Kawasaki-shi, Kanagawa No. 1 Inside Fujitsu Limited

Claims (6)

[Claims] 1. An input data recording / reproducing apparatus which records input data and reproduces a state of a computer at a certain point in time. User input recording means for extracting and recording a keyword; computer state recording means for recording the state of the computer at a specified time; state of the computer at an arbitrary time from the recorded input data sequence and the recorded computer state Computer status reproducing means for reproducing the input data time series, and recording data association means for associating the recorded input data time series with time as a key so that the keyword can be searched by the keyword. Based on the association of the input data series by the specified time or Input data recording / reproducing apparatus characterized by reproducing the computer status at the time associated with the specified keyword. 2. An input data recording / reproducing apparatus which records input data and reproduces a state of a computer at a certain point in time. User input recording means for extracting and recording keywords; sensor information recording means for recording sensor data obtained by a sensor or the like connected to a computer; and network information for recording information obtained via a computer network Recording means, computer state recording means for recording the state of the computer at a specified time, and computer state reproducing means for reproducing the state of the computer at an arbitrary time from the recorded input data time series and the recorded computer state. The user input recording means, the sensor information recording means, and Recording data association means for associating the input data series recorded by the network information recording means with each other using time as a key so as to be searchable by a keyword. An input data recording / reproducing apparatus for reproducing a computer state at a specified time or a time associated with a specified keyword based on the association of the series. 3. Recording not only a computer operation performed by a user via an input device as a time series of events, but also a time series of an input device signal or a time series of a command before the event generating means. 3. An input data recording / reproducing apparatus according to claim 1, further comprising a user input recording means for performing input data recording. 4. A method of automatically extracting a keyword characterizing a specific time in a user's work history from time-series data of a key typed using a keyboard, and recording the keyword as time-series data of the keyword. 2. A device according to claim 1, further comprising user input recording means.
The input data recording / reproducing apparatus according to claim 2 or 3. 5. Network information recording for automatically or periodically acquiring information from an information source or the like on a specified network, and selecting and recording a keyword capable of specifying a date and time from the acquired information. 5. The apparatus according to claim 1, further comprising a user input recording means.
Reproduction device. 6. The computer state recorded at time m recorded by the computer state recording means is reproduced on a computer, and then recorded on the computer by user input recording means, sensor information recording means, or network information recording means. User operation after time m,
A sensor input or network information is applied again, and a computer state reproducing unit for reproducing a state of the computer at an arbitrary time n is provided. 1,
6. The input data recording / reproducing device according to claim 2, 3, 4, or 5.