JP2001195869A - Method for editing command string with execution time as well as device using the same and medium recorded by using the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method for editing command strings with execution time which exactly reproduces information. SOLUTION: The method for editing the command strings with the execution time formed by combining processing commands and their execution time and lining up the same according to the execution time has a state recording stage 2 for recording the state of the object to be processed of the processing command at the recording start time as an initial state, a command recording stage 3 for recording the processing command and its execution time, a recording stage 1-1 for forming the data block combined with the initial state and the command strings with the execution time, a state reproducing stage 7 for reproducing the state of the object to be processed and a reproducing stage 8 having the command reproducing stage 7 for reproducing the command strings with the execution time and using for reproducing the initial state of the object to be processed which is recorded in the data block and reproducing the command strings with the execution time. Accordingly, the edition is easy and the optimum recording and reproducing of the processing results before the recording start are made possible.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for editing a command string with an execution time, an apparatus using the method, and a medium for storing data recorded by the method.

[0002]

2. Description of the Related Art Conventionally, as a system for handling multimedia data including processing on a computer, a system for recording processing contents such as a user operation and a result thereof and a sound and reproducing the recorded sound in synchronization with the processing. It has been known. For example, there is a system that displays a medical image on a screen of a computer and records and reproduces an operation performed on the image on the screen by a doctor and the content of a comment made during the operation. A system has been reported that sends recorded data to another physician and communicates the findings to another physician (Comp).
Uter Assisted Radiology, p
p417-420 (1996)). As a method of realizing such a system, there is a method of recording and reproducing voice and processing in parallel. At the time of recording, the voice is recorded as continuous data, and the process records a command instructing the process and its execution timing. At the time of reproduction, the voice is reproduced and the command is executed in accordance with the processing timing. The recording and reproduction of the voice and the processing are started at the same time, and the voice and the processing can be synchronously recorded and reproduced.

[0003]

When recording a process to be executed with the passage of time as in the prior art,
In some cases, some processing is performed in advance as recording preparation, and recording is started after preparation. For example, in the case of the related art, recording is started after displaying a reference image in advance and performing processing such as enlargement to make it easy to see. These processes before the start of recording can be reproduced by storing them as commands, but there are also redundant processes. For example,
For example, when the image is enlarged once and then reduced, the enlargement processing is canceled by the reduction processing. Therefore, there is a problem that it is redundant to store the commands for the enlargement processing and the reduction processing. The prior art did not consider this problem. When a question or an answer is transmitted / received by multimedia data, an answer can be created as if a pseudo-dialogue is made by answering while citing the received question. In order to realize this, it is necessary to perform editing such as inserting another command sequence into the command sequence. But,
In a command sequence, when the order of commands is changed by editing, there is a problem that the execution result of the command whose order has been changed may be different from the execution result of the command before editing. In the prior art, this problem was not considered.

An object of the present invention is to enable efficient recording and reproduction of processing results executed before the start of recording, facilitate editing of a command sequence, and accurately reproduce original information even after editing. An object of the present invention is to provide a method for editing a command string with an execution time. It is still another object of the present invention to provide a system that realizes a smooth communication of information by exchanging information between medical facilities using this method. Another object of the present invention is to provide a medium storing the command sequence with the execution time.

[0005]

[Means for Solving the Problems] In the following description, "... step" means "...
"Step." In the method of editing a command string with execution time, which is a combination of a processing command and the execution time of a processing command and arranged in accordance with the execution time, the method of editing a command string with execution time according to the present invention includes the following steps: It has a state recording step of recording the state of the command processing target as the initial state, and a command recording step of recording the processing command and the execution time of the processing command, and creates a data block combining the initial state and a command string with the execution time. (2) and (1), further including a state reproduction step of reproducing a processing target state and a command reproduction step of reproducing a command sequence with an execution time, wherein the processing recorded in the data block is performed. It is characterized by having a reproducing step of reproducing a command sequence with an initial state and an execution time of a target.

In the method of editing a command string with execution time according to the present invention, in (1) or (2), a data block newly recorded in a recording step is added after (a) a data block. The reproducing step includes an additional step of reproducing a plurality of data blocks in order. (B) a first data block and a second data block before and after a predetermined time of a command sequence with an execution time of the data block; (B ′) and (b) in which the initial state of the processing target of the second data block is changed to the state of the processing target when the first data block is reproduced to the end. When a second data block is added after the first data block, the adding step includes a processing target state when the first data block is reproduced to the end, and a processing target state of the second data block. Initial state Creating a new initial state of the processing target of the second data block by using the state; (c) the state reproducing step is to convert the current state of the processing target and the initial state of the processing target of the data block to be reproduced from now on (D) generating attribute information based on information such as the date and time when the recording was performed and the name of the writer, and adding the attribute information to the data block. (E) the recording step includes an audio recording step of recording audio data during a period from the start of the recording of the command string with the execution time to the end of the command recording step. Then, a data block in which the audio data is combined with the data block is created, and in the reproducing step, when the data block is reproduced, the audio for reproducing the audio data in synchronization with the command string with the execution time is generated. (F) the command recording step has a moving image recording step of recording moving image data from the start of recording of the command string with execution time to the end thereof, and the moving image data is stored in the data block. Create a data block that combines
The reproducing step includes a moving image reproducing step of reproducing moving image data in synchronism with a command string with an execution time when reproducing a data block. In (g) and (e), the dividing step includes a predetermined data block. Is divided into a first data block and a second data block before and after a predetermined time,
Dividing audio data combined with a predetermined data block before and after a predetermined time, and combining them into a first data block and a second data block, respectively;
(H) In (f), the dividing step includes dividing a predetermined data block into a first data block and a second data block before and after a predetermined time.
When the video data is divided into data blocks, moving image data combined with a predetermined data block is divided before and after a predetermined time, and the moving image data is combined with a first data block and a second data block, respectively. .

The above (1), (2), (a)-
(H) a computer-readable recording medium in which a data block created by using the method for editing a command string with execution time is recorded, and (i) the recording medium processes a processing command at the start of recording. A data block having a first data area in which an initial state indicating a target state is recorded, and a second data area in which a processing command and an execution time of the processing command are combined and recorded; Is recorded by combining a first pointer indicating a data area in which an initial state is recorded, and a second pointer indicating a data area in which a processing command and an execution time of the processing command are combined and recorded; It is characterized in that the first data area, the second data area, and the data block are associated with each other by a first pointer and a second pointer.

The above (1), (2), (a)-
In the method of editing a command string with execution time in (h),
(J) The execution time indicates the time at which the execution of the processing command is started, and (k) the execution time indicates the time at which the execution of the processing command ends.

[0009] Further, the present invention is a recording medium shown in the above (i),
It is characterized in that it has an area of a management table in which at least one pointer indicating an area in which a data block is recorded is recorded.

The above (1), (2), (a)-
The processing command used in the method of editing the command string with execution time in (h) is to process medical information such as images, moving images, voices, test values, medical records, medical records, etc., and to display the medical information. It is characterized in that it shows processing such as ending the display of the displayed medical information and changing the display state of the displayed medical information.

[0011]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below in detail with reference to the drawings. In the embodiment described below, a case where a question or an answer is recorded and reproduced while operating medical information such as a medical image displayed on a screen of a computer will be described as an example. Processing medical information such as images displayed on a computer screen and pointers, lines, and characters displayed on images as processing targets, and displaying medical information such as images, and processing targets such as pointers, lines, and characters, processing Processing such as ending the display of the target and changing the state of the displayed processing target is realized by a command.

FIG. 1 shows a recording step (a) and a reproducing step (b) of a command string with execution time according to an embodiment of the present invention.
6 is a flowchart showing an example of the processing of FIG. In the recording step 1-1 shown in FIG. 1, first, an initial state of a processing target is recorded in a state recording step 2, and a command execution time and a command are recorded in a command recording step 3. Until the recording is stopped (4), the command recording step 3 is repeated, a data block is created by combining the recorded initial state and the command sequence, and the recording is completed (5). In the reproduction step 6-1, first, the initial state of the processing target is reproduced in the state reproduction step 7. When the reproduction of the initial state is completed and the elapsed time from the start of the reproduction of the command string coincides with the execution time (11), the command is reproduced in the command reproduction step 8, and the reproduction of all commands is completed (9). Until the reproduction is stopped (9), the command reproduction step 8 is repeated to terminate the reproduction (10).

FIG. 2 is a diagram showing an example of a data structure of a command string with execution time and an example of a display screen recorded according to the flowchart of FIG. Data block 21-1 of recorded command string with execution time
Are the initial state 22-1, the command execution time 23-1
(The time at which the execution of the command is started, indicating the elapsed time from the start of recording, and the unit is seconds), and has a command 24-1. On the screen 25-1 of the computer at the start of recording,
The image A (26) to be processed is displayed.

Computer screen 25-2 at the end of recording
Has Line-a (27), P on image A (26).
pointer-a (28) and Text-a (29) are displayed.

Before starting recording, the operator displays several images to search for a desired image. When the target image A (26) is found, the other images are closed and the upper left of the image A is displayed in accordance with the coordinates (X1, Y1) on the screen. Further, the operator enlarges the image A and observes a fine portion,
Next, the image A is reduced and displayed in the original size. And
The operator starts recording to ask a question. When recording is started, in the recording step 1-1, the state of the screen 25-1 at the start in the initial state recording step 2 is recorded (22-1). At this time, only the fact that the current image A (26) is displayed at the coordinates (X1, Y1) is recorded. Enlargement and reduction are not included in the initial state 22-1. Next, the operator inputs a line-a (2
7), the operation of displaying and moving Pointer-a (28), the operation of writing Text-a (29), and the like are performed. 1, a command indicating the operation content is recorded in 24-1. As the execution time, the timer is started from the time when the recording of the initial state is completed, and the elapsed time value of the timer when the operation is executed is used. Recorded initial state 22-1, execution time 23-1, command 24-1
Are physically or logically related on a medium to form a data block. Next, the recorded data block 21-1 is reproduced. In the reproducing step 6-1, the initial state 22-1 is reproduced in the state reproducing step 7, and the coordinates (X
The image A (26) is displayed at the position of (1, Y1), and
5-1. Execution time 23-
1 (11), the command 24-1 is executed by the command reproducing step 8, and the line 24 is executed at the recording timing.
-A (27) entry, Pointer-a (28) display and movement, Text-a (29) entry, etc. are reproduced. At the time of reproduction, the timer is started when the reproduction of the initial state is completed, and the command is executed when the elapsed time of the timer matches the execution time, so that the command processing can be reproduced at the same timing as during recording. When the reproduction is completed, the same screen 25-2 as at the end of the recording is displayed on the screen of the computer.

In this embodiment, since the command is recorded after recording the initial state at the start of recording, only the state of the processing result executed before the start of recording is recorded as the initial state. Not recorded. Therefore, optimum contents without redundant processing can be recorded. During playback,
The state reproduction at the start of recording can be speeded up, and when the command is reproduced, the state at the time of recording can be reproduced accurately.

Next, a method for recording and reproducing a plurality of data blocks will be described. FIG. 3 is a flowchart illustrating an example of a process (a) of recording a command sequence with an execution time a plurality of times and a process (b) of reproducing the command sequence. FIG.
(A) shows the flow of processing for recording a command string with execution time. In recording step 1-2, a data block is recorded and recorded in the same manner as in recording step 1-1 shown in FIG. 1 (a). (32), the newly recorded data block is added to the existing data block in the adding step 33-1 to create a data block unit. If there is no recorded data block (32), the process ends. FIG.
(B) shows a flow of a process of reproducing a data block unit having a plurality of data blocks. When reproduction is started (35), first, a head data block is designated (36), and a reproduction step 6-2. To play. Regeneration step 6-2
Then, when the reproduction is performed by the same operation as the reproduction step 6-1 in FIG. 1 and the termination condition is not the stop of the reproduction (37), and when the next data block exists (38), the next data block is designated. (39), and reproduction is performed in the reproduction step 6-2. Reproduction is performed and reproduction is terminated until reproduction stop is instructed (37) or all data blocks are reproduced (38).

FIG. 4 is a diagram showing an example of the structure of a data block unit recorded according to the flowchart of FIG. The data block unit 41 includes the data blocks 21-1, 21-2, 21-3.
Are reproduced in this order in accordance with the flowchart of FIG. Also, the computer screen 25-
1 indicates a state in which the image A (26) is displayed, a screen 25-3 indicates a state in which the image B (42) is displayed, and a screen 25-4 indicates a state in which the image C (43) is displayed.

For example, when asking a question on a plurality of topics, the question may be recorded many times. At this time, recording is performed after preparation for displaying an image or the like, and this is repeated to record a plurality of questions. First, in order to ask the first question, an image A (26) is displayed on the screen, and the screen is changed to 25-1.
State. When recording is started, in the recording step 1-2, the state of the screen 25-1 is recorded as an initial state 22-1,
The command is recorded together with the execution time, and the first data block 21-1 is created. Next, the display of the image A (26) is ended, the image B (42) is displayed, the screen is set to the state of 25-3, and the second question is prepared. When recording is started (31), in the recording step 1-2, the state of the screen 25-3 is recorded in the initial state 22-2, and subsequently, the command is recorded together with the execution time. When the recording step is completed, the recorded first data block 21-1 is present (32), so the additional step 33-1 replaces the data block 21-2 relating to the second question with the first data block. 21-
A data block unit is created by adding it after “1”. Similarly, for the third question, the operator displays the image C (43) on the screen, changes the screen to the state of 25-4, and starts recording (31). In the recording step 1-2, first, the state of the screen 25-4 is recorded as an initial state 22-3, then a command indicating the content of the operation performed by the operator is recorded together with the execution time, and the third case is recorded. Data block 21-
Create 3. This third data block 21-3
Is the second data block 21- in the addition step 33-1.
A data block unit 41-1 having three data blocks, which is added after 2, is created. The data block unit 41-1 creates each data block physically or logically on the medium.

When reproducing the data block unit 41-1, first, the first data block 21-1 is reproduced in the reproducing step 6-2. The initial state 22-1 is reproduced to make the screen 25-1, and then the command is executed according to the execution time. When all the commands of the data block 21-1 have been executed, the reproducing step 6-2 ends, and it is determined whether or not the next data block exists (38). As a result, 2
Since the second data block 21-2 exists, the second data block 21-2 is designated (39) and reproduced in the reproduction step 6-2. In the reproduction step 6-2, the initial state 22
-2 is reproduced, the screen is set to the state of 25-3, and then
Execute the command according to the execution time. Then, the command of the data block 21-2 is reproduced to the end, and the reproduction step 6-2 is completed. Similarly, the third data block 21-3 is reproduced in the reproduction step 6-2. Regeneration process 6
In -2, the initial state 22-3 of the third data block 21-3 is reproduced, and the screen is changed to the state of 25-4.
Execute the command according to the execution time. When all the commands of the third data block 21-3 have been executed, the reproduction step 6-2 ends, and the reproduction processing ends because there is no next data block.

When recording is performed a plurality of times while changing the screen, such as the display image and its state, the state of the screen at the start of each recording is recorded, and then the command is recorded. Is repeated. As a result, even when a plurality of topics are recorded a plurality of times, the state of the screen of each topic and the processing by the command can be accurately reproduced.

Next, a case where editing such as insertion and deletion is performed on a data block will be described. The operator who refers to the data block in which the question is recorded records the answer to the question and returns it to the requester. At this time, if multiple questions were recorded, insert the answer immediately after the question,
Processing such as deleting unnecessary parts is performed to create answer data. First, a method for inserting data will be described.

FIG. 5 is a flowchart showing an example of processing for inserting a new data block in the middle of a data block. In the reproducing step 6-3, the original data block is reproduced until the insertion point and stopped, and in the dividing step 52-1 the original data block is divided at the point of stop to create the first half data block and the second half data block. Next, a new data block to be inserted is recorded in a recording step 1-3, and a new data block is added after the first half data block in an addition step 33-2.
Further, in the adding step 33-3, the latter half data block is added after the new data block.

FIG. 6 shows a change in the structure of a data block when a data block is inserted using the method of FIG.
It is a figure showing an example of a screen. In FIG. 6, 21-1 is an original data block before editing, 21-4 and 21-5 are a first half data block and a second half data block created by dividing the data block 21-1, and 21-6 are inserted. This is a new data block. 25-1 is a screen showing the initial state of the original data block before editing, 25-2 is a screen after reproducing the original data block before editing to the end, and 25-5 is a halfway through the original data block before editing. A screen at the time when the reproduction is stopped until (50 seconds) and the reproduction is stopped, and a screen 25-6 shows the screen after the reproduction of the new data block 21-6 to be inserted.

In the insertion process 51, the original data block 21
-1 is reproduced in the reproduction step 6-3, and the time (50
Seconds). At this time, Line-
a (27) is entered, Pointer-a (28) is displayed and moved, and the screen is in the state of 25-5. Next, in the dividing step 52-1 the original data block 21
The first data block 21-4 and the second half data block 21-5 are created by dividing -1. At this time, in the initial state 22-5 of the divided second half data block 21-5, the state of the screen 25-5 at the time when the reproduction is stopped is recorded. Also, the execution time 23-5 of the latter half data block 21-5
Is adjusted based on the time at which the reproduction is stopped. Here, since the reproduction of the current data block 21-1 is stopped at 50 seconds, “Text-a” of the second half data block 21-5 is stopped.
The execution time of the command "Enter" is changed to 30 seconds.
Next, in the recording step 1-3, a new data block 2 to be inserted is inserted.
Record 1-6. Since the screen at this time is the screen 25-5 in which the original data block 21-1 is stopped halfway, this state is recorded in the initial state 22-6 of the new data block 21-6. The operator performs an operation of writing Line-b (61), and the command of “Write Line-b” is 2
At 4-6, the execution time of 20 seconds is recorded at 23-6, and the recording of the new data block 21-6 ends. When the recording of the new data block 21-6 is completed, the new data block 21 is added after the first half data block 21-4 in the adding step 33-2.
Add -6. Then, after the new data block 21-6 in the adding step 33-3, the latter half data block 21-5
Is added to form the data block unit 42-2 to complete the insertion.

When the data block unit 42-2 is reproduced, first, the initial state 22-4 of the first half data block 21-4 is reproduced, and the screen becomes the state 25-1.
Then, the command 21- of the first half data block 21-4
4 is executed according to the execution time 23-4, and the screen is 25-5.
State. When the reproduction of the data block 21-4 ends, the new data block 21-6 is reproduced next. First, the screen is set to 25-5 recorded in the initial state 22-6.
To the condition of. Here, the current screen is the screen 25-
In step 5, since the state is the same as the initial state 22-6, reproduction of the command is started without changing the screen. Execute command 24-6 of new data block 21-6 at execution time 23
Execute according to -6, and write Line-b (61) on the screen. Next, since the latter half data block 21-5 is reproduced, the initial state 22-5 is reproduced, and the screen is brought to the state of 25-5. Here, the screen is changed from 25-6 to 25.
In order to set the state to -5, Line-b (61), which is the difference between the current screen 26-6 and the initial state 22-5, is deleted. When the screen 25-5 shown in the initial state 22-5 is reproduced, the command 24-5 of the latter half data block 21-5 is executed according to the execution time 23-5, and the Text-a (2
Fill in 9) and the screen will be in the state of 25-2. The reproduction result of the latter half data block 21-5 is in the same screen 25-2 as the reproduction result of the original data block 21-1 before editing.

Next, a case where a part of a data block is deleted will be described. FIG. 7 shows that among the data blocks,
It is a flowchart which shows an example of the process which deletes the command which should be performed from a certain time to a certain time. Division 5
In 2-2, the data block is divided into two at the first time of the part to be deleted, and in the dividing step 52-3, the latter half of the data block is divided into two at the last time of the part to be deleted. Finally, three data blocks are created. Then, in a deletion step 72, the second data block is deleted.

FIG. 8 is a diagram showing an example of a data structure and a screen when a part of a data block is deleted according to the flowchart shown in FIG. In FIG. 8, 21-1 is an original data block before editing, 21-7, 21-8, 21
Reference numeral -9 denotes a first half data block, an intermediate data block, and a second half data block created by dividing the original data block 21-1. Also, 25-1, 25
Reference numeral -2 denotes a screen in an initial state of an original data block before editing and a screen after reproduction, and 25-7 and 25-8 respectively denote screens after reproduction of a first half data block and an intermediate data block. Here, it is assumed that the intermediate data block 21-8 is deleted.

When a part of the original data block 21-1 is to be deleted, first, in a dividing step 52-2, the original data block 21-1 is divided at the leading time of the part to be deleted, and the first half data block 21- 7 and a temporary data block is created. In FIG. 6, the original data block 21-1 is divided at a time point of 15 seconds from the beginning, and the time of the temporary data block is adjusted based on the time point of the original data block 21-1 at 15 seconds. Next, in a dividing step 52-3, the temporary data block is divided at the last time of the portion to be deleted, and an intermediate data block 21-8 and a latter half data block 21-9 are created. Here, the division is performed at the time of 20 seconds of the temporary data block, and the execution time 23-9 of the second half data block is adjusted with reference to the time of 20 seconds of the temporary data block. As a result, the original data block 21-1 is divided into the first half data block 21-7, the intermediate data block 21-8, and the second half data block 21-9. At this time, the initial state 22-7 of the first half data block 21-7 is the same as the screen 25-1 as the initial state of the data block 21-1 before editing.
State, the initial state 22- of the intermediate data block 21-8
8 is a state of the screen 25-7 after executing the first half data block 21-7, and an initial state 2 of the data block 21-9.
2-9 is the state of the screen 25-8 after the execution of the intermediate data block 21-8. Next, in a deletion step 72, the intermediate data block 21-8 to be deleted is deleted. Thus, even if the intermediate data block 21-8 in the middle is deleted, the screen 25-8 at the start is recorded as the initial state in the latter half data block 21-9, so that the latter half data block 21-9 is recorded. Is the result of the original data block 2.
The screen becomes the same as the screen 25-2 after execution of 1-1.

Since the intermediate data block 21-8 has been deleted, the command 24-9 of the second half data block 21-9 has been deleted.
Among the “move Pointer-a” commands, there is no command for displaying Pointer-a (28) to be processed. However, the second half data block 21-
9 includes Pointer-a (2
Since the state where 8) is displayed is recorded, Po
The command for moving the inter-a (28) can be processed without causing inconsistency.

As described above, even when the order of commands is changed by editing such as insertion or deletion of a data block, the state before execution of the changed command is the same as before editing. By recording the initial state, the result of executing a certain command can be kept the same as the result of executing the same command before editing. Even when a command for generating a processing target is deleted, a necessary processing target is recorded in the initial state, so that inconsistency in which no command processing target exists can be avoided beforehand.

In the embodiment described with reference to FIG. 6, after the reproduction of the new data block 21-6, the second half data block 21-5 is reproduced.
Is played, the current state 25-6 and the next initial state 2
The states are made to match by observing the difference of 5-5 and deleting the difference line-b, but the initial state may be created after the current state is erased once. For example, screen 25-
The display of the image A26, the lines 27 and 61, and the pointer 28 on the screen 6 is ended once, and the image A26 is displayed according to the initial state 22-5.
Display, line 27 display, and pointer 28 display.
-5 may be reproduced. This method eliminates the need for processing such as checking the difference, thereby simplifying the initial state reproduction processing.

In the embodiment described with reference to FIG. 6, the initial state 22-6 of the new data block 21-6 to be inserted is the same as that of the immediately preceding data block 21-4.
, But still records it, but in a different way,
An initial state can also be expressed. For example, as a state recording method, information that “the state is the same as the result of the data block 21-4” may be recorded in the initial state 22-6. With this method, the amount of data to be recorded can be reduced. In the embodiment shown in FIG. 6, when performing the insertion, the original data block 21-1 is reproduced halfway and then divided and the new data block 21-6 is inserted. May be performed by designating the time, and a data block may be inserted there. According to this method, it is possible to insert a specified time without performing reproduction.

In the embodiments shown in FIGS. 7 and 8, a method of deleting a part of a data block has been described. From the beginning to the middle of the command sequence of the original data block,
Alternatively, when the command sequence of the original data block is to be deleted from the middle to the end, the dividing step shown in FIG. 7 is performed only once, and the data block is divided at the beginning or end time of the part to be deleted. Alternatively, it can be realized by deleting the latter half data block. By combining these methods, an arbitrary part of the command sequence can be deleted from the original data block. Further, editing may be performed in the data block unit such that the order of the data blocks is switched. Since each data block has an initial state, the recorded contents can be accurately reproduced even if the order of the data blocks is changed.

In the description related to the insertion of FIG. 6 and the deletion of FIG. 8, the screen after executing the same command after editing is set to be the same as that before editing. It can also be reflected. For example, in the example shown in FIG. 6, when the reproduction is performed to the end, the result of the process inserted in the middle becomes invisible, but the result of the inserted process and the result before editing can be overlapped. In this case, an initial state is newly generated when a data block is added.

FIG. 9 is a diagram showing an example of a data structure and a screen display when a new initial state is created when a data block is inserted. According to the procedure shown in FIG. 5, reproduction is performed until the time when the original data block 21-1 is inserted (6-3).
Then, in the dividing step, the data block 21-1 is divided into a first half data block 21-4 and a second half data block 21-5. The execution time of the latter half data block 21-5 'is adjusted based on the time point of division as in the case described with reference to FIG. At this time, the data block 21-5 'corresponds to 21 in FIG.
In the same state as -5, the state of the screen 25-5 is recorded in the initial state. Next, the new data block 21-6 to be inserted is recorded in the recording step 1-3, and the new data block 21-6 is added after the first half data block 21-4 in the additional step 33-2.
-6 is added, and the new data block 2 is added in the adding step 33-3.
The latter half data block 21-5 'is added after 1-6. At this time, an initial state 22-5 'of the latter half data block 21-5' is newly created in the addition step 33-3. Here, when the reproduction of all the data blocks is completed, Line-b (61), which is the result of the inserted new data block 21-6, is also seen, so that it is added to the screen 25-5 in the original initial state. The last screen 25-6 of the new data block 21-6 is compared, the state of the screen 25-6 is recorded in the initial state 22-5 'of the second half data block 21-5, and then the second half data block 21-5' is recorded. Is added. Thus, the data block unit 41-
3 is created. This data block unit 41-3
Is reproduced to the end of the latter half data block 21-5, the screen becomes a state of 25-9, and Line-b (61) according to the command of the inserted new data block 21-6.
Then, Text-a (29) by the command of the latter half data block 21-5 can be simultaneously seen on the screen.

By creating a new initial state at the time of insertion as in the example shown in FIG. 9, the result of the inserted processing and the result of combining the data before editing can be shown. According to this method, for example, in the case where a screen is printed at the stage where reproduction is performed to the end, a screen in which the result of the processing before editing and the processing inserted by editing can be printed.

In the example shown in FIG.
There was no problem in replacing the initial state of 1-5 'with the state of the execution result of the new data block 21-6, but depending on the contents of the data block to be inserted, the processing of the latter half data block 21-5' was not successful. May cause alignment. For example, when a command to end the display of the image A (26) is recorded in the new data block 21-6, the "entry of Text-a" command in the second half data block 21-5 is executed when the image to be processed is processed. Cannot be executed because it does not exist.
In order to prevent such an inconsistency, when the initial state of the latter half data block is replaced, for example, the processing target of the command recorded in the latter half data block 21-5 and
The new initial state to be newly recorded is compared with 2-5 ′, and if the processing target of the command 24-5 ′ is not included in the new initial state, the replacement of the initial state may be prohibited. . The original data block 21-
The recording of the command to end the display of the processing target (image, pointer, line, character, etc.) displayed in 1 in the new data block 21-6 to be inserted may be prohibited. With these methods, it is possible to guarantee that the processing target always exists when the command of the edited data block is executed. Also, after editing,
When a data block is reproduced, a command having no processing target may not be executed. In the case of this method, restrictions such as prohibiting operations during editing can be eliminated.

In the example shown in FIG. 9, the state of the result of the new data block 21-6 at the time of editing and the
From the initial state of -5 ', the latter half data block 21-5'
However, when reproducing a plurality of data blocks, a new initial state may be created from the state of the reproduction result of the immediately preceding data block and the initial state of the data block to be reproduced. For example, FIG.
The data block 2 of the data block unit 41-2 shown in FIG.
When reproducing 1-5, the initial state may be generated using the initial state 22-5 and the screen 25-6 (the state in which the new data block 21-6 is reproduced) which is the current screen state.
Here, the current screen state 25-6 is set as the initial state of the second half data block 21-5, and after reflecting it on the screen, the command 24-5 of the second half data block 21-5 is reproduced. With this method, it is possible to select at the time of reproduction whether to reproduce the state recorded in the data block or to create and reproduce a new initial state by reflecting the result of the processing added by editing.

Next, a method for generating attribute information at the timing of recording a data block and adding the attribute information to the data block will be described. FIG. 10 is a diagram illustrating an example of a case where a data block to which attribute information is added is transmitted and received between two computers. What is attribute information?
This is information indicating when and how the data was created. Here, among a plurality of data blocks, a data block recorded at the time of newly creating data has attribute information of generation 1 and a data block added by subsequent editing has attribute information of generations 2 and 3 and a numerical value. Increase it. A method for identifying the timing at which a data block is created based on attribute information will be described as an example.

Referring to FIG. 10, the computer terminal 1
Each of the operators 04 and 105 transmits and receives a message including a data block. Computer terminal A (10
Data block 2 of message 101 transmitted from 4)
1-10 has attribute information 103-1. The message 102 edited by the operator of the computer terminal B (105) and sent back has the data blocks 21-2, 21-3, 21-4, 21-5, and each data block has attribute information 103-2. , 103-3, 10
3-4 and 103-5.

The computer terminal A (104) records a question for the image A and creates a data block 21-10. At this time, the attribute information 103-1 is added to the data block 21-10. Data block 21-
10 is newly created in the computer terminal A, so that the attribute information 103-1 records that it is generation 1. Then, the message 101 is transmitted to the computer terminal B (10
Send to 5). The operator of the computer terminal B (105) reproduces the data block 21-10 of the message 101. Then, in order to answer the question recorded in the data block 21-10, a message in which the data block 21-12 is inserted and the data block 21-14 is added according to the procedure such as the insertion process shown in FIG. 1
02 is created. At this time, the original data block 21-1
Data blocks 21-11 and 21- formed by dividing 0
Thirteen pieces of attribute information 103-2 and 103-4 have the same generation 1 as the original data block, and the pieces of attribute information of the newly added data blocks 21-12 and 21-14 have the second generation. This message 102 is returned to the computer terminal A, and at the computer terminal A receiving the message 102, the operator reproduces the data block of the message 102 and refers to the answer. At this time, the computer terminal A
If it is determined that the operator does not need to see his own question, the attribute information does not reproduce the data block of the generation 1, and the attribute information is the data blocks 21-12 and 21-1 of the generation 2.
4 can be reproduced and only the answer to the question can be referred to.

As in the example shown in FIG. 10, attribute information can be provided in a data block to manage at which timing the data block was recorded. In addition, since the generation can be selected and reproduced, the reference can be made in a short time, such as selecting and reproducing only the answer. Further, in the above embodiment, only one generation is selected, but a plurality of generations to be reproduced may be selected.

In the example shown in FIG. 10, the attribute information is added according to the timing at which the data block was recorded. However, information such as the name and ID of the operator who executed the recording, the specific information of the facility or device at which the recording was performed, and the creation information The attribute information may be generated from the date and time. By recording the operator name as well as the generation, it is possible to select the data block and reproduce it by specifying the operator name. In addition, the attributes of the data block can be shown to the operator, such as displaying the name of the logger, the name of the facility, the date and time of creation, etc. during reproduction, and displaying the data block in different colors for each operator. The operator can select a data block to be reproduced by viewing the attribute information.

Next, the case of handling multimedia data for recording and reproducing a command sequence in synchronization with audio data and moving image data will be described. FIG. 11 is a diagram showing an example of a processing procedure in which multimedia data is handled by adding a method of recording and reproducing audio to the recording and reproducing processing procedure of the command sequence shown in FIG. FIG. 11A shows a recording procedure, and FIG.
(B) shows a reproduction procedure. In the recording step 1-4, recording of audio data is started in an audio recording start step 121, and recording of audio data is stopped in an audio recording stop step 122. In the reproduction step 6-4, the reproduction of the audio data is started in the audio reproduction start step 123, and in the audio reproduction stop step 124, the reproduction of the audio data is stopped. Other processes are the same as those in FIG.

FIG. 12 is a diagram showing an example of the structure of a data block obtained by combining audio data or moving image data with a command sequence. FIG. 12A shows an example of a data block 111 in which a command sequence with an execution time and a command sequence with execution time and audio data 114-1 are combined. FIG. FIG. 12 shows an example of a data block 112 obtained by combining
(C) shows an example of a data block 113 in which a command sequence with an initial state and execution time, audio data 114-2, and moving image data 115-2 are combined.

When recording multimedia data in which a command string with an execution time and a voice are combined, FIG.
The processing is performed according to the flowchart shown in FIG. When the recording step 1-4 is started, first, an initial state is recorded in a state recording step 2, and recording of audio data is started in an audio recording start step 121, and then recording of a command is started.

When the recording of the command is stopped (4), the recording of the audio data is stopped in the audio recording stop step 122.
As a result, the data block 1 in which the voice data 114-1 is combined in addition to the command string with the execution time and the initial state.
11 is created.

When reproducing the data block 111, processing is performed according to the flowchart shown in FIG.
First, in the reproduction step 6-4, the initial state is reproduced (7), and after the reproduction of the audio data 114-1 is started in the audio reproduction start step 123, the timer is started and the elapsed time of the timer matches the execution time. Then (11), the command is executed (8). If the execution of all commands is completed or the reproduction is stopped (9), the reproduction of the audio data is stopped in the audio reproduction stop step 124.

In the embodiment using FIGS. 11 and 12 (a), the method of recording and reproducing the command sequence with the execution time and the audio data in synchronization has been described. The data block 112 shown in FIG. 12B may be reproduced and recorded. Further, the sound and the moving image may be recorded and reproduced at the same time, and the data block 113 shown in FIG. 12C may be recorded and reproduced. FIG.
1. According to the method described with reference to FIG. 12, it is possible to execute recording and reproduction of multimedia data that performs processing by combining a voice or a moving image with a command sequence with an execution time. By recording and reproducing a command sequence in combination with audio and video, questions and answers can be transmitted in an easy-to-understand manner.

Further, when editing such as insertion and deletion is performed on a data block combined with audio data and moving image data shown in FIG. 12, it is necessary to divide the data block. At this time, in the dividing step (52-1 shown in FIG. 5, 52-2 and 52-3 shown in FIG. 7), the audio data and the moving image data are divided at the same time as the time at which the command string is divided.
Create two data blocks. According to this method, a data block combined with audio data and moving image data can be divided, and editing such as insertion and deletion can be performed.

When creating a data block unit in which a plurality of data blocks including audio data and moving image data are recorded, as shown in FIG. ,
FIG. 12C shows an initial state, a command sequence with an execution time, and a data block including moving image data as shown in FIG.
A data block including an initial state, a command string with execution time, audio data, and moving image data as shown in FIG.
A data block including only the command sequence with the execution time and the initial state as shown in FIG. In this way,
When recording, the type of data to be recorded can be selected as needed.

In the embodiments described so far, the execution time of the command sequence uses the elapsed time from the start of recording the command of the data block, but the value such as the absolute time or the time difference from the previous command is used. You may. When the absolute time is used, the time calculation load at the time of recording can be reduced. Further, when the time difference from the previous command is used, it is not necessary to adjust the time of the divided second half data block at the time of division, and the processing can be simplified.

Next, as an example of a system in which the method of editing a command string with an execution time is applied to the medical field, questions and answers to medical images are recorded using multimedia data to support medical treatment between doctors at remote locations. The following describes a system that performs this. FIG. 13 is a diagram illustrating an example of a system that uses multimedia data obtained by combining an initial state, a command string with an execution time, audio data, and moving image data for medical care support. Medical information,
A computer device such as a personal computer or a workstation having a monitor 132 for displaying a moving image or the like is used.

The system has a command control unit 133 for controlling the recording and reproduction of commands and an audio / moving image data control unit 134 for controlling recording and reproduction of audio data and moving image data. The command control unit 133 displays a control panel 145 for inputting recording and reproduction on the monitor 132, and includes a reproduction button 146, a recording button 147, and a stop button 148.
And the like, the recording and reproduction of multimedia data are started and stopped. At the time of recording, a command generated by an operation from an input device such as the mouse 136 and the keyboard 137 is recorded. At the time of reproduction, the recorded command is reproduced, the medical image 138 is displayed on the screen, and the pointer 1 that points to the attention site on the medical image 138 is displayed.
Processing such as moving the line 39 and displaying the line 140 is performed. The audio / video data control unit includes a command control unit 133
It operates in response to an instruction from the camera, and records audio input from the microphone 141 and moving image input from the camera 142 during recording. At the time of reproduction, a sound is output to the speaker 143 and a moving image 144 is displayed on the monitor 132. The command control unit 133 includes a recording process 1-4, a reproduction process 6-4,
An insertion process 51, a deletion process 71, and the like are executed. The audio / video data control unit issues an instruction to start and stop recording / reproduction (12
1, 122, 123, and 124) from the command control unit, and performs recording and reproduction of audio and moving images. As a command used in the present embodiment, for example, a pointer indicating a target part on an image displaying a specific image is displayed, moved, a line,
In addition to displaying characters on an image, image processing such as enlargement / reduction of an image, change in density gradation of an image, filtering, and the like are available.

The system shown in FIG. 13 is installed in a plurality of medical facilities, and information is exchanged between the medical facilities. The facilities are connected via a network, and the recorded contents are transmitted to the other party by, for example, e-mail. For example, a connection is made between a doctor at a clinic and a specialist at a hospital, and the doctor asks the specialist about points at which medical images taken at the clinic are unknown.

The hospital specialist returns the answer to the question to the attending physician. By creating questions and answers by recording multimedia data, questions and answers that are easy for doctors to understand can be created. A large number of medical images are generated by a single examination, and a plurality of questions are asked for a plurality of images at the clinic. However, a specialist in a busy hospital records a question that can be referred to in as short a time as possible, and the clinic that asks the question changes the image, records the question in a short time, and repeats this. On the hospital side, the reproduction of the initial state and the reproduction of the command are repeatedly performed, so that a plurality of questions can be referred to in a short time. The specialist responds while quoting the question so that the clinic can easily understand it. If you have multiple questions,
An easy-to-understand answer can be created by editing such as inserting and deleting data according to the present embodiment, such as inserting an answer immediately after the question.

In the above embodiment, the method using electronic mail has been described. However, the method of directly transferring a file to transmit the recorded contents to the other party, the method of recording on a floppy disk, a magneto-optical disk or the like without using a network. There is also a method of storing and transporting in a medium. By using these methods, a means for transmitting a data block can be selected according to the environment to be used, such as the presence or absence of a network, the capacity, and the need to secure information security. In this embodiment, the information exchange between the clinic and the hospital has been described.
It can be used for information exchange between medical facilities such as specialized hospitals. In addition to information exchange, the recorded contents may be used as educational materials for education. By recording the progress of interpretation by a specialist, it is possible to determine what points the specialist is paying attention to when diagnosing an image.

In the embodiments described so far, the description has been made using the example of the data structure in which the command string, the audio data, and the moving image data are written in one area in the data block. There is also a structure.

FIG. 14 shows the actual state of the command sequence, audio data, and moving image data stored in an arbitrary area of the medium, respectively, in the initial state, the command sequence with execution time, audio data, and moving image data. FIG. 4 is a diagram showing an example of a data structure in the case of describing a pointer indicating a recording position of a record. Data blocks 151-1 to 1-1 shown in FIG.
Reference numeral 51-3 denotes a pointer (Fn: n = 1, 2, 3) 152 indicating an initial state, a pointer (Cn: n = 1, 2, 3) 153 indicating a command sequence, and audio data in addition to the generation information. A pointer (Sn: n = 1, 2, 3) 154 and a pointer (Mn: n = 1, 2, 3) 155 indicating moving image data are provided. The actual data (substance of the data) shown in FIG. 14B is in another area 156 on the medium, and a pointer 157 is provided for each data. FIG. 14 shows a state where the data block 151-2 is inserted between the data blocks 151-1 and 151-3.
Since a pointer is used, data is divided by changing the area pointed to by the pointer. The data originally contained in one data block is divided by changing the designated pointer without changing the data position, such as C1 and C2, S1 and S2, and M1 and M2.
Although the actual data of the newly inserted data block 151-2 is added after the original data as shown in FIG. 14B, the actual data is added according to the order of the data blocks in FIG. 14A. The data is reproduced in a different order from the data. As described above, when the pointer indicating the actual data recording area is recorded in the data block, editing such as division and insertion of data can be performed only by changing the area indicated by the pointer, and the actual data is moved. You can easily change the order of playback without having to do this.

In the example shown in FIG. 14, pointers for the initial state, command sequence, audio data, and moving image data are specified in the data block, but they may be mixed with those in which data is directly described in the data block. Further, in the present embodiment, the description has been made using the operation on the image displayed on the screen.
It may be used for controlling the operation of a mechanical device. Since commands for the initial state of the mechanical device and subsequent operations are recorded, the recorded operation can be accurately reproduced when the mechanical device is operated using the recorded contents.

In the above-described embodiments, the terminal having both the recording and reproducing functions has been described. However, a terminal having a simplified function for recording only and reproducing only may be used.
For example, a terminal having only the recording function shown in FIG. 3A can be used when a doctor records a series of operations for diagnosing an image as evidence. In addition, the terminal having only the reproduction function shown in FIG. 3B can be used to refer to the record of the diagnosis work of a specialized doctor for the purpose of educating the doctor. By using such an editing method of only recording or only reproduction, construction of the terminal can be simplified.

In the above-described embodiments, the data block unit is an example in which the data blocks are arranged in the reproduction order. However, a table for managing the recording area of the data blocks is prepared, and the reproduction order of the data blocks is specified. You may. In addition, the substance of the data of the plurality of data blocks is
Each may be arranged on a different medium. FIG.
FIG. 3 is a diagram illustrating an example in which a data block unit including a plurality of data blocks is managed in a table that manages pointers indicating recording areas of data blocks, and entities of data such as data blocks are arranged on different media. .

Computer terminal B (21-1) connected to computer terminal A (210-1) by network 211
0-2). Computer terminal A (210-1)
Are the medium A-1 (212-1) and the medium A-2 (212-
2), and the computer terminal B (210-2) has a medium B-1 (212-3). Medium A-1 (212-
1) has a management table 201 that represents a data block unit, and the data block entities 203-1 to 203-1.
Pointers P1 to P4 (202-1) pointing to 203-4
To 202-4) indicate the order of the data blocks.
Further, on the medium A-1 (212-1), an entity 204-1 of the data of the image A and an entity 205 of the data of the audio A are recorded, and on the medium A-2 (212-2), the moving image is recorded. The entity 206 of the data of A and the medium B-1 (212-3)
An entity 204-2 of the data of the image B is recorded.

In the computer terminal A (210-1),
Create a data block unit that records a plurality of data blocks. For example, according to the flowchart shown in FIG.
Record 03-1. In the recording step 1-2 at this time, a data block is recorded according to the flowchart shown in FIG. Then, the table 201 is created on the medium, and the pointer P1 (202-1) indicating the recording area of the data block entity 203-1 is recorded in the table 201. Next, in order to record the second data block, recording is performed according to the flowchart shown in FIG. 3A, and in the recording step 1-2, the data block 203-2 is recorded.
Is recorded, and in an additional step 33-1, a pointer P2 (202-
2) is recorded in the table 201. As described above, the data block unit can be created by recording the pointer to the data block in the table 201. Also,
Even in the case of editing that changes the order of data blocks, such as insertion or deletion of a data lock, the order can be changed simply by rewriting the table, and editing can be performed easily.

In FIG. 15, the third pointer in the management table 201 is the two pointers P3 (202-3) and P4 (2
02-4) is recorded. This indicates that these two data blocks are reproduced in parallel. For example, it can be created by recording one data block while recording another data block while reproducing the data block, and can be used in a case where an answer is recorded while listening to a question and overlapping. When this is played back, two data blocks are played back at the same time, allowing the question and answer to be as if they were interacting. Furthermore, it is also possible to select only the data block to be reproduced from the parallel data blocks, and to reproduce only the question and the answer.

The data block and the substance of the data used in the data block may exist on a medium different from the medium on which the table is recorded. The pointer P3 (202-3) of the management table 201 on the medium A-1 (212-1) in FIG.
The pointer P4 (20) of the management table 201 indicating the data block entity 203-3 recorded above.
2-4) is another computer terminal B on the network
Data block entity 203-4 in (210-2)
Is shown. As described above, by managing the pointers of the data blocks in the table to form the data block unit, the data block unit uses not only the data blocks in the same medium but also the data blocks in another medium or on the network. Can be created.
FIG. 15 also shows a method of recording an image to be processed and moving image data and audio data reproduced together with a command with a pointer indicating a recording area. The entity of the data of the image A used in the initial state of the data block 203-1 is recorded in the area 204-1, and the pointer is recorded in the initial state of the data block 203-1. As for the sound A included in the data block 203-1, only the pointer is recorded in the data block 203-1 and the substance of the data is recorded in the area 205. Further, in the data block 203-2, the medium A on which the data block 203-2 is recorded is recorded.
-1 (212-1), medium A-2 (212-
2) A pointer indicating the data entity 206 of the moving image A above, or the computer terminal B (210-
The pointer indicating the entity (204-2) of the data of the image B recorded on the medium B-1 (212-3) of 2) is recorded. Such a pointer to an area on another medium may be, for example, a physical address on the medium, a file name,
Specific information for searching data in the database, identifier on the network (network address or URL
Etc.).

As described above, the data block pointer is managed by the management table, and the data used in the data block, such as the initial state and the command, is managed by the pointer, so that editing can be facilitated and the network load can be reduced. . For example, even when editing is performed, there is no need to move the data entity of the data block or the data entity used in the data block on the medium, and the editing can be simplified. Further, the computer terminal A (210
When transmitting the data block unit recorded in -1) to the computer terminal B, the computer terminal B (210)
It is not necessary to send the data of the data block 203-4 or the image B (204-2) already existing in -2), and the load on the network 211 at the time of transmission can be reduced.
In FIG. 15, an example in which two computer terminals are connected by a network has been described. However, the present invention can be used in a network in which two or more computer terminals are connected. With this method, it is possible to create multimedia data using various data on a network, including data on a database server or a WWW server.

Next, an example of a command used in the command string with execution time according to the present invention and a specific content of a processing target of the command will be described. FIG. 16 is a diagram showing an example of a data block in the case where various medical information is displayed and doctors exchange information with each other, and a screen at that time. Three
There are three data blocks 21-20 to 21-22. The initial state 22-20 of the first data block 21-20 indicates the state of the screen 25-20, and the command 24-20 is executed according to the execution time 23-20. Then the screen is 25-2
The state becomes 1. The initial state 22-21 of the second data block 21-21 is the first data block 21-20.
Is displayed on the screen 25-21, which is the same as the result of reproducing the command. When the command 24-21 is executed in accordance with the execution time 23-21, the screen changes to the state of 25-22. The initial state 22-22 of the third data block 21-22 is the same as the screen 25-25 as a result of reproducing the second data block 21-21.
21 shows the same state of the screen 25-22 as the result of reproducing the command 21. When the command 24-22 is executed according to the execution time 23-22, the screen becomes the state shown in 25-23. Image A (26-2) is displayed on screens 25-20 to 25-23.
0), image B (220), table of test values D (221), graph of test values D (222), medical record E (223), moving image F (224), sound G (display of playback status) (225) ) Etc. are displayed. First, the first data block 21-20 was recorded with the screen 25-20 as an initial state.
Initial state 22-20 of first data block 21-20
Include images A (26-20) and Line-a (27-2).
0), Pointer-a (28-20), Text-
Displaying a (29-20) is recorded. In the initial state 22-20, the following data is specifically recorded in order to reproduce the screen 25-20. Image A: entity of the data of image A or a pointer to the entity of the data (file name, specific information for searching from a database, etc.), display position (X1, Y1) and display size on the screen, display on the image An area, an enlargement / reduction display magnification, an ID for identifying a display image, and the like.

Line-a: ID for identifying a display image for displaying a line, line coordinates, color, line thickness, type of line (solid line, broken line, etc.), ID for identifying a line, etc.

Pointer-a: ID for identifying a display image for displaying a pointer, display coordinates of the pointer, ID for identifying the pointer, and the like.

Text-a: ID for identifying a display image (image A (26-20)) for displaying characters, character data (“abcdefg”), coordinates for displaying characters, font information for characters, character size, Character color, ID for character identification, etc.

The command changes the state to be processed by designating a parameter to be changed from the states shown in the above initial state. For example, when moving a pointer, the command includes an ID identifying the pointer,
The movement of the pointer is represented by designating the coordinates after the movement. Here, the following data is recorded in the command 24-10 of the data block 21-10.

"Enlarge image A": Image A (26-2)
0) ID, enlargement magnification (z%) or display size on the screen and display area on the image.

"Display image B": entity of data of image B or a pointer to the entity of data (file name, specific information for database search, etc.), display position and display size on screen, display on image A display area, a display magnification for enlargement / reduction, an ID for identifying a display image, and the like.

"Enter Line-c": ID for identifying a display image (image B (220)) for displaying a line, coordinates of the line, color, line thickness, type, ID for identifying the line, and the like.

"Specification of density gradation": I for identifying an image
D, density gradation information (look-up table, luminance, brightness, saturation, etc.).

When the above commands are executed, processes such as enlargement of image A and display of image B are executed, and the screen is displayed as 25-
The state changes from 20 to 25-21.

Next, with this screen 25-21 as an initial state, a second data block 21-21 was recorded. In the initial state 22-21, regarding the image A and the image B, as described above, the pointer information to the entity of the image data, the display position thereof, and the information such as the line and the pointer on the image are recorded. Further, since two images are displayed, the vertical relationship between the two images is also recorded. Here, the image A and the image B that have been recorded are recorded in order from the lower layer, thereby expressing the vertical relationship.

Then, the command was recorded using data such as examination values and medical records in addition to images. The specific contents of the recorded command are as follows.

"Close image A": ID for identifying image A, etc.

"Display inspection value D": a substance of the data of the inspection value D or a pointer to the substance of the data, a display position and a display size on the screen, and a display format (the vertical axis indicates the inspection item (GT
P, GOT, etc.), the inspection date is displayed on the horizontal axis in a table format), an ID for identifying a table of inspection values, and the like.

"Graph display of inspection value D" Data entity of inspection value D or pointer to the entity of data (file name or specific information for searching database), display position and display area on screen, Graph format (vertical axis shows inspection values, horizontal axis shows inspection date, line graph, etc.),
An ID for identifying the graph of the inspection value.

"Graph axis change": ID for identifying the graph of the test value, details of change (extend the range of test date on the horizontal axis), etc.

"Display medical record E": a data entity of the medical record E or a pointer to the data entity (such as a file name or specific information for searching a database), a display position on the screen, a display size, A display format (eg, a patient's chief complaint is displayed as text in the month and day), an ID for identifying the display of the medical record, and the like.

When the above command is executed, the screen becomes 25
The state changes from -21 to 25-22.

Next, the third data block 21-22 was recorded with the state of the screen 25-22 as an initial state. First, in the initial state 22-22, states such as the image B, the table of the test values D, the graph of the test values D, and the medical records E displayed on the screen 25-22 are recorded together with the vertical relationship on the screen. You. Then, the commands 24-22 were recorded. Here, the content of the command indicates, for example, a command that handles audio data such as moving image data of an ultrasonic examination or an endoscopy, and heart sounds. The specific contents of the command are as follows.

"Play movie F": The entity of the data of the movie F (the image of the ultrasonic inspection) or a pointer to the entity of the data (such as a file name or specific information for searching a database) on the screen Display position and display size, playback parameters (playback speed, etc.), movie F display (224)
Such as an ID for specifying

"Reproduce audio G": entity of data of audio G, or pointer to the entity of data (file name, specific information for database search, etc.), reproduction parameters (reproduction speed, etc.), audio ID specifying G, etc.

"Stop of voice G": I for specifying voice G
D etc.

As described above, medical information such as examination values, medical records, moving images, and voices, as well as images, is processed.
Processing such as creating (displaying) a processing target, deleting (ending display) a processing target, and changing the state of the processing target is performed by a command. Thereby, multimedia data combining various medical information can be created, and information exchange between doctors using various medical information can be realized.

As the commands described above, commands for designating and executing a program may be used. For example, FIG.
When performing the display 222 of the graph 6, the reproduction 225 of the audio, the reproduction 224 of the moving image, and the like, the program for performing these processes is executed to display the graph, reproduce the audio, reproduce the moving image, and the like. In the command, a program name or the like for specifying the program is described, and the program is executed. As described above, when performing complicated processing, the processing can be realized by an external program. Further, by increasing the types of programs, the types of processing that can be executed by the command sequence with execution time can be easily increased.

In the above-described embodiments, the execution time has been described as the time at which the execution of the command is started. However, the execution time may be the time at which the execution of the command ends. At the time of recording, the time at which the execution of the command is completed is recorded, and at the time of reproduction, the execution of the command is started in advance so that the processing is completed at the execution time. This is, for example, to determine the time required for processing by temporarily executing the command, and to execute the processing from the execution time before the time required for processing, or to determine the time required for processing by the type of command, and For example, a method of executing the process only for a certain period of time can be considered.
According to this method, the execution result of the command can be displayed at a more accurate time, and the synchronization of the command with the voice or the moving image can be more accurately performed in the data block including the voice or the moving image.

Further, a time error may be allowed for the execution time of the command. Further, an allowable time error may be specified. For example, the command to display an image is specified to adhere to the execution time, and the command to draw a line is specified to allow an error of about 0.1 second from the execution time. A method of changing the allowable range of the error can be considered. At the time of playback, playback is performed within the specified error range, and for data blocks containing audio and video, if the error exceeds the specified range, audio or video playback is paused or delayed, The video and the command may be synchronized. By this method, when playing back a data block on a computer terminal with lower performance than the computer terminal that performed the recording, the command error can be kept within the specified range, and the synchronization deviation between the audio and video and the command can be reduced. Can be kept small.

In the embodiments described so far, as a method of expressing the initial state in the data block, the data of the initial state is recorded in an area dedicated to the initial state. It may be recorded. With this method, the creation of the data block can be simplified.

As an example of editing a data block, one data block may be created by combining two data blocks. For example, in FIG. 6, the initial state 22-5 of the latter half data block 21-5 is deleted,
At the end of the command 24-4 of the first half data block, the command 24-5 of the second half data block 21-5 is added.
An original data block 21-1 is created. The execution time 23-5 of the “write text-a” command of the second half data block 21-5 is determined by combining with the first half data block.
Adjust based on the time for synthesis (50 seconds in this case), and
Change to 0 seconds. The screen where the initial state 22-5 of the second half data block 21-5 and the command 24-4 of the first half data block 21-4 are executed to the end is the same screen 25-5.
And a screen in which the data block 21-5 before composition is reproduced to the end, and a data block 21-1 in which composition is performed.
Are in the same state 25-2. As described above, when the first and second data blocks to be combined are combined, if the state after reproduction of the first data block is the same as the initial state of the second data block, the combination is performed. A condition may be set when combining, such as combining when the attribute information matches. Thus, by combining data blocks, an optimized data block can be created by removing unnecessary initial states, and the data amount can be reduced.

[0097]

[0098]

According to the method for editing a command string with execution time according to the present invention, the initial state of the processing target is recorded at the time of recording. Since the state and the command sequence are treated as one data block, the command sequence can be easily edited, and the original information can be accurately reproduced even after the editing. Further, by transmitting and receiving multimedia data using the editing method of the present invention, it is possible to realize a system capable of smoothly transmitting intention in information exchange between medical facilities.

[Brief description of the drawings]

FIG. 1 is a diagram showing a method for recording and reproducing a command string with execution time according to an embodiment of the present invention.

FIG. 2 is a diagram showing a data structure of a command string with execution time and an example of a screen display according to the embodiment of the present invention.

FIG. 3 is a flowchart showing a process of recording a command sequence with an execution time a plurality of times and a process of reproducing the command sequence with an execution time according to the embodiment of the present invention.

FIG. 4 is a view showing a data structure of a command string with execution time recorded using the method of FIG. 3 and an example of a screen display.

FIG. 5 is a flowchart showing a process of inserting a new data block in the middle of a data block according to the embodiment of the present invention.

FIG. 6 is a diagram showing a change in a data structure when a data block is inserted using the method of FIG. 5, and an example of a screen.

FIG. 7 is a flowchart illustrating a process of deleting a part of a data block according to the embodiment of the present invention.

FIG. 8 is a diagram showing an example of a data structure and a screen when a part of a data block is deleted using the method shown in FIG. 7;

FIG. 9 is a diagram showing an example of a data structure and a screen display when an initial state is newly created when a data block is inserted in the embodiment of the present invention.

FIG. 10 is a diagram showing a case of transmitting and receiving data having a data block to which generation information is added according to the embodiment of the present invention.

FIG. 11 is a diagram showing a processing procedure for handling multimedia data by adding a method of recording and reproducing audio to the recording / reproducing processing procedure of the command sequence shown in FIG. 1;

FIG. 12 is a diagram showing a data structure in which audio data or moving image data and a command sequence are combined in the embodiment of the present invention.

FIG. 13 is a diagram showing a system that uses multimedia data obtained by combining a command string with an execution time, voice, and a moving image for medical care support in an embodiment of the present invention.

FIG. 14 is a diagram showing an example of a command sequence, audio data, and moving image data stored in an arbitrary position in a medium according to an embodiment of the present invention;
The figure which shows an example of the data structure which describes the pointer which shows the storage position of each of a command string, audio | voice data, and moving image data in a data block.

FIG. 15 is a diagram illustrating an example in which a data block unit including a plurality of data blocks is managed by a table for managing the order of data blocks according to the embodiment of the present invention, and data entities are arranged on different media.

FIG. 16 is a view showing an example of a data block and a screen when various medical information is displayed and doctors exchange information with each other in the embodiment of the present invention.

[Explanation of symbols]

1-1 to 1-3: Recording step, 2 ... State recording step, 3 ... Command recording step, 6-1 to 6-4 ... Reproduction step, 7 ... State reproduction step, 8 ... Command reproduction step, 21-1 21-1
4, 21-20 to 21-22, 111, 112, 11
3, 151-1 to 151-3 ... data block, 22-
1-22-9, 22-20-22-22 ... initial state, 2
3-1, 23-20 to 23-22... Execution time, 24-
1, 24-20 to 24-22 ... command string, 25-1 to 25-1
25-9, 25-20 to 25-23 ... screen, 26 ... image A, 27 ... Line-a, 28 ... Pointer-a,
29: Text-a, 33-1 to 33-3: Additional step,
41, 101, 102 ... data, 42 ... image B, 43 ...
Image C, 52-1 to 52-3 ... dividing step, 61 ... Lin
eb, 72: deletion process, 103-1 to 103-5: generation information, 104, 105: computer, 114-1 to
114-2: audio data, 115-1 to 115-2: moving image data, 131: system body, 132: monitor, 1
33: Command control unit, 134: Audio / video control unit, 1
36 ... mouse, 137 ... keyboard, 138 ... medical image, 139 ... pointer, 140 ... line, 141 ... microphone,
142 camera, 143 speaker, 144 video display, 145 control panel, 146 play button, 147 record button, 148 stop button, 152
... Pointer to initial state data, 153 ... Pointer to command string with execution time, 154 ... Pointer to audio data, 155 ... Pointer to video data, 156 ... Data entity, 157 ... Pointer, 201 ... Data block Management tables, 202-1 to 202-4: pointers to data block entities, 203-1 to 203-4, data block entities, 204-1 to 204-2: image data entities, 205: audio data entities Entity, 206: Entity of video data, 210-1 to 210-2: Computer terminal, 211: Network, 212-1 to 212-3
... recording medium, 220 ... image B, 221 ... inspection value D (displayed in table format), 222 ... inspection value D (displayed in graph format),
223: Medical record E, 224: Movie F, 225: Voice G

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 N (72) Inventor Hitoshi Matsuo 1-280 Higashi-Koigabo, Kokubunji-shi, Tokyo Hitachi, Ltd. Office F term (reference) 5C053 FA14 JA01 JA22 5C054 AA02 DA01 DA09 FA04 GA00 GB01 HA12 5D110 AA29 BC20 CA05 CA09 CA16 CD15 CF13 DA17 DB05 DC16 DE04

Claims (24)

[Claims] In a method for editing a command string with an execution time in which a processing command and an execution time of the processing command are combined and arranged in accordance with the execution time, a state of a processing target of the processing command at the start of recording is set to an initial state. And a command recording step of recording the processing command and the execution time of the processing command, and a recording step of creating a data block combining the initial state and the command sequence with the execution time. A method for editing a command string with execution time, characterized in that: 2. A method for editing a command sequence with an execution time according to claim 1, wherein: a state reproduction step of reproducing an initial state of the processing target; and a command reproduction step of executing a command according to the execution time. And a reproducing step of reproducing the initial state of the processing target and the command string with execution time recorded in the data block. 3. The method according to claim 1, further comprising, after the data block, an additional step of adding a data block newly recorded in the recording step.
A method for editing a command string with execution time, characterized by reproducing a plurality of data blocks in order. 4. A method for editing a command string with execution time according to claim 1, wherein the command string with execution time of the data block is first and second data blocks before and after a predetermined time. And a recording step of recording, as an initial state of the second data block, the state of the processing target when the first data block is reproduced to the end. How to edit a command string. 5. The method for editing a command string with execution time according to claim 3, wherein the first data block is followed by the second data block.
When the data block is added, the adding step includes using the state of the processing target when the first data block is reproduced to the end and the initial state of the second data block to obtain the second data. A method of editing a command string with execution time, characterized by newly creating an initial state of a block. 6. The method for editing a command string with an execution time according to claim 2, wherein the state reproducing step includes: a current state of the processing target; and a processing target of the data block to be reproduced. A new initial state of the processing target of the data block using the initial state of (1). 7. A method for editing a command string with an execution time according to claim 1, wherein attribute information is generated based on information such as date and time of recording and a name of a recording person. A method for editing a command string with execution time, comprising an attribute information adding step of adding attribute information to a data block. 8. The method for editing a command string with execution time according to claim 2, wherein the recording step ends after the command recording step starts recording the command string with execution time. Before the data block is created, a voice recording step of recording voice data is performed, and a data block is also created in which the voice data is combined with the data block. A method for editing a command string with execution time, comprising: a sound reproducing step of reproducing the audio data in synchronization with the command string with a time. 9. The method for editing a command string with execution time according to claim 2, wherein the command recording step comprises:
A moving image recording step of recording moving image data between the start and end of the recording of the command sequence with execution time,
Creating a data block in which the moving image data is also combined with the data block; and the reproducing step includes, when reproducing the data block, a moving image reproducing step of reproducing the moving image data in synchronization with the command string with the execution time. A method for editing a command string with execution time, characterized in that: 10. The method for editing a command string with execution time according to claim 8, wherein the dividing step includes the step of dividing the predetermined data block into a first data block and a second data block before and after the predetermined time. When divided into blocks, audio data combined with the predetermined data block is divided before and after the predetermined time, and the divided data is combined with the first data block and the second data block, respectively. How to edit a command string with execution time. 11. The method for editing a command string with execution time according to claim 9, wherein the dividing step includes the step of dividing the predetermined data block into a first data block and a second data block before and after the predetermined time. When dividing the moving image data into the data blocks, the moving image data combined with the predetermined data block is divided before and after the predetermined time, and the moving image data is combined with the first data block and the second data block, respectively. How to edit a command string with execution time. 12. An apparatus for recording / reproducing a command string with an execution time using the method for editing a command string with an execution time according to any one of claims 1 to 11. 13. An apparatus for recording and reproducing a command sequence with an execution time using the method for editing a command sequence with an execution time according to any one of claims 1 to 11, comprising a medical image, examination data, A display device that displays medical information such as medical record information on a screen, and one or more terminal devices having storage means for recording operation information for the medical information, reference information such as a sound explained by a doctor, and a moving image, Recording / reproducing a command string with execution time characterized by supporting information exchange between a plurality of doctors by transmitting / receiving the medical information and the reference information between the one or more terminal devices. apparatus. 14. A computer-readable recording medium on which said data block created by using the method of editing a command string with execution time according to claim 1 is recorded, wherein said data block is said recording block. A first data area in which the processing target state of the processing command at the start is recorded as an initial state, and a second data area in which the processing command and the execution time of the processing command are recorded in combination. Wherein the processing commands are arranged in the second data area in the order of the execution times. 15. A computer-readable recording medium on which the data block created by using the method for editing a command string with execution time according to claim 1 is recorded, wherein the recording medium is the recording medium. A first data area in which an initial state indicating the state of the processing target of the processing command at the start is recorded, and a second data recorded in combination with the processing command and the execution time of the processing command. An area, wherein the data block in the recording medium is recorded by combining a first pointer indicating a data area in which the initial state is recorded, the processing command, and an execution time of the processing command. The second data area is recorded in combination with a second pointer indicating the data area, and the first data area, the second data area, and the data block are Serial first pointer, and a computer-readable recording medium characterized in that associated with the second pointer. 16. The method for editing a command string with execution time according to claim 2, further comprising a reproduction block selecting step of selecting at least one data block to be reproduced when there are a plurality of said data blocks. A method for editing a command string with execution time, characterized in that: 17. The method according to claim 1, wherein the execution time indicates a time at which the execution of the command is started. How to edit. 18. The method according to claim 1, wherein the execution time indicates a time at which the execution of the command is completed. How to edit. 19. The computer-readable recording medium according to claim 14, further comprising a management table area in which at least one pointer indicating an area in which said data block is recorded is recorded. A computer-readable recording medium characterized by the above-mentioned. 20. The method for editing a command string with execution time according to any one of claims 1 to 11, wherein the processing command is used for processing medical information such as an image, a moving image, a voice, a test value, a medical record, and a medical record. And displaying processing such as displaying the medical information, ending the display of the displayed medical information, and changing a display state of the displayed medical information. How to edit a command string with time. 21. A method for editing a command string with execution time, comprising: recording an initial state of a processing target in a first recording area;
At least one processing command and an execution time of the processing command are recorded in a second recording area, and the first recording area and the second recording area form one data block. How to edit a command string with execution time. 22. A method for editing a command string with execution time, comprising: recording an initial state of a processing target in a first area;
At least one processing command and the execution time of the processing command are recorded in the area, and the first recording area and the second recording area store the first data block in relation to the recording position. Forming, recording an initial state of a processing target in a third area, and recording at least one processing command and an execution time of the processing command in a fourth area, the third recording area and the fourth The recording area is
Forming a second data block in relation to the recording position, wherein the first data block and the second data block form a data block unit in relation to the recording position. How to edit a command string with execution time. 23. A method for editing a command string with execution time, comprising: a first area in which an initial state of a processing target is recorded; and a second area in which a processing command and an execution time of the processing command are recorded. When the first data block unit formed in association with the above is divided at a certain division time, a processing command having an execution time earlier than the division time of the second area, and an execution time of the processing command Is recorded in a third area, a processing command having an execution time after the division time of the second area and an execution time of the processing command are recorded in a fourth area, and the processing of the fourth area is performed. The execution time of the command is adjusted with the division time set to time 0, the state of the processing target after executing the processing command recorded in the third area is recorded in the fifth area, The first area and the third area are associated with each other with respect to their recording positions to form a second data block, and the fifth area and the fourth area are associated with each other with respect to their recording positions. 3. A method for editing a command string with execution time, comprising forming three data blocks. 24. The method for editing a command string with an execution time according to claim 20, wherein audio data and / or moving image data is recorded in a third area at a time when the processing command is recorded, and The first area in which the initial state is recorded, the second area in which the processing command and the execution time of the processing command are recorded, and the third area are associated with each other with respect to the recording position to create a data block. A method for editing a command string with execution time, characterized in that: