JPH08272989A - Material generation support system using video - Google Patents

Abstract

PURPOSE: To easily and effectively make good use of video information by relating text information and the video information and handling them as materials. CONSTITUTION: When an operation button for video operation which is displayed at a display part 3 is clicked, a video control part 2 controls operation for the reproduction of a video tape, etc., to display videos in a video window at the display part 3. When a 'from here' button or 'to here' button is clicked on the screen in this state, a system control part 10 sets a 'from here' or 'to here' mark at the current character input position in a document window at the display part 3 and at the same time, a relating process part 9 generates attribute information including position information on the video tape, so that the information is related to the corresponding mark. Further, when the 'from here' mark in the document window is clicked, the videos are reproduced and displayed from the tape position that the attribute information linked to the mark indicates.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a material creation support system using video suitable for creating various materials using information from video material.

[0002]

2. Description of the Related Art In recent years, in the field of business, a system has been widely used in which various explanatory materials are created by a personal computer or the like using various media that are easy to express.

This makes it possible for low-priced personal computers to handle media such as animation using graphic data, VTR video, TV video, and voice information in addition to conventional text information. As a result, it has become possible to improve the expressive ability using these media.

Therefore, by using the function of handling such media, it is possible to create a commercial story with enhanced expressiveness, and to make a report, a presentation, an explanation, etc., by making full use of the above-mentioned various materials. It has become possible to easily create data (materials) that are easy and effective to present.

Further, recently, with the widespread use of various video devices, it has become possible to easily handle video images even at an individual level. Applications are spreading in various fields such as various exhibitions, recording of TV images, recordings of lectures and the like, and explanation of operation procedures of various devices using video images.

As described above, this type of image can be sufficiently handled even at the level of a personal computer. Conventionally, when this kind of video is used as a material, apart from the explanation by the document (text information), the necessary part of the video is cued in advance, and after the explanation by the document, the supplementary video information is added. Was generally used in the form of displaying and explaining. Here, for example, at the time of presentation, in order to synchronize with the document, an explanation in the document and an explanation while pausing the video are required in a series of explanation flows.

[0007]

As described above, in recent years, video information (video material) has been used together with text information (text material) as an explanatory material. However, in the conventional technology, the text material and the video material are not related to each other, and when explaining using the video material, the instructor needs a video (for example, video tape) each time. I had to cue the part and manipulate it as needed. Therefore, it is desired that the video material can be used easily and effectively in combination with the text material.

Further, the image information photographed by a video camera or the like for the purpose of being used as the explanatory material is almost never used again since it is not associated with the text material after the description of the target material is completed. There wasn't. Therefore, it is also demanded to be able to utilize video materials having effective information.

By the way, a video image taken with a purpose is usually reproduced and displayed at least once. At the time of this reproduction / display operation, the viewer often comments on his / her impression. If these comments can be taken in the form of text information or voice memos and easily organized as materials, it is expected that the work efficiency will be greatly improved without wasting the time required for the above-mentioned work.

The present invention has been made in consideration of the above circumstances, and an object thereof is to treat information from a video medium as a material linked to text information so that the video information can be easily and effectively processed. It is to provide a material creation support system that can be utilized.

Another object of the present invention is to provide a material creation support system that can exert more effects by linking sound information such as a voice memo to video information. Yet another object of the present invention is to provide a material creation support system in which a video linked to video text information, a voice memo linked to the video, and the like can be easily used.

[0012]

The configuration according to the first aspect of the present invention is necessary for video image control means for controlling the display of a video image recorded on an image medium and for control by this video image control means. Video operation designating means for designating various operations, text creating / editing means for creating / editing text information used for materials, text information being created or edited by the text creating / editing means, and the video image control Display means for displaying a video image or the like reproduced and output by the means, and video information reproduced and displayed on the display means by the video image control means in the text information displayed on the display means. A video range designating unit that designates a video range to be associated, and, according to the designation of the video range designating unit, the video image of the corresponding range is displayed as text information. The information associating processing means to be associated with the inside and the video image in the range associated with the text information by the information associating processing means are displayed on the display means while the corresponding text information is displayed on the display means. A display designating means (first display designating means) and a control means for controlling the reproduction display of the video image in the corresponding range by the video image control means according to the designation of the display designating means. It is a feature.

Next, the configuration according to the second aspect of the present invention is as follows.
In the configuration according to the first aspect, the position of the video image displayed in a static state on the display unit by the video image control unit or the image file in which the image is stored in advance is displayed on the display unit. A still image designating means for designating a still image to be associated with the text information is added, and when the still image designating means designates, the information associating processing means displays the video image at the corresponding position or the image in the image file as described above. In addition to the configuration of associating with the text information, the video information of the position associated with the text information by the information associating processing means or the image (for example, bitmap image) in the image file is displayed by the corresponding text information. In the displayed state, the second display for displaying on the display means is displayed. When designating by the second display designating means, the control means controls the reproduction of the video image at the corresponding position by the video image control means or the display of the image in the corresponding image file by itself. It is characterized in that the display is controlled.

Next, the configuration according to the third aspect of the present invention is as follows.
In the configuration according to the first aspect, a sound information setting designating unit that designates setting of sound information such as voice, a sound information inputting unit for inputting sound information, and a sound information output for outputting sound information. In addition to the sound information setting designation means, the information association processing means displays the sound information input by the sound information input means or the previously stored sound information on the display means. In addition to the configuration of associating with the displayed text information, the sound information associated with the text information by the information associating processing means is converted into the sound information while the corresponding text information is displayed on the display means. A sound output designating means for outputting by the output means is added, and at the time of designation by the sound output designating means, the control means causes the sound information outputting means to output the corresponding sound information. Characterized in that the Gosuru configuration.

Next, the configuration according to the fourth aspect of the present invention is as follows.
It is characterized by having both the configuration according to the second aspect and the configuration according to the third aspect. Further, the present invention provides a predetermined range designation mark when designated by the image range designation means,
Mark setting means for setting a predetermined still image mark at the time of designation by the still image designation means and a predetermined sound input mark at the time of designation by the sound information setting designation means at the text character input possible position at that time are provided. In the mark set by the mark setting means, a video image of a specified range (in the case of a range specification mark), a video image of a specified position or a specified image file (in the case of a still image mark), or sound information input by the information-related means In addition to the configuration in which the sound information input by the means or the sound information stored in advance is associated, the first display designating means is configured by the range designating mark and the position designating means.
The second display designating means is composed of the still image mark and the position designating means, and the sound output designating means is composed of the sound input mark and the position designating means, and sound in the text information displayed on the display means. When the position of the input mark is specified, the playback display of the video image in the range associated with the mark is controlled, and when the position of the still image mark is specified, the position of the position associated with the mark is controlled. The playback display of the video image or the display of the image in the image file associated with the mark is controlled, and when the sound input mark is positioned, the output of the sound information associated with the mark is controlled. It is also characterized in that it has a configuration.

[0016]

In the above structure, while controlling the display of the video image, it is possible to input the text information for explanation, the voice memo, etc. at any necessary place at any time. It is possible to associate (or audio information previously stored as a file) with the range of a video image (in the case of a moving image) or the position of the video image (or an image file) (in the case of a still image).

Since the above-mentioned text information has a format as an explanation material, when utilizing the explanation material later, a video image (moving image or still image) associated with the text information and the audio information is used. Can be used again at the same time.

Further, in the text information, a voice input mark (a code indicating) corresponding to a voice memo designation, a range designation mark (a code indicating) a video image range designation, a video image position designation or an image file. Set the still image mark (corresponding code) corresponding to the designation,
By linking the information corresponding to this mark (the code representing it) and displaying this (code) mark as a kind of icon on the screen, the above mark in the text information displayed on the screen It is possible to output a voice memo, a moving image, or a still image linked to the mark (code indicating the mark) at which the position is designated, simply by designating the position with a position designating means such as a mouse, and operability is improved. .

Further, the operability is further improved by realizing the video operation designating means, the sound information setting designating means, the video range designating means and the still image designating means by a human interface in which the icon and the position designating means are combined. Is possible.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of a material creation support system using video according to an embodiment of the present invention.

The material creation support system of FIG. 1 is realized by using a personal computer or the like, and has a video image input unit 1, a video image control unit 2, a video image / text information display unit 3, and a voice information input unit 4. , Audio information output unit 5, disk device 6, keyboard 7, mouse 8, video image / text association processing unit 9, and system control unit 1
It consists of zero.

The video image input unit 1 controls the image input from an image medium such as an image tape. Video image controller 2
Controls video operations such as reproduction, stop, pause, fast forward, rewind, and slow reproduction for the video input from the video video input unit 1 in response to an instruction from the system control unit 8.

The video image / text information display unit 3 is used to display a video image reproduced by an image operation by the video image control unit 2, text information given from the system control unit 10 and various operation screens (windows). .

The voice information input unit 4 controls the input of voice uttered by the user, for example. The voice information output unit 5 outputs voice according to a file (voice file) as a voice memo generated based on the voice input by the voice information input unit 4.

The disk device 6 is used to store various text information (text files), various image files (for still images) input from a scanner and various audio files.

The keyboard 7 is used to input various characters and commands. This keyboard 7 is, for example, F1
It includes function keys (not shown) up to F10 and shift keys. These function keys F1 to F
10 is F11 by combining with the shift key
It can also function as a function key up to F20. Therefore, it is assumed that the keyboard 7 equivalently includes function keys F1 to F20.

The mouse 8 is a pointing device used for pointing the position on the screen. Under the control of the system control unit 10, the video image / text association processing unit 9 manages association between the text information, the video image, and the audio information.

The system control unit 10 controls the entire system such as control of the video image control unit 2 and the video image / text association processing unit 9. The system control unit 10 has a text creation / editing unit 11 that controls the input, creation, and editing of text information using a text editing editor.

Next, the operation of the system having the configuration shown in FIG. 1 will be described by taking as an example the material creation using video. First, the system control unit 10 displays an operation screen as shown in FIG. 2 on the video image / text information display unit 3 when the user designates the material creation using the image by the command input from the keyboard 7 or the like. To do. This operation screen is a document window 21 for displaying document materials (text information).
And a video window 22 for displaying video images, etc.
And, for example, 10 operation buttons (icons), that is, [F
1: Playback button 201, [F2: Stop] button 20
2, [F3: Pause] button 203, [F4: Fast forward] button 204, [F5: Rewind] button 205,
[F6: Slow playback] button 206, [F7: “From here”] button 207, [F8: “To here” button 2
08, [F9: voice] button 209, [F10: still image] button 210, and [F11: voice / moving image] button 211.

[F1: Play] button 201, [F2: Stop] button 202, [F3: Pause] button 203,
The [F4: fast forward] button 204, the [F5: rewind] button 205, and the [F6: slow playback] button 206 are used to “play”, “stop”, “pause”, “fast forward”, and “wind”, respectively, of the video image. It is a kind of icon that realizes operation buttons for "return" and "slow playback". The video image operation instruction functions assigned to these buttons 201 to 206 are also assigned to the F1 to F6 keys on the keyboard 7. Therefore, for example, [F
1: Click the Play button 201 with the mouse 8 or
By pressing the F1 key on the keyboard 7, it is possible to instruct the reproduction of the video image.

[F7: “From here”] button 207 and [F8: “To here”] button 208 realize operation buttons for setting the start position and the end position of the video image required as materials, respectively. It is an icon.
The [F9: voice] button 209 is an operation button for setting a voice memo in the still image, and [F10: still image].
Button 210 is an operation button for setting a still image,
The [F11: voice / moving image] button 210 is an icon that realizes an operation button for setting a voice memo in the moving image. The instruction function assigned to each of these buttons is also assigned to the F7 to F11 keys on the keyboard 7.

When the operation screen having the screen structure shown in FIG. 2 is displayed on the video image / text information display section 3, the user inputs a text for creating a material in the document window 21. For this text input, a method of newly creating by the text creation / editing unit 11 in the system control unit 10 by character input using the keyboard 7,
A method in which the text creating / editing unit 11 reads an existing text (document) stored in the disk device 6 by a text input instruction from the keyboard 7 according to a user operation can be applied. In addition, it is also possible to receive text via a network or the like and read the received text.

Here, as shown in FIG. 3, it is assumed that the text 30 is newly created in the document window 21. At the end 31 of the text 30 being created, a cursor indicating the position of the next input character is displayed.

In such a state, when it is desired to associate a certain display range of a certain video image with the text being created, the user first needs to record an 8 mm VTR video tape or VHS video tape on which the corresponding video image is recorded. A video tape (video image medium) is set in the video image input unit 1, and the [F1: Play] button 201 on the display screen is clicked with the mouse 8 (or the F1 key on the keyboard 7 is pressed).

Then, a reproduction instruction is sent from the system control unit 10 to the video image control unit 2, whereby the video image control unit 2 reproduces the video image from the image tape set in the video image input unit 1. To control. The video image reproduced by the control of the video image control unit 2 is displayed in the image window 22 on the display screen of the video image / text information display unit 3.

The user visually recognizes the video window 22 and, when the target video is started, clicks the [F7: "From here"] button 207 on the display screen with the mouse 8 (or the keyboard 7). Press the F7 key above).

Then, the text creation / editing section 11 in the system control section 10 indicates the start of the association with the video image at the position 41 in the text 30 displayed in the document window 21, as shown in FIG. Set a specific mark ("From here" mark in the figure). This position 41 is
It is the place where the cursor existed until then (position 31 in the document window 21 in FIG. 3), and the cursor is moved to the next position. The “from here” mark is set in the form of a kind of character code in the text data (document data), and is treated in the same manner as a character code representing a normal text character.

The text creation / editing unit 11 in the system control unit 10 sets the mark in (the text of) the document window 21 (and sets the code representing the mark in the corresponding text data), As internal information, the setting of attribute information (attribute information necessary for associating a text and a video image) linked (attached) to the mark (a code representing the mark) is set by the video image / text association processing unit 9 as follows. To do.

When the [F7: "From here"] button 207 (or the F7 key) is pressed as described above, the system control unit 10 firstly determines the position information on the tape of the reproduced video image at that time ( The tape address) and the video image name (image tape name) are obtained from the video image control unit 2 and passed to the video image / text association processing unit 9.

Then, the video image / text associating processing unit 9 links the "from here" mark (a code representing the mark) in the text 30 with the video image as attribute information attached to (the text file of) the text 30. Attribute information including a name (video tape name) and a video start position (tape address) is generated, and a pointer indicating the storage position of the attribute information is passed to the text creation / editing unit 11 in the system control unit 10.

As a result, the text creation / editing unit 11
A pointer to the attribute information of the mark received from the video image / text association processing unit 9 is added to the “from here” mark (code representing the mark) set in the text 30 by itself. Unlike the "from here" mark, this pointer is not the target of screen display.

Now, even if the [F7: "From here"] button 207 (or F7 key) is pressed, the video image is
It is continuously reproduced and displayed in the video window 22. Then, when the user reaches the end position of the target video range, this time, the [F8: "up to here"] button 208 on the display screen is displayed.
(Or press the F8 key on the keyboard 7).

Then, as shown in FIG. 4, the text creation / editing section 11 in the system control section 10 has a specific mark ("in the figure" indicating the end of the association with the video image) at the position 42 in the document window 21. Set "up to here" mark). This position 42 is the place where the cursor has been until then, and the cursor is moved to the next position 43. Similar to the “from here” mark, the “to here” mark is set in the form of a kind of character code in the text data, and is treated in the same manner as a character code representing a normal text character.

In the example of FIG. 4, the "from here" mark and the "to here" mark are set continuously,
After the "From here" mark is set, while pressing the [F6: Slow playback] button 206 (or the F6 key on the keyboard 7) on the display screen to change the video playback to "slow playback" It is also possible to input the explanation in the window 21. In short, there is no fixed procedure for the user's operation, and it is possible to arbitrarily press each button or key to execute the corresponding function or input a text. Here, the modification operation is rewritten to the latest operation. Further, an operation such as canceling the correction operation can be easily realized.

Next, by the above-mentioned operation, a video (moving image) having a display range is displayed with respect to the document window 21 in which the text set with the "from here" mark and the "to here" mark is displayed. Figure 5 shows an example of the operation when using
Will be described with reference to.

It is assumed that the text (document) 50 having the document name "ABC" is displayed in the document window 21 as shown in FIG. The text 50 has a "from here" mark 51 and a "to here" mark 52 at the end thereof.

Since the "from here" mark 51 and the "to here" mark 52 are treated as independent character codes in the text data, the cursor moving operation on the text 50 displayed on the screen is performed. Can be performed on each of the marks 51 and 52 in the same manner as an operation during normal text editing. FIG. 5 shows a state where the cursor is over the “up to this point” mark 52 by hatching.

In this case, the user operates the mouse 8 to
Move the cursor to the position of "From here" mark 51,
Then, when the button of the mouse 8 is clicked, the system control unit 10 refers to the attribute information linked to the "from here" mark 51 (a code representing the mark). Then, the system control unit 10 instructs the video image control unit 2 to perform playback display from the display start position of the video tape having the video image name indicated by the referred attribute information.

Then, the video image control unit 2 confirms that the video tape having the video image name instructed by the system control unit 10 is set in the video image input unit 1, and then the instructed display start position ( Fast forward (or rewind) to the tape address), and after that, the reproduction of the video image is started, and the reproduced video image is displayed in the image window 22. Then, when the video image control unit 2 is reproduced up to the display end position of the image tape indicated by the attribute information linked to the next “to this point” mark 52 (a code indicating), the video image control unit 2 To stop the video tape (stop playback output).

In the present embodiment, the [F10: still image] button 210 on the display screen is displayed during the playback display of the video image.
(Or the F10 key on the keyboard 7) is pressed,
Under the control of the system control unit 10, the video tape that was being played back at that time is temporarily stopped under the control of the video image control unit 2, and one frame at that position is displayed as a still image in the video window 22. It is possible to set a "still image" mark at the cursor position in the document window 21 of.

In this case, the system controller 10 displays a list of image files for still images stored in the disk device 6 and also sets the "still image" set above.
Image files or video windows 2 in this list are still images that are linked to the mark (the code that represents them).
A menu screen for the user to select from the still images in 2 is displayed on the video image / text information display unit 3.

If the user wants to select from still images in the video window 22 and the still image currently being displayed is not what the user desires, the user displays [F6:
A desired still image can be displayed in the video window 22 by operating the "slow reproduction" button 206, a "frame advance reproduction" button (not shown), or the like. That is, in this embodiment, the operation buttons displayed on the display screen are valid at any stage.

If the [F10: still image] button 210 (or the F10 key on the keyboard 7) is pressed while the video image is not being reproduced and displayed, it is possible to select only from the image file list. Become.

When the user selects the still image displayed in the video window 22, the system control unit 10 uses the video / text association processing unit 9 to specify the still image. Attribute information is set and linked to (the code representing) the "still image" mark.

Similarly, when the user selects an image file, attribute information designating the image file is set and linked to the "still image" mark. FIG. 6 shows a state in which the “still image” mark 64 is set in the document window 21 in addition to the “from here” mark 61 and the “to this point” mark 62 by the operation described above. It is a thing.

In the example of FIG. 6, the "from here" mark 6
Between the 1 and the "to this point" mark 62, the explanatory text 63
Has been entered, and after the “up to this point” mark 62,
The “still image” mark 64 is set. In the attribute information linked to (attached to) the "still image" mark 64 (a code representing the mark), position information of one frame of the corresponding video image is shown as the tape address of the still image. The description 65 of the still image is input after the "still image" mark 64.

If the cursor 66 is moved to the position of the "still image" mark 64 and the button of the mouse 8 is clicked, the system control unit 10 causes the video image control unit 2 to display the corresponding still image (frame). The video tape is fast forwarded or rewound to the position and the still image is displayed in the video window 22.

When an image file is designated by the attribute information linked to the "still image" mark 64, the contents of the image file are displayed in the video window 22 under the control of the system controller 10. Is displayed.

Next, the attribute information linked to each of the marks (“from here” mark, “to here” mark, “still image” mark, etc.) will be described with reference to FIG. 7. First, each mark (code representing the mark) is displayed in the document window 21.
It is set to the text (text data) displayed in. In this embodiment, information necessary for actually associating with these video images is created by the video image / text association processing unit 9 and linked to these marks as attribute information.

In the example of FIG. 7, the "from here" mark 71
(Corresponding code "11") includes a corresponding video image name (video tape name) 72a (here, "EIZO1"),
And the corresponding reproduction start position information (tape address) 72b (here, "01: 22: 31: 0").
The attribute information 72 including each information field of "0") is linked by the pointer 73. Here, the tape address "A: B: C: D" is a time count value from the beginning of the video tape. “Hour (A) Minute (B) Second (C)
Frame (D) ". Therefore, in the above example of the tape address 72b, 1 hour 2 from the beginning of the video tape.
This means the position of the 2nd minute 31st frame.

Similarly, the "up to this point" mark 74 (the code "21" representing this) has a corresponding video image name (video tape name) 75a (here "EIZO1") and the end of reproduction on the corresponding tape. Position information (tape address) 7
Attribute information 75 including information fields 5b (here, "01: 25: 00: 00" indicating the 1st 25th minute 0th second frame) is linked by a pointer 76.

Similarly, the "still image" mark 77 (the code "51" representing the same) has a corresponding video image name (video tape name) 78a (here "EIZO1") and corresponding position information on the tape. Attribute information 78 including information fields of (tape address) 78b (here, "00: 55: 11: 20") is linked by a pointer 79. The “still image” mark 77 in the example of FIG.
Means that the video image name is “EIZO1” and the tape address is one still image at 0 hours 55 minutes 11 seconds 20 frames.

Next, two types of marks (“voice” mark and “voice / moving image” mark) indicating voice memo input set in the text displayed in the document window 21 and when the mark is set An operation example will be described with reference to FIG.

In this embodiment, the [F9: voice] button 209 (or the F9 key on the keyboard 7) or the [F11: voice / moving image] button 211 (or the F11 key on the keyboard 7) on the display screen is pressed. Then, as shown in FIG.
As shown in, the “voice” mark 82 or the “voice / moving image” mark 83 is set in the text.

For example, while a video image is being reproduced and displayed in the video window 22 and the contents thereof are being confirmed, a voice comment (as a voice memo) may be input to a certain video cut, or an audio file may already be stored in the disk device 6. Suppose you want to enter a formal explanation voice saved as.

In this case, the user selects [F1 on the display screen, for example, as in the case of setting the "still image" mark described above.
0: Still image button 210 (or F on keyboard 7
After pressing the 10 key) to set the “still image” mark 81 as shown in FIG. 8, a still image to be associated with the mark 81 is selected (from a list of image files or a video image to be reproduced and displayed). At this time, the attribute information designating the selected still image is generated and linked to the “still image” mark 81 by the pointer.

Next, the user selects the [F9: voice] button 209 (or the F9 key on the keyboard 7) on the display screen.
Press. Then, the system control unit 10 (the text creating / editing unit 11 therein) sets the “voice” mark 82 shown in FIG. 8 at the cursor position (indicating the next text character input position) in the document window 21.

At the same time, the system control unit 10 displays a list of audio files stored in the disk device 6 and displays a menu screen for allowing the user to select an audio file in this list or a voice memo input by the user. ,
The video image / text information is displayed on the display unit 3.

When the user selects the voice memo (voice memo input), the system control unit 10 guides the user through the display unit 3 to input the voice memo, and the voice information input unit 4 outputs the voice memo. Allow voice input. Thereby, the user inputs a desired voice memo or the like through the voice information input unit 4.

The system control unit 10 includes a voice information input unit 4
The voice memo input by is converted into a file and stored in the disk device 6. At the same time, the system control unit 10 causes the video image / text association processing unit 9 to generate the attribute information that specifies the file (audio file) of the audio memo saved in the disk device 6, and the “audio” mark 82 set in the text. Link to (code representing) with a pointer.

On the other hand, when a selection is made from the list of audio files, the system control unit 10 causes the video image / text association processing unit 9 to provide the attribute information designating the selected audio file. "Voice" mark 82 (code that represents) generated and set in the text
To link to.

In the above, after setting the “still image” mark 81 and associating it with the still image, the “voice” mark 82 is displayed.
Is set and associated with voice information such as a voice memo, that is, the “voice” mark 8 is placed at a position next to the “still image” mark 81.
In the case of setting 2, the [F9: voice] button 20
9 (or F9 key) and [F10: Still image] button 21
By reversing the operation order of 0 (or F10 key), the mark setting order is the reverse of the above, that is, "voice".
It is also possible to set the “still image” mark 81 at the position next to the mark 82.

The "voice" mark 82 set in the text as described above is used as follows.
Now, it is assumed that the user clicks the “voice” mark 82 with the mouse 8. Then, if the audio file is not linked to the "audio" mark 82, the system control unit 10 displays a list of the audio files stored in the disk device 6, and the audio files in the list or the user. The menu screen for allowing the user to select the voice memo input by is displayed on the video image / text information display unit 3.

In this state, when the user selects the voice memo input and inputs a voice memo from the voice information input section 4 or selects a desired voice file from the list, the user can perform the same operation as described above. The attribute information that specifies the voice memo file input by the user or the voice file selected by the user is generated, and the “voice” mark 82 clicked by the user is generated.
Linked to.

On the other hand, if the audio file is linked to the "audio" mark 82 clicked by the user, the system control unit 10 selects the "viewer mode" or the audio for reproducing and outputting the corresponding audio memo or the like. Display the menu screen that allows the user to select the "correction mode" to re-enter the memo.

Here, it is assumed that the user selects the "viewer mode". In this case, the system control unit 10
Instructs the voice information output unit 5 to output the voice of the content of the voice file designated by the attribute information linked to the clicked "voice" mark 82.

Then, the voice information output unit 5 outputs the contents of the voice file instructed by the system control unit 10, for example, a voice memo. It is also possible to convert the voice memo into a text code at the editing stage in the text creation / editing unit 11 in the system control unit 10. Whether or not to convert to such a text code depends on how to use the created material. Further, since each mark such as the "voice" mark 82 is treated the same as the character code, the user operates the keyboard 7 or the mouse 8 at the editing stage by the text creating / editing unit 11
(From the text displayed in the document window 21)
It is possible to delete it if necessary.

Next, a case where the user selects "correction mode" on the menu screen for selecting "viewer mode" or "correction mode" will be described. In this case, the system control unit 10 permits the voice input from the voice information input unit 4 for re-inserting the voice memo.

When the user inputs a necessary voice memo through the voice information input section 4, the system control section 10
The input voice memo is filed and stored in the disk device 6.

At the same time, the system control unit 10 passes the file name of the voice memo to the video image / text association processing unit 9. Then, the video image / text association processing unit 9 deletes the attribute information that has been linked to the “voice” mark (here, the “voice” mark 82) in the text and deletes the new attribute attached to the “voice” mark. As the attribute information, the attribute information including the received file name is generated, and the pointer indicating the storage position of the attribute information is passed to the text creation / editing unit 11 in the system control unit 10.

As a result, the text creation / editing unit 11
The pointer added to (the code representing) the clicked “voice” mark 82 is changed to the pointer newly received from the video image / text association processing unit 9.

If the display form of the "voice" mark 82 in FIG. 8 (for example, color, brightness, presence or absence of blinking, etc.) is switched depending on the presence or absence of a corresponding voice memo, the user is required to change the mark. Whether or not there is a voice memo or the like linked to 82 can be known from the display form of the mark 82.

Next, when the “still image” mark 81 in FIG. 8 is clicked with the mouse 8, the case where the “still image” mark 64 in FIG. 6 described above is clicked with the mouse 8 It will be similar.

Next, the "voice / moving image" mark 83 in FIG.
Will be described. Area with range in video image,
That is, when associating a voice memo with a scene, the user first needs to press the [F11: Voice / Movie] button 211 (or the F11 key on the keyboard 7) on the display screen while the video image is not being reproduced and displayed. )Press. Then, the system control unit 10 sets the “voice / moving image” mark 83 shown in FIG. 8 at the cursor position in the document window 21.

Next, the user is similar to the case where the start position and the end position of the desired display range are set by reproducing and displaying the video image in the image window 22 as already described with reference to FIG. Do the operation.

As a result, the system control unit 10 (the text creating / editing unit 11 therein) sets the start position of the video scene designated by the user ([F7: “From here”] button 20
7 or the F7 key is pressed), as shown in FIG. 8, an “audio / video” mark 83 in the document window 21 is displayed.
A "from here" mark 84 is set at a position subsequent to.

At the same time, the system control unit 10 causes the video image / text association processing unit 9 to generate the attribute information designating the start position of the user-designated video scene, and links it to the "from here" mark 84.

Similarly, at the time of setting the end position of the video scene designated by the user (when the [F8: "Here"] button 208 or the F8 key is pressed), the system control unit 10
As shown in FIG. 8, (the text creating / editing unit 11 therein) sets a “to here” mark 85 at a position subsequent to the “from here” mark 84 in the document window 21.

At the same time, the system control unit 10 causes the video image / text association processing unit 9 to generate attribute information designating the end position of the user-designated image scene, and links it to the "up to this point" mark 85.

In this way, the video scene designated by the user is set. However, unlike the simple setting of the video scene as shown in FIG. 4, the “audio / moving image” mark 83 is set before the “from here” mark 84. As a result, the user can (or is) associated with the video scene indicated by the attribute information attached to the “from here” mark 84 and the subsequent “to here” mark 85 by the audio memo. I can confirm.

By the way, the input of a voice memo or the like to the video scene indicated by the attribute information attached to the "from here" mark 84 and the "to here" mark 85 following the "voice / moving image" mark 83 is performed by the "voice" described above. This can be performed in the same manner as when setting the mark 82 or clicking the "voice" mark 82 with the mouse.

Here, it is assumed that the user clicks the “voice / moving image” mark 83 with the mouse 8. Then, if the audio file is not linked to the "audio / moving image" mark 83, the system control unit 10 displays a list of the audio files stored in the disk device 6, and the audio files in the list. The menu screen that allows the user to select the voice memo entered by the user,
The video image / text information is displayed on the display unit 3.

In this state, when the user selects the voice memo input and inputs the voice memo from the voice information input section 4 or selects a desired voice file from the list, the user operates in the same manner as described above. The attribute information designating the file of the voice memo input by the user or the voice file selected by the user is generated and linked to the “voice / moving image” mark 83 clicked by the user.

On the other hand, if the audio file is linked to the "audio / moving image" mark 83 clicked by the user, the system control unit 10 causes the "viewer mode" for reproducing and outputting the corresponding audio memo or the like. Or display a menu screen that allows the user to select the "correction mode" for reinserting the voice memo.

Here, when the user selects the "viewer mode", the clicked "audio / video" mark 83 is displayed.
The voice information output unit 5 outputs the voice of the contents (voice memo etc.) of the voice file designated by the attribute information linked to.

When the user selects the "correction" mode, the voice memo input by the user through the voice information input section 4 is converted into a file and stored in the disk device 6, and the "voice / moving image" is stored until then. The attribute information linked to the mark 83 is changed to the attribute information including the file name of the voice memo.

In the present embodiment, the reproduction of the video scene (moving image) associated with the content of the audio file linked to the “audio / moving image” mark 83 follows the “audio / moving image” mark 83. This is done by clicking the "from here" mark 84 with the mouse. Since the reproduction of this video scene (moving image) is the same as when the mouse clicks on the "herein" mark 51, which has already been described with reference to FIG. 5, detailed description thereof will be omitted. However, the playback of the video scene is normally performed at the standard playback speed, but the video scene is associated with the content of the audio file linked to the "audio / video" mark as in the above example. If the “audio / video” mark is set immediately before the clicked “from here” mark, the output time of the audio memo corresponding to the video scene is set to a certain reference value, for example, the video scene. If the playback time exceeds a predetermined number of times, the playback is performed in the "slow playback" mode, which is different from the playback of the video scene alone.

The present invention is not limited to the above embodiment. For example, in the above-described embodiment, with respect to the display control of the video image, the functions such as play, stop, and fast forward are assigned to the operation buttons on the screen as a kind of icon or the function keys on the keyboard 7, A correspondence table of arbitrary characters or character strings and each operation command for video display control is prepared, and the character or character string to be input first after kana-kanji conversion in text input in the document window 21 is subjected to video display control. It is also possible to use each operation command for. in this case,
For a user who can perform keyboard input by blind touch, various control operations of video image display can be performed as if they were text input, which further improves the editing work efficiency.

Further, in the above-mentioned embodiment, the case where the video medium of the video image is a tape has been described. However, the video image is digitized and directly recorded on a recording medium such as a hard disk, a magneto-optical disk or a CD-ROM. It is also possible to use. At this time, the digitized video data may be further compressed and recorded on the medium. When such a recording medium is used, the display response of video can be speeded up. In addition, the operation function of video display control when using a digital video medium,
It does not always match the case of using video tape.

Further, in the above embodiment, the range of the video image corresponding to the text input (“from here” and “to here”) is designated by the [F7: “from here”] button 207 and [F8] as icons. : "To here"] button (or F7 key and F8 key on the keyboard 7) is pressed, but it can be specified by inputting the character string "here" and the character string "here". Thus, it is possible to set the input time of the character string "from here" as the video start time and the input end time of the character string "to this" as the video end time.

Further, in a system capable of handling digitized video, since each information of video and text can be displayed in the same window, for example, a specific scene is cut out and displayed as a still image from a moving image, and a specific object in the still image is displayed. It is also possible to indicate an object with an arrow and superimpose the explanation text.

Further, in the above-mentioned embodiment, as the medium pasted (associated) with the text (document file),
Although the case where the video image and the voice information (voice memo) are used has been described, it is also possible to handle acoustic media such as sound effects and environmental sounds (for example, background music, crying animals). Specifically, when the material according to the present invention is used as the material for presentation,
It is also possible to express the background environment by the above-mentioned acoustic media depending on the content of the sentence.

Further, in the above-mentioned embodiment, even when the voice memo and the moving picture are associated with each other, the reproduction of the voice memo and the reproduction of the moving picture respectively correspond to the "voice // moving picture" mark and the "from here" mark. Although it was explained that it was necessary to click, for example, by simply clicking the "Audio / Video" mark, it is possible to play back and display the video linked to the "From here" mark that follows the mark. Is. In short, the present invention can be variously modified and implemented without departing from the gist thereof.

[0104]

As described in detail above, according to the present invention, by associating a video image that can be easily used with a text material, it is possible to directly show a portion that cannot be explained only by the text material. Moreover, it is possible to show an image corresponding to the text unit of the content such as a document.

As described above, according to the present invention, it is possible to effectively use a video having a lot of information, and it is possible to eliminate a situation where a video that has been used once is hardly reused. Is obtained.

According to the present invention, sound information such as a voice memo can be linked to the video image. Therefore, at the time of general presentation, the sound information is pasted together with the video image according to the document content. It is effective in terms of work efficiency, understanding of explanation materials, and impression.

Further, according to the present invention, in the text information,
Set audio input mark corresponding to voice memo designation, range designation mark corresponding to video image range designation, still image mark corresponding to video image position designation or image file designation, and link the information corresponding to this mark In addition, when this mark is displayed on the screen as a kind of icon, the specified mark set in the text information is used to output the video or voice memo linked to the text information. It is extremely easy to use because you only need to specify the position.

[Brief description of drawings]

FIG. 1 is a block diagram showing the configuration of a material creation support system using video according to an embodiment of the present invention.

FIG. 2 is a diagram showing an example of the configuration of an operation screen in the embodiment.

FIG. 3 is a diagram showing an example of a screen before starting a video operation when creating a document material using a video image.

FIG. 4 is a diagram showing an example of a screen for explaining a video operation for setting a required video image as a moving image having a display range in the state of FIG. 3;

5 is a diagram showing an example of a screen for explaining an operation in a document window when using an image in a display range set by the operation in FIG.

FIG. 6 is a diagram showing an example of a screen for explaining an operation when a “still image” mark is set in addition to the “from here” mark and the “to here” mark.

FIG. 7 is a diagram for explaining attribute information linked to various marks applied in the embodiment.

FIG. 8 is a view showing an example of a screen for explaining an operation when setting a mark indicating a voice memo input in a document window.

[Explanation of symbols]

1 ... Video image input unit, 2 ... Video image control unit, 3 ... Video image / text information display unit, 4 ... Audio information input unit,
5 ... Audio information output section, 6 ... Disk device, 7 ... Keyboard, 8 ... Mouse (video operation designating means, video range designating means, display designating means, first display designating means, second display designating means, still image (Designating means, sound information setting designating means, sound output designating means), 9 ... video image / text association processing section, 10 ... system control section, 11 ... text creation / editing section, 21 ... document window, 22 ... video window, 5
1, 61, 71, 84 ... "From here" mark (display designating means, first display designating means), 52, 62, 74, 8
5 ... "up to here" mark, 64, 77, 81 ... "still image" mark (second display designating means), 72, 75, 78
... Attribute information, 73, 76, 79 ... Pointer, 82 ... "Voice" mark (sound output designating means), 83 ... "Voice / video"
Mark (sound output designating means), 201 ... [F1: play] button (video operation designating means), 202 ... [F2: stop] button (video operation designating means), 203 ... [F3: pause] button (video operation) Designating means), 204 ... [F4: Fast forward] button (video operation designating means), 205 ... [F5:
Rewind button (video operation designating means), 206 ... [F
6: Slow playback button (video operation designating means), 207
... [F7: "From here"] button (video range designating means), 208 ... [F8: "to here" button (video range designating means), 209 ... [F9: audio] button (sound information setting designating means) , 210 ... [F10: still image] button (still image designating means), 211 ... [F11: audio / video]
Button (sound information setting specifying means).

Claims (9)

[Claims] 1. A video image control means for controlling display of a video image recorded on a video medium, a video operation designation means for designating various operations necessary for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. And a video range designating unit for designating a video range associated with the text information displayed on the display unit for the video image reproduced and displayed on the display unit by the video image control unit, and the video range. Information associating processing means for associating a video image in a corresponding range with the text information according to the designation by the designating means Display designation means for displaying the video image in the range associated with the text information by the information association processing means on the display means while the corresponding text information is displayed on the display means. A material creation support system using video, comprising: a control means for controlling the reproduction display of a video image in a corresponding range by the video image control means according to the designation of the display designating means. 2. A video image control means for controlling display of a video image recorded on a video medium, a video operation designation means for designating various operations necessary for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. A video range control unit for designating a video range to be associated with the text information displayed on the display unit for the video image reproduced and displayed on the display unit by the video image control unit; By means of the means, the position of the video image displayed in a stationary state on the display means or the image is stored in advance. A still image designating means for designating a still image to be associated with the image file being displayed in the text information displayed on the display means, and a video image in a corresponding range according to the designation of the video range designating means. Information association processing means for associating with the information and for associating the video image at the corresponding position or the image in the image file with the text information according to the designation of the still image designating means, A first display designating means for displaying the video image in the range associated with the text information on the display means with the corresponding text information being displayed on the display means, and the text by the information association processing means. The image in the video footage or image file for the location associated with the information. In a state where the corresponding text information is displayed on the display means, a second display designating means for displaying on the display means, and the video image according to the designation of the first display designating means. The control means controls the reproduction display of the video image in the corresponding range, and the reproduction display of the video image at the corresponding position by the video image control means or the corresponding image by itself according to the designation of the second display designating means. And a control means for controlling the display of images in a file. 3. A video image control means for controlling display of a video image recorded on an image medium, a video operation designation means for designating various operations required for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. Sound information setting designating means for designating the setting of sound information such as voice, sound information inputting means for inputting sound information, sound information outputting means for outputting sound information, and the video image control means Specifies a video range to be associated with the text information displayed on the display means, targeting the video image reproduced and displayed on the display means. Depending on the designation of the video range designation means and the sound information setting designation means, the sound information input by the sound information input means or the previously stored sound information is stored in the text information displayed on the display means. Information association processing means for associating a video image of a corresponding range with the text information according to the designation of the video range designation means, and sound information associated with the text information by the information association processing means. , A sound output designating unit for outputting by the sound information output unit in a state where the corresponding text information is displayed on the display unit, and a video in a range associated with the text information by the information association processing unit. For displaying the video on the display means while the corresponding text information is displayed on the display means. According to the designation by the display designating means and the sound output designating means, the output of the relevant sound information by the sound information outputting means is controlled, and by the designation by the display designating means, the corresponding video image control means is provided. And a control means for controlling reproduction and display of video images in a range. 4. A video image control means for controlling display of a video image recorded on an image medium, a video operation designation means for designating various operations necessary for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. Sound information setting designating means for designating the setting of sound information such as voice, sound information inputting means for inputting sound information, sound information outputting means for outputting sound information, and the video image control means Specifies a video range to be associated with the text information displayed on the display means, targeting the video image reproduced and displayed on the display means. The image range designation means, the position of the video image still displayed on the display means by the video image control means, or the image file in which the image is stored in advance, the text information displayed on the display means. Still image specifying means for specifying a still image to be associated therein, and sound information input by the sound information input means or pre-stored sound information according to the specification of the sound information setting specifying means. Associated with the text information displayed on the means, associated with the video image of the corresponding range in the text information according to the designation of the image range designating means, and corresponding with the designation of the still image designating means. Information association processing means for associating a video image of a position or an image in an image file with the text information; Sound output designating means for causing the sound information output means to output the sound information associated with the text information by the information association processing means in a state where the corresponding text information is displayed on the display means; First display designating means for displaying the video image in the range associated with the text information by the information association processing means on the display means while the corresponding text information is displayed on the display means. To display the video image or the image in the image file at the position associated with the text information by the information association processing means on the display means while the corresponding text information is displayed on the display means The second display designating means, and the sound information outputting means according to the designation of the sound output designating means. The output of the corresponding sound information is controlled, and the reproduction display of the video image in the corresponding range by the video image control unit is controlled according to the designation of the first display designating unit, and the second display designating unit is controlled. According to the designation, the video image control means is provided with a control means for controlling the reproduction display of the video image at the corresponding position or the display of the image in the corresponding image file by itself, the material using the image. Creation support system. 5. A video image control means for controlling display of a video image recorded on an image medium, a video operation designation means for designating various operations necessary for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. And a video range designating unit for designating a video range associated with the text information displayed on the display unit for the video image reproduced and displayed on the display unit by the video image control unit, and the video range. When designating by the designating means, a certain range designation mark is placed at the position where the text characters can be input as part of the text information. Setting means, information association processing means for associating the video image in the designated range of the video range designating means with the range designation mark set by the mark setting means, and an arbitrary on the display screen of the display means. Position specifying means for specifying the position, and when the position specifying means specifies the position of the range designation mark in the text information displayed on the display means, the position designation means associates with the mark by the video image control means. And a control means for controlling reproduction and display of a video image in a specified range. 6. A video image control means for controlling display of a video image recorded on an image medium, a video operation designation means for designating various operations necessary for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. A video range designating unit for designating a video range to be associated with the text information displayed on the display unit for the video image reproduced and displayed on the display unit by the video image control unit; The position of the video image displayed still on the display means or the image is previously stored by the control means. A specified image file for a still image to be associated with the text information displayed on the display means, and a predetermined position at the text character inputtable position at the time of specification by the video range specification means. And a mark setting means for setting a predetermined still image mark as a part of the text information at a position where the text characters can be input at the time of designation by the still image designating means. , The range designation mark set by the mark setting means is associated with the video image in the range designated by the image range designating means, and the still image mark is associated with the video image at the position designated by the still image designating means or the designated image file. Information relating processing means, and for designating an arbitrary position on the display screen of the display means When the position designation means positions the position designation mark in the text information displayed on the display means by the position designation means, the range associated with the mark by the video image control means Controlling the reproduction display of the video image, and when the position of the still image mark is designated, the reproduction display of the video image at the position associated with the mark by the video image control means or the association with the mark by itself. And a control means for controlling display of an image in a stored image file. 7. A video image control means for controlling display of a video image recorded on an image medium, a video operation designation means for designating various operations necessary for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. Sound information setting designating means for designating the setting of sound information such as voice, sound information inputting means for inputting sound information, sound information outputting means for outputting sound information, and the video image control means Specifies a video range to be associated with the text information displayed on the display means, targeting the video image reproduced and displayed on the display means. At the time of designation by the image range designating means and the sound information setting designating means, a predetermined sound input mark is set as a part of the text information at the position where the text characters can be input at that time. Mark setting means for setting a predetermined range designation mark as a part of the text information at a position where text characters can be input, and a sound input by the sound information input means for the sound input mark set by the mark setting means. For associating information or prestored sound information and for associating the range designation mark with the video image in the designated range of the image range designating means, and for designating an arbitrary position on the display screen of the display means Position specifying means and the sound input in the text information displayed on the display means by the position specifying means. When the position of the mark is designated, the output of the sound information associated with the mark by the sound information output means is controlled, and when the position of the range designation mark is designated, the video image control means is used. And a control means for controlling reproduction and display of a video image in a range associated with the mark. 8. A video image control means for controlling display of a video image recorded on a video medium, a video operation designation means for designating various operations required for control by the video image control means, and used as a material. Text creating / editing means for creating / editing text information, and display means for displaying the text information being created or edited by the text creating / editing means and the video image reproduced and output by the video image control means. Sound information setting designating means for designating the setting of sound information such as voice, sound information inputting means for inputting sound information, sound information outputting means for outputting sound information, and the video image control means Specifies a video range to be associated with the text information displayed on the display means, targeting the video image reproduced and displayed on the display means. The image range designation means, the position of the video image still displayed on the display means by the video image control means, or the image file in which the image is stored in advance, the text information displayed on the display means. Still image designating means for designating a still image to be associated therein, and at the time of designation by the sound information setting designating means, a predetermined sound input mark is set as a part of the text information at the text character input possible position at that time, At the time of designation by the image range designating means, a predetermined range designation mark is set as a part of the text information at the position where the text characters can be inputted, and at the time of designation by the still image designating means, at the position where the text characters can be inputted. A mark setting means for setting a predetermined still image mark as a part of text information, and this mark setting means The sound input mark set by the sound information input means is associated with the sound information input by the sound information input means or the previously stored sound information, and the range designation mark is associated with the video image in the designated range of the image range designating means Information associating processing means for associating a video image or a designated image file at a position designated by the still image designation means with a still image mark, a position designation means for designating an arbitrary position on the display screen of the display means, and this position designation When the position of the sound input mark in the text information displayed on the display means is specified by the means, the output of the sound information associated with the mark by the sound information output means is controlled, When the position of the designated mark is designated, the video in the range associated with the mark is controlled by the video image control means. When the still image mark is position-controlled, the reproduction and display of the video image at the position associated with the mark by the video image control unit or the association with the mark by itself is controlled. And a control means for controlling the display of the image in the image file. 9. The control means, when the sound input mark and the range designation mark are continuous in the text information, sets the video image associated with the range designation mark as the sound input mark. 9. The material creation support system using video according to claim 7 or 8, wherein the video image control means reproduces and displays at a reproduction speed according to an output time of the associated sound information.