JP2000278635A - Device for generating and editing explanation source, device for presenting explanation source and explanation aid system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device for generating and editing explanation source, a device for presenting explanation source and an explanation and system that use a video image so as to more simply and effectively conduct education, training or the like. SOLUTION: In this device for generating and editing explanation source, a computer 1 digitally compresses a video image of a tape unit 2 to generate a moving picture file and stores it to a recording medium of a disk unit 5. While reproducing and displaying a video image of this moving picture file on a display device 3, a symbol such as an arrow mark or a character or the like is pasted to the video image to generate a video image teaching material and the disk unit 5 stores the material. On the other hand, in the case of utilizing the reproduced video image teaching material, each symbol is automatically reproduced, displayed or presented synchronously with the video image. Thus, in the case of learning a series of flows of site operations by an unskilled person such as a trainee or a young driver or the like, effective learning can be expected by this device.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a commentary material creation / editing apparatus for creating or editing commentary material based on video, and to present such commentary material by reproducing the commentary material. The present invention relates to a commentary material presentation device for creating a commentary material, and a commentary support system for creating or editing commentary material and presenting the playback material.

[0002]

2. Description of the Related Art In order to ensure safe operation and safe operation of an electronic power plant, research on human factors has been conventionally performed. They were primarily studies on human factors directly related to the main operations of nuclear power plants, such as man-machine interfaces in central control rooms, operator team behavior, and maintenance.

[0003] On the other hand, human errors in on-site operations performed by operators of a power plant can cause a major operational failure, and thus the need for research on on-site operations has increased. Operators generally have a strong image of operating in a central control room, but rather young operators often operate on site rather than operating in a central control room. The site is a place inside a building where many devices and the like necessary for power generation are actually placed or outdoors. In many cases, such operations performed on site are performed by humans manually operating the devices. For example,
Unlike remote control by switch operation performed in the main control room, it is an operation of actually opening and closing a valve manually, or manually turning a power supply on and off by shutting off a power supply panel. Some of these operations take time or require time-consuming operations, and the greater the number of human interventions, the higher the possibility of human error by the operator. Therefore, it is important to prevent human errors in on-site operations performed by operators, and to improve the reliability and reliability of on-site operations.

[0004] Most of the on-site operations are performed by young operators, as described above, and their operating experience is the basis of the knowledge of the operators operating in the central control room. While the young operator is based on the procedure, OJT (On the Job Train)
ing) to learn the on-site operation, but it is necessary to know not only the operation described in the procedure manual but also the knowledge and know-how about the operation as an operator. For this reason, it was necessary to enhance the contents of the OJT and the teaching materials for on-site operation education to supplement the contents more than ever. In addition, it was necessary to transfer the skills and know-how possessed by veteran operators in the field operation to younger operators so as to make them more reliable.

[0005]

SUMMARY OF THE INVENTION Under such circumstances,
The operators themselves felt the need to enhance education and training in their daily work, and have been making efforts to voluntarily shoot footage of field operations as educational teaching materials and leave them on videotapes. However, it was not possible to retake or add images even once, and lacked flexibility, so video tapes were rarely used repeatedly. On the other hand, it is difficult for a young operator to grasp the image only with a paper manual in order to confirm a series of on-site operations. For this reason, there has been a need for an education support system that enables easier education and training while using video.

In developing such an educational support system, there have been problems such as processing of images by a computer and easy operation of power plant operators by their own hands. If video processing is performed using analog technology, it is not technically easy to reproduce text and audio in synchronization with video, and it is not possible to create a system that can be operated easily and easily by operators. It was difficult. In addition, application software for video editing has been sold, but since it was developed for professionals in photography and editing, it is generally expensive and requires sophisticated Technology is required. For this reason, it was difficult for the operator of the power plant to use it.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and has as its object to provide a commentary material creating / editing apparatus which enables education and training to be performed more easily and effectively using video. An object of the present invention is to provide a commentary material presentation device and a commentary support system.

[0008]

According to the present invention, there is provided a commentary material creating / editing apparatus comprising: display means for reproducing and displaying an image composed of digitized moving image information; and each scene of the image displayed by the display means. In response, the association processing means for performing a process of associating the explanation information for explaining the scene, and the video displayed by the display means and the explanation information associated with each scene of the video by the association processing means Storage means for storing the information as commentary material while maintaining the correspondence.

In this commentary material creation / editing apparatus, description information is associated with each scene of the displayed video, and the video and the description information are stored as commentary materials so as to maintain the correspondence. Stored in the means.

[0010] The commentary material creating and editing apparatus of the present invention may further include a video converting means for digitizing a video provided as analog moving picture information and supplying it to a display means. In this case, it is preferable that the video converting means also performs a compression process when digitizing the video.

[0011] In the commentary material creating / editing apparatus of the present invention, further, the explanation information may be input by an interactive operation based on a graphical method.

In the commentary material creating / editing apparatus according to the present invention, the display means may further have a function of displaying a correspondence between the video stored in the storage means and the explanation information.

[0013] In the commentary material creating / editing apparatus of the present invention, the associating processing means further includes at least one of a change in a correspondence relationship between the video stored in the storage means and the description information, or a change in the content of the description information. May be performed.

In the commentary material creating / editing apparatus of the present invention, the explanation information may include at least one of a character, a graphic, a sound, and a still image. Here, the graphic includes, for example, a graphic used to indicate an arbitrary part in the video.

In the commentary material creating / editing apparatus of the present invention, the storage means may be a portable disk-shaped recording medium.

In the commentary material creating / editing apparatus according to the present invention, the associating processing means stores a series of videos as a moving image file and the description information as a description information file in the storage means, respectively. The image file may have a function of linking a plurality of different explanation information files.

According to the present invention, there is provided a commentary material presenting apparatus comprising: a storage unit that stores a video composed of digitized moving image information and explanatory information for explaining each scene of the video in association with each other; There is provided information presenting means for reading out the video and the explanation information, reproducing and displaying the video, and presenting the explanation information in synchronization with the video display.

In the explanation material presenting apparatus, the image and the explanation information associated with each other are read from the storage means. Then, the video is reproduced and displayed, and the explanation information is presented in synchronization with the video display.

In the commentary material presenting apparatus according to the present invention, the information presenting means further has a function of temporarily stopping at a scene associated with any of the explanatory information during reproduction and display of the video. May be provided.

The commentary support system of the present invention describes display means for reproducing and displaying a video composed of digitized moving picture information, and, for each scene of the video displayed by the display means, a description of the scene. And a description processing unit that performs a process of associating the explanation information for the image, and the explanation information associated with each scene of the image by the association processing unit with the image displayed by the display unit so as to maintain the association. Storage means for storing as commentary material; and information presenting means for reading out the video and the explanation information from the storage means, reproducing and displaying the video, and presenting the explanation information in synchronization with the video display. . Where "system"
The term “device” refers to a device in which a plurality of devices are logically aggregated, and it does not matter whether the devices of each configuration are in the same housing. The same is true in the following description.

[0021]

Embodiments of the present invention will be described below in detail with reference to the drawings.

FIG. 1 shows a schematic configuration of a commentary support system according to an embodiment of the present invention. The commentary material creation / editing device and the commentary material presenting device according to the embodiment of the present invention are embodied by the commentary support system according to the present embodiment, and will be also described below.

The commentary support system according to the present embodiment
For example, when operating, maintaining or inspecting various plant facilities and the like, the system is configured as a site operation technology transmission system for transmitting the contents of the operation to other workers. In a more specific example, the present system functions as a tool for creating a video teaching material for facilitating the transmission of such on-site operation technology and making use of the created video teaching material. . Therefore, the present system has three functions of digitizing a video, creating a video teaching material, and using the video teaching material. The video teaching material referred to here corresponds to the “commentary material” in the present invention. In the following description, the video teaching materials will be simply referred to as teaching materials as appropriate.

First, the configuration of the present system will be described. This system is a feature of the present invention, the digitization of video,
A computer 1 that creates, edits, and uses video teaching materials and controls the entire system, and a video tape drive (hereinafter simply referred to as a video tape drive) that supplies raw video signals (analog video signals) to the computer 1 A tape device 2), a display device 3 for displaying visual information (image information) of the created or edited video teaching material, and audio information (voice information) of the video teaching material. Speaker 4 for presenting
And a disk drive device (hereinafter simply referred to as a disk device) for driving a removable disk which is a recording medium for storing the created or edited video teaching material.
5 and a microphone 6 for voice input. here,
The display device 3 mainly corresponds to a specific example of "display means" in the present invention, and the disk device 5 mainly corresponds to a specific example of "storage means" in the present invention. Further, the display device 3 and the speaker 4 mainly correspond to a specific example of “information presenting means” in the present invention.

Between the computer 1 and the tape device 2,
They are connected by a video signal cable 7a, an audio signal cable 7b, and a control signal cable 7c. The computer 1 and the display device 3 are connected by a video signal cable 7d, and the computer 1 and the speaker 4 are connected by an audio signal cable 7e. Between the computer 1 and the disk device 5, for example, SCSI (Small Computer System Interface)
e) It is connected by the specified data cable 7f.
The microphone 6 is connected to the tape device 2 by an audio signal cable 7g.

As the computer 1, an ordinary personal computer or the like is used. The computer 1 includes a keyboard 111 and a mouse 112 for data input. Its internal configuration is as shown in FIG. 2 described later. As the tape device 2, for example, an 8 mm video tape drive is used. Here, the mouse 112 mainly corresponds to a specific example of “input means” in the present invention, together with a GUI (Graphical User Interface) function provided in an OS (Operating System) described later.

As the display device 3, for example, a 19-inch type CRT (cathode ray tube) is used. As shown in FIG. 4, which will be described later, most of the area (for example, three-quarters) of this screen is used for displaying images.

As the disk device 5, for example, a device that records and reproduces data by using a portable (removable) magnetic disk as a recording medium is used. As shown in FIG. 9, a digitally compressed moving image file and one or more symbol files associated with the moving image file are stored in the removable magnetic disk. In addition,
The symbol file will be described later. Here, the removable recording medium is not limited to the magnetic disk, but may be another recording medium. For example, CD-R (writable CD), CD-REW (rewritable CD), DVD
An optical disk such as a (digital video disk) or a magneto-optical disk may be used. Further, the disk device 5 may be built in the main body of the computer 1.

The audio signal cable 7g for connecting the microphone 6 to the tape device 2 is directly connected to the audio signal cable 7b inside the tape device 2, so that the audio input from the microphone 6 is transmitted to the computer 1 as it is. It is being supplied.

FIG. 2 shows the internal configuration of the computer 1. As shown in FIG.
Is a CPU 10 that controls the operation of the entire computer.
A RAM (Random Access Memory) 102 having a program storage area 102a for storing an application program and a work area 102b used when executing the application program;
A display functioning as an interface between a ROM (Read Only Memory) 103 storing a basic program executed by the 101, a hard disk device (HDD) 104 storing an OS and application programs, and the like, and the display device 3. And a connection unit 105. In the present embodiment, a moving image file generating program for generating a digitally compressed moving image file from a raw video tape and a learning material creating / editing program for creating, editing, and presenting teaching materials are preliminarily provided as application programs. It is assumed that it is stored in the HDD 104. The OS stored in the HDD 104 is provided with a so-called GUI function, so that the user can perform an interactive operation (interactively) mainly by using the mouse 112 and the screen display of the display device 3. ing. Here, the CPU 101 and the teaching material creating / editing program mainly correspond to a specific example of “association processing unit” in the present invention.

The computer 1 also includes a control signal input / output unit 106 for transferring a control signal relating to tape drive to and from the tape device 2, a video signal input unit 107 for receiving a video signal from the tape device 2, While receiving the audio signal from the tape device 2, the disk device 5
And an audio signal input / output unit 108 for outputting an audio signal read out from the speaker 4 to the speaker 4. The video signal input unit 107 has an analog / digital conversion unit (not shown) for converting an analog video signal input from the tape device 2 into a digital video signal, and converts the generated digital video signal into a predetermined format. It has a compression unit 107a for compression. Here, the video signal input unit 107 mainly corresponds to a specific example of “video conversion unit” in the present invention.

The computer 1 further includes a disk device 5
Acts as an interface between, for example, SCS
An I-spec disk connection unit 109; a LAN connection unit 110 for connecting to the LAN 8;
1 and a mouse 112.

The above components are mutually connected by a system bus 113.

Next, an operation method of the commentary support system having the above-described configuration will be described.

First, referring to FIGS. 3 to 8, an operation for actually creating or editing an educational material using this system and an actual educational material utilizing this system will be described. The operation for presentation will be described.

[Creation of Moving Picture File] First, the operation for creating a digitally compressed moving picture file from raw video recorded on a video tape will be described. When the computer 1 is started, the screen of the display device 3 displays
An initial screen (not shown) in which icons of some application programs are arranged is displayed. In a specific example, although not shown, an icon indicating a moving image file generation program and an icon indicating a teaching material creation / editing program are displayed. Here, the user selects (double-clicks) the moving image file generation program on the screen by using the mouse 112 or the like, starts the program, and specifies the file name of the storage destination. Is displayed.

FIG. 3 is an enlarged view of the upper left area of the screen, showing a control panel area 11 in which various video control buttons are arranged and a video display area 12 occupying most of the screen on the right side. It is. The control panel area 11 has four control buttons 11a to 11d for controlling the operation of the tape device 2. The control button 11a is a tape rewind button, the control button 11b is a tape running stop button, the control button 11c is a play button, and the control button 11d is a tape fast forward button. By clicking these buttons, the tape device 2 can be freely controlled.

The control panel area 11 also includes an in-point button 11e and an out-point button 11f for designating a section of the video recorded on the tape of the tape device 2 to be digitized and taken into the computer 1.
Is arranged. The in-point button 11e is used to specify the start position of the capture target section, and the out-point button 11f is used to specify the end position of the capture target section. The reproduction time on the video tape at the time when each button is selected is displayed on the right side of each of these buttons.

In the control panel area 11, an image compression mode setting button 11g and an audio compression mode setting button 11h for setting a compression mode at the time of recording (capture) are arranged. , A capture start button 11i is arranged.

In FIG. 3, when the video tape of the tape device 2 is reproduced by the four control buttons 11a to 11d, the video is displayed in the video display area 12. Here, the capture target section is designated using the in-point button 11e and the out-point button 11f, and further, if necessary, the image compression mode and the audio compression mode are set by the image compression mode setting button 11g and the audio compression mode setting button 11h. Set the compression mode. Then, by clicking and selecting the capture start button 11i,
The video of the designated section on the video tape set in the tape device 2 is digitized in real time and temporarily stored in the HDD 104 of the computer 1 as a moving image file. This movie file is, for example, a movie playback program "Quick Time" (a product of Apple USA)
Is created in a playable file format. In addition,
Using the in-point button 11e and the out-point button 11f, it is also possible to designate a plurality of capture target sections. In this case, the designated sections are connected to each other, and become one moving image file at the end of the import. In the following description, selecting a button or the like means
Mouse 11 with the mouse cursor on the button etc.
2 means performing an operation of clicking.

As described above, in the present system, a video can be taken in as a digital moving image file by simply clicking the icon, so that the system is simple and requires little time and effort.

[Creating and Editing Teaching Materials] Next, each scene (scene) of the video displayed on the screen of the display device 3
An operation for creating a teaching material that associates explanatory information (hereinafter, referred to as a symbol) such as characters, figures, sounds, and still images will be described.

When the icon (not shown) of the teaching material creation / editing program is double-clicked on the initial screen (not shown), the teaching material creation / editing program is started, and the editing initial screen (not shown) is displayed. Here, when "new" is selected from a menu (not shown), a dialog (not shown) for specifying a moving image file serving as a basis of the teaching material is displayed. Here, when the target moving image file is selected, as shown in FIG.
3 is opened, and the specified moving image file is read from the HDD 104 and displayed on the editing window 13.

In FIG. 4, various control buttons and boxes for inputting setting data are arranged in a control panel area 14 on the left side of the editing window 13. In a video area 15 occupying most of the right part of the editing window 13, a designated moving image file (in this figure,
An image of a file named “Replace No. 5 Sharpin” is displayed. Below the video area 15, a movie control bar 17 corresponding to the entire length of the video is arranged. The moving tab 17 of the movie control bar 17
By dragging a with a mouse, an image at an arbitrary time can be displayed. Alternatively, the video display time can be moved by a play button, a fast forward button, a reverse button, etc. arranged on the left and right of the movie control bar 17. As shown in FIG. 4, below the movie control bar 17, when the beginning of the video of the moving image file is 00:00:00,
The current display time 18 is displayed.

By operating buttons, icons, and the like in the control panel area 14 while watching the video in the video area 15, the user can create a teaching material in which various symbols are attached to each scene of the video. Has become. Functions such as buttons and icons in the control panel area 14 are as follows.

Arrow icon 14a: Has a function of inputting an arrow on an image using a mouse.

Freehand icon 14b: Has a function of inputting a free curve such as a freehand graphic on an image using a mouse.

Character icon 14c: has a function of creating a text frame using a mouse and inputting characters in the text frame.

Voice icon 14d: Using a microphone,
A function that records audio in accordance with the content of video (so-called audio dubbing function).

Still image icon 14e: has a function of inputting a still image such as an attached diagram, a system diagram, or a photograph as detailed material prepared separately.

In point button 14g: has a function of designating a video section to be associated with a symbol, that is, a start point of a symbol display period.

Out point button 14h: has a function of designating the end point of the symbol display period.

Immediate event button 14i: has a function of making it possible to associate a symbol only at a specific point in time. The same function is performed when both the In point button 14g and the Out point button 14h are clicked at the same time.

Silence section in point button 14j: has a function of designating the start point of the silence section. Here, the mute section is a section in which no sound is output during the playback of the teaching material. The mute section is displayed by an audio bar 16 arranged below the video area 15. Here, the section displayed in black is the silence section.

Silence section out point button 14k: A function for designating the end point of the silence section.

Silence section setting button 14m: mute section in point button 14j and mute section out point button 14k
Has a function of executing a process of setting the section designated by the に よ っ て as a mute section.

Silence section erase button 14n: Has a function of executing processing for deleting a set silence section.

Record button 14p: In point button 14g
And a function of executing a process of associating a voice with a section designated by the out point button 14h.

Text / image designation button 14q: has a function of executing processing for associating a designated text or image with a designated section.

The attribute setting area 14o includes an arrow icon 14
This is an area for setting various attributes for a symbol (symbol currently being set) selected by any one of the icons a through still image 14e.
Here, the “name” column 14r is a column in which the name of the symbol is input or displayed, and the “description” column 14s
Is an area where a description of the symbol is input or displayed. The automatic stop check box 14t is for setting whether to set the automatic stop mode. By setting this to the checked state, the playback of the teaching material is stopped at the start of the display of the symbol that is currently set. The stop period box 14u is for setting a time from stop to restart in the automatic stop mode. The color setting button 14v is for designating a symbol color. The in-point box 14w
The display start time of the symbol is indicated, and the out point box 14x indicates the display end time of the symbol. The display period box 14y is a section in which the symbol is displayed, that is, a time from the display start time displayed in the in-point box 14w to the display end time displayed in the out-point box 14x. In addition, several check boxes 14z for setting a character font are provided. In the example of FIG. 5, the display period of the symbol has not been set yet, and the time is not displayed in the in-point box 14w and the out-point box 14x.

Using the tools of the arrow icons 14a to 14e, the user views an image and places an arrow, a freehand graphic, a character, a still image, or a sound at an arbitrary position during an arbitrary period of the image. Can be pasted (that is, associated), and these can be stored on the recording medium of the disk device 5 in association with the video.
For example, as shown in FIG. 4, an arrow 21 and a character 22 can be pasted or a freehand graphic 23 can be written at an arbitrary position during an arbitrary period of a video. Also,
As shown in FIG. 6, a still image 24 such as a drawing can be pasted at an arbitrary position during an arbitrary period of a video.
Further, as shown in FIG. 7, a still image 25 such as a photograph can be pasted at an arbitrary position during an arbitrary period of a video.

Here, the operation for pasting each type of symbol to the video will be described.

First, the operation for pasting an arrow will be described. The user monitors the appearance of the scene to which the arrow is to be pasted while watching the video. Then, when the scene appears, clicking the arrow icon 14a temporarily stops the reproduction of the video. Here, when the mouse is dragged from an arbitrary position (first position) on the image to another arbitrary position (second position), an arrow from the first position to the second position is displayed on the image. Is written to. Changing the display period, size, color, and other attributes of the arrow, and moving or deleting the arrow can be easily performed with a mouse. For example, the color can be changed by clicking the color setting button 14v to display a color setting dialog and making necessary settings there. The display period of the arrow is set by clicking the in-point button 14g while displaying the video at the start of display and by clicking the out-point button 14h while displaying the video at the end of display. Is done. Of course, the display period can be changed in the same manner. Furthermore, the same arrow can be stuck on a plurality of different periods on the video. Note that the operation of pasting the freehand graphic is basically the same as the case of the arrow, and a description thereof will be omitted.

Next, an operation for pasting a character (text) will be described. The user watches the video,
Watch for the scene where you want to paste the text. When the character icon 14b is clicked when the scene appears, the reproduction of the video is temporarily stopped. here,
When the mouse 112 is dragged from an arbitrary position (first position) on the video to another arbitrary position (second position), a line connecting the first position and the second position becomes a diagonal line. A rectangular character input box appears, in which the keyboard 111
You can enter characters from. Characters can be entered in the frame by keyboard input. The input into the rectangular character input box can be performed by directly reading from the keyboard, or by reading an existing text file and importing the contents into the character input box. In this case, by clicking the text / image specification button 14q, a dialog for specifying a text file is opened, and the icon of the text file displayed there may be selected. In the case of a character, as in the case of the arrow or the freehand graphic described above, the operation of changing the size and color of the character, and moving and deleting the character can be easily performed with a mouse. Of course, it is possible to freely set or change the character display period in the same manner. The display time can also be.

Next, an operation for pasting a voice will be described. In this case, when the explanation of the content of the video is to be blown in by voice, the voice icon 14d is clicked at a desired time. As a result, the audio icon 26 is displayed in the video area 1
5 so that a voice input from the microphone 6 (FIG. 1) can be recorded. However, at this point, the audio icon 26 is displayed in a light color. Here, record button 1
Click 4p to start recording.
Input audio from. To stop recording, press record button 1 again
This is done by clicking 4p. By stopping this recording,
The recorded input audio is pasted in a period starting from the time when the audio icon 14d on the video is clicked. This can be understood from the fact that the audio icon 26 on the video area 15 is displayed dark. The release of the sound pasted on the video is canceled by the sound icon 26 on the video area 15.
Can be deleted by using a mouse. Therefore, if an incorrect explanation or the like is given, it is possible to retake it any number of times.

Next, the operation for pasting a still image will be described. In this case, the user clicks the still image icon 14e at a desired time while reproducing the video. As a result, the image icon 27 is pasted on the video area 15, and a state in which a still image can be pasted is established.
Here, for example, it is assumed that an attached diagram to be added as a supplement to the video, such as a system diagram of the operation target device or a still image of the internal structure of the operation target device, is stored in advance as a still image file. I do. However, at this point, the still image icon 27 is displayed faintly. Here, when the text / image designation button 14q is clicked, a still image designation dialog is displayed, and the icon of the still image file displayed there is selected. When a file is designated, a still image window is opened, and the position and size of the still image window are changed as necessary. Thereby, as shown in FIGS. 6 and 7, for example, the selected still images 24 and 25 are pasted on the video. This can be understood from the fact that the still image icon 27 on the video area 15 is displayed dark. The valid period of the still image, that is, the display period is set in advance using the in-point button 14g and the out-point button 14h. The release of the still image pasted on the video can be canceled by deleting the still image icon 27 on the video area 15 with the mouse, as in the case of the audio.

Next, the setting of the mute section will be described.
For example, when trying to create a teaching material by photographing an operation at a work site, it is usual that, at the time of the photographing, noises of peripheral devices are taken in together with a video. Such noise often hinders learning when it is later used as teaching material. Therefore, a function for setting a mute section is provided to enable such noise to be eliminated as necessary. To set the mute section, first, the mute section in-point button 14j is clicked at the first time when the mute state is desired, and the mute section out point button 14k is clicked at the time when the mute state is to be ended. Next, the mute section setting button 14m is clicked.
Thereby, the section can be set as a mute section. Since this function is realized by controlling the volume at an arbitrary point on the audio track, it is also possible to restore the deleted audio. As a specific example, after moving the moving tab 17a of the movie control bar 17 within the range of the silence section to be canceled, the setting of the silence section can be canceled by clicking the silence section erase button 14n. It is also possible to change the length of the silence section once set to be longer or shorter.

Also, as shown in FIG.
By clicking the mark 31, a symbol list 32 can be displayed. This symbol list 3
In 2, each symbol is associated with a symbol type, an in-point, an out-point, ON / OFF of automatic stop setting, a stop period after automatic stop, and a description of the symbol. Since the symbol data on the list 32 has a one-to-one correspondence with the symbols on the video area 15, the symbol can be selected by clicking the symbol data on the list 32. When the symbol data on the list 32 is double-clicked, the symbol can be selected and moved to the in point of the symbol.

The teaching materials created by the above-described operations are stored in the recording medium of the disk device 5 in the form of a moving image file and a symbol file, which will be described later, and are used for subsequent operation learning. Because the recording medium is portable, the teaching materials stored therein can be used in similar systems at other locations. Further, the created teaching material can be transferred to a similar system in another place via the LAN 8 and used there.

As described above, since still images such as arrows, freehand characters, characters, voices, and attached drawings can be easily pasted on the video reproduced on the screen of the display device 3, for example, While watching the video obtained by shooting the operation, on the desk, knowledge of the operation procedure and operation,
Know-how, points of caution, and the like can be stored as data in association with each scene in the video. Therefore, it is possible to easily create an extremely effective teaching material for learning the on-site operation. It is also easy to revise the contents of the teaching materials once created.

[Use of Created Teaching Material] Next, an operation for using the created teaching material will be described.

The created teaching material can be reproduced by the same system and can be used for learning. Arrows, freehand figures,
Characters, audio, and still images have individual display periods. When the playback of the video teaching material is started and the arrow, the freehand graphic, the character, the sound, and the still image are in the section (that is, the display period), these symbols are synchronized with the video. Automatically played back and displayed or presented. At that time, the user can quickly access an arbitrary place in the teaching material by using the movie controller 17 arranged below the video area 15.

When the backward or forward skip function is used, it is possible to see only the positions of symbols, such as arrows and characters, pasted when the teaching material was created. This is a function not found in ordinary analog video, and is convenient for a user who wants to see only necessary points and points of caution, because efficient learning can be performed. This skip function is performed by a skip icon 28,
It can be executed by clicking 29.

When reproducing and using the teaching material, it is convenient to use the automatic stop function. Usually, symbols such as characters and arrows are displayed only during a set display period. However, if the symbol is, for example, a character composed of long sentences, or a drawing with complicated content, if the display period of the symbol is short, the display may disappear before the user has finished reading the entire document. is there. Therefore, in such a case, it is preferable to use an automatic stop function that can stop the reproduction of the teaching material at the start of displaying the symbol by checking the automatic stop check box 14t. Further, in this case, by setting the time from the automatic stop point to the restart in the stop period box 14u, the reproduction of the teaching material can be automatically restarted after the set time has elapsed.

Next, the moving image file and the symbol file created by the present system will be described with reference to FIGS.

FIG. 9 shows the relationship between the moving image file stored in the recording medium 5a of the disk device 5 and the symbol file. In the example shown here, one "operation"
For a video file 50 named “operation description 1”, a video file 52 named “operation description 2”, and a video file 53 named “operation description 3” Two symbol files are stored in association with each other. Each symbol file is created separately by the above-described teaching material creation process. In other words, it is easy to create a plurality of different teaching materials based on the same video material. Therefore, for example, when the present system is used as a teaching material in a school, it is easy to learn using a video teaching material provided with different explanations according to the level of the degree of understanding or achievement of the student. Here, the symbol file corresponds to a specific example of the “description information file” in the present invention.

FIG. 10 shows a schematic configuration of one symbol file. As shown in the figure, the symbol file includes a symbol file name 61, a moving image file name 62, an index table 63, and a symbol table 64. For example, taking the symbol file 51 shown in FIG. 9 as an example, the symbol file name 61 is “operation description 1”, and the moving image file name 62 is “operation”.

FIG. 11 shows the structure of the index table 63. This index table 63 is
The time and the index in the created video teaching material are associated with each other. Here, the time means the playback time of each scene (accurately, a video frame) when the beginning of the video teaching material is 00:00:00. The index is a type of identification code assigned to each symbol. In the example shown in this figure, the video teaching material has a length of about 18 minutes. The index is I (1),
I (2), I (3), I (4), I (5),... As is clear from this figure, at a certain playback time, a plurality of different indexes may be pasted on the video.

FIG. 12 shows the structure of the symbol table 64. The symbol table 64 associates indexes I (1), I (2), I (3),..., Symbol types, and attributes associated with the symbols. Here, the indexes I (1), I (2), I (3),.
Is the same as the index shown in FIG. The type of the symbol is any of the arrow, the freehand graphic, the character (text), the voice, and the still image, which have already been described. Attributes are various types of information related to the presentation form and expression form of a symbol, and include, for example, the following.

(1) When the symbol is an arrow or a freehand figure: display position, display period, shape, color, size, presence / absence of automatic stop, stop period.

(2) When the symbol is text Display position, display period, font, decoration, color, size, presence / absence of automatic stop, stop period, text file name.

(3) When the Symbol is Sound The presentation period, the presence or absence of automatic stop, the stop period, and the sound file name.

(4) When the symbol is a still image: display position, display period, size, presence / absence of automatic stop, stop period, still image file name.

Next, with reference to FIGS. 13 and 14, the operation of the computer 1 when creating or editing video teaching materials and when utilizing (playing back) video teaching materials using this system will be described.

First, referring to FIG. 13, mainly the CPU 10 of the computer 1 at the time of creating / editing the video teaching material.
1 will be described.

First, the CPU 101 starts reproducing a moving image file stored in the recording medium of the disk device 5 (step S101). Next, the CPU 101 performs an operation of selecting a symbol such as an arrow or a text (that is, FIG.
Of the icons 14a to 14e on the control panel 14) (step S102; Y), and if a symbol selection operation is performed (step S102; Y).
At that time, the reproduction of the moving image is stopped (step S10).
3) Acquire the type of the symbol selected there (step S104).

Next, the CPU 101 acquires the times of the in point and the out point (step S105). And
The CPU 101 registers the index I (i) associated with the obtained IN point and OUT point in the index table of FIG. 11 (step S106).

Here, when the attribute (position, size, etc.) of the symbol is input, the CPU 101 acquires the input attribute (step S107). Then, the acquired symbol type and attribute are registered in the symbol table 64 of FIG. 12 (step S108).

Here, when the operation for ending the creation / editing of the video teaching material is not performed (step S109; N), and when another symbol is selected (step S1).
10; Y), the process returns to step S104, and returns to step S1.
The processing up to 09 is performed. On the other hand, when an operation of ending the creation / editing of the video teaching material is performed (step S10).
9; Y), the index table 63, the symbol table 64, and the moving image file name are stored as symbol files in the recording medium of the disk device 5 (step S11).
1).

In this way, a video teaching material is completed by associating symbols such as arrows and characters with each scene of the video.

Next, the operation of the CPU 101 of the computer 1 at the time of reproducing the video teaching material will be described with reference to FIG. First, the CPU 101 reads a symbol file from the recording medium of the disk device 5 (step S
201). Next, the CPU 101 extracts the index table 63 and the symbol table 64 from the read symbol file and expands them on the memory (work area 102b of the RAM 102) (step S20).
2).

Next, the CPU 101 acquires a moving image file name from the symbol file (FIG. 12) (step S2).
03), the reproduction of the moving image is started (step S20)
4). Then, each time the CPU 101 acquires a time that changes with the progress of the reproduction (step S20).
5) Search the index table (FIG. 11) and extract all indexes associated with that time (step S206).

Next, the CPU 101 searches the symbol table 64 using the extracted index as a key, and extracts the attribute attached to the symbol (step S20).
7). Next, the CPU 101 displays a symbol based on the content of the extracted attribute (step S208). If the reproduction has not been completed yet (step S2
09; Y), the flow returns to step S205 again, and the subsequent processing is repeated.

In this way, indices such as arrows and characters are displayed or presented in synchronization with the reproduction of the video.

As described above, according to the explanation support system of the present embodiment, it is possible to easily create a video teaching material by pasting symbols such as arrows and characters on a video.
At the time of use, each symbol is automatically reproduced and displayed or presented in synchronization with the video, so that untrained persons such as trainees and young drivers can perform a series of on-site operations. In learning the flow, more effective learning can be expected. This is because the use of the video teaching material makes it easier to grasp the image of the operation contents than the case of using a paper manual, and the learning can be carried out independently without an instructor. Further, since the learning of the on-site operation can be repeated on the desk without going to the on-site, it is a complement to OJT. In addition, it is possible to efficiently check the points to be noted, perform image training, and the like before actually performing the operation at the site.
For this reason, many effects such as the accumulation of knowledge about operations and the know-how of veterans can be transmitted, and the reliability, reliability and skills of on-site operations are improved.

Although the present invention has been described with reference to some embodiments, the present invention is not limited to these embodiments, and various modifications are possible. For example, in each of the above-described embodiments, a system having a function of digitizing a video tape video of the tape device 2 and taking it into the computer 1 has been described. In this case, for example, as shown in FIG. 15, the tape device 2 may be omitted and the microphone 6 may be directly connected to the computer 1.

Further, in the present embodiment, the created video teaching material is stored in the removable recording medium of the disk device 5, but it is stored in another recording medium, for example, the hard disk device 104 in the computer 1. You may. Alternatively, the information may be transferred to another control via the LAN 8.

Further, in this embodiment, the system for transmitting the operation technique at the site of the plant or the like to another person has been described. However, the present invention is not limited to this, and may be applied to other uses. Applicable. For example, the present invention can be widely applied to educational support use in schools, homes, study schools, etc., customer service education and various presentations in the business field and the like, and commentary and analysis of game contents in the sports field.

[0099]

As described above, claims 1 to 1 are described.
According to the commentary material creating / editing apparatus described in any one of the above, the explanation information is associated with each scene of the displayed video, and the commentary is performed by maintaining the correspondence between the video and the explanation information. Since it is stored in the storage means as a material for use, it is possible to add descriptive information explaining the contents of the video to the video while watching the video, and easily create a more understandable video teaching material. This has the effect.

According to the commentary material presenting apparatus of any one of claims 11 to 16, the mutually associated video and explanation information are read from the storage means, and the video is reproduced and displayed. Since the explanation information is presented in synchronization with the display of the video, it is possible to simultaneously receive the explanation information that explains the content of the video while watching the video, which makes it easier to understand the content of the video. It works.

According to a seventeenth aspect of the present invention, explanation information is associated with each scene of a displayed video, and the video and the description information are maintained in a corresponding relationship to provide a commentary material. As it is stored in the storage means, the video and the description information associated with each other are read out from the storage means, and the video is reproduced and displayed, and the description information is presented in synchronization with the video display. This makes it possible to easily create an easy-to-understand video teaching material, and to easily understand the contents of the video.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of a commentary support system according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a computer in FIG.

FIG. 3 is a diagram illustrating a part of a display screen of a display device when a moving image file is generated.

FIG. 4 is a diagram illustrating an example of a display screen of a display device when a teaching material is created.

FIG. 5 is an enlarged view of a part of FIG. 4;

FIG. 6 is a diagram illustrating another example of the display screen of the display device when the teaching material is created.

FIG. 7 is a diagram illustrating still another example of the display screen of the display device when the teaching material is created.

FIG. 8 is a diagram illustrating a part of a display screen of a display device when a teaching material is created.

FIG. 9 is a diagram illustrating a relationship between a moving image file and a symbol file.

FIG. 10 is a diagram showing a schematic configuration of a symbol file.

FIG. 11 is a diagram illustrating a structure of an index table.

FIG. 12 is a diagram illustrating a structure of a symbol table.

FIG. 13 is a flowchart showing mainly the operation of the CPU of the computer when creating / editing the video teaching material.

FIG. 14 is a flowchart mainly showing the operation of the CPU of the computer when playing back the video teaching material.

FIG. 15 is a block diagram illustrating a modification of the commentary support system according to the present embodiment.

[Explanation of symbols]

DESCRIPTION OF SYMBOLS 1 ... Computer, 2 ... Tape device, 3 ... Display device, 4 ... Speaker, 5 ... Disk device, 6 ... Microphone,
14: control panel area, 15: video display area,
17: Movie control bar, 63: Index table, 64: Symbol table, 101: CPU,
102 RAM, 104 hard disk device, 106
... Control signal input / output unit, 107 ... Video signal input unit, 10
8. Voice input / output unit, 111 keyboard, 112 mouse.

 ──────────────────────────────────────────────────続 き Continued on the front page (72) Inventor Tetsuya Matsui 4-11-38 Toyo, Koto-ku, Tokyo F-term in Toyo Information System Co., Ltd. (Reference) 5C018 AA02 AB01 AB02 AB12 AB13 AC08 5C053 FA14 FA21 FA23 GA11 GB01 GB05 GB11 GB21 HA29 JA03 JA16 KA05 KA21 KA24 KA25 LA06 LA11 LA14

Claims (17)

[Claims] 1. A display means for reproducing and displaying an image composed of digitized moving image information, and for each scene of the image displayed by the display means,
Association processing means for performing a process of associating explanation information for explaining the scene; and a video displayed by the display means and explanation information associated with each scene of the video by the association processing means, And a storage means for storing as a commentary material so as to maintain the correspondence. 2. The commentary material creating / editing apparatus according to claim 1, further comprising video converting means for digitizing a video provided as analog moving picture information and supplying the digitalized video to the display means. 3. The commentary material creating / editing apparatus according to claim 2, wherein said video converting means also performs a compression process when digitizing said video. 4. An explanation material creating / editing system according to claim 1, further comprising an input means for enabling said explanation information to be inputted by an interactive operation based on a graphical method. apparatus. 5. The commentary material creation / editing apparatus according to claim 1, wherein the display means further has a function of displaying a correspondence relationship between the video stored in the storage means and the explanation information. . 6. The associating processing means further has a function of changing at least one of a correspondence between a video stored in the storage means and explanatory information, or a content of the explanatory information. 2. The commentary material creation / editing apparatus according to claim 1, wherein: 7. The commentary material creating and editing apparatus according to claim 1, wherein the explanation information includes at least one of a character, a graphic, a sound, and a still image. 8. The commentary material creating / editing apparatus according to claim 7, wherein the graphic includes a graphic used to indicate an arbitrary part in a video. 9. The commentary material creation / editing apparatus according to claim 1, wherein said storage means is a portable disk-shaped recording medium. 10. The association processing unit stores a series of videos as a moving image file and explanation information as an explanation information file in the storage unit. 2. The commentary material creation / editing apparatus according to claim 1, further comprising a function of linking different explanation information files. 11. A storage unit for storing a video composed of digitized moving image information and description information for explaining each scene of the video in association with each other, and reading the video and the description information from the storage unit And an information presenting means for reproducing and displaying a video and presenting explanation information in synchronization with the video display. 12. The commentary material presenting apparatus according to claim 11, wherein the video stored in the storage means is digitally compressed. 13. The commentary material presentation apparatus according to claim 11, wherein the explanation information includes at least one of a character, a graphic, a sound, and a still image. 14. The commentary material presenting apparatus according to claim 13, wherein the graphic includes a graphic used to indicate an arbitrary part in a video. 15. The commentary material presenting apparatus according to claim 11, wherein said storage means is a portable disk-shaped recording medium. 16. The information presenting means further has a function of, during reproduction and display of a video, when a scene to which any of the explanatory information is reached reaches, a pause is made at that scene. The commentary material presentation device according to claim 11. 17. Display means for reproducing and displaying an image composed of digitized moving image information; and for each scene of the image displayed by the display means,
Association processing means for performing a process of associating explanation information for explaining the scene; and a video displayed by the display means and explanation information associated with each scene of the video by the association processing means, A storage means for storing the correspondence as commentary material and a video and explanation information are read from the storage means, and the video is reproduced and displayed, and the explanation information is presented in synchronization with the video display. A commentary support system comprising information presenting means.