JP2004102116A - Moving picture speech analysis and evaluation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a moving picture speech analysis and evaluation system which enables, by operably text-displaying speech information together with a moving picture, comprehension of the contents of information transmission by communication as well as the progress of training state with the progress of time when the state of operator training using a simulator of a plant like a nuclear power plant is stored in a moving picture recording medium such as a VTR. <P>SOLUTION: The moving picture speech analysis and evaluation system 1 is composed of an information processing system 2 equipped with a display 2B having a moving picture display section, a voice waveform display section and analysis/evaluation chart display section and a computation storage device 2A. A moving picture data file, a speech data file, and time information are stored in the computation storage device 2A. The computation storage device 2A refers to the speech data file to display a voice waveform signal on the voice waveform display section and also synchronously outputs speeches, and refers to the moving picture data file to synchronously display the moving picture on the moving picture display section. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a moving image sound analysis and evaluation system which displays a sound text and its sound waveform together with a moving image on a display, thereby enabling analysis and evaluation of information transmission by dialogue.
[0002]
[Prior art]
In a plant, such as a nuclear power plant, which requires operator skills as well as reliability, operator training using a simulator is performed periodically, and the results are recorded and reproduced by a VTR and analyzed and evaluated.
[0003]
However, only the reproduction of the VTR cannot sufficiently grasp the information necessary for the analysis and evaluation, such as the operation state of the simulator, the state of the plant parameters, and whether the information transmission between the operators has been correctly performed.
[0004]
Therefore, it is conceivable to use a moving image sound display system shown in FIG. 4 described in Japanese Patent Application Laid-Open No. 10-326177, which is a system that displays sound as text data during moving image reproduction of a VTR.
[0005]
The conventional video / audio display system A has a configuration in which a video display control unit C for controlling a video data file B, a text display control unit E for controlling a voice text data file D, and a language selection unit F are connected to a display G. .
[0006]
The voice text data file D is obtained by recognizing the voice of the moving image data file B by a voice recognition unit (not shown), converting the voice data into text data, and storing the text data.
[0007]
The text display control unit E includes the moving image information H from the moving image display control unit C, the language information I to be displayed from the language selection unit F, and the time of the audio text data file D corresponding to the moving image information H from the time chart file J. Information K is input.
[0008]
In the video / audio display system A, the text display control unit E selects the voice / text data file D of the specified language information I corresponding to the time information K suitable for the video / video information H, and converts the voice / text information L into the video / video. This is transmitted and displayed on the display G together with the moving image information H output from the display control unit C.
[0009]
[Problems to be solved by the invention]
In training an operator using a simulator of a nuclear power plant or the like, processing of text information such as extraction of remarkable communication and repetitive reproduction is only possible by displaying voice as text using the conventional video sound display system A. The operation is complicated, and it is difficult to accurately grasp the time history.
[0010]
In addition, it is necessary to determine the operating state of the simulator, the state of the plant parameters, or the reliability of information transmission between operators working in each area of the simulator by considering the appropriateness of the moving image and audio information.
[0011]
The present invention has been made in order to cope with the above-described conventional circumstances. In the case where a training situation of an operator using a simulator such as a plant such as a nuclear power plant is stored in a moving image recording medium such as a VTR. It is another object of the present invention to provide a video sound analysis and evaluation system capable of displaying voice information along with a video so that the voice information can be operated, and grasping the information transmission content through communication as well as the temporal training status.
[0012]
Another object of the present invention is to provide a moving picture audio analysis / evaluation system in which log information recorded in a simulator can be used and the reliability of information transmission by communication can be easily confirmed.
[0013]
[Means for Solving the Problems]
In order to achieve the above object, a moving picture audio analysis evaluation system according to the present invention has a display having a moving picture display section, an audio waveform display section, and an analysis evaluation chart display section, and an arithmetic storage device. In the arithmetic storage device, a moving image data file, an audio data file, and time information are stored, and the arithmetic storage device converts the audio waveform signal with reference to the audio data file. Displayed on an audio waveform display unit and synchronously outputs audio, and refers to the moving image data file to synchronously display a moving image on the moving image display unit, and further extracts some or all of the dialogues included in the audio data file. Synchronous display of the dialogue text converted to text format and the time obtained from the time information on the analysis evaluation chart display unit It is characterized in that it has a so that.
[0014]
In addition, in order to achieve the above object, the video / audio analysis / evaluation system according to the present invention stores analysis / evaluation information in the arithmetic storage device as described in claim 2, wherein the arithmetic storage device is The analysis evaluation result created from the dialogue text and the analysis evaluation information is synchronously displayed on the analysis evaluation chart display unit.
[0015]
Further, in order to achieve the above object, the moving image sound analysis and evaluation system according to the present invention stores simulator parameter information in the operation storage device as described in claim 3, wherein the operation storage device A feature is that the simulator parameter information is displayed in text with the time obtained from the time information in synchronization with the analysis evaluation chart display unit.
[0016]
Further, in order to achieve the above object, the moving picture audio analysis / evaluation system according to the present invention, as described in claim 4, wherein the information processing system includes information input means, and the audio waveform display unit The apparatus is characterized in that the audio waveform signal, the audio and the moving image are synchronously output controlled so that the reproduction speed and the reproduction direction can be adjusted by inputting the output instruction information by the information input means.
[0017]
Further, in order to achieve the above object, the moving picture audio analysis and evaluation system according to the present invention, as described in claim 5, wherein the information processing system includes information input means, and the audio waveform display unit The synchronous output range of the audio waveform signal, audio and moving image is set by inputting the range instruction information by the information input means.
[0018]
Further, in order to achieve the above object, the moving picture audio analysis and evaluation system according to the present invention selects an arbitrary part of the audio waveform signal from the audio waveform display unit by the information input means as described in claim 6. Then, the time corresponding to the portion of the selected audio waveform signal is automatically calculated based on the time information stored in the arithmetic and storage device, and is displayed in text on the analysis evaluation chart display section. Things.
[0019]
Further, in order to achieve the above object, the moving picture audio analysis evaluation system according to the present invention includes a display having an audio waveform display unit, an arithmetic storage device, and information input means, as described in claim 7. An audio data file is stored in the arithmetic storage device, and the arithmetic storage device displays an audio waveform signal on the audio waveform display unit with reference to the audio data file, and displays an audio waveform file. When the output instruction information is input to the unit by the information input means, the synchronous output control is performed so that the reproduction speed and the reproduction direction can be adjusted. The reproduction range is set.
[0020]
BEST MODE FOR CARRYING OUT THE INVENTION
An embodiment of a video sound analysis and evaluation system according to the present invention will be described with reference to the accompanying drawings.
[0021]
FIG. 1 is a configuration diagram showing an embodiment of a moving picture audio analysis evaluation system according to the present invention.
[0022]
The video / audio analysis / evaluation system 1 has a configuration in which a video input system 3 and a simulator data storage medium 4 are connected in parallel to an information processing system 2.
[0023]
The information processing system 2 has a configuration in which a display 2B and information input means 2C such as a mouse or a keyboard are connected to an arithmetic storage device 2A.
[0024]
The moving image input system 3 has a configuration in which a video capture unit 5, a video deck 6, and a VTR (Video Tape Recorder) 7 are connected in series, and the video capture unit 5 is connected to the arithmetic storage device 2A of the information processing system 2. You.
[0025]
On the other hand, the simulator data storage medium 4 is also connected to the arithmetic storage device 2A of the information processing system 2.
[0026]
Next, a procedure of information processing of the moving image audio analysis and evaluation system 1 will be described.
[0027]
First, moving image sound information to be analyzed and evaluated is stored in a moving image sound recording medium such as a VTR 7. In the video / audio analysis / evaluation system 1, an analysis / evaluation target is a training situation of each operator engaged in each task using a simulator of a nuclear power plant having a plurality of tasks. It is stored in the VTR 7 as an audio recording medium.
[0028]
In the video / audio analysis / evaluation system 1, the content to be analyzed / evaluated is communication transmission between operators of the simulator of the nuclear power plant and appropriate timing.
[0029]
Next, the moving picture audio information recorded on the VTR 7 is reproduced by the video deck 6 of the moving picture input system 3, taken into the video capture unit 5 and converted, and the converted moving picture audio digital data is stored in the arithmetic storage device of the information processing system 2. Input to 2A.
[0030]
Simulator parameter information such as, for example, on / off operation of an operating device switch of the simulator by a simulator operator, issuance or clearing of an alarm, etc. at each time of training by the simulator is stored in the simulator data storage medium 4, This simulator parameter information is input to the arithmetic storage device 2A of the information processing system 2.
[0031]
On the other hand, the arithmetic storage device 2A of the information processing system 2 stores a plurality of AVI (Audio Video Interleave) files, basic information, format information, and evaluation chart information.
[0032]
Each AVI file in the arithmetic storage device 2A is composed of an AVI file name, a moving image data file, and an audio data file. Each of the moving image audio digital data input from the video capture unit 5 of the moving image input system 3 is stored in the arithmetic storage device 2A. Each file is saved as a file. That is, the AVI file is video and audio information of the training status of the simulator to be analyzed and evaluated.
[0033]
In the basic information stored in the arithmetic storage device 2A, two directories, a task information table and a moving image audio information table, are created. The task information table contains a task name and an origin time, and the moving image audio information table contains a moving image data file. The number, audio data file number, AVI file name and origin are stored.
[0034]
The basic information is unique information attached to each AVI file that is separately input and created by the information input unit 2C when storing the AVI file in the arithmetic storage device 2A. That is, the basic information is information necessary for analyzing and evaluating the training status of the simulator, but is information that cannot be obtained from the AVI file.
[0035]
The origin time stored in the task information table of the basic information and the origin stored in the video / audio information table of the basic information are obtained by analyzing the training status of the simulator on the video data file and the audio data file included in the AVI file. This is time information for knowing the time required for evaluation.
[0036]
The origin stored in the moving image audio information table of the basic information is a time point that becomes a reference of the time axis when the audio of the audio data file included in the AVI file is represented as a waveform. When the origin of the audio waveform obtained from this audio data file is specified, the relative time at the origin, that is, the time from the start of the audio waveform to the origin, is determined.
[0037]
The origin time stored in the task information table of the basic information is the time at the origin set on the audio waveform obtained from the audio data file, and by correcting the relative time with the origin time, the moving image data included in the AVI file The time at each point on the file and the audio data file can be obtained.
[0038]
That is, in the simulator of the nuclear power plant, in order to analyze and evaluate the training situation of each operator engaged in each task, time information during training is required, but the time information is not included in the AVI file. Therefore, by separately creating information on the origin and the origin time in the basic information, the time information can be used for analysis and evaluation of the training situation in the simulator.
[0039]
The moving image data file number, the sound data file number, and the AVI file name stored in the moving image sound information table of the basic information are the identification information of the moving image data file and the sound data file to be selected stored as the AVI file corresponding to the basic information. It is.
[0040]
The format information stored in the arithmetic storage device 2A is composed of the number of tasks, the number of elements, marks and mark numbers, symbols and symbol numbers, line types and line numbers, and shows the training status of each operator engaged in each task in the simulator. This is information that defines a display method and rules when displaying the result of the analysis and evaluation on the display 2B of the information processing system 2.
[0041]
This format information is determined in advance, and is input and set by the information input means 2C of the information processing system 2 separately from the storage of the AVI file.
[0042]
A directory called an analysis data table is created in the evaluation chart information stored in the arithmetic storage device 2A, and the analysis data table stores ID, time data, text information, mark numbers, symbol numbers, and line display information. You. The evaluation chart information is analysis evaluation information serving as display contents of the analysis evaluation result of the task in the simulator corresponding to each AVI file.
[0043]
Only a plurality of pieces of fragment information required for analysis and evaluation are extracted from an audio data file of an AVI file to be analyzed and evaluated for a training situation in the simulator, and an ID is assigned for identification.
[0044]
Similarly, an ID is also assigned to information input from the simulator parameter storage medium 4 to the arithmetic storage device 2A of the information processing system 2 and obtained from each simulator parameter information to be analyzed and evaluated.
[0045]
Each piece of information such as simulator parameter information to which an ID for identification is assigned is composed of time data, text information, a mark number, a symbol number, and line display information, and is analysis data which is a directory provided in the evaluation chart information. Stored in a table.
[0046]
In the video / audio analysis / evaluation system 1, the analysis / evaluation target is the training situation of each operator engaged in each task using a simulator of a nuclear power plant having a plurality of tasks. Communication and appropriate timing.
[0047]
Next, time data and text information in the analysis data table provided in the evaluation chart information stored in the arithmetic storage device 2A will be described.
[0048]
The simulator parameter information input from the simulator data storage medium 4 to the arithmetic storage device 2A of the information processing system 2 is symbolized, and the contents are obtained even if the operator engaged in each task of the simulator directly checks the simulator parameter information. Can not know.
[0049]
Therefore, in the arithmetic storage device 2A of the information processing system 2, information for converting the symbolized simulator parameter information into a readable language is previously input and saved as text information in the analysis data table of the evaluation chart information. You.
[0050]
For example, the simulator parameter information represented by (09:32:26 C012SD) is as follows: 09:32:26 indicates time, C indicates a control switch, 012S indicates main controller speed setting, and D indicates decrease. It is converted into (09:32:26 PLR main controller speed setting decrease) based on text information provided in the analysis data table of the evaluation chart information provided in the storage device 2A.
[0051]
Similarly, the simulator parameter information represented by (09:32:23 A213 OF) is as follows: 09:32:23 is time, A is an alarm, 213 is a condenser primary H / W water level low, and OF is clear. Therefore, it is converted to (09:32:26 condenser primary HW water level low clear) based on the text information.
[0052]
When converting the simulator parameter information based on the text information provided in the analysis data table of the evaluation chart information, when the simulator parameter information indicates an alarm and when the simulator parameter information indicates the operation of the simulator operator, Are displayed so as to be visually possible.
[0053]
For example, (09:32:26 PLR main controller speed setting decrease) indicates an alarm, and (09:32:26 condenser primary H / W water level low clear) indicates the operator's operation. 32:26 PLR Main controller Speed setting Decrease) The time between the time and the language message is one blank, and the time between (09:32:26 Condenser primary H / W water level low clear) and the time between the language message Is set to two blanks and converted to be visually identifiable.
[0054]
An ID is assigned to each of the converted simulator parameter information together with information for converting the simulator parameter information into a readable language, and a language message portion of each simulator parameter information is included in the analysis data table of the evaluation chart information. The time information part of the simulator parameter information is stored for each ID as text information, which is a component, and as time data.
[0055]
On the other hand, a dialog part is extracted from the audio information obtained from the audio data file of the AVI file stored in the arithmetic storage device 2A of the information processing system 2, and is converted into a plurality of dialog texts. At this time, each time corresponding to each dialogue portion is stored as time data. The plurality of conversation texts and time data are stored for each ID as text information and time data, which are components in the analysis data table of the evaluation chart information.
[0056]
The dialogue text stored in the analysis data table of the evaluation chart information is composed of a portion indicating a time and a language message as well as the alarm or simulator parameter information indicating the operation of the simulator operator. For this reason, there are three blanks between the time and the language message of the dialog text so that the dialog text and the alarm or simulator parameter information indicating the operation of the simulator operator can be visually identified. Is converted to
[0057]
FIG. 2 is a diagram showing the display contents of the display 2B shown in FIG.
[0058]
The display 2B includes an audio waveform display unit 20, a moving image display unit 21, and an analysis evaluation chart display unit 22.
[0059]
The audio waveform display section 20 of the display 2B is provided with a waveform position setting section 23, and displays an audio waveform signal 24 obtained from an audio data file stored as an AVI file in the arithmetic storage device 2A.
[0060]
The origin and the origin time to be stored in the task information table of the basic information included in the arithmetic storage device 2A can be determined and created from the audio waveform display unit 20 by the information input unit 2C.
[0061]
The origin of the audio waveform signal 24 displayed on the audio waveform display unit 20 is set by the information input unit 2C such as a mouse provided in the information processing system 2 in the waveform position setting unit 23. At this time, the origin of the audio waveform signal 24 displayed on the audio waveform display unit 20 is specified, and at the same time, the relative time at the origin is obtained.
[0062]
Further, the time at the origin of the audio waveform signal 24 displayed on the audio waveform display section 20 can be input and set by the information input means 2C as the origin time. From the set origin time and the relative time at the origin, a value for converting the relative time at each time point on the audio waveform signal 24 into a time is obtained.
[0063]
On the other hand, a moving image is reproduced on the moving image display section 21 of the display 2B by a moving image data file stored as an AVI file in the arithmetic storage device 2A. For the moving image displayed on the moving image display unit 21, range indication information, which is a range to be reproduced in the audio waveform signal 24 displayed on the audio waveform display unit 20, is input and set by the information input unit 2C such as a mouse. Outputs only the set output range in synchronization with the audio waveform signal 24.
[0064]
Also, the position of the audio waveform signal 24 displayed on the audio waveform display section 20 of the display 2B is selected by the information input means 2C, or output instruction information such as movement of the audio waveform signal 24 is given to reproduce moving images and audio. It is possible to control the speed, the playback position and the playback direction such as playback, reverse playback, fast forward or rewind.
[0065]
The output control of the moving image, audio, and audio waveform signals 24 to the display 2B is performed by operating the audio waveform signal 24 itself with the information input means 2C, and additionally, a waveform display button 25, a reproduction button 26 provided on the display 2B. , The stop button 27 and the forward button 28 and the backward button 29 provided at both ends of the audio waveform display section 20 can be controlled by operating the information input means 2C.
[0066]
With the waveform display button 25 displayed on the display 2B, switching between display and non-display of the audio waveform signal 24 in the audio waveform display unit 20 is designated, and a play button 26 and a stop button 27 are used to display moving image, audio, and audio waveform signals. The playback and stop commands of the playback 24 and the forward button 28 and the backward button 29 specify playback and reverse playback of the moving image, audio, and audio waveform signals 24.
[0067]
A flat portion of the audio waveform signal 24 displayed on the audio waveform display section 20 on the display 2B indicates a silent state. For this reason, the audio waveform display unit 20 extracts only a sound data file in which the audio waveform signal 24 is not flat, that is, an audio data file of a part where a dialogue exists or a moving image data file synchronized with the audio data file. The situation can be analyzed and evaluated, and the time required for the analysis can be reduced.
[0068]
Each of the audio waveform signals 24 extracted and displayed by the information input means 2C included in the information processing system 2 by specifying the range selection in the audio waveform display unit 20 is displayed in a text format together with the time at which each dialogue was performed. , And the time is stored as time data and the dialog text is stored as text information in the analysis data table of the evaluation chart information provided in the arithmetic storage device 2A shown in FIG.
[0069]
The conversion of the dialogue obtained from the voice data file into a text format can be performed either by a direct input by the information input means 2C or by a voice / text automatic conversion system having a voice recognition function (not shown). .
[0070]
The time data at this time can be obtained by simply specifying and selecting the range of the audio waveform signal 24 displayed on the audio waveform display section 20 on the display 2B by the information input means 2C, and the origin time stored in the basic information and the selected range. Is calculated from the relative time from the origin corresponding to and is automatically input.
[0071]
The analysis evaluation chart display unit 22 on the display 2B displays the analysis evaluation results for the time, protocol + main sequence, and a plurality of tasks (in the example of FIG. 2, two tasks 1 and 2) with marks, symbols, or lines, respectively. It is made up of columns that represent the represented chart.
[0072]
In each row of the analysis evaluation chart display unit 22, time data and text information corresponding to each ID which is a component in the analysis data table of the evaluation chart information created in advance in FIG. And a column indicating the protocol + main sequence.
[0073]
That is, in the column of time and protocol + main sequence of the analysis evaluation chart display unit 22, information sources such as alarms generated by the simulator, operation contents of the operator, and conversation contents of the operator corresponding to each time are displayed. You.
[0074]
The column indicating the analysis evaluation result in the analysis evaluation chart display unit 22 is composed of a plurality of tasks (two in the example of FIG. 2, task 1 and task 2), and each task column further engages in each task. It is composed of a plurality of columns indicating each operator. In the example shown in FIG. 2, the row indicating the operator is 4 indicating m indicating the main board operator, s indicating the supervisor, a indicating the reactor auxiliary equipment operator, and b indicating the BOP (Balance of Plant) board operator. It is composed of six columns, i, indicating the name and site, and o, indicating the outside such as the power supply command center.
[0075]
The correspondence between the alphabet symbols indicating the operators engaged in the respective tasks and the operators is displayed on the operator display unit 30 provided near the analysis evaluation chart display unit 22 on the display 2B.
[0076]
The reason why the number of tasks is plural in the column indicating the analysis evaluation result of the analysis evaluation chart display unit 22 is to consider the occurrence of a plurality of tasks and to make it easy to understand the contents of the tasks, and to execute the tasks in parallel. Can be set according to the number of tasks.
[0077]
In the column showing the operators engaged in each task in the analysis evaluation chart display unit 22, the analysis evaluation contents for the training status of each operator by the nuclear power plant simulator, which is the analysis evaluation target, that is, Information sources such as communication timing, analysis and evaluation results such as appropriateness of the information transmission result, and simulation parameter information to be referred to are displayed as marks, symbols or lines corresponding to the IDs.
[0078]
Information for determining a mark, a symbol, or a line for displaying each analysis evaluation result corresponding to each ID is set and input from the analysis evaluation chart display unit 22, and the time data and the time are stored in the analysis data table of the evaluation chart information. Along with the text information, a mark number, a symbol number, and line display information are stored for each ID as numerical information.
[0079]
Then, when the analysis evaluation result is displayed again on the analysis evaluation chart display unit 22 on the display 2B, the mark number, the symbol number, and the line display information as the numerical information are converted into the numerical values stored in the format information of the arithmetic storage device 2A. The mark number, the symbol number, and the line display information can be converted into the mark, the symbol, and the line type and displayed based on the correspondence information between the information, the mark, the symbol, and the line type.
[0080]
The number of tasks, the number of elements representing the number of operators, the mark, the symbol, and the line type, which are information necessary for the display of the analysis evaluation chart display unit 22, are stored in advance in the format information provided in the arithmetic storage device 2A shown in FIG. The information is set and stored, and this information is used.
[0081]
Next, the contents and meanings of marks, symbols, and line types displayed as information sources such as simulator parameter information on the display 2B will be described.
[0082]
FIG. 3 is a diagram showing types and contents of marks, symbols, and lines used in FIGS. 1 and 2.
[0083]
The operator's communication timing, which is the content of the analysis evaluation, is evaluated in three categories: appropriate, premature, and delayed, and corresponds to the marks of ○, □, and Δ, respectively.
[0084]
The information transmission result at the time of the information exchange between the operators is evaluated as the recognition status of the receiving side by three classifications of accepted, unaccepted, and erroneously transmitted, and corresponds to the marks of ●, ×, and | ●, respectively. In the case of erroneous transmission, the mark (|) is displayed on both the transmitting side and the receiving side.
[0085]
The qualitative contents of the information between the simulator operators are classified into five types: policy decision (task display), status report, discussion, instruction or operation report and other contents, and intention display. 3 are represented by different line types.
[0086]
Further, the types of information sources, which are the basis of information transmission between the simulator operators, such as alarm, CRT, recorder / instrument, lamp, discussion, spontaneous / forecast, and external, are respectively described as A, C, I, L, D, Expressed using the S / P and O symbols.
[0087]
If there is an error in the information transmitted between the simulator operators, a symbol E indicating that an error has occurred is described.
[0088]
Note that the vertical solid line displayed in the column indicating each operator in the analysis evaluation chart display unit 22 on the display 2B shown in FIG. 2 indicates the operator engaged in each task. For example, the operator engaged in task 1 is consistently the chief s, and similarly, the operator engaged in task 2 is consistently indicated as the reactor auxiliary operator a.
[0089]
The marks, symbols, and line types displayed on the analysis evaluation chart display section 22 are format information provided in the arithmetic storage device 2A shown in FIG. 1, and can be freely changed by the user according to the usage mode.
[0090]
When the setting of the basic information, the format information, and the evaluation chart information for the AVI file to be evaluated and analyzed is completed and the information is stored in the arithmetic storage device 2A of the information processing system 2, the audio waveform is displayed on the display 2B. The display of the audio waveform signal 24 on the display unit 20, the reproduction of the moving image on the moving image display unit 21, and the scrolling of the analysis evaluation chart display unit 22 can be executed in synchronization with time.
[0091]
Next, the operation and meaning in a specific display example of the display 2B shown in FIG. 2 will be described.
[0092]
From the analysis / evaluation chart display section 22 on the display 2B, the task is composed of two tasks, task 1 and task 2. The operator uses the operator display section 30 to read the main board operator m, the chief s, and the operation of the reactor auxiliary equipment. It can be seen that it is composed of a worker a, a BOP board operator b, a site i and an outside o.
[0093]
Further, it can be seen from the solid line display parallel to the columns that the chief s was engaged in task 1 and the reactor auxiliary operator a was engaged in task 2 consistently.
[0094]
Attention is paid to the first line following the line indicating the title of the analysis evaluation chart display section 22. At 9:32:23, the alarm “primary HW water level low” for the condenser is cleared, At the same time, the operator A of the reactor auxiliary equipment communicated the information that "the turbine condensate filtration pump room floor is leaking," but it can be seen from the mark of ● that other operators did not accept it.
[0095]
Further, since the basis of the information transmission is based on the lamp of the simulator, the symbol of L is attached beside the mark ●.
[0096]
On the other hand, at 9:32:25, the chief s said, "Don't use condensate filtration pump." At 9:32:26, a warning "PLR main controller speed setting decreased" was also issued. The information transmission that "only one is rotating." Is sent to the main board operator m. The information transmitted at this time is a policy decision, and since the timing is appropriate, a solid line is displayed from the mark of ○ toward the column m indicating the main board operator.
[0097]
In response to information transmission from the chief s, at 9:32:28, the main board operator m is again notified to the chief s, "Yes." This information transmission is also at an appropriate timing, and since the content of the information is an operation report, a dotted line is displayed from the mark of 列 toward the column of the chief s.
[0098]
Next, at 9:32:29, the BOP board operator b sends an operation report to the chief s indicated by a dotted line, "Because I tripped A, I will lock A." The chief s receives the operation report at 9:32:31 with a reply "Yes."
[0099]
At 9:32:33, the operator A of the reactor auxiliary equipment told the main board operator m, the chief s, and the BOP board operator b, "The turbine condensate filtration pump room floor is leaking." It was against. This is because the reactor operator a confirmed the lamp and reported the situation at the appropriate timing, but it was not accepted that it was not accepted. It can be seen from the solid line drawn from the row of the furnace auxiliary equipment operator a toward the row of the main board operator m, the chief s and the BOP board operator b, and the X mark in each row.
[0100]
Further, in the example of the analysis evaluation chart display section 22 on the display 2B, at 9:32:33, the operator A of the nuclear reactor auxiliary equipment has an information transmission portion indicating that "the turbine condensate filtration pump room floor is leaking." In the selected display state, the audio waveform signal 24 at this time is displayed on the audio waveform display unit 20, and the moving image is displayed in synchronization with the moving image display unit 21.
[0101]
The video sound analysis and evaluation system 1 performs not only the operation training using a simulator of a nuclear power plant or the like but also the training and recording and storage of the moving image as well as the simulator parameter information, and analyzes and evaluates the communication and operation of the operator. The effect of training can be enhanced by synchronizing the display of the evaluation result with a simple symbol and the audio and video during training.
[0102]
Next, an application example of the moving image audio analysis evaluation system 1 will be described.
[0103]
The analysis evaluation chart display unit 22 can display not only simulator parameter information or operator's dialogue in text format but also other information.
[0104]
For example, it is also possible to display a commentary on a moving image and an audio in a text format. By synchronizing and displaying the commentary in addition to the video or audio and time, it is possible to further improve the training effect.
[0105]
In addition, the video / audio analysis / evaluation system 1 does not necessarily need to include all of the video display unit 21, the audio waveform display unit 20, and the analysis / evaluation chart display unit 22 on the display 2B.
[0106]
For example, when the analysis and evaluation work is unnecessary and only the text display of the voice is required, only the voice waveform signal 24 of the voice waveform display unit 20 and the text display of the dialogue obtained from the voice waveform signal 24 are displayed on the display 2B. Can also be displayed. The moving image audio analysis and evaluation system 1 composed of the audio waveform signal 24 displayed on the audio waveform display unit 20 and the text display of the dialogue can be used, for example, as a support system for the transcription of a recording dialogue in the tape writer field. It is possible.
[0107]
When the moving image audio analysis and evaluation system 1 is used as a transcript of a recording dialogue, the audio is displayed as the audio waveform signal 24 on the audio waveform display unit 20 on the display 2B, so that the user listens from the audio waveform signal 24. It is easy to search and select the right place. This leads to a reduction in working time.
[0108]
Further, since the voice is information digitized as the voice waveform signal 24, it is possible to easily and quickly perform information processing such as repetitive reproduction or editing.
[0109]
The information processing system 2 of the video / audio analysis / evaluation system 1 shown in FIG. 1 has a configuration in which a display 2B and information input means 2C such as a mouse or a keyboard are connected to an arithmetic storage device 2A. The input means 2C may be integrated into the arithmetic storage device 2A and integrated, or the information processing system 2 may include a plurality of displays 2B and information input means 2C.
[0110]
The video sound analysis and evaluation system 1 is used not only for training of operators of nuclear power plants, but also for various power plants such as thermal power plants, combined cycle power plants, wind power plants, chemical plants, and steel plants. It can be applied to various industrial plants such as incineration plants, power protection systems, air traffic control systems, and other various systems.
[0111]
【The invention's effect】
In the video sound analysis and evaluation system according to the present invention, for example, when the training status of an operator in a training using a simulator such as a nuclear power plant is stored in a video recording medium such as a VTR, the sound is displayed in a waveform along with the video. In addition, since the text is displayed in a time series, it is possible to analyze the communication between the operators together with the change over time, thereby enhancing the training effect.
[0112]
In addition, since the log information recorded in the simulator can be referred to and the communication analysis result is simply displayed by using a symbol, the training status can be easily grasped.
[Brief description of the drawings]
FIG. 1 is a configuration diagram showing an embodiment of a moving picture audio analysis evaluation system according to the present invention.
FIG. 2 is a view showing display contents of a display of FIG. 1;
FIG. 3 is a diagram showing types and contents of marks, symbols, and lines used in FIGS. 1 and 2;
FIG. 4 is a configuration diagram of a conventional moving image sound display system.
[Explanation of symbols]
1 Video audio analysis evaluation system
2 Information processing system
2A arithmetic storage device
2B display
2C information input means
3 Video input system
4 Simulator data storage medium
5 Video capture unit
6 VCR
7 VTR
20 Audio waveform display
21 Video display section
22 Analysis evaluation chart display section
23 Waveform position setting section
24 sound waveform signal
25 Waveform display button
26 Play button
27 Stop button
28 Forward button
29 Back button
30 Operator display section

Claims (7)

An information processing system including a display having a moving image display unit, an audio waveform display unit, and an analysis evaluation chart display unit, and an arithmetic storage device. The arithmetic storage device stores a moving image data file, an audio data file, and time information. The arithmetic storage device displays an audio waveform signal on the audio waveform display unit with reference to the audio data file, synchronously outputs audio, and refers to the video data file to display a moving image on the video display unit. And a dialogue text obtained by converting a part or all of the dialogues included in the voice data file into text format and a time obtained from the time information are synchronously displayed on the analysis evaluation chart display unit. A video sound analysis evaluation system characterized by the following. Analysis evaluation information is stored in the arithmetic storage device, and the arithmetic storage device is configured to synchronously display an analysis evaluation result created from the interactive text and the analysis evaluation information on the analysis evaluation chart display unit. The moving image sound analysis and evaluation system according to claim 1, wherein: Simulator parameter information is stored in the arithmetic storage device, and the arithmetic storage device is configured to display the simulator parameter information in text in synchronization with the time obtained from the time information in synchronization with the analysis evaluation chart display unit. The moving image sound analysis evaluation system according to claim 1, wherein: The information processing system includes an information input unit, and when an output instruction information is input from the audio waveform display unit by the information input unit, the audio waveform signal, the audio, and the moving image are synchronized so that the reproduction speed and the reproduction direction can be adjusted. 2. The moving image sound analysis evaluation system according to claim 1, wherein output control is performed. The information processing system includes an information input unit, and the range output information is input from the audio waveform display unit by the information input unit, so that a synchronous output range of an audio waveform signal, audio, and a moving image is set. The moving image sound analysis evaluation system according to claim 1, wherein: When an arbitrary part of the audio waveform signal is selected from the audio waveform display unit by the information input unit, a time corresponding to the selected part of the audio waveform signal is automatically calculated based on the time information stored in the arithmetic storage device. The moving image sound analysis evaluation system according to claim 1, wherein text is displayed on the analysis evaluation chart display section. An information processing system comprising a display having an audio waveform display unit, an arithmetic storage device, and information input means, wherein an audio data file is stored in the arithmetic storage device, and the arithmetic storage device refers to the audio data file. And displaying an audio waveform signal on the audio waveform display unit, and by inputting output instruction information to the audio waveform display unit with the information input unit, the synchronous output control is performed so that the reproduction speed and the reproduction direction can be adjusted. A moving image sound analysis and evaluation system, wherein a sound reproduction range is set by inputting range instruction information to the sound waveform display section by the information input means.

Images