JP2003195939A - Plant monitoring controlling system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To confirm an error in voice recognition by an operator. <P>SOLUTION: In this plant monitoring controlling system comprising a display device for providing the plant monitoring information to the operator, a display control device for controlling the output of the image plane to the display device and the contents of the display on the image plane indicated by an operation input command means, and a voice input device for interpreting the contents of the phonation from the operator and outputting the image plane operation command, the voice input device comprises a voice recognizing means for recognizing the contents of phonation as the operation command, and outputting the voice operation command character string to the display control device. The display control device has a synoptic table of operation objects by the operator, such as a button and a menu displayed at the present, and an image plane selecting means for selecting the image plane to be displayed on the display device on the basis of the operation command. The image plane selecting means analyzes the voice operation command character strings outputted from the voice input device as the operation command input, displays the operation object agreed between the voice operation command character string and a synoptic table of the operation objects in an emphasized state, and forbidding the operation of the disagreed operation object. <P>COPYRIGHT: (C)2003,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a plant monitoring control system which is used in a power generation plant, a power system plant, a plant for general industries, etc. and which uses voice input as a screen control method.

[0002]

2. Description of the Related Art In plant monitoring and control systems for power generation and electric power systems, a man-machine interface using a CRT or a large screen as a display device and an operating device such as a mouse or a keyboard as an input device has begun to be adopted. . In plant monitoring, an operator usually operates a screen by selecting an operation target such as a button or area on the screen using an operating device such as a mouse. However, the risk of erroneous operation due to selection mistakes during operation is increasing.

FIG. 9 is a block diagram of a display device of a conventional plant monitoring control system. The operator performs expansion to the next screen and plant operation through the operation command input means 11 including an operation device such as a mouse and the operation target on the screen displayed on the display device 2. The operation target refers to a display item which is arranged on the screen like a button or a menu and is selected by the operator when operating the plant or developing the screen.

An example of a screen displayed on the display device 2 is shown in FIG.
Shown in. In FIG. 10, the screen 21 is composed of a menu area 22 at the top of the screen and a detailed information area 23 at the bottom of the screen. Several types of buttons are arranged in the menu area 22, and the operator switches the contents displayed in the detailed information area 23 by selecting these buttons.

In the menu area 22, "A system" and "B system"
There are several types of buttons in addition to the buttons, and when the operation command input means 11 selects the button "A system", the screen selection means 12
Displays an information screen related to "A system" in the detailed information area 23. Similarly for other buttons, detailed information area 23
Display information screen related to.

That is, in the detailed information area 23, information on only one of the buttons arranged in the menu area 22 is displayed. The operator performs a selection operation of the operation target device on the information screen related to the “A system” displayed in the detailed information area 23. The screen selection means 12 receives the operation target selected by the operation command input means 11 and performs a process according to the selected operation target.

At this time, when the information screens displayed in the detailed information areas of "A system" and "B system" are similar, the operator intends to display the screen of "A system". , "B system" is selected, there is a possibility of continuing the operation without noticing the selection error.

In order to improve the man-machine interface from the viewpoint of improving the safety against the above-mentioned erroneous operation, an operation method using voice input has also been proposed. For example, in the proposal of Japanese Unexamined Patent Publication No. 9-114579, the contents of utterance at the time of pointing and calling in the plant screen operation are taken into a computer by using a voice recognition technique.

[0009] Then, it is a proposal to improve the safety by using the normal screen operation and the pointing and naming together. However, there is a possibility that a voice recognition error may occur, and a recognition error may cause an erroneous operation. On the other hand, in the proposal of Japanese Unexamined Patent Publication No. 9-114579, the occurrence of recognition error is avoided by making the voice recognition dictionary compact.

[0010]

Even if the above-mentioned conventional method is used, it is difficult to completely avoid the recognition error in the voice recognition. Further, when operating the system, it is desirable to notify the operator of the error when a recognition error occurs.

The present invention has been made in order to solve the above problems, and not a recognition error of voice recognition is avoided, but a recognition result is notified so that an operator can confirm whether or not it is an error. It is an object of the present invention to provide a plant monitoring and control system as described above.

[0012]

A plant monitoring control system according to [Claim 1] of the present invention provides a display device for providing plant monitoring information to an operator, a screen output to the display device, and an operation input command for a mouse or the like. In a plant monitoring control system comprising a display control device for controlling screen display contents instructed by an operator by means, and a voice input device for interpreting the voice contents of the operator and outputting a screen operation command, the voice input device is uttered by the operator. Has a voice recognition means for recognizing the contents as an operation command and outputting the recognized voice operation command character string to the display control device, and the display control device is operated by an operator such as a button or menu currently displayed. Screen for selecting the screen to be displayed on the display device based on the operation command from the operator The screen selecting means analyzes the voice operation command character string output from the voice input device as an operation command input, and matches the voice operation command character string with the item in the operation target list table. When there is an item to be highlighted, the matching operation target is highlighted and
The operation targets that do not match are now in the operation prohibited state.

In the plant monitoring control system according to [Claim 2] of the present invention, in [Claim 1], the voice input device reads the voice operation command character string output by the voice recognition unit as voice, and a voice synthesizing unit. The voice operation command character string uttered by the operator is converted into a sentence format and repeated.

In the plant monitoring control system according to [Claim 3] of the present invention, in [Claim 1], the screen selection means includes the operation command input means before the voice operation command character string is output from the voice input device. When there is a further operation instruction, a message prompting the operator to input the operation instruction by voice is output to the display device.

In the plant monitoring control system according to [Claim 4] of the present invention, in [Claim 1], the operation target list table is a selectable operator list table which is a list of operators who can operate the operation target. Having for each item, the voice input device comprises a speaker identification means for identifying who is the operator who input the voice, the speaker identification means identifies the speaker when the operator utters, The screen selection means searches for a match between the voice operation command character string and the item of the operation target list table, and when the speaker specified by the speaker identification means is not included in the selectable operator list table, , The operation command by voice is invalidated.

In the plant monitoring control system according to [Claim 5] of the present invention, in [Claim 1] or [Claim 4], the screen display content is created based on the hierarchical structure of the plant, and the operator When the names are uttered in the order from the top to the bottom of the hierarchical structure of the plant, the names recognized on the screen are highlighted in the order from the top to the bottom.

The plant monitoring control system according to [Claim 6] of the present invention displays a map on the screen when controlling geographically dispersed plants in [Claim 1] or [Claim 4]. , The plant recognized from the voice of the operator is highlighted on the map.

In the plant monitoring control system according to [Claim 7] of the present invention, in [Claim 3], voice recognition is started by the operator's selection of an operation target on the screen as a trigger.

In the plant monitoring control system according to [Claim 8] of the present invention, in [Claim 7], the dictionary used for voice recognition is selected in response to the operator's selection of the operation target on the screen. I chose

In the plant monitoring control system according to [Claim 9] of the present invention, in [Claim 1], when a plurality of operators control the plant, each operator carries a dedicated microphone and the voice recognition means is The operator is identified by the microphone that is the transmission source of the audio signal, and the operator identification result is notified to the screen selection means.

In the plant monitoring control system according to [Claim 10] of the present invention, in [Claim 9], each operator carries a position determination means together with a microphone, and the screen selection means is an operator who utters the operation target. The operation is allowed only when is near the display device displaying the operation target.

[0022]

BEST MODE FOR CARRYING OUT THE INVENTION (First Embodiment) A first embodiment of the present invention will be described with reference to FIG. FIG. 1 is an overall configuration diagram of a plant monitoring control system, which includes a display control device 1, a display device 2, and a voice input device 3. The display control device 1 includes an operation command input unit 11, a screen selection unit 12, and an operation target list table 13.
The voice input device 3 includes a voice recognition unit 31 and a microphone 32.
Have and. In the following, the screen 21 of FIG. 10 will be described as an example.

The voice input device 3 takes in the operation contents uttered by the operator through the microphone 32, and obtains the voice operation command character string by the voice recognition means 31. For example, when the operator wants to select “A system” on the screen 21,
By uttering "A system" through a microphone, a character string of "A system" is obtained as an output of the voice recognition means 31.

If the voice recognizing means 31 is compatible with continuous utterance voice recognition, "A", "", and "select" will be selected even when inputting in a text format such as "select A". Because it is possible to get two character strings
As the output of the voice recognition means 31, a method of obtaining "A system" may be used.

FIG. 2 shows the operation target list table 13.
The operation target list table 13 represents a list of operation targets on the screen 21 displayed on the display device 2. At the same time that the screen contents are updated, the operation target list table 13 is rewritten to the latest contents. The operation command input means 11 corresponds to an operation device such as a mouse or a touch screen for an operator to operate the screen. When the operator selects one of the buttons in the menu area 22 of the screen 21, the operation command input means 11 outputs an operation command to the screen selection means 12.

The screen selection means 12 is the operation command input means 1
1 and an operation command from the voice input device 3 are received, and a predetermined process is performed. When there is an input from the voice input device 3, the screen selection means 12 obtains a voice operation command character string output from the voice recognition means 31 from the voice input device 3 and displays on the currently displayed screen. Each item of the operation target list table 13 showing the list of operation targets is compared with the voice operation command character string.

If there is a matching item as a result of comparison here, the screen selecting means 12 displays the menu area 22 of the screen 21.
Among the operation targets, the matching operation target is highlighted and displayed by blinking or color change. Further, the operation targets that do not match are changed to a state in which the operator cannot select them.
In the example in which the operator utters "A system", the button "A system" on the screen is changed in color and highlighted as shown in FIG.

Even if the operator tries to operate an operation target other than the button "A type", the operation cannot be performed.
When the voice operation command character string output from the voice recognition means 31 does not match any item in the operation target list table 13, a message indicating that the text does not match is output to the display device 2 and the screen 21 is changed. Absent.

According to this embodiment, the screen selection means 12
Is capable of selecting only the operation target uttered by the operator based on the voice operation command character string input from the voice input device 3, and limiting the operation target operable by the operator through the operation command input means 11. Becomes possible,
It is less likely that the operator will make an operational error.

Regarding the influence of the recognition error of the voice recognition which is a concern when using the voice recognition, there is a recognition error due to the voice recognition because the recognition result can be easily discriminated by the selectable state of the screen and the color. However, the correction is easy and the influence of the recognition error can be reduced.
Furthermore, since the voice input device 3 only changes the screen display color and selection state and does not directly operate the screen, there is no risk of operation due to erroneous recognition of voice.

(Second Embodiment) FIG. 4 is a block diagram showing a second embodiment. In FIG. 4, the same functional parts as those in FIG. In the present embodiment, the recognition result is to be repeated by voice, and the configuration added for that purpose is the voice synthesizing means 33.

Next, the operation will be described. After the voice recognition means 31 obtains a voice operation command character string from the content of the operation instruction uttered by the operator, the voice synthesis means 33 converts the voice recognition result into a voice and sends it to the operator. The point is to notify the contents. Others are the same as in the case of FIG.

According to the present embodiment, since the recognition result of the voice recognition is repeated by voice and the operator is notified, it is possible for the operator to further confirm whether or not there is a recognition error. It is possible to reduce.

(Third Embodiment) A third embodiment of the present invention will be described. The configuration according to this embodiment is the same as that of the first embodiment. In the present embodiment, the processing safety is ensured. The operator executes a screen selection operation through the operation command input means 11. The screen selection unit 12 receives the operation command from the operation command input unit 11, but does not receive the operation command from the voice input device 3, so that the execution is stopped, and a message screen prompting the voice input to the voice input device 3 instead. Is output to the display device 2, and the process waits until the operation command from the voice input device 3 is received.

Upon receiving the operation command from the voice input device 3, the screen selection means 12 changes the selection state of the screen from the operation command from the voice input device 3, and further waits from the operation command input means 11 which is on standby. Accept the operation command and continue the process. If the operation command from the operation command input means 11 or the operation command from the voice input device 3 is an operation to select the operation target changed to the inoperable state, the operation is performed as in the first embodiment. Is rejected.

According to the present embodiment, even if the operator tries to perform the operation by the operating device before the voice input, the operator waits until the voice input is made by the operator. It is possible to improve.

(Fourth Embodiment) FIG. 5 is a block diagram showing a fourth embodiment. In FIG. 5, the same functional portions as those in FIG. 1 are designated by the same reference numerals and the description thereof will be omitted. In the present embodiment, an attempt is made to make it difficult for an operator to make an operation error, and the speaker identification means 34 is added for that purpose.

Next, the operation will be described. The speaker identifying means 34 identifies which operator occurred when the operator uttered, and outputs the operator identifier. The voice input device 3 sends the operation command character string output by the voice recognition means 31 and the operator identifier output by the speaker identification means 34 to the screen selection means 12 of the display control device 1.

The operation target list table 13 is shown in FIG. The operation target list table 13 is first in that it represents a list of operation targets on the screen displayed on the display device 2.
The embodiment is the same as the embodiment described above, except that each item has an operable operator identifier. When the screen selection means 12 receives the operation content character string and the operator identifier from the voice input device 3, the screen selection means 12 compares the items of the operation target list table 13 with both the operation command character string and the operator identifier.

In comparison, if there is a matching item in both the operation command character string and the operator identifier, the screen selecting means 12 selects the unmatching operating objects among the operating objects on the screen.
The color is changed and the operator changes the state so that it cannot be selected. If the operation command character string output from the voice recognition unit 31 does not match any item in the operation target list table 13, a message indicating that the operation command character string does not match is output to the display device 2,
The screen 21 is not changed.

According to the present embodiment, the screen selection means 12
Is in a state in which only the operation command content uttered by the operator can be selected based on the operation command received from the voice input device 3, and the operator can restrict the operation target through the operation command input means 11 and the operator operates. Less likely to cause mistakes.

Regarding the influence of the recognition error of the voice recognition which is a concern when using the voice recognition, there is a recognition error due to the voice recognition because the recognition result can be easily discriminated by the selectable state and color of the screen. However, the correction is easy and the influence of the recognition error can be reduced.

Further, since the voice input device 3 only changes the display color and selection state of the screen and does not directly operate the screen, the safety is sufficient. Further, it becomes possible to set a restriction so that only a specific operator can operate by the speaker identification means, and the safety becomes higher.

(Fifth Embodiment) The fifth embodiment corresponds to the case where the plant has a hierarchical structure. FIG. 6 is an example of a display screen having a hierarchical structure, and shows a case where A system and B system having a similar structure composed of a pump and a valve are arranged in parallel. The difference between the A system and the B system is that the B system has small valves 6-9 that do not exist in the configuration of the A system.

FIG. 7 is a tree data structure representing a logical structure corresponding to the plant configuration of each item, and each item represents all the items of the operation target list table 13 of FIG. That is, the suction valve 6-3, the pump 6-4, and the discharge valve 6
-5 indicates that it is an A system component device, and that the suction valve 6-6, the pump 6-7, the discharge valve 6-8, and the small valve 6-9 are B system devices. . Such a hierarchical data structure can be represented by, for example, an object-oriented model.

The suction valves, pumps, discharge valves and small valves 6-3 to 6-9 described above are operation objects, and in the conventional method, the operator selects these operation objects to perform the operation. However, in the present embodiment, the operator operates the “A system” “pump” to operate the A system pump 6-4.
Then, the screen selection means 12 makes the voice recognition means 31
When the character string "A system" is sent from, the target is identified as 7-1 in the data structure of FIG. 7, and at the same time, the frame surrounding A system corresponding to 7-1 on the display screen of FIG. Highlight 6-1. Next, when the "pump" is sent, the target is identified as 7-2 in the data structure of FIG. 7, and the corresponding pump 6-
Highlight 4

According to the present embodiment, by highlighting along the plant hierarchy as described above, when the operator intentionally calls system A and accidentally utters system B, a frame surrounding system B is displayed. Since 6-2 is highlighted, the error can be surely recognized early. When the small valve 6-9 of the B system is erroneously pronounced as "A system small valve", the screen selection means 12 determines from the device name database of FIG. 7 that there is no small valve in the A system. , Can inform the operator. For example, by the voice notification function, "There is no small valve in the A system."
Can be notified.

(Sixth Embodiment) In the present embodiment,
This corresponds to the case where plants are geographically dispersed and each has a similar structure like an electric power transmission and distribution system. The logical structure is the same as that of the fifth embodiment, but the map showing the arrangement of the plants in FIG. 8 is used as the display screen. That is, when the operator utters "Tokyo East", 8-2 is highlighted on the display screen of FIG.

(Seventh Embodiment) In the present embodiment,
The screen selection means 12 ignores the voice operation command character string sent from the voice recognition means 31 until the operation command input means 11 obtains an input, and uses the input of the operation target as a trigger.
Recognition of the voice operation command character string is started.
The operator first selects the operation target on the screen by the operation command means 11 and utters the operation target for confirmation.

The voice recognizing means 31 includes a voice such as an operator's voice and, depending on the situation, ambient noise, and these as a voice operation command character string as the operation screen selecting means 12.
However, in the present embodiment, since the operation screen selection means 12 knows the timing of inputting a true voice operation command character string, erroneous recognition can be prevented. Further, as a similar method, when the operator sits in front of the operation screen, for example, an infrared sensor can be used as the timing for inputting the voice operation command character string.

(Eighth Embodiment) In the present embodiment,
When the operation command is input from the operation command input unit 11, the screen selection unit 12 transmits the category name including the operation command to the voice recognition unit 31. That is, the voice recognition means 31 has a voice recognition dictionary corresponding to the category name, and selects the dictionary according to the category name sent from the voice recognition means 31.
According to the present embodiment, it is possible to perform the operation of the contents subdivided for each category corresponding to the operation command.

(Ninth Embodiment) In the present embodiment,
When operating a plant by a plurality of operators, each operator carries a dedicated microphone 32. Therefore, the voice recognition means 31 can identify the operator by the microphone to which the voice signal is sent, so that the voice recognition can be performed more reliably using the voice recognition dictionary specified for each operator.

Further, the voice recognition means 31 sends the identification information of the uttered operator to the screen selection means 12 together with the voice operation command character string. Upon receiving this, the screen selecting means 12 matches the voice operation command character string with the identification information of the operator,
Ensure that operations are performed by authorized operators. According to this embodiment, the accuracy of the operation command can be further improved.

(Tenth Embodiment) In the present embodiment, each operator carries a microphone 32 and a position determining means. As a specific example of the position determining means, when the operator approaches the display device 2, the receiver attached to the display device 2 receives the microwave, and thereby it can be seen that the specific operator is near the display device 2. .

The screen selecting means 12 confirms that the operator speaking is in the vicinity of the display device 2 displaying the operation target, and gives the operation permission. The same check can be performed by the operator using a wired microphone and connecting the wired microphone to a microphone input jack installed near the display device 2 during operation. According to the present embodiment, more reliable operation can be guaranteed by the operator's discrimination.

[0056]

As described above, according to the present invention, a voice processing technique such as a voice recognition technique or a voice synthesis technique is used in combination with an existing input device for operating a display screen in a plant monitoring control system. As a result, it is possible to perform a highly safe operation that does not make the operator feel uncomfortable.

[Brief description of drawings]

FIG. 1 is an overall configuration diagram of a plant monitoring control system according to a first embodiment.

FIG. 2 is an operation target list table.

FIG. 3 is an example of a display screen of a display device (display after operation instruction by voice).

FIG. 4 is an overall configuration diagram of a plant monitoring control system according to a second embodiment.

FIG. 5 is an overall configuration diagram of a plant monitoring control system according to a third embodiment.

FIG. 6 shows an example of a display screen having a hierarchical structure.

FIG. 7 is a tree data structure of an operation target list table corresponding to a plant configuration.

FIG. 8 is a map display screen showing the layout of plants.

FIG. 9 is an overall configuration diagram of a conventional plant monitoring control system.

FIG. 10 is an example of a display screen of a display device.

[Explanation of symbols]

1 Display control device 2 display 3 voice input device 11 Operation command input means 12 screen selection means 13 Operation target list table 31 voice recognition means 32 microphones 33 voice synthesis means 34 Speaker identification means 21 Display screen 22 Menu area 23 Detailed Information Area 6-1 Display screen A system frame 6-2 Display screen B system frame 6-3 Display screen A system suction valve 6-4 Display screen A system pump 6-5 Display screen A system discharge valve 6-6 Display screen B system suction valve 6-7 Display screen B system pump 6-8 Display screen B system discharge valve 6-9 Display screen B system small valve 7-1 Tree data item "A system" 7-2 Tree data item “Pump” 8-1 Map screen "Tokyo West" 8-2 Map screen "Tokyo East" 8-3 Map screen "South of Tokyo"

─────────────────────────────────────────────────── ─── Continuation of front page (51) Int.Cl. ⁷ Identification code FI theme code (reference) G06F 3/16 G06F 3/16 320D 320G G10L 13/00 G10L 3/00 551R 15/00 561D 15/22 R 15/28 (72) Inventor Toshifumi Hayashi 1st floor, Toshiba-cho, Fuchu-shi, Tokyo F-term in Toshiba Fuchu Works (reference) 5D015 KK04 LL06 5D045 AB30 5E501 AC02 BA05 BA08 CA03 CA08 CB09 CB15 EA12 EA21 FA03 FA05 FA13 FA14 FA23 FA32 FA35 FA43 FA45 FB43 5H223 AA01 CC09 EE28 FF04

Claims (10)

[Claims] 1. A display device for providing plant monitoring information to an operator, a display control device for controlling the screen display contents instructed by the operator by a screen output to the display device and an operation input command means such as a mouse, and a voice of the operator. In a plant monitoring control system comprising a voice input device that interprets the contents and outputs a screen operation command, the voice input device recognizes the contents uttered by an operator as an operation command,
The display control device has a voice recognition unit that outputs the recognized voice operation command character string to the display control device, and the display control device stores an operation target list table in which a list of operation targets such as buttons and menus currently displayed by the operator is stored. And a screen selection means for selecting a screen to be displayed on the display device based on an operation command from the operator, wherein the screen selection means analyzes a voice operation command character string output from the voice input device as an operation command input. When there is a matching item between the voice operation command character string and the item in the operation target list table, the matching operating target is highlighted, and at the same time, the non-matching operating target is set to the operation prohibited state. Plant monitoring control system. 2. The plant monitoring control system according to claim 1, wherein the voice input device includes voice synthesizing means for reading a voice operation command character string output by the voice recognizing means as voice, and a voice operation command issued by an operator. A plant monitoring and control system characterized by converting a character string into a text format and repeating it. 3. The plant monitoring control system according to claim 1, wherein the screen selecting means is an operator when an operation command is input from the operation command input means before the voice operation command character string is output from the voice input device. A plant monitoring control system, which outputs a message prompting the user to input an operation command by voice to a display device. 4. The plant monitoring control system according to claim 1, wherein the operation target list table has, for each item, a selectable operator list table that is a list of operators who can operate the operation target, and the voice input device is A speaker identification means for identifying who is the operator who inputs the voice, the speaker identification means identifies the speaker when the operator utters, and the screen selection means is a voice operation command character string. Search for a match with the items in the operation target list table, and if the speaker specified by the speaker identification means is not included in the selectable operator list table, invalidate the operation command by voice. A plant monitoring and control system. 5. The plant monitoring control system according to claim 1 or 4, wherein the screen display contents are created based on the hierarchical structure of the plant, and the operator names the hierarchical structure of the plant in order from the higher order to the lower order. The plant monitoring and control system characterized in that the names recognized on the screen are highlighted in order from upper to lower. 6. The plant monitoring control system according to claim 1 or 4, when controlling geographically dispersed plants, a map is displayed on the screen and the plants recognized from the voice of the operator are displayed on the map. A plant monitoring and control system characterized by being highlighted in. 7. The plant monitoring control system according to claim 3, wherein voice recognition is started by using an operator's selection of an operation target on a screen as a trigger. 8. The plant monitoring control system according to claim 7, wherein a dictionary used for voice recognition is selected in response to an operator selecting an operation target on a screen. 9. The plant monitoring control system according to claim 1, wherein when a plurality of operators control the plant, each operator carries a dedicated microphone, and the voice recognition means identifies the operator by a microphone that is a transmission source of the voice signal. In addition, the plant monitoring control system is characterized in that the operator identification result is notified to the screen selecting means. 10. The plant monitoring control system according to claim 9, wherein each operator carries a position determining means together with a microphone, and the screen selecting means is near a display device on which the operator who speaks the operation target displays the operation target. A plant monitoring and control system characterized by permitting operations only when in