JP2000259233A - Device for monitoring and supporting plant operation - Google Patents

Abstract

PROBLEM TO BE SOLVED: To facilitate to educate an operator by displaying operation supporting images obtained by synthesizing ITV images of an ITV camera related to VR (virtual reality) images in a VR image that virtually displays a plant in a three-dimensional manner. SOLUTION: When a virtual plant display system 4 is started, a main controlling part 4a makes a memory in a VR displaying part 4g read all three- dimensional image data for VR images stored in a three-dimensional virtual plant database 4h. Next, the part 4a makes a communicating part 4b establish communication connection with an interface agent 1. When the agent 1 inputs a command to the part 4b here, the part 4a analyzes the contents of the command. Then, various operation support images are displayed on a CRT display 6 by controlling respective operations of the part 4b, a VR controlling part 4c, an ITV displaying part 4d, a message displaying part 4e and a video synthesizing part 4f as a result of this analytical result, that is, in accordance with the type of the command.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a plant operation monitoring support device for ascertaining the operation state of a plant and assisting a monitoring operation of an operator.

[0002]

2. Description of the Related Art A conventional human interface related to plant operation monitoring is as follows. That is, the operator's operation input is performed by operating a touch panel, a mouse, and the like on the display, and the plant operation state information is presented to the operator by displaying various process values as numerical values or graphics on a CRT display. It is done by that.

[0003] For example, as operating state information, a connection system of various devices constituting a plant is displayed on a CRT display as a two-dimensional graphics screen, and the process value of each device on the two-dimensional graphics screen is represented by a numerical value. It is presented to the operator by displaying. Traditionally,
A large number of such two-dimensional graphics screens are provided for each application, and the operator grasps the operation state of the plant by selecting the two-dimensional graphics screen by himself / herself.

[0004]

In such a conventional technique, since the operation state of the plant is displayed two-dimensionally on the CRT display, it is difficult for the operator to intuitively grasp the operation state of the plant. It is. In addition, since the operating state of each device must be ascertained by selecting a two-dimensional graphics screen for many devices constituting the plant, the operation for ascertaining the operating state of the plant is complicated. When the scale of the plant is increased, the number of devices constituting the plant is also increased. Therefore, in a large-scale plant, the load on the operator becomes particularly large.

Further, since it is necessary to judge the operation state of the plant based on numerical display of various process values on the CRT display or two-dimensional graphic display, knowledge of the plant configuration and process and monitoring of plant operation are required. Experience is required. In addition, in order to operate and operate a plant, it is necessary to acquire an operation method for a large number of devices, so that skill is required. Therefore, conventionally, it has been necessary to prepare specialized equipment (plant operation training simulator) and training curriculum for training operators.

In addition, the existing human interface related to the conventional plant operation monitoring is
The present applicant has filed Japanese Patent Application Nos. 9-202002, 9-2
Japanese Patent Application No. 31581 or Japanese Patent Application No. 10-263609 proposes an interface agent to which case-based reasoning technology based on the AI method is applied. This interface agent uses a case-based reasoning technique to detect past operating cases that are similar to the current plant operating state, and to determine the current plant operating state by analogy based on the past operating cases. Then, a voice message for plant operation support is provided to the operator.

The present invention has been made in view of the above-mentioned problems, and has the following objects. (1) The load on the operator is further reduced. (2) To facilitate the training of operators.

[0008]

In order to achieve the above object, according to the present invention, as a first means relating to a plant operation monitoring support apparatus, an operation support image indicating an operation state of a plant is displayed on an image display means. In a plant operation monitoring support device that supports an operator who monitors the operation of the plant by
VR (virtual
(Reality) A means for displaying a driving support image obtained by synthesizing an ITV image of an ITV camera related to the VR image in an image is adopted.

Further, as the second means relating to the plant operation monitoring support device, means for switching the ITV image in accordance with the change of the VR image in the first means is adopted.

As the third means relating to the plant operation monitoring support apparatus, the above-mentioned first or second means is provided with an acoustic notifying means for notifying the contents of the driving support video by sound.

As a fourth means relating to the plant operation monitoring support device, in any one of the above first to third means,
A means for displaying a driving support image based on the inference result of the interface agent that infers the current plant operation state based on past plant operation cases is employed.

As a fifth means relating to the plant operation monitoring support apparatus, the above fourth means adopts means for switching the driving support video based on a voice instruction of an operator voice-recognized by the interface agent.

[0013]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of a plant operation monitoring support device according to the present invention will be described below. In addition,
In the present embodiment, the above-described interface agents are linked to each other.

FIG. 1 is an overall configuration diagram of a plant operation monitoring support device according to the present embodiment. In this figure,
Reference symbol A is a plant to be monitored, 1 is an interface agent, 2 and 7 are speakers, 3 is a microphone, 4 is a virtual plant display system (plant operation monitoring support device), and 5 is an input device (for example, a mouse or keyboard). , 6 are CRT displays (video display means).

The interface agent 1 recognizes a voice instruction input from an operator of the plant A via the microphone 3 and outputs the voice instruction to the virtual plant display system 4, and is obtained from the plant A and operates the plant A. The operation state of the plant A is inferred by case-based inference based on various data indicating the state (plant data), and various voice messages for assisting the operator are output to the speaker 2 according to the inference result.

As a result of the case-based inference by the interface agent 1, the virtual plant display system 4 operates the images (ITV images) of the ITV cameras (industrial surveillance cameras) provided in the plant A and operates the input device 5. Various images (driving support images) for assisting the operator are synthesized based on the instruction and output to the CRT display 6.

This virtual plant display system 4
Synthesizes various driving support images by combining a VR (virtual reality) image generated based on the result of the case-based inference by the interface agent 1, a text message, and an ITV image obtained from the plant A. In addition, the virtual plant display system 4 generates sound related to the VR image and outputs the sound to the speaker 7 in order to further improve the reality of the VR image. The input device 5 is for inputting a VR video operation instruction and a specific operation instruction for the plant A.

FIG. 2 is a block diagram showing a functional configuration of the interface agent 1. As shown in FIG. As shown in FIG. 1, the interface agent 1 includes a language conversion system 1a, an inference engine 1b, a matching rule 1c, a case memory 1d, a data collection unit 1e, a communication unit 1f, and the like.

The language conversion system 1a recognizes a voice instruction input to the microphone 3 by a driver, converts the voice instruction into voice data readable by a computer, outputs the voice data to the inference engine 1b, and outputs the voice data from the inference engine 1b. The input voice data is voice-synthesized into a voice message recognizable by the operator and output to the speaker 2.

More specifically, the language conversion system 1a extracts a keyword spotting voice by recognizing a specific keyword extracted from a voice instruction issued by an operator and recognizes the voice instruction of the operator input in the past. Speech combining case-based inference speech recognition that recognizes speech instructions by storing as past data (past speech example data) and comparing and inferring the past speech example data with the currently input speech instruction (current speech example data) Recognition.

The data collecting section 1e collects, from the plant A, measurement data of various devices constituting the plant A and operation instructions (operation instruction data) of the operator for the plant A at predetermined sampling times. Is output to the inference engine 1b. This plant data is composed of measurement data at the sampling time and operation instruction data at that time, and is information indicating the operating state of the plant A at the sampling time.

The inference engine 1b sequentially stores the plant data as operation case data (current operation case data) indicating the current operation state in the case memory 1d, and resembles the current operation case data based on the matching rule 1c. By retrieving past operation case data (past operation case data) from the case memory 1d, the current operation state of the plant is inferred and determined.

The case memory 1d stores the inference engine 1b
The current operation case data sequentially input from the above are sequentially accumulated as past operation case data (which becomes past data with the passage of time). The collation rule 1c defines a procedure for collating current driving case data with past driving case data based on a case-based reasoning method, that is, a procedure for searching for past driving case data similar to the current driving case data.

The inference engine 1b determines the current operation state of the plant A by case-based inference based on the collation rule 1c. The details of the method of generating the current operation case data by the inference engine 1b and the details of the search of the past operation case data are described in the above-mentioned applications.

The communication section 1f mediates the communication between the inference engine 1b and the virtual plant display system 4. For example, a virtual plant display is performed using the inference result of the inference engine 1b and the speech recognition result of the language conversion system 1a as commands. Output to system 4.

In the present embodiment, a specific operation instruction for the plant A can be input from the virtual plant display system 4 via the interface agent 1. When receiving the operation instruction from the virtual plant display system 4, the communication unit 1f outputs the operation instruction to the inference engine 1b. The operation instruction is input to the plant A via the inference engine 1b and the data collection unit 1e.

FIG. 3 is a block diagram showing a functional configuration of the virtual plant display system 4. As shown in FIG. As shown in this figure, the virtual plant display system 4
Are the main control unit 4a, the communication unit 4b, the VR control unit 4c,
It comprises an ITV display unit 4d, a message display unit 4e, a video synthesis unit 4f, a VR display unit 4g, a three-dimensional virtual plant database 4h, a direct operation unit 4i, a sound generation unit 4j, an ITV synthesis unit 4k, and the like. Note that the sound generator 4j
Constitutes an acoustic notification unit together with the speaker 7.

The main control unit 4a, based on various commands input from the interface agent 1 via the communication unit 4b and operation instructions input from the input device 5 via the direct operation unit 4i, communicates with the communication unit 4b, VR Control unit 4
c, the operation of the ITV display unit 4d, the message display unit 4e, and the video synthesizing unit 4f is generally controlled.

The communication section 4b mediates communication with the interface agent 1 under the control of the main control section 4a. When the above various commands are received from the interface agent 1, the communication section 4b outputs the commands to the main control section 4a. When an operation instruction of the input device 5 is input from the unit 4a, the operation instruction is output to the interface agent 1.

The direct operation unit 4i receives an operation instruction from the input device 5 and outputs the operation instruction to the VR control unit 4c. The VR control unit 4c controls generation of a VR video by the VR display unit 4g. This VR control unit 4c
Based on the control information input from the main control unit 4a and the operation instruction of the input device 5 input from the direct operation unit 4i, a VR video change instruction to be displayed on the CRT display 6 is output to the VR display unit 4g.

The VR control unit 4c includes a sound generation unit 4j
To speaker 7 by sound (sound related to VR video)
Also controls the output of The sound generation unit 4j outputs, to the speaker 7, a sound related to the VR video, for example, a driving sound of a device displayed in the VR video or a voice message or the like notifying a driver that the VR video has been switched. .

The ITV display unit 4d selects one of the images of a plurality of ITV cameras and outputs the selected image to the image synthesizing unit 4f and the ITV synthesizing unit 4k under the control of the main control unit 4a. A plurality of ITV cameras are provided at key points of the plant A, and constantly photograph the operating states of various devices constituting the plant A. The message display unit 4e converts the message information (for example, text data) input from the main control unit 4a into video information, and converts the message information into video information.
Is output to

The three-dimensional virtual plant database 4h is
Various 3 for VR images showing the shapes of the components of plant A
This is a database that stores dimensional image data. The VR image according to the present embodiment is a walk-through image that three-dimensionally displays, as a virtual space, a state in which an operator moves while checking the state of various devices in the plant A, for example.

In such a walk-through image, a three-dimensional image changes according to a change in the position of the operator in the virtual space of the plant A. Therefore, the walk-through image is a three-dimensional image that changes continuously according to the position and viewpoint of the driver in the three-dimensional virtual space. The three-dimensional virtual plant database 4h stores three-dimensional image data relating to the shapes of the components of the plant A necessary for generating such a walk-through image.

The VR display unit 4g reads the three-dimensional image data from the three-dimensional virtual plant database 4h,
A VR video is generated based on a VR video change instruction input from the control unit 4c and output to the video synthesizing unit 4f. The VR display unit 4g is internally provided with the ITV fusion unit 4g.
k. The ITV fusion unit 4g performs texture mapping (dynamic texture mapping) of the ITV image on a part of the VR image for each frame.
f.

The virtual plant display system 4 includes:
In addition to the walk-through images, various VR images that individually display the operating states of the various devices that make up the plant A are displayed as C.
It is configured to selectively display on the RT display 6. The VR display unit 4g, based on the three-dimensional image data stored in the three-dimensional virtual plant database 4h,
These various VR images are generated.

The video synthesizing section 4f is provided with the main control section 4a.
Under the control of the above, various images input from the ITV display unit 4d, the message display unit 4e, and the VR display unit 4g are synthesized and output to the CRT display 6.

Next, the operation of the plant operation monitoring support apparatus configured as described above will be described in detail. Since the operation of the interface agent 1 is described in detail in each of the above-mentioned applications, the outline will be described below.

First, for the plant A that is normally operated continuously, the data collection unit 1 of the interface agent 1
“e” acquires plant data every sample time at a predetermined interval and outputs it to the inference engine 1b. Inference engine 1b
Maps the plant data periodically input from the data collection unit 1e into a metric space indicating the similarity to the past operation case data already stored in the case memory 1d, and then sets the case as the current operation case data. The data is sequentially output to the memory 1d. As a result, the current operation case data is sequentially stored in the case memory 1d as the past operation case data indicating the past operation state of the plant A according to the operation progress of the plant A.

The inference engine 1b accumulates the current operation case data in the case memory 1d and searches the case memory 1d based on the matching rule 1c to obtain the past operation case data similar to the current operation case data. Search whether exists. For example, for all combinations of one or a plurality of past operation case data and the current operation case data over a predetermined time period in the past, the mutual distance between the current operation case data and each of the past operation case data is calculated, and the distance is calculated. Is detected as the similar driving case data most similar to the current driving case data.

When the similar operation case data is detected in this way, the inference engine 1b infers the current operation state of the plant A based on the similar operation case data, and based on the inference result, the inference engine 1b of the plant A. Generate message data indicating the operating state. For example, if the similar operation case data is in the past when a certain device constituting the plant A is abnormal, the current operation case data indicates the abnormal state of the plant A, so the inference engine 1b Then, message data for notifying the operator of this fact is generated.

The language conversion system 1 a synthesizes a voice message based on the message data and outputs the synthesized voice message to the speaker 2. As a result, the operator can recognize from the voice message that the operation state of the plant A is in an abnormal state, and can take necessary measures.

On the other hand, the inference result of the operation state of the plant A by the inference engine 1b and the recognition result of the voice instruction of the operator in the language conversion system 1a are transmitted from the interface agent 1 to the virtual plant display system 4 as commands to the virtual plant display system 4. Sent to system 4. When the inference engine 1b transmits the command to the virtual plant display system 4 via the communication unit 1f, the command is transmitted to the main control unit 4 via the communication unit 4b of the virtual plant display system 4.
is input to a.

Next, the detailed operation of the virtual plant display system 4 will be described with reference to the flowchart shown in FIG.

First, the virtual plant display system 4
Is activated, the main control unit 4a causes all the VR image 3D image data stored in the 3D virtual plant database 4h to be read into the memory in the VR display unit 4g (step S1). Thereby, the VR display unit 4
It is possible to speed up the generation of the VR image by g, and to realize a VR image that responds promptly to a VR image change instruction from the operator.

When the reading of the VR video three-dimensional image into the memory is completed, the main control unit 4a causes the communication unit 4b to establish a communication connection with the interface agent 1 (step S2). The communication unit 4b establishes a communication connection with the communication unit 1f of the interface agent 1 according to an instruction from the main control unit 4a. Thereafter, the main control unit 4a, that is, the virtual plant display system 4 enters a standby state until the command is input from the interface agent 1 via the communication unit 4b or an operation event is input from the input device 5. Become.

Here, when a command is input from the interface agent 1 to the communication unit 4b (step S
3), the main controller 4a analyzes the contents of this command (step S4). Then, the communication unit 4b and the VR control unit 4
c, various driving support images are displayed on the CRT display 6 by controlling the operations of the ITV display unit 4d, the message display unit 4e, and the image synthesizing unit 4f (step S5).

For example, if the command indicates an abnormality of a specific device based on the inference result of the inference engine 1b, the main control unit 4a, in step S5, displays text data indicating the abnormality of the device in the message display unit 4e. Output to As a result, the message display unit 4e
Generates a character message image based on the text data, and displays it on the CRT display 6 via the video synthesizing unit 4f. At this time, the video synthesizing unit 4f performs CRT based on the position designation information input from the main control unit 4a.
The position of the display message on the display 6 is set.

In the same manner as above, if the command indicates an abnormality of a specific device, the main control unit 4a
Outputs an instruction to selectively display an ITV image of the abnormal device to the ITV display unit 4d. As a result, the ITV display unit 4d displays the ITV video of the abnormal device on the CRT display 6 via the video synthesis unit 4f.

Further, the main control section 4a instructs the VR display section 4g to generate and output a VR image of the abnormal device via the VR control section 4c. As a result, the VR display unit 4g
A VR image of the abnormal device is generated based on the three-dimensional image data previously read from the three-dimensional virtual plant database 4h, and is displayed on the CRT display 6 via the image synthesizing unit 4f. The VR image of the abnormal device is a VR image obtained by performing a three-dimensional simulation of the abnormal state of the abnormal device.

Here, the VR display unit 4g of the present embodiment is
When displaying VR video on the CRT display 6, the IT
Using the V synthesizing unit 4k, the ITV video of the abnormal device input from the ITV display unit 4d is synthesized into the VR video. That is, the ITV synthesizing unit 4k synthesizes the ITV video within the VR video by performing texture mapping (dynamic texture mapping) of the ITV video on a specific surface in the VR video which is a three-dimensional video for each frame.

More specifically, for example, when the abnormal device is a “compressor”, the actual operation status of the compressor is displayed on a specific surface of the compressor which is virtually displayed three-dimensionally on the VR video. Is displayed. Since the ITV video of this compressor is dynamically texture-mapped on the side of the compressor in frame units, it becomes a moving image that changes in frame units in the same manner as a normal ITV video.

FIG. 5 is a schematic diagram showing such a driving assistance image based on the VR image. As shown in this figure, IT
The V image is displayed as a moving image on a specific surface of a device that is three-dimensionally displayed in the VR image by dynamic texture mapping. Here, the operator can change the position and the viewpoint with respect to the device by operating the input device 5, but since the ITV image is dynamically texture-mapped on the specific surface, the operator faces the specific surface in front. And confront (facing)
In this case, the ITV image can be most visually recognized.

As described above, by displaying the ITV image indicating the actual operation state of the compressor in the VR image of the virtual compressor by dynamic texture mapping and displaying it, the virtual V
It is possible to suppress the operator's excessive immersion feeling in the R image, and to more easily and accurately grasp the operating state of the plant A.

It should be noted that the above command is used in the language conversion system 1
If the instruction is a change instruction of the driving support image that is voice-recognized by a, the main control unit 4a causes the CRT display 6 to display the driving support image corresponding to the change instruction in step S5. For example, when a command to confirm the status of the specific device is input, the main control unit 4a
Sends an instruction to select and display the ITV video of the device.
V display unit 4d to output the ITV video of the
It is displayed on the T display 6. Further, the main control unit 4a controls the VR display unit 4g via the VR control unit 4c to display the VR video of the device on the CRT display 6.

On the other hand, in step S6, when an operation event relating to the VR video change instruction is input from the input device 5 directly to the operation unit 4i, the operation event is directly transmitted from the operation unit 4i via the VR control unit 4c. It is input to the main control unit 4a. The main control unit 4a analyzes the operation event (step S7), and instructs the VR control unit 4c to display a VR video according to the analysis result, that is, the type of the operation event (step S8).

The VR control unit 4c causes the VR display unit 4g to generate a VR image according to the instruction of the main control unit 4a, and outputs an audio output instruction corresponding to the VR image to the sound generation unit 4j. As a result, the VR display unit 4g outputs a new VR video according to the operation event to the video synthesizing unit 4f and causes the CRT display 6 to display the new VR video. In addition, the sound generation unit 4j outputs the VR displayed on the CRT display 6.
The sound corresponding to the video is output to the speaker 7.

By operating the input device 5, the operator can virtually move in the plant A on the walk-through image. When an operation event for instructing advancing in a predetermined direction is input from the input device 5, the operator can change the position where he stands on the walk-through image. For example, when the operator arrives in front of the compressor in an abnormal state, the sound generation unit 4j outputs an abnormal operation sound of the compressor to the speaker 7 to make the virtual experience of the operator more realistic. I do.

When an operation event relating to the operation of the device displayed on the walk-through image is input in step S6, the operation event is directly transmitted to the main control unit via the operation unit 4i and the VR control unit 4c. Part 4a
Is input to The main control unit 4a transmits the operation event to the interface agent 1 via the communication unit 4b (device operation processing: step S9). Then, this operation event is input to the plant A via the communication unit 1f, the inference engine 1b, and the data collection unit 1e of the interface agent 1, and based on the operation event, the operation of the device displayed on the walkthrough video is performed. Operated.

For example, when an operation event instructing to stop the operation of the compressor displayed on the walk-through image is input from the input device 5, the operation of the compressor is stopped based on the operation event. Alternatively, when an operation event indicating that measurement data of a specific device is to be obtained is input from the input device 5, the numerical value of the measurement data of the specific device is changed to the interface agent 1 based on the operation event.
And is displayed on the CRT display 6 via the virtual plant display system 4.

According to the present embodiment, the driving support image is displayed on the CRT based on the inference result of the operation state of the plant A by the case-based inference and the voice recognition result of the voice instruction by the operator.
Since the display is displayed on the display 6, the operator visually confirms the operating state of the plant A by the driving support image displayed on the CRT display 6 in addition to the auditory confirmation of the operating state of the plant A based on the voice message. You can check. Therefore, it is easy to confirm the operation state of the plant A, and it is possible to greatly reduce the load on the operator as compared with the conventional human interface related to plant operation monitoring.

Since the driving support video is displayed on the CRT display 6 in the form of a VR video, an ITV video or a message, the operator can intuitively and easily grasp the operating state of the plant A. Further, since the instruction of the operator is input to the interface agent 1 by voice recognition, the operator can easily input his / her own intention to the interface agent 1.
Therefore, it is possible to reduce the load on the operator also by these methods, and to reduce the training period of the operator and the cost related to the training equipment, because the skill of the operator is not required as much as in the past. Is possible.

The above embodiment is not configured to directly operate the plant A based on the voice instruction of the operator whose voice has been recognized by the interface agent 1. This takes into account the fact that the current operation of the plant A is operated in parallel.

That is, the present invention provides a next-generation human interface technology relating to the operation of the plant A. When applying the present invention to the actual plant A, the operator can easily understand the present invention. In order to make full use of it, it is necessary to coexist with a conventional human interface for a certain period. During this coexistence period, the operator is used to the voice instruction input to some extent, and then instructs the actual operation of the plant by voice, so that the operation of the plant requiring accuracy can be reliably performed by the audio instruction.

The present invention is not intended for a specific plant, but can be applied to operation monitoring of all plants composed of a plurality of various devices.

[0066]

As described above, the plant operation monitoring support device according to the present invention has the following effects.

(1) As a first means relating to the plant operation monitoring support device, a plant operation monitor for displaying an operation support image indicating an operation state of the plant on a video display means to assist an operator who monitors the operation of the plant. In the support device, an ITV related to the VR image is included in a VR (virtual reality) image that virtually displays a plant in three dimensions.
Since the driving support video synthesized with the ITV video of the camera is displayed, the operator can accurately and easily determine the operation state of the plant by using such a driving support video, thereby greatly reducing the load. be able to.

(2) Also, for example, when the driving support video is composed only of the VR video, the driver may be excessively immersed in the VR video in the virtual space, making it difficult to distinguish between the real and the virtual space. There is a concern about falling. On the other hand, by synthesizing the ITV image indicating the actual situation of the plant in the VR image, it is possible to suppress the operator's excessive immersion in the virtual VR image.

(3) Since the ITV image is switched according to the change of the VR image, the operator can easily and accurately grasp the state of each device constituting the plant at each position in the VR image. .

(4) Since the apparatus is provided with the sound notifying means for notifying the contents of the driving support image by sound, the operator can more intuitively grasp the operating state of the plant.

(5) The operation support image is displayed based on the inference result of the interface agent which infers the current plant operation state based on past plant operation cases. An accurate driving support image is displayed. Therefore, the load of the operation monitoring work of the plant by the driver can be further reduced.

(6) Since the driving assistance video is switched based on the voice instruction of the driver who has been voice-recognized by the interface agent, the driving assistance video can be easily changed by the voice instruction. That is, since the instruction input by the operator is extremely easy and intuitive, and the operation does not require skill, it is possible to reduce the time required for training the operator and reduce the cost associated with the training of the operator. is there.

[Brief description of the drawings]

FIG. 1 is an overall configuration diagram of an embodiment of the present invention.

FIG. 2 is a block diagram showing a functional configuration of an interface agent according to an embodiment of the present invention.

FIG. 3 is a block diagram showing a functional configuration of an embodiment of the present invention.

FIG. 4 is a flowchart showing the operation of one embodiment of the present invention.

FIG. 5 is a schematic diagram illustrating an example of a driving support image according to an embodiment of the present invention.

[Explanation of symbols]

 A: Plant 1: Interface agent 1a: Language conversion system 1b: Inference engine 1c: Matching rule 1d: Case memory 1e: Data collection unit 1f: Communication unit 2: Speaker 3: Microphone 4 … Virtual plant display system 4a… main control unit 4b… communication unit 4c… VR control unit 4d… ITV display unit 4e… message display unit 4f… video synthesis unit 4g… VR display unit 4h… 3D virtual plant database 4i Direct operation unit 4j Sound generation unit (sound notification unit) 4k ITV synthesis unit 5 Input device 6 CRT display (video display unit) 7 Speaker (sound notification) means)

 ────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Yuji Matsuura 3-1-1, Toyosu, Koto-ku, Tokyo Ishikawajima Harima Heavy Industries, Ltd. East Term Technical Center F term (reference) AC16 BA05 CA03 CA08 CB02 CB09 CB14 CB15 DA17 EA21 FA15 FA27 FA32 FA36 FA42 FB34 5H223 AA01 DD09 EE06 FF03 FF06 9A001 HH03 HH17 HH23 LL09

Claims (5)

[Claims] 1. A plant operation monitoring support device for displaying an operation support image indicating an operation state of a plant (A) on an image display means (6) to assist an operator monitoring operation of the plant. VR (virtual
(Reality) A plant operation monitoring support device characterized in that an operation support image obtained by synthesizing an ITV image of an ITV camera related to the VR image is displayed in the image. 2. The plant operation monitoring support device according to claim 1, wherein the ITV image is switched according to a change in the VR image. 3. The plant operation monitoring support device according to claim 1, further comprising an audio notifying unit (4j, 7) for notifying the contents of the driving support image by sound. 4. A driving support image is displayed based on an inference result of an interface agent (1) for inferring a current plant operation state based on past plant operation cases. The plant operation monitoring support device according to any one of the above. 5. The plant operation monitoring support device according to claim 4, wherein the operation support video is switched based on a voice instruction of an operator voice-recognized by the interface agent.