JP7260839B2 - Plant management method, plant management device and plant management program - Google Patents

Description

The present invention relates to a plant management method, a plant management device, and a plant management program.

For example, Patent Literature 1 discloses a water quality abnormality detection device for a power plant that can detect water quality abnormality or signs of abnormality. This water quality abnormality detection device is provided corresponding to the equipment that constitutes the power plant, and is a plant model that can calculate the water quality information regarding the water quality of the feed water based on the operation data of the power plant and the internal parameters that indicate the internal state of the equipment. , an acquisition unit that acquires operation data from the power plant, and an operation that calculates internal parameters corresponding to the current internal state of the equipment based on the operation data and water quality information calculated from the plant model to calculate the operation internal parameters. and a judgment unit for judging presence/absence of abnormalities in water quality or signs of abnormalities based on the reference internal parameters and the operational internal parameters that serve as references in the state of normal operation.

A 3D model is generated in the virtual space using the design data of equipment and facilities, and information such as the operating status and environmental information of the actual equipment and facilities in the real space is acquired in real time, and that information is displayed in the virtual space. A technology called digital twin is spreading, which enables design improvement, operation instructions according to the environment, failure prediction, etc. by performing simulations by feeding back to the 3D model.

For example, in Patent Document 2, based on data of various electrical quantities held by a data collection server, a simulation model of a power system including a model that reproduces each subsystem is generated, and changes in various electrical quantities are generated. describes a technology that faithfully simulates an actual power system by updating the model based on It is possible to quantitatively indicate the stability of the current power system, such as how robust the current power system is against disturbances such as system faults. Therefore, it is possible to present the minimum necessary countermeasures more economically when performing system reinforcement or power equipment reinforcement.

JP 2019-144751 A JP 2019-154201 A

By the way, when digital twin technology is used for plant management, for example, when the vibration state and temperature state of equipment are captured using vibration sensors and temperature sensors, information can only be obtained at measurement points. Acquiring a large amount of data requires arranging a large number of sensors, which is difficult to achieve due to increased costs and the like. On the other hand, when the number of sensors is small, the amount of information obtained is small, and there is a problem that it is difficult to improve the accuracy of the simulation.

SUMMARY OF THE INVENTION An object of the present invention is to provide a plant management method, a plant management apparatus, and a plant management program capable of improving simulation accuracy while suppressing an increase in cost.

In order to achieve the above object, the plant management method of the present invention includes:
a three-dimensional model generating step of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space;
a situation image acquisition step of acquiring information about the status of the plant equipment as image information;
a storage step of storing the information about the status of the plant equipment acquired as the image information in association with the corresponding part of the three-dimensional model;
Prepare.

The plant management device in the present invention is
a generation unit that generates a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space;
an acquisition unit that acquires information about the status of the plant equipment as image information;
a storage unit that stores the information about the status of the plant equipment acquired as the image information in association with the corresponding part of the three-dimensional model;
Prepare.

The plant management program in the present invention is
a process of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space;
A process of acquiring information about the status of the plant equipment as image information;
a process of storing the information about the status of the plant equipment acquired as the image information in association with the corresponding part of the three-dimensional model;
run on the computer.

ADVANTAGE OF THE INVENTION According to this invention, the accuracy of simulation can be improved, suppressing a rise in cost.

BRIEF DESCRIPTION OF THE DRAWINGS It is a figure which shows roughly the structure of the plant management apparatus which concerns on embodiment of this invention. FIG. 11 is a diagram showing an example of a situation image superimposed and displayed on the image of the three-dimensional model; FIG. 4 is a diagram showing an example of situation information stored in association with position coordinates of a three-dimensional model; It is a figure which shows an example which superimposes and displays the information which each pixel of a situation image has on the corresponding position on a plant image. It is a flow chart which shows an example of the plant management method concerning an embodiment of the invention. 4 is a flow chart showing another example of the plant management method according to the embodiment of the present invention; It is a figure which shows an example of the situation information superimposed and displayed on the plant image from a viewpoint. It is a figure which shows roughly the structure of the plant management apparatus which concerns on the modification 1 of this Embodiment. It is a figure which shows roughly the structure of the plant management apparatus based on the modification 2 of this Embodiment. FIG. 4 is a diagram showing an example of maintenance information stored in association with a three-dimensional model; FIG.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a diagram schematically showing the configuration of a plant management system 1 according to an embodiment of the invention. FIG. 2 is a diagram showing an example of a situation image superimposed on the three-dimensional model image. In the following explanation, the information about the status of the plant equipment P may be referred to as "status information". Also, image information in the situation information may be referred to as a "situation image". Also, a situation image acquired by an imaging device may be referred to as a “captured image”.

As shown in FIG. 1 , the plant management apparatus 1 includes an input section 12 , an infrared camera 14 (imaging device), a control section 20 , a storage section 30 and a display section 40 .

The input unit 12 inputs various data (for example, design information and measurement information regarding the plant equipment P).

The infrared camera 14 captures infrared rays radiated from the plant equipment P and its background. The infrared camera 14 may be installed at a predetermined location in the plant facility P (installation type), may be arranged so as to be transportable (portable type), or may be mounted on a small unmanned aircraft (drone type). , may be mounted on a robot that automatically patrols the inside of the plant facility P (patrol photographing robot type).

The infrared camera 14 periodically transmits the photographed infrared image of the plant equipment P to the control unit 20 . The storage unit 30 stores the infrared image and additional information about the shooting location and shooting direction of the infrared camera 14 that accompanies the infrared image.

The visible light camera 16 captures visible light reflected from the plant equipment P. The acquisition unit 24 acquires the shooting location and shooting direction of the visible light camera 16 . The visible light camera 16 may be installed at a predetermined location in the plant facility P (installation type), may be arranged so as to be transportable (portable type), or may be mounted on a small unmanned aircraft (drone type). ), it may be mounted on a robot that automatically patrols the inside of the plant facility P (patrol photographing robot type).

The visible light camera 16 periodically transmits the captured visible light image of the plant equipment P to the control unit 20 . The storage unit 30 stores a visible image and additional information about the shooting location and shooting direction of the visible light camera 16 that accompanies the visible image. It is preferable that the visible light camera 16 shoots in the same shooting direction from the same shooting point as the infrared camera 14 . The visible light camera 16 and the infrared camera 14 may be configured integrally.

The control unit 20 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The CPU reads a program corresponding to the processing content from the ROM, expands it in the RAM, and centrally controls the operation of each block of the plant management apparatus 1 in cooperation with the expanded program. At this time, various data stored in the storage unit 30 are referenced. The storage unit 30 is configured by, for example, a nonvolatile semiconductor memory (so-called flash memory) or a hard disk drive.

The control unit 20 communicates variously with a device (for example, an infrared camera 14, a visible light camera 16) connected to a communication network such as a LAN (Local Area Network) or a WAN (Wide rea Network) via a communication unit. Send and receive data. The control unit 20 implements functions of the generation unit 22, the acquisition unit 24, the alignment unit 26, and the image generation unit 28, for example, based on various data transmitted from an external device.

The generation unit 22 generates a three-dimensional model in a virtual space on the computer based on various data input by the input unit 12 . Here, the various data include the layout of the plant equipment P as a whole (including position coordinates), the positions and shapes of the component parts that make up the plant equipment P, information on the refined product in the plant equipment P (for example, in the case of gas, type, flow rate in piping, pressure, temperature, etc.), design information of the plant equipment P, and measurement data of the plant equipment P (environmental data such as temperature, humidity, sunshine conditions, wind speed, atmospheric pressure, etc.).

The acquisition unit 24 acquires information (status information) about the status of the plant equipment P as a status image. For example, when the information about the status of the plant equipment P is temperature information or fluid leakage information, the acquisition unit 24 acquires an infrared image (status image) of the plant equipment P photographed by the infrared camera 14 . The acquisition unit 24 also acquires the shooting location and shooting direction of the infrared camera 14 . The acquisition unit 24 also acquires a visible light image (situation image) of the plant equipment P photographed by the visible light camera 16 . The acquisition unit 24 also acquires the shooting location and shooting direction of the visible light camera 16 .

The image processing/analysis unit 25 extracts an image (extracted image) and a temperature image of the gas leakage area by image-processing the infrared image captured by the infrared camera 14 . In addition, the image processing/analysis unit 25 performs image processing and image analysis on the visible light image captured by the visible light camera 16 to obtain an image (extracted image) of the rust area showing the state of rust generation in the plant equipment P, An image (extracted image) of the deformation area indicating the deformation state of the external shape of the plant equipment P or an image (extracted image) of the vibration area indicating the vibration state of the plant equipment P is extracted. In the following description, the situation image includes an image (extracted image) of the gas leakage area and a temperature image extracted from the infrared image (original image) by image processing. The situation image includes an image of the rust area (extracted image), an image of the deformed area (extracted image), or a vibration image of the plant equipment P (extracted image) extracted from the visible light image (original image). be

Further, the image processing/analysis unit 25 obtains spatial coordinate information of the gas cloud spreading in space and information (situation information) of the gas leak position from the image of the gas leak area. A known method such as the method described in Japanese Patent No. 6620878 can be used as a method for estimating the leak position.

The image processing/analysis unit 25 obtains temperature information (status information) of the components by converting the value of each pixel of the captured infrared image (situation image) based on a predetermined formula.

The image processing/analysis unit 25 obtains vibration information (amplitude and frequency) of component parts such as piping that constitutes the plant equipment by analyzing the captured visible light image (situation image). A technique for obtaining vibration information is described in, for example, International Publication WO2018207528.

The image processing/analysis unit 25 obtains rust information (status information) regarding the appearance of component parts such as piping that constitutes the plant equipment by analyzing the captured visible light image (status image). The occurrence of rust can be recognized by using color information of the image, for example.

The image processing/analysis unit 25 obtains deformation information (situation information) regarding the appearance of component parts such as piping that constitutes the plant equipment by analyzing the captured visible light image (situation image). Occurrence of deformation can be obtained by comparing the photographed image and the design information of the plant facility P, for example. Alternatively, it can be obtained by using a camera capable of acquiring three-dimensional information of an object to be photographed and comparing the obtained three-dimensional shape of the object to be photographed with the design information of the plant equipment P. Three-dimensional information can be obtained by using, for example, a distance measurement method based on triangulation or a distance measurement method using the speed of light (time-of-flight method).

The alignment unit 26 associates the position of each pixel of multiple types of situation images (gas leak area image, rust area image, etc.) with the coordinate position of the three-dimensional model. In the following description, associating the situation image with the three-dimensional model means associating the position of each pixel of the situation image with the position in the coordinates of the three-dimensional model.

The storage unit 30 stores information (status information) about the status of the plant equipment P in association with the corresponding part of the three-dimensional model. Specifically, the storage unit 30 stores an infrared image of the plant equipment P captured by the infrared camera 14 in association with the three-dimensional model. The storage unit 30 also stores the visible light image of the plant equipment P captured by the visible light camera 16 in association with the three-dimensional model.

FIG. 3 is a diagram showing an example of situation information stored in association with position coordinates of a three-dimensional model. As shown in FIG. 3, the storage unit 30 stores the shooting date and time as supplementary information. The storage unit 30 also stores the surface temperature (° C.), the presence or absence of gas leakage, and the presence or absence of rust as status information. As shown in FIG. 3, "20", "40", and "25" in the column of surface temperature indicate the surface temperature ° C., "0" in the column of gas leakage indicates that there is no gas leakage, and "1 ” indicates that there is a gas leak. In addition, the extent (spatial coordinates) of the gas cloud in the three-dimensional space is stored in association with the gas leak position (not shown). The spatial coordinates of the gas cloud can be calculated from infrared images taken from multiple locations. If there is only an infrared image from one direction, the calculation may be performed by assuming that the spread in the depth direction is the same as the spread in the horizontal direction. In addition, captured infrared images (including moving images) or gas cloud images (including moving images) extracted by image processing may be stored in association with gas leak positions. A "0" in the rust column indicates no rust and a "1" indicates rust present. It may be stored in multiple stages according to the state of rust.

The image generator 28 generates an image of the plant equipment P (hereinafter referred to as a plant image) from a predetermined viewpoint based on the three-dimensional model.

The display unit 40 displays the information of each pixel of the situation image superimposed on the corresponding position on the plant image.

FIG. 4 is a diagram showing an example of displaying the information of each pixel of the situation image superimposed on the corresponding position on the plant image. In one example shown in FIG. 4, the plant image is an image of a gas tank. The situation image is an image (here, gas cloud) showing the state of gas leakage. As for the gas cloud, a CG (Computer Graphics) image generated based on the spatial coordinates of the gas cloud stored in the storage unit 30 is displayed. A map (a plan view of a 3D model) of the plant facility P is displayed at the bottom of the display screen. The viewpoint position of the infrared camera 14 is indicated in the plan view of the 3D model as a black circle. A height bar specifying the height of the viewpoint is displayed on the right side of the plan view of the 3D model. In the plan view, the field angle range of the plant image from the viewpoint (black circle) is indicated by a dashed line. A diagram of a combination of ellipses indicating the orientation of the viewpoint is displayed in the lower right portion of the display screen. The direction of the viewpoint and the display angle of view can be changed by operating the mouse on the plant image. Alternatively, it may be made changeable by moving a black circle and a height bar in the plan view. The display angle of view may be changed by + and - buttons.

Each component of the control unit 20 may be connected via a network, and the three-dimensional model may be stored on the cloud, for example. Also, the control unit 20 may be on the cloud. The control unit 20 may be composed of a plurality of CPUs and may operate integrally by being connected via a network. The storage unit 30 may also be configured in a distributed manner. Moreover, the display unit 40 may be arranged in the plant facility P. Further, the display unit 40 may be arranged in a central monitoring room or the like of the head office to centrally manage the plant facilities P in various places.

Next, an example of the plant management method according to the embodiment of the present invention will be explained. FIG. 5 is a flow chart showing an example of the plant management method according to the embodiment of the invention. This flow starts when the CPU develops the plant management program in the RAM. It is assumed that the control unit 20 executes each function of the generation unit 22, the acquisition unit 24, the image processing/analysis unit 25, the alignment unit 26, and the like.

First, as an example of the plant management method, the steps from the start of this flow to the storage of the status information will be described with reference to FIG. Here, an image (situation image) of a gas leakage area will be described as an example of situation information.

In step S100, the control unit 20 generates a three-dimensional model of the plant equipment P in the virtual space on the computer based on at least one of the design information and the measurement information regarding the plant equipment P. The design information includes the three-dimensional shape and position information of the plant equipment P. The measurement information includes the three-dimensional shape and position information of the plant equipment P measured by a three-dimensional measuring device using a laser or the like.

Next, in step S110, the controller 20 acquires an infrared image.

Next, in step S120, the control unit 20 extracts an image (extracted image) of the gas leakage area from the infrared image by image processing. Further, the control unit 20 estimates the leak position from the image of the gas leak area.

Next, in step S130, the control unit 20 associates the image of the gas leak area and the leak position with the three-dimensional model.

As for the method of associating the image of the gas leak area with the three-dimensional model, for example, the photographing point of the infrared camera 14 is acquired by a GPS (Global Positioning System), an altitude sensor, or the like. The photographing direction of the infrared camera 14 is acquired by an acceleration sensor, a gyro sensor (angular velocity sensor), a geomagnetic sensor, or the like. The acquired shooting point and shooting direction are applied to the 3D model of the plant facility P, and based on the angle of view information (focal length and image sensor size information) of the camera, the plant image generated from the 3D model is converted to the camera. By cutting out the field angle range, a plant image having the same viewpoint and the same field angle as the photographed image is obtained. Alternatively, the equipment in the photographed image may be recognized from the information of the photographing location and the shape information of the plant equipment P, for example, by pattern recognition. As a result, each pixel of the situation image (captured image) and the three-dimensional model of the plant equipment P can be associated with each other. Furthermore, information for each pixel extracted from the situation image (information possessed by the pixel of the situation image) can be incorporated into the three-dimensional model as information about the situation of the plant facility P at the position corresponding to the pixel.

Next, in step S140, the storage unit 30 stores the image of the gas leak area and the leak position in association with the corresponding part of the three-dimensional model. After that, the flow shown in FIG. 5 ends.

Next, the steps up to displaying the situation information (here, information on the gas leakage area) on the plant image will be described with reference to FIG. FIG. 6 is a flow chart showing another example of the plant management method according to the embodiment of the invention. This flow starts when the CPU develops the plant management program in the RAM. Note that the control section 20 will be described as executing the functions of the image generating section 28 and the like.

In step S200, the control unit 20 determines whether or not a viewpoint for creating a three-dimensional model has been designated.

In step S<b>210 , the control unit 20 reads the three-dimensional model data from the storage unit 30 , generates a plant image from the specified viewpoint, and causes the display unit 40 to display the image.

At step 220, the control unit 20 determines whether or not any of the status information (surface temperature, gas leakage, presence or absence of rust, vibration, etc.) to be superimposed on the plant image has been specified.

In step S230, based on the specified situation information (here, gas leakage), the control unit 20 blinks the leak position (red target mark) at the corresponding position on the plant image, and displays the gas cloud on the plant image. CG is displayed at the position corresponding to . After that, the flow shown in FIG. 6 ends. In addition, you may return to before step S200 after that.

FIG. 7 is a diagram showing another example of situation information displayed superimposed on the corresponding position on the image of the plant image P (plant image) from the viewpoint. As shown in FIG. 7, a plant image from a viewpoint is displayed, and situation information (here, temperature distribution) is superimposed on the corresponding position of the plant image. In FIG. 7, the difference in temperature is represented by the type of hatching. The amount of liquid stored can be recognized from the temperature information (indicated by the black area in FIG. 7). The display screen also displays switching buttons for displaying information on temperature, vibration, rust, and gas leakage. By specifying the information to be displayed, the information can be superimposed on the plant image and displayed. When "Temperature" is specified, the measured temperature is displayed in multiple colors, from low temperature: purple to high temperature: red. When "vibration" is specified, for example, an area where the vibration exceeds a predetermined value is displayed blinking. It may be displayed in multiple colors according to the amplitude of vibration. If "rust" is specified, for example, the area with rust is displayed blinking in red. It may be displayed in multiple colors according to the degree of rust. When "gas leakage" is specified, the location of the leakage is indicated by, for example, a red target mark and blinking. A plurality of pieces of information may be displayed on the plant image. By specifying multiple switching buttons, the specified information is displayed at the same time.

The plant management method according to the present embodiment includes a three-dimensional model generation step of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space, and A situation image acquisition step of acquiring information as image information, and a storage step of storing the information relating to the situation of the plant equipment acquired as image information in association with the corresponding portion of the three-dimensional model.

With the above configuration, since information (status information) about the status of the plant equipment P is obtained as a status image, a large number of status images can be obtained at a low cost compared to the case of arranging a large number of sensors for detecting information about the status of the plant equipment P. can be obtained. This makes it possible to suppress an increase in cost. In addition, it becomes possible to import a large amount of situation information as data into the three-dimensional model of the plant at one time, so that the accuracy of various simulations such as operation simulation and deterioration simulation of the plant equipment P can be improved.

In addition, the plant management method according to the present embodiment captures the plant equipment P using a plurality of infrared cameras 14 arranged at mutually different positions, a patrolling photographing robot, or a drone, so that the plant equipment can be viewed from many viewpoints. Acquire an infrared image of P. Since infrared images are obtained from a plurality of viewpoints, information regarding the plant equipment P can be obtained from various directions. Therefore, information about the plant equipment P can be obtained without omission. In addition, when a gas leak is photographed, the position of the gas leak in a three-dimensional space and the spread of the gas cloud can be calculated from the images from multiple viewpoints, so the gas leak area of the plant equipment P can be captured three-dimensionally. becomes possible.

In addition, the plant management method according to the present embodiment inputs information obtained from many infrared images (for example, temperature information, gas leak information) and information from visible images (information on rust and vibration) into the 3D model. can be used to simulate plant conditions, so the accuracy of the simulation can be easily improved.

(Modification 1)
Next, a modified example of this embodiment will be described. In addition, in the description of the modified example, the configuration different from the above-described embodiment will be mainly described, and the same configuration will be given the same reference numerals, and the description thereof will be omitted.

First, Modification 1 of the present embodiment will be described with reference to FIG. FIG. 8 is a diagram schematically showing the configuration of a plant management device 1 according to Modification 1 of the present embodiment. As shown in FIG. 8, the plant management apparatus 1 according to Modification 1 includes a transmissive spectacles-type terminal 50 (hereinafter referred to as smart glasses) through which the view of the plant equipment is transmitted. The smart glasses 50 transmit and receive data to and from the control unit 20 via a communication line such as a LAN (Local Area Network) or the Internet line. Note that FIG. 8 omits the transmission/reception units provided in each of the control unit 20 and the smart glasses 50 .

The smart glasses 50 are provided with an area specifying section 52 and a projection section 54 . The smart glasses 50 have a lens portion through which the sight of the plant facility P is transmitted.

The area identification unit 52 identifies the worker's position and line of sight direction (that is, field of view) based on the positional coordinates of the smart glasses 50 (lens unit) worn by the worker and the inclination with respect to the coordinate axes.

The control unit 20 receives information about the position coordinates of the smart glasses 50 (lens unit) and the tilt with respect to the coordinate axes from the smart glasses 50 . The acquisition unit 24 acquires information about the status of the plant equipment within the field of view of the worker as a status image (for example, an infrared image captured by the infrared camera 14).

The image processing/analysis unit 25 extracts a gas cloud image representing the gas leakage area from the infrared image.

The control unit 20 associates the gas cloud image with the three-dimensional data of the plant equipment P and stores them.

The alignment unit 26 generates an image (plant image) of the plant equipment P seen from the smart glasses 50 based on the position coordinates of the smart glasses 50 (lens unit) and the tilt with respect to the coordinate axes, and aligns the plant image with the scene seen from the smart glasses. and

The control unit 20 reads the gas cloud data associated with the three-dimensional data of the plant equipment P from the storage unit 30, associates it with the scene seen from the smart glasses 50, and projects the gas cloud image onto the lens unit. 54. Note that the control unit 20 may control the projection unit 54 so that an image showing the gas leak position, gas flow rate, and gas flow direction is projected onto the lens unit instead of the gas cloud image. .

The plant management apparatus 1 according to Modification 1 includes smart glasses 50 that project a gas cloud image onto a lens portion that transmits the scene of the plant equipment P. FIG. As a result, for example, hydrocarbon gases that transmit visible light, which cannot be seen with the naked eye, can be visualized through the smart glasses 50, making it possible to instantly and accurately visually recognize gases that are at risk of explosion.

Note that in the plant management device 1 according to Modification 1, the smart glasses 50 may have each function of the control unit 20 .

(Modification 2)
Next, the plant management device 1 according to Modification 2 will be described with reference to FIG. FIG. 9 is a diagram schematically showing the configuration of a plant management device according to Modification 1 of the present embodiment. In addition, in the description of Modified Example 2, the configuration different from that of the above-described embodiment will be mainly described, and the same configuration will be given the same reference numerals, and the description thereof will be omitted.

A plant management apparatus 1 according to Modification 2 includes a simulation execution unit 66 and a maintenance information creation unit 68 in addition to the configuration of the above embodiment.

The simulation execution unit 66 simulates deterioration of the plant equipment P based on the three-dimensional model, the history of the situation images and the situation information continuously stored in the storage unit 30 . Here, the deterioration of the plant equipment P refers to the deterioration of the plant equipment P and the component parts of the plant equipment P, and includes, for example, metal fatigue, damage, rust, spread of deformation, failure risk, and the like.

The maintenance information creation unit 68 creates maintenance information regarding the location, timing, and content of maintenance required for the plant equipment P based on the simulation results. The storage unit 30 stores maintenance information in association with the three-dimensional model.

FIG. 10 is a diagram showing an example of maintenance information stored in association with a three-dimensional model. As shown in FIG. 10, the history of maintenance information is stored in the storage unit 30, such as when maintenance was performed on a particular component (for example, the pipe 1) and the details of the maintenance. In addition, schedules of maintenance information such as the timing of the next maintenance based on a simulation or the like and the details of the maintenance are stored. As shown in FIG. 10, the pipe 1 was replaced on March 5, 2018 and March 10, 2019, and the replacement schedule for April 2020 is stored.

The display unit 40 displays the maintenance information superimposed on the image of the three-dimensional model. Specifically, as shown in FIG. 2, the display unit 40 displays the maintenance information of "inspection time 20xx year xx month" superimposed on the image of the three-dimensional model.

The plant management apparatus 1 according to Modification 2 includes a simulation execution unit 66 that simulates the deterioration of the plant equipment P based on the three-dimensional model and the continuously stored status images and history of status information. The simulation execution unit 66 uses the temperature information, vibration information, rust information, deformation information and change history information stored in the storage unit 30, and measurement information from various sensors arranged in the planton facility P. From this, for example, the degree of metal fatigue is simulated, and the future situation is predicted from the situation of that change. For example, with temperature information, the degree of deterioration is determined in consideration of the location of abnormal temperature occurrence, the number of abnormal temperature occurrences, the amplitude of the temperature change cycle, and the number of times. For example, in the vibration information, the abnormal state and the degree of deterioration are determined from the location of vibration occurrence, the amplitude of vibration, and the frequency of vibration. Further, the degree of deterioration is determined from the state of rust and deformation of pipes, for example. In addition to this information from the appearance, for example, design information and measurement information such as the flow rate and pressure of the fluid flowing through the pipe, the material and thickness of the pipe, etc., can be taken into account to estimate the progress of deterioration of the pipe. The surface condition of the plant equipment P is acquired based on the situation image, and the information contained in the situation image is used to simulate the deterioration of the plant equipment. It is possible to obtain simulation results precisely.

The plant management apparatus 1 according to Modification 2 also includes a maintenance information creation unit 68 that creates maintenance information regarding plant equipment based on the simulation results. As a result, the maintenance information displayed superimposed on the image of the three-dimensional model can be used as an effective judgment material when planning maintenance. In addition, as shown in FIG. 2, by displaying the maintenance information superimposed on the image of the three-dimensional model, it is possible to easily grasp the locations where the risk of failure is low.

Note that the plant management apparatus 1 according to Modification 2 may include smart glasses 50 according to Modification 1 (see FIG. 8). In Modified Example 2, by providing the smart glasses 50, it is possible to display temperature information, vibration information, and the like as information about the status of the plant equipment P on the smart glasses 50 (lens portion).

In the above-described embodiment, the deterioration prediction of the plant equipment P is performed based on the simulation result, but the present invention is not limited to this, and may be performed by artificial intelligence (AI).

In the above-described embodiment, the information superimposed on the three-dimensional model includes the deterioration prediction and maintenance information of the plant equipment P. However, as an application example of the present invention, for example, a dangerous place related to deterioration prediction Candidate information may be used. For example, if a pipe is hot in a place where it is not originally hot, or if there is deformation such as rust or dents, it is determined that there is a risk of damage, and this fact is superimposed on the 3D model. may be displayed as In addition, using various information such as temperature distribution, vibration distribution, leakage position, rust generation position, deformation position and deformation amount of equipment (for example, pipes etc.) of plant equipment P, the degree of danger due to deterioration and abnormality etc. It may be ranked and displayed by superimposing the degree of danger on the three-dimensional model.

In addition, the above-described embodiments are merely examples of specific implementations of the present invention, and the technical scope of the present invention should not be construed to be limited by these. Thus, the invention may be embodied in various forms without departing from its spirit or essential characteristics.

The disclosure contents of the specification, drawings and abstract contained in the Japanese application of Japanese Patent Application No. 2020-122165 filed on July 16, 2020 are incorporated herein by reference.

1 plant management device 12 input unit 14 infrared camera 16 visible light camera 20 control unit 22 generation unit 24 acquisition unit 25 image processing/analysis unit 26 alignment unit 28 image generation unit 30 storage unit 40 display unit 50 smart glasses 52 area identification unit 54 projection unit 62 visible light image analysis unit 64 infrared image analysis unit 66 simulation execution unit 68 maintenance information creation unit

Claims (10)

a three-dimensional model generating step of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space;
a situation image acquisition step of acquiring information about the status of the plant equipment as image information using an imaging device ;
a storage step of storing the information about the status of the plant equipment acquired as the image information in association with the corresponding part of the three-dimensional model ;
in the storing step, using information about the shooting location and shooting direction of the imaging device to associate the position on the image acquired by the imaging device with the position of the three-dimensional model;
A plant management method , wherein information relating to the status of the plant equipment at the corresponding position is stored in association with each position of the three-dimensional model . a three-dimensional model generating step of generating a three-dimensional model of the plant equipment in a virtual space on a computer based on design information related to the plant equipment in the real space;
a situation image acquisition step of acquiring information about the status of the plant equipment as image information;
a storage step of storing the information about the status of the plant equipment acquired as the image information in association with the corresponding part of the three-dimensional model;
simulating deterioration of the plant equipment based on the three-dimensional model and information about the status of the plant equipment;
a step of creating maintenance information regarding the location, timing, and content of maintenance required for the plant equipment based on the simulation results;
a step of storing the created maintenance information in association with the three-dimensional model;
a step of displaying the maintenance information at a corresponding location of the three-dimensional model;
A plant management method comprising: The information about the status of the plant equipment includes at least one of temperature information, vibration information and fluid leakage information of the plant equipment, and information about the appearance of the plant equipment.
The plant management method according to claim 1 or 2 . The imaging device is at least one of an infrared camera and a visible light camera,
The plant management method according to claim 1 . a related information acquiring step of acquiring the stored three-dimensional model and information relating to the status of the plant facility associated with the corresponding portion of the three-dimensional model;
a display step of generating an image of the plant equipment from a predetermined viewpoint position from the three-dimensional model and displaying information on the status of the plant equipment superimposed on the corresponding position on the three-dimensional model;
The plant management method according to any one of claims 1 to 4 . creating risk level information for the plant equipment based on the three-dimensional model and information about the status of the plant equipment;
a step of storing the generated risk information in association with the three-dimensional model;
a step of displaying the information on the degree of risk at the corresponding location of the three-dimensional model;
The plant management method according to any one of claims 1 to 5 . further comprising a projection step of projecting information about the status of the plant equipment onto a lens unit of a transmissive eyeglass-type terminal that transmits the scene of the plant equipment;
The plant management method according to any one of claims 1 to 6 . a storage unit that stores a three-dimensional model of the plant equipment generated in a virtual space on a computer based on design information related to the plant equipment in the real space;
an acquisition unit that acquires information about the status of the plant equipment as image information captured by an imaging device ;
a positioning unit that associates the position on the image acquired by the imaging device with the position of the three-dimensional model using information about the shooting location and shooting direction of the imaging device.
The storage unit further stores information about the status of the plant facility at the corresponding position in association with each position of the three-dimensional model.
Plant management equipment. an acquisition unit that acquires information about the status of plant equipment in real space as image information;
The information about the state of the plant equipment acquired as the image information is stored in association with the corresponding part of the three-dimensional model of the plant equipment generated in the virtual space on the computer based on the design information about the plant equipment in the real space. a storage unit for
a simulation execution unit that simulates deterioration of the plant equipment based on the three-dimensional model and information about the status of the plant equipment;
a maintenance information creation unit that creates maintenance information regarding the location, timing, and content of maintenance required for the plant equipment based on the simulation results;
a display unit for displaying the maintenance information at corresponding locations of the three-dimensional model;
the storage unit further stores the maintenance information in association with the three-dimensional model;
Plant management equipment. A process of acquiring information about the status of plant equipment in real space as image information captured by an imaging device ;
A process of storing the information about the status of the plant equipment acquired as the image information in association with the corresponding part of the three-dimensional model of the plant equipment generated in the virtual space on the computer based on the design information about the plant equipment. and,
Alignment processing for matching a position on an image acquired by the imaging device with a position of the three-dimensional model using information about the shooting location and shooting direction of the imaging device;
a process of associating with each position of the three-dimensional model and storing information about the status of the plant facility at the corresponding position;
A plant management program that causes a computer to execute

Images