JP2010003190A - Maintenance system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a maintenance system capable of providing proper information to a personal digital assistant, and efficiently performing a field patrol and a maintenance work. <P>SOLUTION: In the maintenance system 1, the personal digital assistant 2 and a center information processing server 4 are respectively connected through a network 3 in a mutually transmittable way. The personal digital assistant 2 has a display part 16, an operating part 17, a camera part 18, and a projector part 19. The center information processing server 4 makes an image authentication processing part 61 perform matching processing of a photographed image of a plant apparatus 6 received from the personal digital assistant 2 and an apparatus mask image 75, and acquires inspection area information from the photographed image. Then, it superimposes the inspection area information upon an apparatus display image 76 for displaying an inspection result, further superimposes inspection character information to combine a projected image, and transmits the resultant image to the personal digital assistant 2. The resultant image is projected for display from the projector part 19. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a maintenance / inspection system, and more particularly to a maintenance / inspection system that performs maintenance / inspection of equipment of a plant facility such as a power plant or a chemical plant.

  Generally, monitoring and inspection of the plant site is carried out by providing ITV (industrial television) camera devices that can remotely control the shooting direction and zoom magnification on the pillars inside or outside the plant in the main locations. The operator regularly visits the site based on a checklist that includes a means for confirming the site status by remote operation by the operator and a checklist containing the equipment status confirmation items. There was a means to use it together with a means to confirm the presence or absence of abnormality.

  In the on-site monitoring in the conventional plant monitoring device, the ITV camera device as the monitoring means is fixedly installed, and in many cases, it is installed at a considerably far distance from the plant equipment for the purpose of securing a wide field of view. Therefore, it is impossible to take a close-up image of a specific plant equipment, which is mainly used for outline monitoring of the site situation, and the status check of each equipment is confirmed by periodic site inspections by plant operators. The reality is.

  Therefore, a technique described in Patent Document 1 has been proposed as a labor-saving technique for on-site inspection that saves labor such as on-site inspection by a plant operator. According to this technology, the site patrol robot automatically patrols the site, acquires the site video and site audio in real time, and allows the operator to check the current status of the equipment without omission in the plant operation room.

Also, the position and display color of the operation buttons indicating the operation state of the device, the operation state display lamp, etc. are extracted from the photographed image, and the corresponding device state value during normal operation corresponding to the plant operation state registered in the database in advance. And a technique for determining an item in which a difference has occurred and automatically notifying the operator of a state change.
JP 2000-039914 A

  By the way, plant sites are not necessarily provided with trajectories or passages through which on-site patrol robots can pass, and are often premised on patrols by humans. On-site patrols are not necessarily involved in plant operations and have detailed knowledge of on-site plant equipment and knowledge of the plant as a whole. Inspection patrols and maintenance inspection workers are engineers that are separate from the operators. Often it is.

  Therefore, an object of the present invention is to provide a portable information terminal for carrying information when a patrol and maintenance worker carries an inspection manual or maintenance inspection instruction and inspects on-site equipment in the plant. The purpose of the present invention is to provide a maintenance inspection system that can be provided and can efficiently perform on-site patrols and maintenance inspection work comparable to experienced workers.

In order to achieve the above-described object, the maintenance and inspection system of the present invention is a maintenance and inspection system in which a server and a portable information terminal are connected to each other via a network so as to be capable of mutual transmission.
The portable information terminal transmits and inputs an input means, a display means, a camera for photographing a maintenance inspection target device, and a captured image of the maintenance inspection target device photographed by this camera together with device identification information of the maintenance inspection device. Communication means for transmitting information inputted by the means to the server, and receiving information sent from the server,
The server
Photographing maintenance and inspection equipment by receiving information transmitted from the portable information terminal and matching processing with a communication means for transmitting information to the portable information terminal and a photographed image of the maintenance target apparatus received from the portable information terminal A mask image storing means for storing a mask image having an opening for specifying an inspection region of the image in correspondence with the device identification information, and a device display image for displaying a maintenance inspection result of the maintenance target device. A storage unit for storing a device display image corresponding to the device identification information; a mask image searching unit for searching for a corresponding mask image from the storage unit for the mask image based on the device identification information received from the portable information terminal; Device display image search means for searching for the corresponding device display image from the storage means of the device display image based on the device identification information received from the portable information terminal An image matching means for performing a matching process between a captured image of a maintenance inspection target device received from a portable information terminal and a mask image retrieved based on the device identification information, and corresponding to an opening of the mask image after being matched. Inspection area information acquisition means for acquiring inspection area information from the inspection area of the photographed image of the maintenance inspection target device, and overwriting the acquired inspection area information in a predetermined area corresponding to the opening of the searched device display image And information superimposing means for generating an output device display image, and the information is retrieved based on the device identification information of the maintenance inspection target device received from the portable information terminal and the captured image of the maintenance inspection target device. The device display image for output generated by overwriting the inspection area information acquired in the predetermined region of the displayed device display image is transmitted to the portable information terminal, Characterized in that displayed on the display unit of the broadcast terminal.

  According to the present invention, clear and accurate image data to be registered as equipment inspection history information by an operator by displaying a clear output equipment display image showing a maintenance point result of equipment subject to maintenance inspection on a portable information terminal. Can provide.

  According to the present invention, when inspection and maintenance inspection workers carry inspection manuals and maintenance inspection instructions and inspect plant equipment, appropriate information can be provided to the portable information terminal to be carried, Provide a maintenance inspection system that enables efficient site inspection and maintenance inspection work comparable to veteran workers.

Hereinafter, a maintenance inspection system which is a preferred embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a schematic configuration of a maintenance / inspection system according to the present invention, and FIG. 2 is a circuit configuration block diagram of a portable information terminal in the maintenance / inspection system.
As shown in FIG. 1, the maintenance and inspection system 1 is carried by an operator along with a maintenance and inspection instruction (not shown) mainly for inspecting on-site equipment (hereinafter abbreviated as “plant equipment”) 6 of a plant. The portable information terminal 2 includes a center information processing server 4 that is a server installed on the center side to which the portable information terminal 2 is connected via the network 3.
Here, the plant equipment 6 corresponds to the maintenance target equipment described in the claims.

Incidentally, the portable information terminal 2 is connected to a wireless terminal 3 a connected to the network 3 by wireless communication, and the center information processing server 4 is connected to a node terminal 3 b connected to the network 3.
In addition, the device manufacturer information servers 5A and 5B are connected to the other node terminal 3b of the network 3, and the server management terminal 7 is connected to the node terminal 3c.
The plant equipment 6 is, for example, a relay board, a motor control board, an AVR (Automatic Voltage Regulator) board, a control board, or the like.
FIG. 1 shows a relay panel as an example of the plant equipment 6. In the relay panel of this example, a name plate 113 displaying device identification information to be described later is attached or printed on the surface of the casing of the relay panel. This relay panel has an indicator lamp 114 and a panel 115 of relays and switches.

  The portable information terminal 2 is in the form of a mobile phone or a mobile personal computer or PDA (Personal Digital Assistants), and includes a microphone 11, a speaker 12, a processing unit 13, a communication control unit (communication means) 14, an antenna (communication). Means) 15, a display unit (display unit) 16 using a liquid crystal or the like, a keyboard or touch panel type operation unit (input unit) 17, a camera unit (camera) 18, and a projector unit (display unit) 19. Yes.

The center information processing server 4 includes a communication control unit (communication unit) 51, a processing unit 52, and a maintenance inspection database (storage unit) 53.
Here, the maintenance / inspection database 53 corresponds to “mask image storage means”, “device display image storage means”, and “maintenance inspection data plate storage means” described in the claims.

The processing unit 52 is configured to include a memory such as a CPU, a ROM, and a RAM, and an interface circuit in terms of hardware. Functionally, the overall control unit 60, the image recognition processing unit 61, the projection image generation unit 62, and the database management unit 64 It is comprised including.
The maintenance inspection database 53 is a data area of a storage device connected to the CPU of the processing unit 52 via the interface circuit described above. The data area includes plant equipment inspection related information 71, equipment inspection history. Information 72, equipment inspection guidance information 73, data search directory 74, equipment mask image 75, equipment display image 76, and the like are stored. Specific contents of the plant equipment inspection related information 71, equipment inspection history information 72, equipment inspection guidance information 73, data search directory 74, equipment mask image (mask image) 75, and equipment display image 76 will be described later.

  Although not shown in the above storage device, the communication control unit 51, the overall control unit 60, the image recognition processing unit 61, the projection image generation unit 62, and the database management unit 64 as the center information processing server 4 of the maintenance / inspection system 1. A program for executing each function is stored.

<Mobile information terminal>
First, the portable information terminal 2 will be described in detail.
The processing unit 13 of the portable information terminal 2 is composed of a CPU, for example, executes a control program stored in a ROM, and performs a predetermined calculation using a control signal input from the operation unit 17 or the like of the portable information terminal 2. For example, a control signal is output to each unit of the portable information terminal 2 to control the display unit 16, the communication control unit 14, the camera unit 18, and the projector unit 19.

  The portable information terminal 2 basically has the function of a mobile phone, and the processing unit 13 cooperates with the communication control unit 14 to process the voice information acquired by the microphone 11 by the processing unit 13 and transmit it to the outside. Or received audio information from the outside, processed by the processing unit 13 and output to the speaker 12, processed by the processing unit 13 and transmitted to the outside by taking a captured image taken by the camera unit 18, or from the outside It has a function of receiving data such as image information and processing the received data such as image information by the processing unit 13 and displaying the data on the display unit 16 or projecting and displaying the data by the projector unit 19.

The power supply circuit 21 includes a charging circuit for the battery 20 such as a lithium ion battery, a voltage detection circuit for detecting the voltage of the battery 20, a DC / DC conversion circuit, and the like, and an external interface (in FIG. 2, “external I / F”). The battery 20 is charged with a charging current supplied from the outside via the line 22, or is supplied to each part of the portable information terminal 2 (omitted in FIG. 2 and only to the CPU constituting the processing unit 13). Actually, it is also supplied to the microphone 11, the speaker 12, the communication control unit 14, the display unit 16, the operation unit 17, the camera unit 18, and the projector unit 19). Or supply.
The memory 27 is a RAM and is used as a main memory when the CPU executes a program. The memory 28 is a nonvolatile memory such as a ROM and a flash memory, for example, and stores a program or temporarily stores various data. Used when

(Camera part)
The camera unit 18 includes a photographing lens 31, an image sensor 32 such as a CCD or CMOS image sensor, a photographing control circuit 33, and a lens driving circuit 34.
The imaging control circuit 33 controls the image sensor 32 and the lens driving circuit 34 according to a command from the processing unit 13, performs image processing on the imaging signal output from the image sensor 32, and outputs the image processing signal to the processing unit 13. The imaging control circuit 33 causes the image sensor 32 to start acquiring an imaging signal in response to an imaging start instruction from the processing unit 13 in response to an instruction input from the operation unit 17, and reads the imaging signal from the image sensor 32 after imaging is completed. After the image processing, the image data is output to the processing unit 13.

The photographing lens 31 includes a plurality of lenses (not shown), and includes, for example, a focus lens group for focus adjustment and a zoom lens group for zoom ratio adjustment.
The lens driving circuit 34 drives a part of the focus lens group forward / backward in the optical axis direction based on the focus adjustment signal output from the photographing control circuit 33. In addition, the lens driving circuit 34 drives a part of the zoom lens group forward and backward in the optical axis direction based on the zoom adjustment signal output from the photographing control circuit 33. Incidentally, the processing unit 13 outputs a focus adjustment amount and a zoom adjustment amount for the camera unit 18 to the photographing control circuit 33 in accordance with an operation signal input from the operation unit 17, and the photographing control circuit 33 outputs the focus adjustment signal and the zoom adjustment amount. The zoom control signal is output from the photographing control circuit 33 to the lens driving circuit 34.

The projector unit 19 includes a projection control circuit 41, a light source 42 such as an LED, a liquid crystal panel 43, a projection lens 44, and a lens driving circuit 45. The projection control circuit 41 supplies a drive current to the light source 42 according to the projection command output from the processing unit 13. The light source 42 illuminates the liquid crystal panel 43 with brightness according to the supplied current.
The projection control circuit 41 further generates a drive signal for driving the liquid crystal panel 43 according to the image data sent from the processing unit 13 and outputs the drive signal to the liquid crystal panel 43. Specifically, this drive signal applies a voltage corresponding to the image signal for each pixel to the liquid crystal layer of the liquid crystal panel 43. In the pixels of the liquid crystal panel 43 to which a voltage is applied, the arrangement of liquid crystal molecules changes, and the light transmittance of the liquid crystal layer changes. Thus, the liquid crystal panel 43 generates an optical image by modulating the light from the light source 42 in accordance with the image signal.

The projection lens 44 includes a plurality of lenses (not shown) and includes, for example, a focus lens group for focus adjustment and a zoom lens group for zoom ratio adjustment.
The projection lens 44 projects an optical image emitted from the liquid crystal panel 43 toward a screen or the like. Based on the offset adjustment signal output from the projection control circuit 41, the lens driving circuit 45 drives the projection lens 44 to advance and retract in a direction orthogonal to the optical axis. Further, the lens driving circuit 45 drives a part of the focus lens group to advance and retreat in the optical axis direction based on the focus adjustment signal output from the projection control circuit 41. The lens driving circuit 45 further drives a part of the zoom lens group forward / backward in the optical axis direction based on the zoom adjustment signal output from the projection control circuit 41. Incidentally, the processing unit 13 outputs an offset adjustment amount, a focus adjustment amount, and a zoom adjustment amount to the projector unit 19 according to an operation signal input from the operation unit 17 to the projection control circuit 41, and the projection control circuit 41 performs the offset adjustment. The adjustment signal, the focus adjustment signal, and the zoom adjustment signal are output to the lens driving circuit 45.

<Center information processing server>
Next, returning to FIG. 1, functions of each unit of the center information processing server 4 will be described in detail with reference to FIGS. 3 to 5 as appropriate. FIG. 3 is a diagram for explaining the configuration of the data search directory of the maintenance inspection database. FIG. 4 shows an example of a received image and a device mask image corresponding to the received image. FIG. 5 is an example of a device display image.

(Maintenance inspection database)
First, a detailed configuration of the maintenance / inspection database 53 will be described.
The plant equipment inspection related information 71 is drawing information and document information including a plant system diagram, a single line connection diagram, and the like, and is stored in the maintenance inspection database 53 so as to be searchable using the data search directory 74 based on the equipment identification information. Stored.
The equipment inspection history information 72 is time-sequentially using the projection image (output equipment display image) (see FIG. 5) generated by the projection image generation unit 62 based on the captured image acquired by the portable information terminal 2 as a maintenance inspection record. The history information accumulated in A specific method for generating the equipment inspection history information 72 will be described later. The equipment inspection history information 72 is stored in the maintenance inspection database 53 so that it can be searched using the data search directory 74 based on the equipment identification information.
The equipment inspection guidance information 73 is, for example, an equipment inspection manual or a treatment guide when equipment is abnormal, and is stored so as to be searchable using the data search directory 74 based on the equipment identification information.

The data search directory 74 includes, for example, as shown in FIG. 3, a device identification information column 74a for describing device identification information for individually identifying the plant device 6, a model code column 74b for describing a model code (device type information), a plant A device name column 74 c that describes the name of the device 6, a device mask image column 74 d that specifies the file name of the mask image corresponding to the plant device 6, and a device display image that specifies the file name of the device display image corresponding to the plant device 6 Field 74e, a data template field 74f for designating the file name of the maintenance inspection data template corresponding to the plant equipment 6, a related information field 74g for designating the file name of the plant equipment inspection related information corresponding to the plant equipment 6, and the plant equipment 6 Equipment inspection history column 74h for specifying an address where inspection history exists, plant equipment Equipment inspection guidance information field 74i for designating the file name of the equipment inspection guidance information and equipment name field 74k of the plant equipment 6 to be controlled are provided, and the above-described various information and data can be searched using the equipment identification information as a key code. It is configured.
By the way, in the example of the device identification information described in the device identification information column 74a of FIG. 3, the hyphen symbol “-” precedes the board model code, and the hyphen symbol “-” follows the serial number. .

Here, the device identification information is, for example, an alphanumeric combination code string assigned to individually identify the plant device 6, and the plant device 6 can be individually identified even in the same type of plant device 6. In combination with a model code (device type information) indicating the type and model of the device, one piece of device identification information is configured, and a format is determined in advance so that it can be understood which part of the device type information indicates the model code. Yes. For example, the device identification information is divided into front and rear portions by a hyphen symbol “-”, the portion before the hyphen indicates the model code, and the portion after the hyphen indicates the serial number.
Note that the method of distinguishing between the model code portion and the serial number portion is not limited to the hyphen symbol, and any other character or code may be used as long as the character can be easily recognized.

The device mask image 75 is stored in the maintenance inspection database 53 so as to be searchable using the data search directory 74 based on the device identification information. Specific examples of the device mask image 75 are illustrated in FIGS. 4B, 4D, and 4F. Details of the device mask image 75 will be described later in the detailed functional description of the image recognition processing unit 61.
The device display image 76 is stored in the maintenance inspection database 53 so as to be searchable using the data search directory 74 based on the device identification information. A specific example of the device display image 76 is illustrated in FIG.

(Communication control unit)
The communication control unit 51 has a function of controlling data transmission / reception communication with the portable information terminal 2 via the network 3.
(General Control Department)
The central control unit 60 of the processing unit 52 controls the data transfer of each unit as the center information processing server 4, searches various data from the maintenance inspection database 53, for example, plant equipment inspection related information 71, equipment inspection history information 72, Control of search of device inspection guidance information 73, data search directory 74, device mask image 75, device display image 76, etc., communication control by communication control unit 51 with portable information terminal 2, image recognition processing unit 61, projection image generation It has a function of performing overall adjustment such as control of the unit 62 and the database management unit 64.

(Image recognition processor and mask image)
The image recognition processing unit 61 acquires a captured image (also referred to as a received image) acquired by the camera unit 18 of the portable information terminal 2 via the communication control unit 51 and is acquired by being controlled by the overall control unit 60. The device identification information included in the received image is extracted and recognized. Then, in response to this, the overall control unit 60 corresponds to the recognized device identification information from among a plurality of device mask images 75 which are input and stored in advance as part of the data of the maintenance inspection database 53. The mask image 75 is retrieved and transferred to the image recognition processing unit 61. The image recognition processing unit 61 performs matching processing between the received image and the retrieved device mask image 75, and corresponds to the opening 118 of the device mask image 75 (see (b), (d), and (f) of FIG. 4). A function of acquiring image information of a region to be processed.

FIG. 4 is an example of a received image and a corresponding device mask image. (A) is a received image obtained by photographing the front of the AVR operation display panel, and (b) is a device corresponding to (a). (C) is a received image obtained by photographing the front of the input / output card unit on the back of the computer, (d) is a device mask image corresponding to (c), and (e) is a relay image. It is the received image which image | photographed the front of a circuit board, (f) is an apparatus mask image corresponding to (e).
As shown in FIGS. 4A, 4C, and 4E, the received images 111A, 111B, and 111C display device identification information for identifying each plant device 6, in this example, the electric panel. The nameplate 113 to be copied is shown.
The nameplate 113 displays, for example, “model: AVR1-0501”, “model: HKC-1001”, and “model: H0001-001”, but is a combination of the board model and serial number. is there.

And as shown to (a), (c), (e) of FIG. 4, the panel which displays the name of the plant equipment to which the indicator lamp 114 and the indicator lamp 114 respond | correspond on the front of the board under the nameplate 113 is shown. And a panel 115 such as a relay or switch for controlling a device to which the indicator lamp 114 corresponds.
In FIG. 4A, the operation indicator lamp of the AVR operation display panel is indicated by the indicator lamp 114, and in FIG. 4C, the operation indicator of the input / output card is indicated by the indicator lamp 114, as shown in FIG. In (e), the operation lamp of the relay circuit board is indicated by an indicator lamp 114.
On the other hand, as shown in FIGS. 4B, 4D, and 4F, the device mask images 75A, 75B, and 75C include the opening 118 corresponding to the area of the indicator lamp 114 and the panel described above. An outline 119 corresponding to 115 is included.

  Since the magnification is different between the received image 111 (displayed as 111A, 111B, 111C in FIG. 4) and the device mask image 75 (displayed as 75A, 75B, 75C in FIG. 4), the area of the indicator lamp 114 of the received image 111 In order to extract only image information as inspection area information, matching processing is required.

(Projected image generator)
The overall control unit 60 (see FIG. 1) corresponds to the device identification information acquired by the image recognition processing unit 61 from among a plurality of device display images 76 that are input and stored in advance as part of the data of the maintenance inspection database 53. In response to searching the device display image 76 or searching the inspection character information to be described later based on the device identification information acquired by the image recognition processing unit 61 from the data search directory 74, the projection image generating unit 62 performs the search. The inspection area information acquired by the image recognition processing unit 61 is superimposed on the area corresponding to the opening 122 (displayed by 122A, 122b, and 122C in FIG. 5) of the device display image 76 that has been obtained. The information is written in a specific area of the retrieved device display image 76, or a projection image (output device display image) is generated.

(Database Management Department)
For example, the database management unit 64 performs various types of information (plant equipment inspection related information 71, equipment inspection history information 72, equipment inspection guidance information, etc.) included in the maintenance inspection database 53 by an operation from the server management terminal 7 constituted by a personal computer. 73, the data search directory 74, the device mask image 75, and the device display image 76) have a function of newly registering, deleting, or changing.
It should be noted that, based on the service contract for receiving the plant equipment inspection-related information 71 from the equipment manufacturer, the equipment management server 7 accesses the equipment manufacturer information servers 5A, 5B, etc. as necessary, and the plant equipment 6 subject to maintenance inspection. New plant equipment inspection related information 71 can be obtained, and the plant equipment inspection related information 71 obtained by the server management terminal 7 can be registered in the maintenance inspection database 53 via the database management section 64.

(Explanation of flowchart)
Next, with reference to FIGS. 6 to 13, a maintenance inspection method by cooperation between the portable information terminal 2 and the center information processing server 4 will be described with reference to FIGS. 1 to 5 as appropriate.
6 to 10 are flowcharts showing a flow of control for creating the equipment inspection history information 72 based on the photographed image by the cooperation of the portable information terminal 2 and the center information processing server 4.
FIG. 11 is an explanatory view showing a maintenance / inspection main screen of the portable information terminal.
Here, an operator carries the portable information terminal 2 and a work instruction sheet, and is a board designated in advance in the work instruction sheet among the boards shown in the single-line diagram arranged at various positions in the plant premises. As an example, a description will be given of a case where the display contents such as indicator lamps indicating on and off of the board surface are inspected on a regular route.
The center information processing server 4 is always operating, and establishes a communication line with the portable information terminal 2 connected to the center information processing server 4 to communicate with each other. Then, when communication with the portable information terminal 2 is completed, the established communication line is disconnected.

The control flow on the portable information terminal 2 side is shown in steps S01 to S38, and the control flow on the center information processing server 4 side is shown in steps S101 to S134.
In step S01, the worker operates the operation unit 17 of the portable information terminal 2 to activate the plant equipment maintenance / inspection program. Then, the plant equipment maintenance / inspection program is activated to request communication connection with the center (step S02: “communication connection with center”), and the center information processing server 4 establishes communication connection (step S101).
Then, the overall control unit 60 of the center information processing server 4 transmits the plant name and the menu screen for maintenance inspection (maintenance inspection main screen 80 (see FIG. 11)) to the portable information terminal (step S102). The portable information terminal 2 receives a maintenance / inspection main screen 80 as shown in FIG. 11, and the screen is displayed on the display unit 16. The portable information terminal 2 accepts an input of a plant name and a maintenance / inspection object (step S03: "Plant name, maintenance inspection acceptance").

The maintenance inspection main screen 80 includes a screen title column 81 and an input column 82 displaying “Plant name / maintenance inspection target”. An end button 101 is arranged at the right end of the screen title column 81. A combo box 83 labeled “Plant name” and a combo box 84 labeled “Maintenance inspection target” are arranged.
The combo boxes 83 and 84 include input display windows 83a and 84a and option display buttons 83b and 84b. For example, in the case of the combo box 83, the keyboard of the operation unit 17 (see FIG. 1) is directly used. You can enter plant names such as “xxx factory”, “△△△ factory”, “XXX water purification plant”, etc., and in the case of the combo box 84, “single-line diagram board display”, It is also possible to input a maintenance inspection target such as “control system instruction display”,..., Or to select an input display window 83a by selecting from an option display window that is temporarily opened by pressing the option display buttons 83b and 84b. 84a can also be displayed.
Here, it is assumed that a cursor movement / decision button is facilitated on the operation unit 17 instead of the mouse, and the cursor can be moved to perform an operation of pressing an icon button or selecting a menu item or option.
In the input field 82, an operation button 102 indicating completion of input in the maintenance / inspection main screen 80 displaying "Next" is prepared.

Incidentally, “single-line diagram display” indicates a case where the display state of the maintenance inspection target panel indicated in the single-line diagram template 90 is inspected according to the single-line diagram template 90 as shown in FIG. The display state of the indicator light of the maintenance inspection target panel shown in the connection diagram template 90 is recorded.
The single-line diagram template 90 shows the same wiring and equipment tree as the single-line diagram, and includes a device identification information column 95 of the plant equipment 6 that receives power supply from the power supply line 91 indicated by a single line, and a projection image described later. The recording area 93 into which is inserted is described in advance.
Here, for the plant equipment 6 to be inspected for maintenance, the equipment identification information column 95 is a background color that is easy to call attention, and the equipment identification information is displayed there, and the recording area 93 is writable. Is set to For the plant equipment 6 that is not the object of maintenance inspection, the equipment identification information column 95 has, for example, a white background color, the equipment identification information is displayed there, and is displayed on the board instead of the recording area 93. It is set to non-writable.
The “control system instruction display” is to record the display state of the instruction meter provided on the control panel subject to maintenance and inspection according to the “control system panel surface diagram template” (not shown).

In step S04, the portable information terminal 2 checks whether or not the input is completed. If the input is completed (Yes), the process proceeds to step S05. If the input is not completed (No), the portable information terminal 2 proceeds to step S03. Continue.
In step S05, the portable information terminal 2 transmits the plant name and maintenance inspection target selected in step S03 to the center information processing server 4, and the center information processing server 4 receives the plant name and maintenance inspection target and controls them. The control unit 60 searches for a maintenance inspection data template for a maintenance inspection target (step S103).
Here, the maintenance / inspection data template is the above-described single-line diagram template 90 or a control system panel surface diagram template not shown.
Incidentally, the control system panel surface system diagram template is a template that systematically displays the control equipment and the plant equipment 6 that is a control panel included in each layer of the hierarchical control system.

In step S06, the portable information terminal 2 is operated by the operator using the operation unit 17, and the camera unit 18 images the board surface of the plant device 6 ("photographing the target device"), and temporarily stores the captured image. (Step S07), and the shooting parameters are temporarily stored (step S08).
Here, the shooting parameters include a focal length, a focus signal, a center position in the line of sight direction, presence / absence of a flash, shooting date / time, and the like when shooting a subject with the camera unit 18.

This flow of steps S06 to S08 allows the worker to shoot a plurality of times, and the worker selects an image that is well captured from the photographed and stored images, and performs the transmission operation. And
Next, it is checked whether or not the worker has operated the portable information terminal 2 to select a photographed image (step S09). If it is selected (Yes), the process proceeds to step S10. If it is not selected (No), the process returns to step S06, and steps S06 to S09 are repeated.
In step S10, the portable information terminal 2 checks whether or not it is connected to the center information processing server 4 (“connect to center?”). If it is connected (Yes), the process proceeds to step S11. If it is not connected, connection is attempted and step S10 is repeated. In this step S10, there is a possibility that the portable information terminal 2 may be weak due to radio wave shielding by a plant device 6 or a building that temporarily stops being connected to the center information processing server 4, so that the connection is simply confirmed. It is.

In step S11, the portable information terminal 2 transmits the selected captured image to the center information processing server 4, and then transmits the imaging parameter corresponding to the selected captured image (step S12). After step S12, the process proceeds to step S13 in FIG.
In response, the overall control unit 60 of the center information processing server 4 receives the captured image (step S104) and receives the imaging parameter (step S105). After step S105, the process proceeds to step S106 in FIG.

The image recognition processing unit 61 of the center information processing server 4 recognizes device identification information of the plant device 6 from the captured image received in step S104 (step S106: “recognition of device identification information of the device from the received image”). Hereinafter, the received captured image is referred to as a received image.
The technique for extracting and recognizing alphanumeric characters such as device identification information from the photographed image as described above is a technique already used in an automobile number reading device or the like, and will not be described here.
Next, in step S107, the overall control unit 60 of the center information processing server 4 transmits the device identification information recognized in step S106 to the portable information terminal 2.

The portable information terminal 2 receives the transmitted device identification information and displays it on the display unit 16 (step S13). At this time, the display screen displays the received device identification information, “is the device identification information recognized correctly?”, “Yes”, an icon button for display, and “No”, an icon button for display. The
In step S14, the mobile information terminal 2 checks whether the icon button displaying “Yes” is pressed or whether the icon button displaying “No” is pressed (“Yes” pressed?), And “Yes”. Is displayed (Yes), an OK signal is transmitted to the center information processing server 4 (step S15). If the icon button labeled "No" is pressed (No), the work is performed. A manual input of device identification information from the operation unit 17 by a worker is accepted (step S16). On the screen for accepting manual input of device identification information, for example, an icon button displaying “Next” is prepared. When the icon button displaying “Next” is pressed, the input is completed.

  In step S17, the portable information terminal 2 checks whether or not the manual input of the hearing identification information is completed. If the input has been completed (Yes), the process proceeds to step S18. If the input has not been completed (No), the process returns to step S16.

In step S108, the overall control unit 60 of the center information processing server 4 checks whether or not an OK signal has been received from the portable information terminal 2 in response to step S15. If an OK signal is received (Yes), the process proceeds to step S110. If an OK signal is not received (No), the process proceeds to step S109.
In step S109, the overall control unit 60 of the center information processing server 4 receives the device identification information corresponding to step S18. After step S18, the process proceeds to step S19 in FIG. 9 according to the symbol (C).
As described above, even if the device identification information is recognized from the received image on the center information processing server 4 side in steps S13 to S18, it is transmitted to the portable information terminal 2 side so that the worker confirms it. On the other hand, the reliability is higher than when the subsequent processing is automatically performed.

In step S110, the overall control unit 60 of the center information processing server 4 uses the data search directory 74 as shown in FIG. 3 to use the device mask image 75, device display image 76, device inspection guidance information corresponding to the device identification information. 73 is searched.
FIG. 5 shows an example of the device display image. This device display image 76 corresponds to the relay circuit board shown in FIG. 5 (e), and includes a display area 76a for a single-line diagram, a projected character information input area 76b to be described later, and a related information display request. An icon button 105 is provided.

The display area 76a is drawn to show that the wiring 121 of the single-line connection diagram is branched into three, and round openings 122A, 122B, 122C are arranged at three ends of the wiring. FIG. 5 shows a state after the inspection area information is pasted on the openings 122A, 122B, 122C in step S113. Double hatching (“red (lit)”), white background (“white (dark)”), double hatching ( Although shown in the state of “red (lit)”, at the stage when the device display image 76 is searched, the openings 122A, 122B, and 122C are all plain white areas (inspection area information is pasted in step S113). It is the previous state).
Furthermore, the identification names 123A, 123B, and 123C of the plant equipment 6 that is the target of the inspection area information indicated by the openings 122A, 122B, and 122C are “machine A” below the openings 122A, 122B, and 122C of the display area 76a. , “B machine”, “C machine” are displayed.
In the projected character information input area 76b below the display area 76a, the device name 124 to be controlled of this relay circuit board, which is indicated as “*** pump” in FIG. 5, and “model: H001-001” are indicated. The device identification information 125 of the relay circuit board itself, “inspection date and time 08-02-28-16”, and the display of inspection character information including the date and time information 126 at the time of maintenance inspection are displayed. Is searched, nothing is displayed in the projected character information input area 76b.
Under the projected character information input area 76b, an icon button 105 for displaying “related information display” is arranged.
The icon button area 106 displayed for reference below the icon button 105 is displayed on the screen of the display unit 16 when a projection image is displayed on the portable information terminal 2, and step S20. I will explain later.

  In step S111, the image recognition processing unit 61 of the center information processing server 4 performs a matching process on the received image and the device mask image searched in step S110.

For example, the matching process is performed based on the imaging parameter acquired in step S105. That is, in the matching process, the size setting for the matching process of the device mask image is performed based on the subject distance or the focal length parameter at the time of photographing, or the center position on the received image 111 is supported based on the line-of-sight direction at the time of photographing. Then, the center position of the device mask image 75 is adjusted.
The matching process is not limited to the method described above, and may be performed by another method.

In step S112, the image recognition processing unit 61 of the center information processing server 4 checks the received image 111 (displayed as 111A, 111B, and 111C in FIG. 4) corresponding to the opening 118 (see FIG. 4) of the device mask image. Extract information and store it temporarily.
In the example shown in FIG. 4 of the present embodiment, extracting the inspection area information includes processing for discriminating the in-panel arrangement of the indicator lamp 114 indicating the operating status of the plant equipment 6 and its color.
The display colors of the indicator lamps 114 are usually limited to colors such as “red”, “blue (green)”, “yellow”, and “white”. If reference colors of these colors are prepared in advance, By comparing with this reference color, color discrimination can be easily performed.
In order to minimize errors in the extraction of the inspection area information due to the influence of the shift in the matching process between the received image 111 and the device mask image 75, in color determination in the area of the received image 111 corresponding to the opening 118, The area (hereinafter referred to as “determination area”) is divided into small areas, one or more different small area images close to the center of the determination area are cut out, and the cut out small area image is defined as a reference color prepared in advance. By making a comprehensive determination (for example, 2 out of 3 logic) of one or more color determination results obtained by comparison, more reliable color determination can be performed.

Strictly speaking, the reference color is set to have a predetermined color band, and a subtle change in color when captured by the camera unit 18 of the portable information terminal 2, the specification of the indicator lamp 114, and the emission color by the manufacturer. The above-mentioned “red”, “blue (green)”, “yellow”, and “white” are set to be discriminable.
By the way, “red” indicates the on state, “white (off)” indicates the off state, “green” indicates the off state or “no abnormality” state, and “yellow” indicates the “caution” state. As shown, the use of colors varies.

In the following description, the received image 111C shown in FIG.
As shown in FIG. 4E, from the received image 111C, three indicator lights 114 arranged in a line from the left to the right are, for example, “red (lit)”, “white (dark)”, “red They are arranged in the order of “lit”.

In step S113, the projection image generation unit 62 of the center information processing server 4 displays the opening 122 (displayed by 122A, 122B, and 122C in FIG. 5) of the device display image 76 (see FIG. 5) searched in step S110. The inspection area information extracted from the received image 111C is pasted to generate a composite image. Then, it progresses to step S114 of FIG. 8 according to code | symbol (D).
In step S114, the overall control unit 60 of the center information processing server 4 searches the data search directory 74 for the device name indicated by the device identification information, and checks the character information together with the date / time information included in the imaging parameter acquired in step S105. Generate as At this time, device identification information may be included as part of the check character information.
The overall control unit 60 searches the device name column 74k to be controlled in addition to the device name column 74c (see FIG. 3) for the device identification information in the data search directory 74, and stores it in the device name column 74k to be controlled. When the device name is described, the device name in the device name column 74k is set as the device name in step S114.
This is because when the plant device 6 in the received image is an electrical panel or a control panel, the name of the panel is described in the device name column 74c, and the name of the device to be controlled is described in the device name column 74k. . Then, the operating state of the plant equipment to be controlled such as “ON” and “OFF” can be determined from the display state of the panel indicator lamp 114 so that the worker can display it via the display unit 16 of the portable information terminal 2. This is because the device name described in the device name column 74k is more appropriate.

In step S115, the overall control unit 60 of the center information processing server 4 searches for a corresponding determination condition in the equipment inspection guidance information 73 searched in step S110.
Incidentally, the determination conditions included in the device inspection guidance information 73 are described so as to be easily searchable by attaching corresponding device identification information together with an identifier indicating the determination conditions.
In step S116, the overall control unit 60 of the center information processing server 4 checks whether there is a corresponding determination condition. If there is a determination condition (Yes), the process proceeds to step S117. If there is no determination condition (No), the process proceeds to step S120.
In step S117, the overall control unit 60 of the center information processing server 4 checks whether the inspection area information extracted in step S112 satisfies the determination condition searched in steps S115 and S116. If the determination condition is satisfied (Yes), the process proceeds to step S118, and the overall control unit 60 of the center information processing server 4 generates determination result character information “satisfy the determination condition”, and the process proceeds to step S121.
If the determination condition is not satisfied in step S117 (No), the process proceeds to step S119, and the overall control unit 60 of the center information processing server 4 generates the determination result character information “Warning! The determination condition is not satisfied”. Then, the process proceeds to step S121.

If No in step S116 and the process proceeds to step S120, the overall control unit 60 of the center information processing server 4 uses the check character information generated in step S114 as projection character information as it is.
In step S121, the overall control unit 60 of the center information processing server 4 combines the check character information generated in step S114 with the determination result character information generated in step S118 or step S119 to obtain projected character information.
In step S122, the projection image generation unit 62 of the center information processing server 4 shows the projection character information generated in step S120 or step S121 as a predetermined region of the composite image generated in step S113, for example, as shown in FIG. A projection image 78 is generated by overlaying on the projection character information input area of the device display image 76. After step S122, the process proceeds to step S123 in FIG.

In step S123, the overall control unit 60 of the center information processing server 4 temporarily stores the projection image 78 generated in step S122 and transmits it to the portable information terminal 2 via the communication control unit 51 (step S124).
In response to step S124, in step S19, the portable information terminal 2 receives the projection image and temporarily stores it. In step S20, the portable information terminal 2 projects the projection image received via the projector unit 19 onto an appropriate wall surface or the like. At this time, the projected image may also be displayed on the display unit 16.
When the device display image 76 is displayed on the portable information terminal 2, the icon button area 106 (see FIG. 5) on the display screen of the display unit 16 of the portable information terminal 2 displays “To next device”. An icon button 106a for inputting an instruction to move to the next inspection of the plant equipment 6, an icon button 106b for inputting an instruction to end the inspection of a series of plant equipment 6 displayed as “END”, and an “END” icon button 106b When pressed, an icon for confirming and inputting the end of the inspection of a series of plant equipment 6 displayed as “finish confirmation” is changed from a half-display state only indicating the presence of the icon button so far to a clear display. A button 106c is displayed.

In step S125, the overall control unit 60 of the center information processing server 4 searches the data search directory 74 based on the device identification information acquired in step S106 or step S109, and checks the device inspection guidance information 73 and other plant device inspection related items. A menu list of information 71 is transmitted to the portable information terminal 2.
In response to step S125, in step S21, the portable information terminal 2 receives the menu list and temporarily stores it. The received menu list is incorporated in the icon button 105 displayed as “related information display” in the projection image 78 shown in FIG. 5. When the operator presses the icon button 105, a small window opens and a menu (not shown) is displayed. A list is displayed. On the menu list display screen, “request” and “no request” icon buttons are displayed.
In step S22, the portable information terminal 2 checks whether or not the equipment inspection guidance information 73 and other plant equipment inspection related information 71 are requested, that is, either of the “request” or “not required” icon buttons is pressed. Check if it was done. If requested (Yes), the process proceeds to step S23. If not requested (No), the process proceeds to step S28.

In step S23, the portable information terminal 2 accepts input of request information, and in step S24, checks whether the input of request information is completed. When the input is completed (Yes), the process proceeds to step S25, and when the input is not completed (No), step S23 is continued. In step S <b> 25, the portable information terminal 2 transmits the request information list to the center information processing server 4.
Upon receiving step S25, the overall control unit 60 of the center information processing server 4 receives the request information list via the communication control unit 51 (step S126), retrieves the requested information from the maintenance inspection database 53 and carries it. It transmits to the information terminal 2 (step S127).

  Receiving step S127, the portable information terminal 2 receives the request information and temporarily stores it (step S26). And according to operation of the operation part 17 of a worker, the portable information terminal 2 projects the received request information on a suitable wall etc. by the projector part 19 (step S27).

  In this state, in the icon button area 106 (see FIG. 5) of the display screen of the display unit 16 of the portable information terminal 2, an instruction to move to the inspection of the next plant device 6 displayed as “To next device” is input. When the icon button 106a, the icon button 106b for inputting an instruction to end the inspection of the series of plant equipment 6 displayed as “End”, and the “End” icon button 106b are pressed, the existence of the icon buttons up to that point is present. The icon button 106c for confirming and inputting the end of the inspection of the series of plant equipment 6 displayed as “confirmation of end” is displayed instead of the half display state only indicating “”.

In step S28, the portable information terminal 2 checks whether or not the movement is to the next device, that is, whether or not the icon button 106a for displaying “to the next device” is pressed. If the button is pressed (Yes), the process proceeds to step S29. If the button is not pressed (No), the process proceeds to step S30 in FIG.
In step S <b> 29, the portable information terminal 2 transmits to the center information processing server 4 a notification of the end of the maintenance inspection of this device. Upon receiving step S29, the overall control unit 60 of the center information processing server 4 searches the projection image temporarily stored in step S123 for the maintenance inspection data template searched in step S103 (in the description of this flowchart, the single-line diagram template 90 (FIG. 12) (step S128) Specifically, for example, it corresponds to the device identification information column 95 that matches the device identification information of the plant device 6 that is the current maintenance inspection target of the single-line diagram template 90 shown in FIG. Is written in the recording area 93. Then, the process proceeds to step S129 in FIG.

In step S30, the portable information terminal 2 checks whether or not a series of maintenance inspections is finished, that is, checks whether or not the “end” display icon button 106b is pressed. If the button is pressed (Yes), the process proceeds to step S31. If the button is not pressed (No), the process returns to step S06 in FIG.
In step S <b> 31, the portable information terminal 2 transmits a notification of completion of a series of maintenance inspections to the center information processing server 4. The central control unit 60 of the center information processing server 4 receives the notification of completion of this series of maintenance inspections via the communication control unit 51, and whether there is an inspection target device that is not written in the maintenance inspection data template. A check is made (step S129).

In step S <b> 130, in response to step S <b> 129, the overall control unit 60 of the center information processing server 4 checks whether there is any maintenance inspection forgotten. If there is no maintenance inspection (Yes), the process proceeds to step S131. If there is no maintenance inspection (No), the process proceeds to step S132.
In step S <b> 131, the overall control unit 60 of the center information processing server 4 displays the maintenance / inspection device on the maintenance / inspection data template and transmits it to the portable information terminal 2. For example, in the case of the single-line diagram template 90, the device identification information column 95 of the plant device 6 for which maintenance inspection has been forgotten is blinked and transmitted.
The portable information terminal 2 receives the maintenance inspection data template and projects and displays it on the projector unit 19 (step S32). Thereafter, the process returns to step S06 in FIG. 6 according to the reference (F), and the maintenance inspection of the plant equipment 6 forgotten for the maintenance inspection is continued.

In step S <b> 132, the overall control unit 60 of the center information processing server 4 transmits a maintenance / inspection data template to the portable information terminal 2.
The portable information terminal 2 receives the maintenance inspection data template and projects and displays it on the projector unit 19 (step S33). Then, it displays according to operation of the operation part 17 by a worker. In this way, the worker inspects and inspects the single-line connection diagram template 90 and checks the projected character information input area 76b of each plant device 6 again to check whether there is an oversight of an abnormal alarm display. You can check through the street.
FIG. 13 shows a display screen of a maintenance inspection data template (in the case of a single-line diagram template), (a) shows an entire display screen of the maintenance inspection data template, and (b) selects and enlarges the display of that one device. Indicates the case.
The single-line diagram template 90 shown in FIG. 13A is the same as the configuration shown in FIG. 12, and the enlarged view shown in FIG. 13B is the same as the configuration of the projection image 78 shown in FIG. Description is omitted.
Incidentally, in the single-line diagram template 90 shown on the display screen, vertical scroll buttons 107 a, 107 b, 107 c and horizontal scroll buttons 108 a, 108 b, 108 c are prepared, and a scroll operation can be performed by operating the operation unit 17. The display range can be moved (step S34: “display according to operation”).

In this state, in the icon button area 106 (see FIG. 5) of the display screen of the display unit 16 of the portable information terminal 2, an icon button for confirming and inputting the end of the inspection of the series of plant devices 6 displayed as “end confirmation”. 106c is displayed.
In step S <b> 35, the portable information terminal 2 checks whether or not the “End Confirmation” icon button of a series of maintenance inspections has been pressed (Is the series maintenance inspection end confirmation button pressed?). When the end confirmation button is pressed (Yes), the process proceeds to step S36, and when not pressed (No), the process returns to step S34.

  In step S <b> 36, the portable information terminal 2 transmits a notification of completion of a series of maintenance inspections to the center information processing server 4. The overall control unit 60 of the center information processing server 4 receives this notification via the communication control unit 51, and writes the maintenance inspection data template in the equipment inspection history information 72 (step S133). As a result, the maintenance inspection data template in which the projection image 78 is written is stored as the equipment inspection history information 72 every time maintenance inspection is performed.

In step S37, the portable information terminal 2 displays on the display unit 16 an unillustrated icon button for “maintenance inspection completed” that ends the maintenance inspection, and this icon button is pressed to check whether the inspection is completed. To do. In the case of termination (Yes), the process proceeds to step S38, the communication with the center information processing server 4 is disconnected, and the series of control is terminated.
In response to this, the center information processing server 4 ends the communication with the portable information terminal 2 (step S134).

  If it is not the end in step S37 (No), the process returns to step S03 in FIG. 6 according to the symbol (I), and for example, what has been inspected according to the single-line diagram template 90 as an object of the plant equipment 6 so far, Maintenance inspection is continued according to another object, for example, a control system surface diagram template.

  Step S110 of the flowchart in the present embodiment corresponds to the mask image search unit and the device display image search unit described in the claims, and step S111 corresponds to the image matching unit described in the claims. S112 corresponds to the inspection area information acquisition unit described in the claims, and step S113 corresponds to the information superimposing unit described in the claims.

  According to this embodiment, in the case of maintenance inspection, when the plant equipment 6 to be inspected is a relay circuit board that controls a pump motor or the like, for example, when the lighting state of the indicator lamp 114 of the relay circuit board is checked, The center information processing server 4 searches the device name 74k (see FIG. 3) of the plant equipment 6 to be controlled based on the data search directory 74 as inspection character information to be displayed on the projection image 78, and the indicator light 114 is displayed. Which pump it is for can be easily discriminated from the projection image 78 (see FIG. 5), and the operator can easily discriminate it without looking through the inspection instructions or the like. Therefore, even an operator who is familiar with the correspondence between the plant system diagram and the single-line diagram of the control panel and does not store it accurately can make an accurate determination.

Also, for example, the inspection area information itself of the received image is automatically pasted into the opening 122 (shown as 122A, 122b, 122C in FIG. 5) of the device display image 76, and used as the device inspection history information 72. Mistakes can be prevented and work quality is improved.
For example, an accurate inspection report can be made even by an operator having a color vision abnormality with respect to a specific color.
Further, for example, since the equipment inspection history information 72 is registered in a form in which the projection image 78 is pasted on the single-line diagram template 90 (see FIG. 13), inspection of the inspection target panel connected to the single-line diagram is performed. The results can be seen at a glance, and you can immediately see where they are changing compared to previous inspection results. In addition, when an abnormality is found in the downstream board on the connection of the single-line diagram, it is easy to identify the cause by looking at the board at the same level as the board or the upstream board.

<Modification>
As a method of recognizing the device identification information of the plant device 6 in the image recognition processing unit 61 of the center information processing server 4 of the present embodiment, the received image 111 received from the portable information terminal 2 (see FIG. 4, but in FIG. 4) In this case, the nameplate 113 on which the device identification information is displayed is printed on the display image 111A and 111B, and the device identification information is recognized from the received image 111. However, the present invention is not limited to this.
For example, the portable information terminal 2 transmits two shot images including the shot image of the nameplate 113 and the shot image including the panel lamp 114 and the panel 115 of the plant equipment 6 to the center information processing server 4. In 61, the device identification information may be recognized from the photographed image of the nameplate 113. As described above, when the device identification information is recognized from the photographed image of the nameplate 113, the characters described on the nameplate 113 can be enlarged and photographed, and the accuracy of recognition of the device identification information is reduced because there is little other information on the board. Will increase.

Further, in the present embodiment, the plant device 6 is a relay panel, a motor control panel, an AVR panel, a control panel, or the like, and the lighting state of the indicator lamp 114 provided on the panel surface is acquired as inspection area information. However, the present invention is not limited to this.
Some control panels are provided with meters such as a voltage meter and a current meter. The indicated value indicated by the indicator needle of the meter may be acquired by image recognition as inspection area information.
In addition, acquisition of the indicator value of a meter is not restricted to an analog meter, and even in the case of digital value display, it can be acquired as inspection area information by image recognition.

It is a block diagram which shows schematic structure of the maintenance inspection system which concerns on this invention. It is a circuit block diagram of the portable information terminal in the maintenance inspection system. It is a figure explaining the structure of the data search directory of a maintenance inspection database. It is an example of a received image and a device mask image corresponding to it. It is an example of an apparatus display image. It is a flowchart which shows the flow of control of preparation of the apparatus inspection history information based on the picked-up image by cooperation with a portable information terminal and a center information processing server. It is a flowchart which shows the flow of control of preparation of the apparatus inspection history information based on the picked-up image by cooperation with a portable information terminal and a center information processing server. It is a flowchart which shows the flow of control of preparation of the apparatus inspection history information based on the picked-up image by cooperation with a portable information terminal and a center information processing server. It is a flowchart which shows the flow of control of preparation of the apparatus inspection history information based on the picked-up image by cooperation with a portable information terminal and a center information processing server. It is a flowchart which shows the flow of control of preparation of the apparatus inspection history information based on the picked-up image by cooperation with a portable information terminal and a center information processing server. It is explanatory drawing which shows the maintenance inspection main screen of a portable information terminal. It is a figure explaining a single line connection diagram template. It is a figure which shows the display screen of a maintenance inspection data template (in the case of a single wire diagram template), (a) shows the whole display screen of a maintenance inspection data template, (b) Selects and enlarges the display of that one device. Indicates the case.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Maintenance inspection system 2 Portable information terminal 3 Network 3a Wireless terminal 3b, 3c Node terminal 4 Center information processing server 5A Equipment manufacturer information server 6 Plant equipment (maintenance inspection target equipment)
7 Server management terminal 13 Processing unit 14 Communication control unit (communication means)
15 Antenna (communication means)
16 Display section (display means)
17 Operation part (input means)
18 Camera section (camera)
19 Projector section (display means)
DESCRIPTION OF SYMBOLS 20 Battery 21 Power supply circuit 27,28 Memory 31 Shooting lens 32 Image sensor 33 Shooting control circuit 34,45 Lens drive circuit 41 Projection control circuit 42 Light source 43 Liquid crystal panel 44 Projection lens 51 Communication control part (communication means)
52 Processing Unit 53 Maintenance Inspection Database (Storage Unit)
60 General Control Unit 61 Image Recognition Processing Unit 62 Projected Image Generation Unit 64 Database Management Unit 71 Plant Equipment Inspection Related Information 72 Equipment Inspection History Information 73 Equipment Inspection Guidance Information 74 Data Search Directory 74a Equipment Identification Information Field 74b Model Code Field 74c Equipment Name Field 74d Equipment mask image field 74e Equipment display image field 74f Data template field 74g Related information field 74h Equipment inspection history field 74i Equipment inspection guidance information field 74k Equipment name field 75, 75A, 75B, 75C Equipment mask image (mask image)
76 device display image 76a display region 76b projection character information input region 78 projection image (device display image for output)
80 Maintenance inspection main screen 81 Screen title field 82 Input field 83, 84 Combo box 83a, 84a Input display window 83b, 84b Option display button 90 Single-line diagram template 91 Power supply line 93 Recording area 95 Device identification information field 101 End button 102 Operation buttons 105, 106a 106b, 106c Icon button 106 Icon button area 111A, 111B, 111C Received image 113 Name plate 114 Indicator 115 Panel 118 Opening 119 Outline 121 Wiring 122A, 122B, 122C Opening 123A, 123B, 123C Identification name 124 Device name 125 Device identification information 126 Date and time information

Claims (3)

A maintenance and inspection system in which a server and a personal digital assistant are connected to each other via a network,
The portable information terminal
Input means;
Display means;
A camera that shoots the maintenance target device;
A communication unit that transmits a captured image of the maintenance inspection target image captured by the camera and information input by the input unit to the server, and receives information transmitted from the server;
With
The server
Communication means for receiving information transmitted from the portable information terminal, and transmitting information to the portable information terminal;
A mask image having an opening for specifying an inspection area of the image of the maintenance / inspection device to be matched with a captured image of the maintenance / inspection target device received from the portable information terminal is used as the device identification information. A mask image storing means for storing correspondingly;
Device display image storage means for storing a device display image for displaying a maintenance inspection result of the maintenance inspection target device in association with the device identification information;
Based on the device identification information received from the portable information terminal, a mask image search means for searching the corresponding mask image from the mask image storage means;
Based on the device identification information received from the portable information terminal, device display image search means for searching a corresponding device display image from the storage means of the device display image;
An image matching means for performing a matching process between the captured image of the maintenance target device received from the portable information terminal and the searched mask image based on the device identification information;
Inspection area information acquisition means for acquiring the inspection area information from the inspection area of the photographed image of the maintenance inspection target device corresponding to the opening of the mask image that has been subjected to matching processing;
Information superimposing means for overwriting and superimposing the acquired inspection area information on a predetermined area corresponding to the opening of the searched device display image, and generating an output device display image;
With
Based on the device identification information of the maintenance / inspection target device received from the portable information terminal and the captured image of the maintenance / inspection target device, the acquired inspection region in the predetermined region of the retrieved device display image A maintenance inspection system, wherein an output device display image generated by overwriting information is transmitted to the portable information terminal and displayed on the display means of the portable information terminal. In the camera of the portable information terminal, it is stored in the captured image including at least the device identification information of the maintenance target device,
The maintenance inspection system according to claim 1, wherein the server includes a device identification information acquisition unit that identifies and acquires the device identification information included in the captured image. The server further comprises a storage unit for maintenance inspection data template for storing at least a template of a single-line diagram.
2. The device display image for output is written in a predetermined area of the template of the single-line diagram based on the device identification information received from the portable information terminal, and used as maintenance inspection history information. The maintenance inspection system according to claim 2.

Images