WO2012046726A1 - Inspection assistance device, inspection assistance system, method of assisting inspection, and inspection assistance program - Google Patents

Inspection assistance device, inspection assistance system, method of assisting inspection, and inspection assistance program Download PDF

Info

Publication number
WO2012046726A1
WO2012046726A1 PCT/JP2011/072870 JP2011072870W WO2012046726A1 WO 2012046726 A1 WO2012046726 A1 WO 2012046726A1 JP 2011072870 W JP2011072870 W JP 2011072870W WO 2012046726 A1 WO2012046726 A1 WO 2012046726A1
Authority
WO
WIPO (PCT)
Prior art keywords
inspection
measuring instrument
information
identification information
measurement
Prior art date
Application number
PCT/JP2011/072870
Other languages
French (fr)
Japanese (ja)
Inventor
憲午 中尾
原田 稔
Original Assignee
新日本製鐵株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 新日本製鐵株式会社 filed Critical 新日本製鐵株式会社
Priority to BR112013006357-2A priority Critical patent/BR112013006357A2/en
Priority to KR1020137005404A priority patent/KR101361934B1/en
Priority to JP2011554321A priority patent/JP5037732B2/en
Publication of WO2012046726A1 publication Critical patent/WO2012046726A1/en

Links

Images

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0208Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterized by the configuration of the monitoring system
    • G05B23/0216Human interface functionality, e.g. monitoring system providing help to the user in the selection of tests or in its configuration
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B23/00Testing or monitoring of control systems or parts thereof
    • G05B23/02Electric testing or monitoring
    • G05B23/0205Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults
    • G05B23/0259Electric testing or monitoring by means of a monitoring system capable of detecting and responding to faults characterized by the response to fault detection
    • G05B23/0267Fault communication, e.g. human machine interface [HMI]
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/10Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people together with the recording, indicating or registering of other data, e.g. of signs of identity
    • GPHYSICS
    • G07CHECKING-DEVICES
    • G07CTIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C3/00Registering or indicating the condition or the working of machines or other apparatus, other than vehicles
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/37Measurements
    • G05B2219/37212Visual inspection of workpiece and tool

Definitions

  • the present invention relates to an inspection support apparatus, an inspection support system, an inspection support method, and an inspection support program.
  • the workers visit the factory equipment site and check the results on the specified format paper on which the inspection items are described. Fill in. In this way, the facilities in the factory are inspected.
  • the worker may forget to measure the measuring instruments.
  • the measuring instrument may be forgotten when the worker to be checked changes.
  • GPS Global Positioning System
  • the measured value of the measuring instrument is transmitted to a management device provided on the ground or managed. Since it is difficult to send instructions to the worker from the equipment, it is not possible to rely on GPS alone.
  • the present invention utilizes an existing analog measuring instrument or a digital measuring instrument connected to a control panel or a computer, and the measured value of the measuring instrument is automatically input at a low cost, and
  • the purpose is to provide an inspection support device, an inspection support system, an inspection support method, and an inspection support program that can prevent an inspection omission of a measuring instrument even when the number of measuring instruments is large or when workers are replaced. .
  • the inspection support device, inspection support system, inspection support method, and inspection support program that solve the above problems are as follows (1) to (15).
  • an inspection support apparatus that supports an inspection operation of an apparatus having a plurality of measuring instruments, and a camera that photographs each of the measuring instruments;
  • a display unit for displaying support information for supporting the inspection work;
  • a storage unit for storing inspection information including identification information of each measuring instrument to be measured; and based on image information of each measuring instrument photographed by the camera And recognizing the identification information and measurement value of each measuring instrument, associating each measurement value with each identification information, and storing it in the storage unit.
  • a processing unit that displays the identification information of the unmeasured measuring instrument on the display unit as the support information when it is determined that there is an unmeasured measuring instrument that is not yet stored in the unit.
  • the camera further photographs the section identification information displayed in the section in which each measuring instrument is arranged;
  • the processing unit displays a warning indicating that the unmeasured measuring instrument remains on the display unit as the support information.
  • the processing unit determines that all the measurements of the measuring instruments in the section have been completed, the apparatus to be inspected next is It is preferable to display the section identification information assigned to the other arranged sections on the display unit.
  • the processing unit causes the voice input / output unit to output the identification information of the unmeasured measuring instrument by voice.
  • the processing unit causes the measurement value to be output from the voice input / output unit and allows the measurement value to be stored. When it is determined that the voice is input to the voice input / output unit by the inspector, the measurement value is preferably stored in the storage unit.
  • the inspection information includes information on a normal value range of each measuring instrument and a cause of failure of each measuring instrument. Failure information about the measurement device; and when the processing unit determines that at least some of the measurement values of each of the measuring devices are out of the normal value range, the measurement value of the measuring device. It is preferable to execute at least one of causing the display unit to display the cause-of-failure information assumed based on the information as the support information and outputting the sound from the voice input / output unit.
  • the failure cause information is based on the measurement value when the processing unit determines that the measurement value is out of the normal value range.
  • the processing unit adds inspection of the additional measuring instrument to the item of the inspection work.
  • the failure cause information includes a measurement value history of each measuring instrument; and the processing unit refers to the failure cause information and performs the measurement.
  • the value history is a downward trend or an upward trend
  • the downward trend or the upward trend is displayed on the display unit as the support information, and the voice input / output unit is configured to output a voice.
  • at least one is performed.
  • the inspection information further includes an inspection item outside the measuring instrument that is a confirmation item other than the measuring instrument; and the failure cause information is the measuring instrument.
  • the processing unit further includes another cause of failure corresponding to an outside inspection item; when the voice of the inspector regarding the inspection item outside the measuring instrument is input to the voice input / output unit, Recognizing the inspection result related to the inspection item outside the measuring instrument, and further, when it is determined that the inspection result means an abnormality of the device, causing other failure causes to be displayed on the display unit as the support information; It is preferable to execute at least one of outputting voice from the voice input / output unit.
  • the inspection support device that supports the inspection work of the device having a plurality of measuring instruments, and the inspection result that stores the inspection result transmitted from the inspection support device
  • An inspection support system having a storage device, wherein the inspection support device is a camera that photographs each of the measuring instruments; a display unit that displays support information that supports the inspection work by an inspector; A storage unit for storing inspection information including identification information of each measuring instrument; and recognizing the identification information and measurement value of each measuring instrument based on image information of each measuring instrument photographed by the camera; When it is determined that there is an unmeasured measuring instrument that is not yet stored in the storage unit among the measuring instruments, the measured value is stored in the storage unit in association with each identification information, Above A processing unit that displays the identification information of the measuring instrument on the display unit as the support information.
  • the inspection result storage device transmits the inspection information to the inspection support device, and the inspection support device includes: A communication unit that receives the measurement values stored in the storage unit;
  • an inspection support method for supporting an inspection work by an inspector of an apparatus having a plurality of measuring instruments, wherein each measuring instrument is photographed.
  • a photographing step for obtaining image information; a recognition step for recognizing identification information and a measurement value of each measuring instrument based on the image information; and a correspondence between each measurement value and the identification information of each measuring instrument
  • a storing step for storing above; a determination step for determining whether or not there is an unmeasured measuring instrument not yet stored in the storage unit among the measuring instruments; and determining that the unmeasured measuring instrument is present in the determining step
  • the apparatus to be inspected next is arranged It is preferable to further include a second notification step of notifying the inspector of the section identification information assigned to the section.
  • a display unit that displays support information that supports an inspection operation of the apparatus, a camera that photographs a plurality of measuring devices provided in the apparatus, and measurement
  • a storage unit for storing inspection information including identification information of each measuring instrument to be used, and an inspection supporting program for use in an inspection supporting apparatus, which is based on image information captured by the camera.
  • the inspection support apparatus can automatically record measurement values of an existing analog measuring instrument or a digital measuring instrument connected to a control panel or a computer at a low cost. In addition, if there are unmeasured measuring instruments, this is displayed to the worker to point out omissions in the inspection items, so even if the number of measuring instruments is large or the workers are replaced, the measuring instruments are not checked. Can be prevented.
  • inspection support device [2] inspection result storage device, [3] inspection information, [4] failure cause information, [5] measuring instrument or device position information, [6] inspection result information, and [7]
  • inspection support processing flows [1] inspection support device, [2] inspection result storage device, [3] inspection information, [4] failure cause information, [5] measuring instrument or device position information, [6] inspection result information, and [7]
  • the inspection support device [1] described below includes inspection information [3], failure cause information [4], measuring instrument or device position information [5], and inspection result information [6] from the inspection result storage device [2]. Then, an inspection support process [7] is performed in which the measurement value of the measuring instrument is acquired by image recognition or the state of the apparatus is acquired by voice recognition from an operator.
  • FIG. 1 is a perspective view showing an example of a worker 5 provided with an inspection support device 100.
  • the worker 5 shown in FIG. 1 wears the helmet 50 provided with the camera 20, wears the voice input / output unit 10 in his ear, and wears the processing terminal 30 in the safety belt 60.
  • the worker 5 can be equipped with an inspection support device without having anything in his hand.
  • the inspection support device 100 automatically acquires the measurement value of the pressure gauge G1 based on the photographed image acquired by the camera 20 only by the operator 5 facing the pressure gauge G1.
  • FIG. 2 is a diagram illustrating an example of a hardware configuration of the inspection support apparatus.
  • the inspection support apparatus 100 supports an inspection operation of an inspected apparatus having a plurality of measuring instruments, and includes a voice input / output unit 10, a camera 20, and a processing terminal 30, as shown in FIGS.
  • the processing terminal 30 includes a communication unit 33, a display unit 34, a processing unit 32, an input unit 35, and a storage unit 31.
  • the camera 20 photographs each measuring instrument (for example, the pressure gauges G1 and G2 shown in FIG. 1).
  • the display unit 34 displays support information for supporting the inspection work by the worker (inspector) 5.
  • the storage unit 31 stores inspection information including identification information (such as an identification number of a measuring instrument and a name of a measuring instrument) for identifying each pressure gauge G1 and G2 to be measured.
  • the processing unit 32 stores the measurement values of the pressure gauges G1 and G2 in the storage unit 31 and displays the identification information of the unmeasured measuring instrument on the display unit 34.
  • the voice input / output unit 10 includes the inner ear microphone 11 and the communication unit 18, and sends the voice of the worker 5 to the processing terminal 30.
  • the voice signal received from the processing terminal 30 and output from the processing terminal 30 is output to the worker 5 by the inner ear microphone 11.
  • the inner ear microphone 11 has both functions of voice input to the processing terminal 30 and voice output from the processing terminal 30 to the worker, and is mounted in the ear hole of the worker 5 as shown in FIG.
  • the eardrum vibrates, so that the sound propagates through the air in the ear canal.
  • the inner ear microphone 11 converts this sound into a digital signal and outputs the digital signal to the communication unit 18.
  • the communication unit 18 inputs the digital signal output from the inner ear microphone 11 to the processing terminal 30. Further, the inner ear microphone 11 outputs the digital signal output from the communication unit 18 as sound, and outputs sound to the worker 5 by vibrating the eardrum of the worker 5.
  • a technique described in Japanese Patent Application Laid-Open No. 2001-157292 an earphone that exhibits a microphone function through air conduction in the ear canal) can be applied to the inner ear microphone 11.
  • the communication unit 18 transmits and receives audio signals to and from the processing terminal 30 wirelessly or by wire.
  • wireless communication technologies applicable to the communication unit 18 include infrared communication such as IrDA (Infrared Data Association), Bluetooth (registered trademark), wireless LAN (Local Area Network), UWB (Ultra Wide Band), WUSB, and the like.
  • technologies such as (Wireless Universal Serial Bus), ZigBee (registered trademark), and FM transmitter.
  • the voice input / output unit 10 enables voice exchange between the processing terminal 30 and the worker 5, the worker 5 uses the voice input / output unit 10 without operating the processing terminal 30 by hand.
  • the processing terminal 30 can be operated orally.
  • the start or stop of the processing terminal 30 is also performed by the worker 5 saying “start” or “stop”.
  • the measurement values of the pressure gauges G1 and G2 recognized by the processing terminal 30 can be input to the storage unit 31 by voice. That is, the processing unit 32 notifies the operator 5 of the “measured values” of the pressure gauges G 1 and G 2 by voice output from the voice input / output unit 10.
  • the worker 5 generates a sound permitting storage of the measured value (for example, a sound “confirmed”), and the processing unit 32 performs measurement when the sound is input to the sound input / output unit 10.
  • the value is stored in the storage unit 312. Further, the processing unit 32 may output both the “identification information” and the “measured value” from the voice input / output unit 10 by voice.
  • the camera 20 is disposed on the head of the worker 5, and has a lens (not shown) having a predetermined focal length and a solid-state imaging device (not shown) such as a CCD (Charge Coupled Device) image sensor. ), And the image passing through the lens is imaged on a solid-state imaging device and is output as image information including a plurality of pixels.
  • the camera 20 transmits the captured image information to the processing terminal 30 via a communication unit (not shown) similar to the communication unit 18 of the voice input / output unit 10. It is important to actually look at the device because there are some inspection items that are insufficient to monitor the measuring instrument with a camera from a remote location. As in the present embodiment, when the worker 5 goes to a place where the pressure gauges (measuring instruments) G1 and G2 are actually arranged, it is possible to check inspection items that are not sufficient only by remote monitoring. .
  • the processing terminal 30 includes a storage unit 31, a processing unit 32, a communication unit 33, a display unit 34, an input unit 35, a charging unit 36, and a sensor 37.
  • the storage unit 31 is, for example, a DRAM (Dynamic Random Access Memory) or an SSD (Solid State Drive) using a flash memory. Data stored in the storage unit 31 will be described later with reference to FIG. Since the number of measuring instruments that can be inspected by the inspection support apparatus 100 is assumed to be a very large number of several tens to several hundreds, the storage unit 31 in the processing terminal 30 includes a plurality of measuring instruments. Only instruments that are checked daily are stored. Moreover, when the measuring instrument to measure changes with days, it is also possible to replace the measuring instrument memorize
  • the processing unit 32 loads the data from the storage unit 31 by executing the program stored in the storage unit 31, calculates the loaded data, and stores the calculation result in the storage unit 31.
  • the processing unit 32 is, for example, a CPU (Central Processing Unit). Specifically, the processing unit 32 executes a program stored in the storage unit 31 to perform voice recognition processing, measurement value recognition processing, and inspection support processing. Each process will be described later.
  • the communication unit 33 has the same function as the communication unit 18 of the inner ear microphone 11 and performs data communication with the camera 20 and the voice input / output unit 10.
  • the display unit 34 is a display device such as a Liquid Crystal Display (LCD), for example.
  • the processing unit 32 outputs a display drive signal for driving the display unit 34 to the display unit 34.
  • the input unit 35 is an operation button that is manually operated by the worker 5, and outputs an input signal generated by pressing the operation button to the processing unit 32.
  • the input signal is, for example, a start or stop input of a voice recognition process or a measuring instrument recognition process, which will be described later, a confirmation input for confirming recognition of a measurement value, a re-recognition input for re-recognizing a measurement value, or the like.
  • the charging unit 36 includes a battery, and when the processing terminal 30 is placed in a cradle described later, the battery 36 charges the battery with electricity supplied from the cradle, and stores information stored in the storage unit 31 and an inspection result described later. It operates as a communication unit when performing synchronization with information stored in the storage device 200.
  • the latitude / longitude information does not necessarily have to be received from the GPS satellite, but the sensor 37 can also receive the latitude / longitude information from the GPS satellite and recognize the position of the processing terminal 30.
  • the sensor 37 has an acceleration sensor, and can detect in which direction the processing terminal 30 is arranged with respect to the longitude / latitude information.
  • the processing unit 32 performs voice recognition on the voice signal transmitted from the voice input / output unit 10 and received by the communication unit 21.
  • the processing unit 32 extracts the content spoken by the worker 5 as character data from the audio signal transmitted from the audio input / output unit 10 using the acoustic model and the language model.
  • the acoustic model represents what frequency characteristics each phoneme to be recognized has, and is associated with what language the phoneme corresponds to.
  • the processing unit 32 can recognize phonemes corresponding to words using this acoustic model.
  • the language model is data representing the appearance probability of each wording.
  • the appearance probability is the probability that the next appearing word will appear after that word on the assumption that a certain word is recognized.
  • 3A to 3D are diagrams showing an example of a measuring instrument to be inspected.
  • 3A to 3D show pressure gauges G1 and G2, a thermometer G3, and a liquid level gauge G4.
  • the processing unit 32 uses the image information received from the camera 20 to identify the pressure gauges G1, G2, thermometer G3, and liquid level gauge G4 included in the inspection information described later ( For example, the identification number of the measuring instrument) is recognized. For example, the processing unit 32 divides the image into certain regions, binarizes the divided regions, and extracts character elements. The processing unit 32 then matches the data obtained by quantifying the features of the extracted character elements with the feature amount data obtained by quantifying the features of the standard characters stored in the storage unit 31, thereby including individual images included in the image. Recognize the characters. By recognizing the character, the processing unit 32 recognizes the identification information of the measuring instrument included in the image information.
  • Measurement value recognition processing When the processing unit 32 recognizes the identification numbers (identification information) of the measuring instruments of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4, the recognized identification number is predetermined.
  • the pressure gauges G1 and G2, the thermometer G3, and the liquid level gauge G4 are identified by comparing with the information in the image area.
  • the processing unit 32 performs pattern matching between the data obtained by performing image processing on the pointers N1 to N3 in the image area and quantifying the data and the feature amount data. Recognize existence and their orientation.
  • the processing unit 32 recognizes the measurement range of the pressure gauges G1, G2 and the thermometer G3. For example, as shown in FIGS. 3A to 3C, when it is known in advance that the pointers N1 to N3 of the pressure gauges G1 and G2 and the thermometer G3 are present below the identification number, the processing unit 32 recognizes the recognized identification.
  • the direction of the pointers N1 to N3 in the lower image area with respect to the information and the measurement ranges of the pressure gauges G1 and G2 and the thermometer G3 are image-recognized.
  • the measurement range of the level gauge G4 and the height position of the liquid level N4 within this measurement range are image-recognized. That is, the processing unit 32 identifies each of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 based on the image information of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 taken by the camera 20.
  • each pressure gauge G1, G2, thermometer G3, liquid level gauge G4 Recognize the measured values of each pressure gauge G1, G2, thermometer G3, liquid level gauge G4, and correspond these measured values to each identification number (PG-101, PG-102, TG-101, LG-101) Then, the data is stored in the storage unit 31.
  • the case where there are four measuring devices has been described above. Actually, there are several tens to several hundreds of measuring devices, and in these measuring devices, the same recognition is performed by the processing unit 32, and the measured values are stored in the storage unit 31. Is remembered.
  • the pressure gauges G1, G2, and the thermometer G3 are provided with markings P1a, P2a, and P3a at the respective graduation positions.
  • a scale plate corresponding to the identification numbers PG-101, PG-102 and TG-101 and a level display corresponding to the identification number LG-101 are registered.
  • the processing unit 32 recognizes an image of the pointer N1 of the pressure gauge located below the identification number “PG-101”.
  • the pressure range of the pressure gauge recognized from the pressure gauge G1 is recognized as “0 to 2 MPa”.
  • the measured value “0.85 MPa” is calculated from the marking P1a and the direction of the pointer N1.
  • the pressure gauge G2 and the thermometer G3 calculate the measured value “0.6 MPa” from the direction of the marking P2a and the pointer N2, and calculate the temperature “125 ° C.” from the direction of the marking P3a and the pointer N3.
  • the measured value “ ⁇ 20%” is calculated from the marking P4a and the liquid level N4.
  • the processing unit 32 determines the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge based on the image information of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4.
  • the identification information and the measured values of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 are recognized, and these measured values are assigned to the identification numbers (PG-101, PG-102, TG-101, LG-101). And stored in the storage unit 31.
  • the positions and the number of markings are not limited to the example described above, and three more markings P1b, P1c, and P1d may be further provided on the scale plate as shown in the pressure gauge G1 in FIG. 3A.
  • the distance D1 from the marking P1b to the marking P1c and the distance D2 from the marking P1a to the marking P1d are stored in the storage unit 31 in advance.
  • the camera 20 captures the scale plate, and the processing unit 32 has the distance from the marking P1b to the marking P1c and the distance from the marking P1a to the marking P1d approximate to the distance D1 stored in the storage unit 31 ( That is, it is determined whether the measuring instrument is photographed from the front. If approximate, the processing unit 32 calculates a measurement value from the marking P1a and the direction of the pointer N1. Thereby, since the camera 20 can recognize the position of the pointer N1 accurately, it is possible to calculate the measurement value with higher accuracy.
  • Inspection support processing includes the normal value range information of the pressure gauges G1, G2 and the thermometer G3, and the failure cause information regarding the failure causes of the pressure gauges G1, G2 and the thermometer G3. It is preferable that it is further included.
  • the processing unit 32 determines that at least a part of the measurement values of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 is outside the normal value range as the inspection support process, Failure cause information assumed based on the measured value is notified to the worker 5 by outputting at least one of voice and image. Specifically, past cases are registered in the processing terminal 30 as failure cause information, and items (failure causes) considered based on the measurement values are displayed on the display unit 34.
  • the failure cause information includes an identification number (identification information) of an additional measuring instrument to be additionally measured that is assumed based on the measured value when the processing unit 32 determines that the measured value is outside the normal value range. ), And the processing unit 32 preferably adds the inspection of the additional measuring instrument to the item of the inspection work.
  • the identification number of the additional measuring instrument is stored in the storage unit 31. Thereby, when the measured value is outside the normal value range, at least one of the display number and the voice of the identification number of the additional measuring instrument is executed as the item of the inspection work, and the worker inspects the displayed measuring instrument.
  • the failure cause information includes the measurement value history of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4.
  • the processing unit 32 displays and voices the downward trend or the upward trend as support information on the display unit 34. At least one of voice output from the input / output unit 10 is executed. Specifically, even when the measured value is within the normal value range, the measured value history is first referred to. In the measured value history, for example, as shown in FIG. 4, the horizontal axis represents measurement time, and the vertical axis represents the measured value.
  • a measured value M1 at the time of previous inspection (time: T1), a measured value M2 at the time of previous inspection (time: T2), and a measured value M3 at the time of current inspection (time: T3) are displayed.
  • the measured values M1, M2, and M3 are all within the range between the upper limit value (HL) and the lower limit value (LL), but are increasing.
  • the processing unit 32 causes at least one of the display on the display unit 34 and the audio output from the audio input / output unit 10 to be in an upward trend. Furthermore, the processing unit 32 extrapolates a time T4 that will exceed the upper limit value based on the three measurement values M1, M2, and M3.
  • the estimated time T4 is displayed on the display unit 34, and the worker 5 knows that treatment such as repair of the device is necessary by the time T4.
  • the inspection information includes failure cause information
  • the problem of the apparatus can be solved in advance.
  • the measurement value history is stored in the storage unit 31, it is possible to reliably transmit information on the measuring instrument to the next worker even if the worker 5 is replaced.
  • the processing unit 32 is further provided as an inspection support process.
  • the processing unit 32 includes an uninspected unmeasured measuring instrument that is not yet stored in the storage unit 31 among the pressure gauges G1, G2, and the thermometer G3, the processing unit 32 32 displays the identification number of the unmeasured measuring instrument on the display unit 34.
  • the voice input / output unit 10 may cause the worker 5 to output the voice of the identification number of the unmeasured measuring instrument as support information.
  • the processing unit 32 displays an error message on the display unit 34 or an error alarm when the operator 5 measures a measuring instrument that does not require measurement (a measuring instrument other than the measuring instrument stored in the storage unit 31). May be output from the voice input / output unit 10. Details of the inspection support process will be described later together with an explanation of information stored in the storage unit 31 and a processing flow.
  • the worker 5 faces the pressure gauge G1, for example.
  • the inspection support apparatus 100 recognizes the pressure gauge identification information “PG-101” and outputs a recognition sound to the voice input / output unit 10 when recognizing the measurement value “0.8 MPa” of the pressure gauge G1. Then, the measurement value recognition is output to the worker 5 by voice or image. Thereafter, the measured value “0.8 MPa” is automatically input to the inspection support apparatus 100.
  • the operator 5 faces the pressure gauge G2, and the measured value of the pressure gauge G2 is input to the inspection support apparatus 100.
  • the worker 5 inputs the measurement values from the plurality of measuring instruments, confirms the plurality of input values on the display unit 34 of the processing terminal 30, and performs the definite input by the input unit 35.
  • the automatic measurement value input is confirmed by the operator 5 by the processing terminal 30.
  • FIG. although a confirmation input operation is not necessarily required, the measurement value can be reliably input to the inspection support apparatus 100 by performing the confirmation input with the input unit 35.
  • the inspection support system includes an inspection support device 100 and an inspection result storage device 200.
  • FIG. 5 is a diagram illustrating an example of an inspection result storage device.
  • the inspection result storage device 200 is an information processing device that stores the inspection result transmitted from the above-described inspection support device 100, and includes a processing unit 210, a storage unit 220, a communication unit 230, a secondary storage device 240, A drive device 250 and an input / output controller 260 are included.
  • the inspection result storage device 200 is connected to the cradle 420 via the network 400.
  • the inspection result storage device 200 can synchronize with the information in the processing terminal 30 via the cradle 420.
  • the cradle 420 can transmit / receive data to / from the inspection result storage device 200 via the network 400, and supplies power supplied from the power source 430 to the inspection support device 100.
  • the processing unit 210 is, for example, a CPU.
  • the input / output controller 260 is a unit that controls connection between the processing unit 210 and other units.
  • the input / output controller 260 operates in accordance with a standard such as PCI Express (Peripheral Component Interconnect Express).
  • the storage unit 220 is a device that stores data and programs.
  • the storage unit 220 is, for example, a DRAM.
  • the secondary storage device 240 is a device that can store programs and data stored in the storage unit 220 and can retain information even when power is not supplied.
  • the secondary storage device 240 is a disk array using a magnetic disk, an SSD using a flash memory, or the like.
  • the communication unit 230 transmits the inspection information to the inspection support device 100 and receives each measurement value stored in the storage unit 31 of the inspection support device 100. Specifically, the communication unit 230 transmits and receives data to and from the processing terminal 30 connected to the network 400 and connected to the cradle 420.
  • the drive device 250 is a device that reads and writes a storage medium 290 such as a CD-ROM (Compact Disc Only Memory), a DVD (Digital Versatile Disc), and the like.
  • the drive device 250 includes a motor that rotates the storage medium 290, a head that reads and writes data on the storage medium 290, and the like.
  • the storage medium 290 can store a program.
  • the drive device 250 reads a program from the storage medium 290 set in the drive device 250.
  • the processing unit 210 stores the program read by the drive device 250 in the storage unit 220 or the secondary storage device 240 and transmits the program to the processing terminal 30 via the communication unit 230 and the cradle 420. Therefore, the program stored in the processing terminal 30 can be provided as the storage medium 290.
  • FIG. 6 is a diagram illustrating an example of a memory map of the storage unit.
  • the storage unit 31 stores inspection information 600, failure cause information 700, inspection result information 800, measuring instrument or device position information 900, sound and image recognition information 950, and a program 990.
  • the program 990 is executed by the processing unit 32 and transmitted from the inspection result storage device 200 via the cradle 420.
  • the speech and image recognition information 950 includes feature amount data, a language model, an acoustic model, and the like, which are information necessary for speech recognition, measurement device recognition, and measurement value recognition.
  • the inspection information 600, failure cause information 700, inspection result information 800, measuring instrument or device position information 900 will be described below.
  • FIG. 7 is a diagram illustrating an example of inspection information.
  • the inspection information 600 shown in FIG. 7 includes “line number”, “measurement device or device identification information”, “normal value range”, “measurement device measurement value”, “device inspection item”, and “device inspection result”. It has a row number column 601, a measuring instrument or device identification information column 603, a normal value range column 605, a measuring instrument measurement value column 607, an apparatus inspection item column 609, and an apparatus inspection result column 611. Data having a corresponding relationship is input to each line of the inspection information 600.
  • inspection items to be inspected by the worker are shown.
  • the inspection results collected by the operator using the inspection support apparatus 100 for the inspection items are registered.
  • the inspection information 600 when the inspection support device 100 is set in the cradle 420, the previous inspection information 600 is transmitted to the inspection result storage device 200, and the next inspection information 600 is stored in the storage unit 31.
  • the in the newly stored inspection information 600 data of inspection items of measuring instruments to be inspected by the operator 5 in one inspection operation is input.
  • the processing unit 32 When the operator 5 does not inspect the measuring instrument to be measured, that is, the processing unit 32 is still stored in the storage unit 31 with respect to the data of the inspection item of the measuring instrument input to the inspection information 600. When it is determined that there is no unmeasured measuring instrument, it is preferable to output a warning (alarm) to the worker 5 via at least one of the voice input / output unit 10 and the display unit 34.
  • the timing for outputting the warning is, for example, 1) When the sensor 37 recognizes from the latitude / longitude information of the GPS that the worker 5 has moved away from the device or measuring instrument to be inspected by a certain distance 2) When the operation is completed by operating the input unit 35 even though there are uninspected items, 3) When the inspection support device 100 is set in the cradle 420 even though there are uninspected items, and 4) in each room For example, when the measurement of the measuring instrument is completed. Since 1) uses GPS, it may be difficult to output a warning if there is a worker 5 in the basement. Therefore, 2) to 4) are preferred. Especially, 4) should be checked next. Since the room may be located far away, the unmeasured measuring instrument can be recognized before the worker 5 goes to the next room.
  • a room number (section identification number) is displayed inside the door of the entrance / exit of the room (section) where a plurality of measuring instruments are arranged.
  • the camera 20 captures the room number displayed in the room.
  • the processing unit 32 causes the display unit 34 to display a warning indicating that an unmeasured measuring instrument remains in the room as support information.
  • the processing unit 32 determines that the measurement of each measuring instrument in the room is completed, the processing unit 32 displays the room number assigned to the other section where the device to be checked next is arranged on the display unit 34. It is preferable to display.
  • the inspection items collected by the operator using the inspection support apparatus 100 include “inspection items for measuring instruments” and “inspection items for apparatus states” that are not measuring instruments. In the following, description will be made separately for “inspection items for measuring instruments” and “inspection items for apparatus status”.
  • Inspection item of measuring device “Measurement device or device identification information” indicates a measuring device or device to be checked, and “Normal value range” indicates a normal value range of the measuring device to be checked.
  • the inspection support apparatus 100 When the inspection support apparatus 100 recognizes the measurement instrument identification information from the image captured by the camera 20, the inspection support apparatus 100 inputs the measurement value recognized in the "measurement measurement value" on the same line as the recognized measurement instrument identification information.
  • the recognized measuring instrument identification information includes, for example, the identification numbers “PG-101” and “PG-102” displayed on the upper portions of the pressure gauges G1 and G2 and the thermometer G3 which are measuring instruments shown in FIGS. 3A to 3D. , “TG-101”, “LG-101”.
  • the recognized measurement values are, for example, the measurement values of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 shown in FIGS. 3A to 3D.
  • Normal value range is a reference value for determining whether or not an image-recognized measurement value is an abnormal value.
  • the inspection support apparatus 100 reads out the failure cause associated with the recognized measuring instrument identification information with reference to the failure cause information 700 as shown in FIG. Then, at least one of the display on the display unit 34 and the audio output by the audio input / output unit 10 is executed. The inspection support apparatus 100 executes this processing in response to an input to the measurement information inspection information 600.
  • the processing unit 32 outputs the cause of the failure to the worker as a sound or an image.
  • the inspection information preferably includes an inspection item outside the measuring instrument that is a confirmation item other than the measuring instrument, that is, an inspection item of the device.
  • the “device inspection item” indicates an inspection item for the device to be inspected, which is input to the “measurement device or device identification information string” by the worker 5.
  • the failure cause information is, for example, an inspection item to be inspected visually by the worker 5 "oil leak from the pump” or an inspection item to be inspected by the olfaction of the operator 5 Such as “Odor from pump” and “Motor casing amplitude” measured by the operator 5 using a vibration meter, etc.
  • the processing unit 32 When the voice of the worker 5 regarding the device inspection item is input to the voice input / output unit 10, the processing unit 32 recognizes the inspection result regarding the device inspection item based on this voice. Further, when the processing unit 32 determines that the inspection result indicates an abnormality of the apparatus, the processing unit 32 displays at least the cause of the failure as support information on the display unit 34 and outputs the voice from the voice input / output unit 10. Run one.
  • FIG. 8 is a diagram showing an example of an apparatus to be inspected.
  • a motor device 300 that is an inspection target device shown in FIG. 8 is a device having a motor casing 305 and an oil pit 310. As shown in FIG. 8, a device that does not have a measuring instrument is also an inspection target.
  • “Equipment inspection result” is an inspection result for “Equipment inspection item (outside measuring instrument inspection item)”.
  • the inspection result for the device inspection item “oil leakage from the pump P101” is “present” or “not present”, and the inspection result for the device inspection item “motor casing amplitude” is “50 ⁇ m”.
  • FIG. 9 is a diagram illustrating an example of failure cause information.
  • the failure cause information 700 shown in FIG. 9 includes a row number column 701 to which “row number”, “measurement device or device identification information”, and “failure cause information” are input, a measurement device or device identification information column 703, a failure It has a cause information column 705. In each row of the failure cause information 700, data having a corresponding relationship is input.
  • the cause of failure that may occur when the measuring instrument is out of the normal value range is input.
  • the cause of failure is “oil leakage from the piping”, “liquid leakage to the oil pit”, “the oil level in the oil tank is low”, etc.
  • the processing unit 32 outputs the cause of the failure as a sound or an image via the sound input / output unit 10 or the display unit 34.
  • the worker 5 not only simply outputs the sound or image of the abnormality, but also checks the sound or the image output against the actual state of the device to check what is the cause of the abnormality at the time of the abnormality. can do.
  • such support processing is useful for the worker 5 who does not know the response processing when an abnormality occurs.
  • FIG. 10 is a diagram illustrating an example of inspection result information.
  • the inspection result information 800 illustrated in FIG. 10 includes a row number column 801, a measuring device or device identification information column 803, and an inspection result column for inputting “row number”, “measurement device or device identification information”, and “inspection result”, respectively. 805. Data having a corresponding relationship is input to each row of the inspection result information 800.
  • the measurement value “130 ° C.” that is the latest measurement data (the nth data, n is a natural number) in the third row is within the normal value range shown in FIG.
  • the (n-1) -th and (n-2) -th data which are measurement data at the time of the past inspection, tend to rise to “110 ° C.” and “120 ° C.”, respectively.
  • the processing unit 32 generates an interpolation curve from the past measurement data and the latest measurement data, and predicts that the measurement value after the next inspection exceeds the normal value range because the generated interpolation curve tends to increase or decrease.
  • the worker 5 is sounded or outputted as an image indicating that the measurement value has an upward tendency or a downward tendency.
  • the processing unit 32 outputs a sound or an image indicating that the measurement value has an upward trend or a downward trend, and also outputs a cause of failure related to the measuring instrument determined to be an upward trend or a downward trend to the worker 5 by voice or image output. Good.
  • the device position information 900 is not necessarily required. However, as described above, when the sensor 37 receives latitude / longitude information from a GPS satellite, the device position information 900 is stored in the storage unit 31. Preferably it is stored. In this case, the measuring instrument or device position information 900 shown in FIG. 11 includes a row number column 901 for inputting “row number”, “measuring device or device identification information”, and “measuring device or device position”. A device identification information column 903 and a measuring instrument or device position column 905 are included. Data corresponding to each other is input to each row of the measuring instrument or device position information 900.
  • the processing terminal 30 includes inspection information 600 stored in the inspection result storage device 200, failure cause information 700, inspection result information 800, measuring instrument or device position information 900, sound and image recognition information 950, and a program 990.
  • the information is transmitted from the storage device 200 and stored.
  • the processing terminal 30 starts to recognize the measurement value of the measuring instrument.
  • This program 990 stores a procedure for recognizing the identification number (identification information) and measurement value of each measuring instrument based on the image information captured by the camera 20, and the measurement value in association with the identification number of each measuring instrument.
  • the procedure to be stored in the unit 31 the procedure for determining the presence or absence of an unmeasured measuring instrument that is not yet stored in the storage unit 31 among the measuring instruments, and the determination that there is an unmeasured measuring instrument.
  • the worker 5 takes the processing terminal 30 from the cradle 420 (step S01).
  • the room number is photographed by the camera 20 (first photographing step: step S02).
  • the processing unit 32 determines whether or not the room number (section identification number) captured by the camera 20 is the room number in the inspection order (step S03).
  • the photographed room number is not the room number in the inspection order (“No” in step S03)
  • the correct room number is notified by at least one of display and sound (step 04).
  • the process returns to step 02.
  • the apparatus is inspected (step S05).
  • step S21 determines whether or not the device to be inspected next has a measuring instrument.
  • the worker 5 stands in front of the pressure gauge G1, and the camera 20 photographs the identification number and measuring instrument of the pressure gauge G1 (imaging process: step S22).
  • the processing terminal 30 Based on the image information of the measuring instrument photographed by the operator 5, the processing terminal 30 recognizes an image of the pointer N1 of the pressure gauge G1 at a predetermined position with respect to the recognized identification number, and obtains the measured value of the pressure gauge G1. Recognize (recognition process: step S23).
  • the processing unit 32 determines whether or not the identification number recognized by the camera 20 is a measuring instrument according to the inspection order (step S24).
  • the recognized identification number is not the identification number of the measuring instrument in accordance with the inspection order (“No” in step S24)
  • the correct identification number (or name of the measuring instrument) of the correct measuring instrument is displayed and / or voice output. (Step S25).
  • the process returns to step S22.
  • the recognized identification number is the identification number of the measuring instrument according to the inspection order (“Yes” in step S24)
  • the identification number and the measured value are displayed on the display unit 34 (step S26).
  • the worker 5 confirms the displayed identification number and measurement value, and if the identification number and measurement value are correct, the operator 5 generates a “confirmed” sound.
  • step S27 it is determined whether or not the “confirmed” voice of the worker 5 is obtained within a predetermined time. If the sound of “determined” is not obtained within a predetermined time or if the worker 5 utters “invalid”, a re-inspection is instructed (step S28), and the process returns to step 22. Next, the processing terminal 30 determines whether or not the measured value is within the reference value range (step S29).
  • the processing terminal 30 refers to the failure cause information 700 to determine the cause of failure related to the measuring instrument indicating the measured value outside the normal value range.
  • a voice or image is output to the member (step S31).
  • the processing terminal 30 tends to decrease or increase according to the previous measurement value history and the current measurement value as shown in FIG. Further, it is determined whether or not the measured value is out of the normal value range in the next and subsequent measurements (step S30).
  • the processing terminal 30 determines that the measured value is not within the normal value range in the subsequent measurements (“No” in step S30)
  • the processing terminal 30 refers to the failure cause information 700 and relates to this measuring instrument.
  • the cause of the failure is output to the worker 5 by voice or image (step S31).
  • step S30 When the measurement value is within the normal value range in the measurement after the next inspection (“Yes” in step S30), or after executing step S31, the processing terminal 30 confirms the measurement value in association with the identification number. Then, the measured value is input to the inspection information 600 of the storage unit 31, and the inspection result is stored (storage process: step S32).
  • step S31 If the inspection item is not a measuring instrument (“No” in step S21), as shown in FIG. 14, inspection items other than the measuring instrument, that is, device inspection items are confirmed (step S31).
  • the processing unit 32 inputs the inspection result regarding the device inspection item based on this voice (step S32).
  • the processing unit 32 determines that the inspection result indicates an abnormality of the device (“Yes” in step S33)
  • the processing unit 32 causes the display unit 34 to display the cause of the failure related to the device, and the voice input / output unit 10 At least one of outputting is executed (step S34).
  • the inspection result is stored (storage process: step S35).
  • the processing unit 32 is other than the measuring instrument and measuring instrument arranged in the room.
  • the processing terminal 30 uses the voice input / output unit 10 or the display unit 34 to inform the operator of the identification number of the unmeasured measuring instrument. Notification is made by at least one of image output (first notification step: step S34). After the notification, the process returns to step S21.
  • step S33 “Yes”) the inspection of the device in the room is completed, and as shown in FIG. 12, the room number is photographed by the camera 20 when leaving (step S06).
  • the processing unit 32 determines whether all the inspection items in the room have been inspected, and when the inspection items remain (“No” in step S07), the processing unit 32 returns to step S05. If no inspection items remain (“Yes” in step S07), the processing unit 32 determines whether inspection of all rooms has been completed (step S08). When the inspection of all the rooms has not been completed (“No” in step S08), the room number (section identification information) assigned to the other room where the apparatus to be inspected next is arranged is notified (No. 1).
  • Step S09 the process returns to Step S02.
  • the worker 5 is notified to place the processing terminal 30 on the cradle 420 and finish the inspection (step S10).
  • the processing unit 32 determines whether or not the processing terminal 30 is placed on the cradle 420. If not placed (“No” in step S11), the processing unit 32 returns to step S10.
  • the processing terminal 30 transmits the inspection information to the inspection result storage device 200, thereby ending the inspection support process.
  • the inspection support method includes at least an imaging process, a recognition process, a storage process, a determination process, It is preferable to provide 1 alerting

Abstract

An inspection assistance device (100) is provided with a camera (20) which picks up an image of each measurement device; a display device (34) which displays assistance information assisting with the inspection work by the person inspecting; a storage unit (31) which stores inspection information including identification information for each measurement device that should be measured; and a processing unit (32) which identifies the respective identification information and a measurement value for each measurement device on the basis of the image information for each measurement device picked up by the camera (20), stores measurement values and identification information in the storage device (31) while associating each measurement value with the respective identification information, and furthermore, when it is determined that among the measurement devices there is an unmeasured measurement device, which is not yet stored in the storage device (31), causes the display unit (34) to display the identification information of the unmeasured measurement device as assistance information.

Description

点検支援装置、点検支援システム、点検支援方法、及び点検支援プログラムInspection support device, inspection support system, inspection support method, and inspection support program
 本発明は、点検支援装置、点検支援システム、点検支援方法、及び点検支援プログラムに関する。
 本願は、2010年10月05日に、日本に出願された特願2010-225709号に基づき優先権を主張し、その内容をここに援用する。
The present invention relates to an inspection support apparatus, an inspection support system, an inspection support method, and an inspection support program.
This application claims priority based on Japanese Patent Application No. 2010-225709 filed in Japan on October 05, 2010, the contents of which are incorporated herein by reference.
 工場には、回転機器、加熱圧延機器、静的機器などの機器が設置されており、工場の安全運転上、これらの機器の定期的な点検が必要になる。また、これらの機器の計測器は、DCS(Distributed Control System)等のシステムで遠隔監視されるものもあるが、遠隔監視の対象外でかつ、現場でのみ測定値の確認が可能な現場計測器や、現場計測器でも点検できない点検項目もある。 In the factory, equipment such as rotating equipment, heating and rolling equipment, and static equipment is installed, and periodic inspection of these equipment is necessary for safe operation of the factory. Some of these instruments are remotely monitored by systems such as DCS (Distributed Control System), but they are not subject to remote monitoring and can be measured only on site. There are also inspection items that cannot be inspected even with on-site measuring instruments.
 現場計測器の測定値の確認や、現場計測器でも点検できない点検項目の確認を行なうために、作業員は、工場設備現場を巡回して、点検項目が記載される所定のフォーマット紙に点検結果を記入する。このようにして、工場内設備の点検がなされている。 In order to confirm the measured values of the on-site measuring instruments and the inspection items that cannot be inspected even with the on-site measuring instruments, the workers visit the factory equipment site and check the results on the specified format paper on which the inspection items are described. Fill in. In this way, the facilities in the factory are inspected.
 或いは、作業員が現場計測器の検針時に読み上げる音声を音声認識し、音声認識により生成した音声信号を、コンピュータが認識できるデータに変換することで、点検作業を支援する装置も提案されている。 Alternatively, an apparatus that supports an inspection work by recognizing a voice read by a worker at the time of meter reading of an on-site measuring instrument and converting a voice signal generated by the voice recognition into data that can be recognized by a computer has been proposed.
日本国特開平11-228047号公報Japanese Unexamined Patent Publication No. 11-228047 日本国特開2009-32206号公報Japanese Unexamined Patent Publication No. 2009-32206
 紙に点検結果を記入する方法では、作業員による記入ミスが生じる。そのため、正確な点検結果が蓄積されず、工場設備の安全運転上必要な、機器の経年劣化等の正確な実績情報も得られにくい。 In the method of filling the inspection results on the paper, there will be a mistake in the entry by the worker. Therefore, accurate inspection results are not accumulated, and it is difficult to obtain accurate performance information such as aging deterioration of equipment necessary for safe operation of factory equipment.
 また、作業員が検針した測定値を音声認識する装置の場合、作業員が測定値を誤って読み上げてしまうと、誤った測定値がコンピュータに格納されてしまう。 Also, in the case of a device that recognizes a measured value read by a worker by voice, if the worker reads out the measured value by mistake, the wrong measured value is stored in the computer.
 さらには、測定する計測器の数が多いため、作業員が計測器を測定し忘れる場合ある。また、専門の作業員が行う点検ではないため、点検する作業員が代わることによって、計測器を測定し忘れる場合がある。また、GPS(Global Positioning System)では位置情報が得られない場所(例えば、地下)に計測器が配置されている場合、地上に設けられた管理機器に計測器の測定値を送信したり、管理機器から作業員に指示を送ったりすることが難しいため、GPSのみに頼ることができない。 Furthermore, since the number of measuring instruments to be measured is large, the worker may forget to measure the measuring instruments. In addition, since the inspection is not performed by a specialized worker, the measuring instrument may be forgotten when the worker to be checked changes. In addition, when a measuring instrument is placed in a location (for example, underground) where position information cannot be obtained by GPS (Global Positioning System), the measured value of the measuring instrument is transmitted to a management device provided on the ground or managed. Since it is difficult to send instructions to the worker from the equipment, it is not possible to rely on GPS alone.
 そこで、上記問題に鑑みて、本発明は、既設のアナログ計測器、あるいは、制御盤やコンピュータに接続しているデジタル計測器を活用し、計測器の測定値が低コストで自動入力され、かつ、計測器の数が多い場合や作業員が代わる場合でも、計測器の点検漏れを防止することが可能な点検支援装置、点検支援システム、点検支援方法、及び点検支援プログラムの提供を目的とする。 Therefore, in view of the above problem, the present invention utilizes an existing analog measuring instrument or a digital measuring instrument connected to a control panel or a computer, and the measured value of the measuring instrument is automatically input at a low cost, and The purpose is to provide an inspection support device, an inspection support system, an inspection support method, and an inspection support program that can prevent an inspection omission of a measuring instrument even when the number of measuring instruments is large or when workers are replaced. .
 上記の課題を解決する点検支援装置、点検支援システム、点検支援方法、及び点検支援プログラムは、次の(1)~(15)の通りである。 The inspection support device, inspection support system, inspection support method, and inspection support program that solve the above problems are as follows (1) to (15).
(1)本発明の一態様に係る点検支援装置によれば、複数の計測器を有する装置の点検作業を支援する点検支援装置であって、前記各計測器を撮影するカメラと;点検者による前記点検作業を支援する支援情報を表示する表示部と;測定すべき前記各計測器の識別情報を含む点検情報を記憶する記憶部と;前記カメラが撮影した前記各計測器の画像情報に基づいて前記各計測器それぞれの前記識別情報及び測定値を認識し、前記各測定値を前記各識別情報と対応付けた上で前記記憶部に記憶させ、さらに、前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器があると判断した場合に、前記未測定計測器の前記識別情報を前記支援情報として前記表示部に表示させる処理部と;を備える。
(2)上記(1)に記載の点検支援装置によれば、前記カメラが、前記各計測器が配置されている区画内に表示された区画識別情報をさらに撮影し;前記区画内に前記未測定計測器が残っている場合に、前記処理部が、前記未測定計測器が残っていることを示す警告を前記支援情報として前記表示部に表示させることが好ましい。
(1) According to the inspection support apparatus according to an aspect of the present invention, an inspection support apparatus that supports an inspection operation of an apparatus having a plurality of measuring instruments, and a camera that photographs each of the measuring instruments; A display unit for displaying support information for supporting the inspection work; a storage unit for storing inspection information including identification information of each measuring instrument to be measured; and based on image information of each measuring instrument photographed by the camera And recognizing the identification information and measurement value of each measuring instrument, associating each measurement value with each identification information, and storing it in the storage unit. And a processing unit that displays the identification information of the unmeasured measuring instrument on the display unit as the support information when it is determined that there is an unmeasured measuring instrument that is not yet stored in the unit.
(2) According to the inspection support apparatus described in (1) above, the camera further photographs the section identification information displayed in the section in which each measuring instrument is arranged; When the measurement measuring instrument remains, it is preferable that the processing unit displays a warning indicating that the unmeasured measuring instrument remains on the display unit as the support information.
(3)上記(2)に記載の点検支援装置によれば、前記処理部は、前記区画内の前記各計測器の測定が全て完了したと判断した場合に、次に点検すべき前記装置が配置されている他の区画に割り当てられた前記区画識別情報を前記表示部に表示させることが好ましい。
(4)上記(1)から(3)のいずれか1項に記載の点検支援装置によれば、音声を入力及び出力する音声入出力部をさらに備えることが好ましい。
(5)上記(4)に記載の点検支援装置によれば、前記処理部が、前記音声入出力部に、前記未測定計測器の前記識別情報を音声で出力させることが好ましい。
(6)上記(4)または(5)に記載の点検支援装置によれば、前記処理部は、前記測定値を前記音声入出力部から音声出力させ、かつ、前記測定値の記憶を許可する前記音声が前記点検者により前記音声入出力部に入力されたと判断した場合に、前記測定値を前記記憶部に記憶させることが好ましい。
(3) According to the inspection support apparatus described in (2) above, when the processing unit determines that all the measurements of the measuring instruments in the section have been completed, the apparatus to be inspected next is It is preferable to display the section identification information assigned to the other arranged sections on the display unit.
(4) According to the inspection support apparatus described in any one of (1) to (3), it is preferable to further include a voice input / output unit that inputs and outputs voice.
(5) According to the inspection support apparatus described in (4) above, it is preferable that the processing unit causes the voice input / output unit to output the identification information of the unmeasured measuring instrument by voice.
(6) According to the inspection support apparatus described in (4) or (5) above, the processing unit causes the measurement value to be output from the voice input / output unit and allows the measurement value to be stored. When it is determined that the voice is input to the voice input / output unit by the inspector, the measurement value is preferably stored in the storage unit.
(7)上記(4)から(6)のいずれか1項に記載の点検支援装置によれば、前記点検情報は、前記各計測器の正常値範囲の情報と、前記各計測器の障害原因に関する障害原因情報とをさらに含み;前記処理部は、前記各計測器のうちの少なくとも一部の前記測定値が、前記正常値範囲外であると判断した場合に、この計測器の前記測定値に基づいて想定される前記障害原因情報を、前記支援情報として前記表示部に表示させることと、前記音声入出力部から音声出力させることとの少なくとも一方を実行する;ことが好ましい。
(8)上記(7)に記載の点検支援装置によれば、前記障害原因情報は、前記測定値が前記正常値範囲外であると前記処理部により判断された場合に、前記測定値に基づいて想定される追加して計測すべき追加計測器の識別情報を含み;前記処理部が、前記点検作業の項目に前記追加計測器の点検を追加する;ことが好ましい。
(9)上記(7)に記載の点検支援装置によれば、前記障害原因情報は、前記各計測器の測定値履歴を含み;前記処理部は、前記障害原因情報を参照して、前記測定値履歴が下降傾向又は上昇傾向であると判断した場合に、前記下降傾向又は前記上昇傾向を、前記支援情報として前記表示部に表示させることと、前記音声入出力部から音声出力させることとの少なくとも一方を実行する;ことが好ましい。
(10)上記(7)に記載の点検支援装置によれば、前記点検情報は、前記各計測器以外の確認項目である計測器外点検項目をさらに含み;前記障害原因情報が、前記計測器外点検項目に対応した他の障害原因をさらに含み;前記処理部は、前記計測器外点検項目に関する前記点検者の前記音声が前記音声入出力部に入力された場合に、この音声に基づいて前記計測器外点検項目に関する点検結果を認識し、さらに、前記点検結果が前記装置の異常を意味すると判断した場合に、他の障害原因を、前記支援情報として前記表示部に表示させることと、前記音声入出力部から音声出力させることとの少なくとも一方を実行する;ことが好ましい。
(7) According to the inspection support apparatus according to any one of (4) to (6), the inspection information includes information on a normal value range of each measuring instrument and a cause of failure of each measuring instrument. Failure information about the measurement device; and when the processing unit determines that at least some of the measurement values of each of the measuring devices are out of the normal value range, the measurement value of the measuring device. It is preferable to execute at least one of causing the display unit to display the cause-of-failure information assumed based on the information as the support information and outputting the sound from the voice input / output unit.
(8) According to the inspection support apparatus described in (7) above, the failure cause information is based on the measurement value when the processing unit determines that the measurement value is out of the normal value range. It is preferable that identification information of an additional measuring instrument to be additionally measured that is supposed to be included is included; and the processing unit adds inspection of the additional measuring instrument to the item of the inspection work.
(9) According to the inspection support apparatus according to (7), the failure cause information includes a measurement value history of each measuring instrument; and the processing unit refers to the failure cause information and performs the measurement. When it is determined that the value history is a downward trend or an upward trend, the downward trend or the upward trend is displayed on the display unit as the support information, and the voice input / output unit is configured to output a voice. Preferably, at least one is performed.
(10) According to the inspection support apparatus described in (7) above, the inspection information further includes an inspection item outside the measuring instrument that is a confirmation item other than the measuring instrument; and the failure cause information is the measuring instrument. The processing unit further includes another cause of failure corresponding to an outside inspection item; when the voice of the inspector regarding the inspection item outside the measuring instrument is input to the voice input / output unit, Recognizing the inspection result related to the inspection item outside the measuring instrument, and further, when it is determined that the inspection result means an abnormality of the device, causing other failure causes to be displayed on the display unit as the support information; It is preferable to execute at least one of outputting voice from the voice input / output unit.
(11)本発明の一態様に係る点検支援システムによれば、複数の計測器を有する装置の点検作業を支援する点検支援装置と、この点検支援装置から送信される点検結果を格納する点検結果格納装置とを有する点検支援システムであって、前記点検支援装置が、前記各計測器を撮影するカメラと;点検者による前記点検作業を支援する支援情報を表示する表示部と;測定すべき前記各計測器の識別情報を含む点検情報を記憶する記憶部と;前記カメラが撮影した前記各計測器の画像情報に基づいて前記各計測器それぞれの前記識別情報及び測定値を認識し、前記各測定値を前記各識別情報と対応付けた上で前記記憶部に記憶させ、さらに、前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器があると判断した場合に、前記未測定計測器の前記識別情報を前記支援情報として前記表示部に表示させる処理部と;を備え、前記点検結果格納装置が、前記点検支援装置に前記点検情報を送信するとともに、前記点検支援装置の前記記憶部に記憶された前記各測定値を受信する通信部を有する。 (11) According to the inspection support system according to one aspect of the present invention, the inspection support device that supports the inspection work of the device having a plurality of measuring instruments, and the inspection result that stores the inspection result transmitted from the inspection support device An inspection support system having a storage device, wherein the inspection support device is a camera that photographs each of the measuring instruments; a display unit that displays support information that supports the inspection work by an inspector; A storage unit for storing inspection information including identification information of each measuring instrument; and recognizing the identification information and measurement value of each measuring instrument based on image information of each measuring instrument photographed by the camera; When it is determined that there is an unmeasured measuring instrument that is not yet stored in the storage unit among the measuring instruments, the measured value is stored in the storage unit in association with each identification information, Above A processing unit that displays the identification information of the measuring instrument on the display unit as the support information. The inspection result storage device transmits the inspection information to the inspection support device, and the inspection support device includes: A communication unit that receives the measurement values stored in the storage unit;
(12)本発明の一態様に係る点検支援方法によれば、複数の計測器を備えた装置の、点検者による点検作業を支援する点検支援方法であって、前記各計測器を撮影して画像情報を得る撮影工程と;前記画像情報に基づいて、前記各計測器それぞれの識別情報及び測定値を認識する認識工程と;前記各測定値を前記各計測器の前記識別情報と対応付けた上で記憶する記憶工程と;前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器の有無を判断する判断工程と;前記判断工程において前記未測定計測器が有ると判断された場合に、前記未測定計測器の前記識別情報を前記点検者に報知する第1報知工程と;を備える。
(13)上記(12)に記載の点検支援方法によれば、前記記憶工程の前に、前記各計測器が配置されている区画内に表示された区画識別情報を撮影する第1撮影工程と;前記記憶工程の後に、前記区画内の全ての前記各計測器の測定が終了した後、前記区画内に表示された前記区画識別情報を撮影する第2撮影工程と;をさらに備え、前記区画内に前記未測定計測器が残っている場合に、前記第2撮影工程の直後に前記第1報知工程を実施することが好ましい。
(14)上記(13)に記載の点検支援方法によれば、前記区画内の前記各計測器の測定が全て完了したと判断した場合に、次に点検すべき前記装置が配置されている他の区画に割り当てられた前記区画識別情報を前記点検者に報知する第2報知工程をさらに備えることが好ましい。
(12) According to the inspection support method according to one aspect of the present invention, there is provided an inspection support method for supporting an inspection work by an inspector of an apparatus having a plurality of measuring instruments, wherein each measuring instrument is photographed. A photographing step for obtaining image information; a recognition step for recognizing identification information and a measurement value of each measuring instrument based on the image information; and a correspondence between each measurement value and the identification information of each measuring instrument A storing step for storing above; a determination step for determining whether or not there is an unmeasured measuring instrument not yet stored in the storage unit among the measuring instruments; and determining that the unmeasured measuring instrument is present in the determining step A first notification step of notifying the inspector of the identification information of the unmeasured measuring instrument.
(13) According to the inspection support method described in (12) above, the first imaging step of imaging the zone identification information displayed in the zone where the measuring devices are arranged before the storage step; A second photographing step of photographing the section identification information displayed in the section after measurement of all the measuring instruments in the section is completed after the storing step; It is preferable that the first notification step is performed immediately after the second imaging step when the unmeasured measuring instrument remains in the inside.
(14) According to the inspection support method described in (13) above, when it is determined that the measurement of each measuring instrument in the section has been completed, the apparatus to be inspected next is arranged It is preferable to further include a second notification step of notifying the inspector of the section identification information assigned to the section.
(15)本発明の一態様に係る点検支援プログラムによれば、装置の点検作業を支援する支援情報を表示する表示部と、前記装置に設けられた複数の計測器を撮影するカメラと、測定すべき前記各計測器の識別情報を含む点検情報を記憶する記憶部と、を有する点検支援装置に用いられる点検支援プログラムであって、前記カメラが撮影した画像情報に基づいて前記各計測器の前記識別情報及び測定値を認識する手順と;前記測定値を前記各計測器の前記識別情報と対応付けた上で前記記憶部に記憶させる手順と;前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器の有無を判断する手順と;前記未測定計測器が有ると判断された場合に、前記未測定計測器の前記識別情報を前記支援情報として前記表示部に表示させる手順と;を備える。 (15) According to the inspection support program according to one aspect of the present invention, a display unit that displays support information that supports an inspection operation of the apparatus, a camera that photographs a plurality of measuring devices provided in the apparatus, and measurement A storage unit for storing inspection information including identification information of each measuring instrument to be used, and an inspection supporting program for use in an inspection supporting apparatus, which is based on image information captured by the camera. A procedure for recognizing the identification information and the measurement value; a procedure for storing the measurement value in the storage unit after associating the measurement value with the identification information of each measurement device; A procedure for determining the presence or absence of an unmeasured measuring instrument that is not yet stored; and when it is determined that there is the unmeasured measuring instrument, the identification information of the unmeasured measuring instrument is displayed on the display unit as the support information Hand When; comprises.
 本発明の上記態様に係る点検支援装置は、既設のアナログ計測器、あるいは、制御盤やコンピュータに接続しているデジタル計測器の測定値を低コストで自動記録することができる。さらには、未測定計測器が有った場合にこれを作業員に表示して点検項目の漏れを指摘するため、計測器の数が多い場合や作業員が代わる場合でも、計測器の点検抜けを防止することが可能である。 The inspection support apparatus according to the above aspect of the present invention can automatically record measurement values of an existing analog measuring instrument or a digital measuring instrument connected to a control panel or a computer at a low cost. In addition, if there are unmeasured measuring instruments, this is displayed to the worker to point out omissions in the inspection items, so even if the number of measuring instruments is large or the workers are replaced, the measuring instruments are not checked. Can be prevented.
本発明の一実施形態に係る点検支援装置を備えた作業員の一例を示す斜視図である。It is a perspective view which shows an example of the worker provided with the inspection assistance apparatus which concerns on one Embodiment of this invention. 同点検支援装置のハードウェア構成の一例を示す図である。It is a figure which shows an example of the hardware constitutions of the inspection assistance apparatus. 同点検支援装置によって点検対象となる計測器の一例を示す図である。It is a figure which shows an example of the measuring device used as the inspection object by the inspection assistance apparatus. 同点検支援装置によって点検対象となる計測器の一例を示す図である。It is a figure which shows an example of the measuring device used as the inspection object by the inspection assistance apparatus. 同点検支援装置によって点検対象となる計測器の一例を示す図である。It is a figure which shows an example of the measuring device used as the inspection object by the inspection assistance apparatus. 同点検支援装置によって点検対象となる計測器の一例を示す図である。It is a figure which shows an example of the measuring device used as the inspection object by the inspection assistance apparatus. 同点検支援装置の処理部により、正常値範囲外となる時刻を測定値履歴に基づいて推定した場合を示すグラフである。It is a graph which shows the case where the time which becomes outside a normal value range is estimated based on the measured value history by the processing part of the inspection support device. 本発明の一実施形態に係る点検支援システムにおける点検結果格納装置の一例を示す図である。It is a figure which shows an example of the inspection result storage apparatus in the inspection assistance system which concerns on one Embodiment of this invention. 同点検支援装置の記憶部のメモリマップの一例を示す図である。It is a figure which shows an example of the memory map of the memory | storage part of the inspection assistance apparatus. 同記憶部に記憶される点検情報の一例を示す図である。It is a figure which shows an example of the inspection information memorize | stored in the memory | storage part. 同点検支援装置の点検対象となる装置の一例を示す斜視図である。It is a perspective view which shows an example of the apparatus used as the inspection object of the inspection assistance apparatus. 同点検支援装置の点検情報に含まれる障害原因情報の一例を示す図である。It is a figure which shows an example of the failure cause information contained in the inspection information of the inspection assistance apparatus. 同点検結果格納装置に格納された点検結果情報の一例を示す図である。It is a figure which shows an example of the inspection result information stored in the inspection result storage apparatus. 同計測器又は装置位置情報の一例を示す図である。It is a figure which shows an example of the measuring device or apparatus position information. 同点検支援装置の処理端末により実行される点検支援処理フローの全体を示すフローチャートである。It is a flowchart which shows the whole inspection support process flow performed by the processing terminal of the same inspection support apparatus. 図12に示すフローチャートのステップS05として行われるサブルーチンを示すフローチャートである。It is a flowchart which shows the subroutine performed as step S05 of the flowchart shown in FIG. 図13に示すサブルーチンの続きを示すフローチャートである。14 is a flowchart showing a continuation of the subroutine shown in FIG. 13.
 以下、〔1〕点検支援装置、〔2〕点検結果格納装置、〔3〕点検情報、〔4〕障害原因情報、〔5〕計測器又は装置位置情報、〔6〕点検結果情報、及び〔7〕点検支援処理フローに分けて、本発明に係る一実施形態を順に説明する。 Hereinafter, [1] inspection support device, [2] inspection result storage device, [3] inspection information, [4] failure cause information, [5] measuring instrument or device position information, [6] inspection result information, and [7] The embodiment according to the present invention will be described in order, divided into inspection support processing flows.
 以下に説明する点検支援装置〔1〕は、点検結果格納装置〔2〕から、点検情報〔3〕、障害原因情報〔4〕、計測器又は装置位置情報〔5〕、点検結果情報〔6〕を受け取り、計測器の測定値を画像認識して取得するか又は装置の状態を作業員から音声認識して取得する点検支援処理〔7〕を実行する。 The inspection support device [1] described below includes inspection information [3], failure cause information [4], measuring instrument or device position information [5], and inspection result information [6] from the inspection result storage device [2]. Then, an inspection support process [7] is performed in which the measurement value of the measuring instrument is acquired by image recognition or the state of the apparatus is acquired by voice recognition from an operator.
 〔1〕点検支援装置
 まず、本実施形態に係る点検支援装置について説明する。図1は、点検支援装置100を備えた作業員5の一例を示す斜視図である。
 図1に示す作業員5は、カメラ20が設けられたヘルメット50を装着し、耳に音声入出力部10を装着し、安全帯60に処理端末30を装着する。図1に示すように、作業員5は、手に何も持つことなく、点検支援装置を装備することができる。後述するように、作業員5が圧力計G1に対峙するだけで、点検支援装置100が、そのカメラ20により取得された撮影画像に基づいて圧力計G1の測定値を自動的に取得する。
[1] Inspection Support Device First, the inspection support device according to the present embodiment will be described. FIG. 1 is a perspective view showing an example of a worker 5 provided with an inspection support device 100.
The worker 5 shown in FIG. 1 wears the helmet 50 provided with the camera 20, wears the voice input / output unit 10 in his ear, and wears the processing terminal 30 in the safety belt 60. As shown in FIG. 1, the worker 5 can be equipped with an inspection support device without having anything in his hand. As will be described later, the inspection support device 100 automatically acquires the measurement value of the pressure gauge G1 based on the photographed image acquired by the camera 20 only by the operator 5 facing the pressure gauge G1.
 図2は、点検支援装置のハードウェア構成の一例を示す図である。点検支援装置100は、複数の計測器を有する被点検装置の点検作業を支援し、図1及び図2に示すように、音声入出力部10と、カメラ20と、処理端末30とを有する。処理端末30は、通信部33、表示部34、処理部32、入力部35、及び記憶部31を有する。このカメラ20は、各測定器(例えば、図1に示す圧力計G1,G2)を撮影する。表示部34は、作業員(点検者)5による点検作業を支援する支援情報を表示する。記憶部31は、測定すべき各圧力計G1,G2を見分けるための識別情報(計測器の識別番号や計測器の名称等)を含む点検情報を記憶する。処理部32は、圧力計G1,G2の測定値を記憶部31に記憶させ、未測定計測器の識別情報を表示部34に表示させる。 FIG. 2 is a diagram illustrating an example of a hardware configuration of the inspection support apparatus. The inspection support apparatus 100 supports an inspection operation of an inspected apparatus having a plurality of measuring instruments, and includes a voice input / output unit 10, a camera 20, and a processing terminal 30, as shown in FIGS. The processing terminal 30 includes a communication unit 33, a display unit 34, a processing unit 32, an input unit 35, and a storage unit 31. The camera 20 photographs each measuring instrument (for example, the pressure gauges G1 and G2 shown in FIG. 1). The display unit 34 displays support information for supporting the inspection work by the worker (inspector) 5. The storage unit 31 stores inspection information including identification information (such as an identification number of a measuring instrument and a name of a measuring instrument) for identifying each pressure gauge G1 and G2 to be measured. The processing unit 32 stores the measurement values of the pressure gauges G1 and G2 in the storage unit 31 and displays the identification information of the unmeasured measuring instrument on the display unit 34.
 〔1.1〕音声入出力部
 音声入出力部10は、図2に示すように、内耳マイク11と通信部18とを備えており、処理端末30に対して作業員5の音声を内耳マイク11により音声入力し、処理端末30から受信した音声信号を、同じく内耳マイク11により作業員5に対して出力する。内耳マイク11は、処理端末30に対する音声入力と、処理端末30から作業員への音声出力との両方の機能を備え、図1に示したように作業員5の耳孔内に装着される。作業員5が音声を発声する際に鼓膜が振動することによって、耳孔内の空気中を音声が伝播する。内耳マイク11は、この音声をデジタル信号に変換し、デジタル信号を通信部18に出力する。通信部18は、内耳マイク11から出力されたデジタル信号を処理端末30に入力する。また、内耳マイク11は、通信部18から出力されたデジタル信号を音声として出力し、作業員5の鼓膜を振動させることで、作業員5に音声を出力する。内耳マイク11には、例えば特開2001-157292号公報に記載される技術(耳孔内の空気伝導を介してマイク機能を発揮するイヤホン)を適用することができる。
[1.1] Voice Input / Output Unit As shown in FIG. 2, the voice input / output unit 10 includes the inner ear microphone 11 and the communication unit 18, and sends the voice of the worker 5 to the processing terminal 30. The voice signal received from the processing terminal 30 and output from the processing terminal 30 is output to the worker 5 by the inner ear microphone 11. The inner ear microphone 11 has both functions of voice input to the processing terminal 30 and voice output from the processing terminal 30 to the worker, and is mounted in the ear hole of the worker 5 as shown in FIG. When the worker 5 utters the sound, the eardrum vibrates, so that the sound propagates through the air in the ear canal. The inner ear microphone 11 converts this sound into a digital signal and outputs the digital signal to the communication unit 18. The communication unit 18 inputs the digital signal output from the inner ear microphone 11 to the processing terminal 30. Further, the inner ear microphone 11 outputs the digital signal output from the communication unit 18 as sound, and outputs sound to the worker 5 by vibrating the eardrum of the worker 5. For example, a technique described in Japanese Patent Application Laid-Open No. 2001-157292 (an earphone that exhibits a microphone function through air conduction in the ear canal) can be applied to the inner ear microphone 11.
 通信部18は、処理端末30に対して無線又は有線で音声信号を送受信する。通信部18に適用できる無線通信技術の例として、IrDA(Infrared Data Association)等の赤外線通信や、Bluetooth(登録商標)や、無線LAN(Local Area Network)や、UWB(Ultra Wide Band)や、WUSB(Wireless Universal Serial Bus)や、ZigBee(登録商標)や、FMトランスミッター等の技術がある。 The communication unit 18 transmits and receives audio signals to and from the processing terminal 30 wirelessly or by wire. Examples of wireless communication technologies applicable to the communication unit 18 include infrared communication such as IrDA (Infrared Data Association), Bluetooth (registered trademark), wireless LAN (Local Area Network), UWB (Ultra Wide Band), WUSB, and the like. There are technologies such as (Wireless Universal Serial Bus), ZigBee (registered trademark), and FM transmitter.
 音声入出力部10は、処理端末30と作業員5との間の音声のやりとりを可能にするので、作業員5は、処理端末30を手で操作することなく、音声入出力部10を用いて、処理端末30を口頭で操作することができる。例えば、処理端末30の起動又は停止も、作業員5が「起動」又は「停止」と発声することで行う。また、処理端末30が認識した圧力計G1,G2の各測定値の記憶部31への入力も、音声により行うことが可能である。すなわち、処理部32は、圧力計G1,G2の「測定値」を作業員5に音声入出力部10からの音声出力により報知する。そして、作業員5が測定値の記憶を許可する音声(例えば、「確定」という音声)を発生し、処理部32は、この音声が音声入出力部10に入力されたと認識した場合に、測定値を記憶部312に記憶させる。また、処理部32は、「識別情報」と「測定値」との両方を音声入出部10から音声出力させても良い。 Since the voice input / output unit 10 enables voice exchange between the processing terminal 30 and the worker 5, the worker 5 uses the voice input / output unit 10 without operating the processing terminal 30 by hand. Thus, the processing terminal 30 can be operated orally. For example, the start or stop of the processing terminal 30 is also performed by the worker 5 saying “start” or “stop”. In addition, the measurement values of the pressure gauges G1 and G2 recognized by the processing terminal 30 can be input to the storage unit 31 by voice. That is, the processing unit 32 notifies the operator 5 of the “measured values” of the pressure gauges G 1 and G 2 by voice output from the voice input / output unit 10. Then, the worker 5 generates a sound permitting storage of the measured value (for example, a sound “confirmed”), and the processing unit 32 performs measurement when the sound is input to the sound input / output unit 10. The value is stored in the storage unit 312. Further, the processing unit 32 may output both the “identification information” and the “measured value” from the voice input / output unit 10 by voice.
 〔1.2〕カメラ
 カメラ20は、作業員5の頭部に配置されており、所定の焦点距離のレンズ(図示略)と、CCD(Charge Coupled Device)イメージセンサなどの固体撮像素子(図示略)とを有しており、レンズを通した映像は固体撮像素子に結像され、それを複数の画素からなる画像情報として出力する。カメラ20は、音声入出力部10の通信部18と同様の通信部(図示略)を介して、処理端末30に撮影した画像情報を送信する。
 計測器を遠隔地からカメラで監視するだけでは不十分な点検項目もあるため、実際に装置を目視することが重要である。本実施形態のように、作業員5が、実際に圧力計(計測器)G1,G2が配置されている場所へ行くことにより、遠隔監視だけでは足りない点検項目も点検することが可能となる。
[1.2] Camera The camera 20 is disposed on the head of the worker 5, and has a lens (not shown) having a predetermined focal length and a solid-state imaging device (not shown) such as a CCD (Charge Coupled Device) image sensor. ), And the image passing through the lens is imaged on a solid-state imaging device and is output as image information including a plurality of pixels. The camera 20 transmits the captured image information to the processing terminal 30 via a communication unit (not shown) similar to the communication unit 18 of the voice input / output unit 10.
It is important to actually look at the device because there are some inspection items that are insufficient to monitor the measuring instrument with a camera from a remote location. As in the present embodiment, when the worker 5 goes to a place where the pressure gauges (measuring instruments) G1 and G2 are actually arranged, it is possible to check inspection items that are not sufficient only by remote monitoring. .
 〔1.3〕処理端末
 処理端末30は、記憶部31、処理部32、通信部33、表示部34、入力部35、充電部36、センサ37を有する。
[1.3] Processing Terminal The processing terminal 30 includes a storage unit 31, a processing unit 32, a communication unit 33, a display unit 34, an input unit 35, a charging unit 36, and a sensor 37.
 記憶部31は、例えば、DRAM(Dynamic Random Access Memory)又はフラッシュメモリを用いたSSD(Solid State Drive)である。記憶部31に格納されるデータについては、図5を用いて後述する。
 点検支援装置100によって点検可能な計測器の個数としては、数十~数百個と非常に多い数が想定されるので、処理端末30内の記憶部31には、複数の計測器のうち、日常点検する計測器のみが記憶されている。また、日によって、測定する計測器が変わる場合は、記憶部31に記憶されている計測器を入れ替えることも可能である。
The storage unit 31 is, for example, a DRAM (Dynamic Random Access Memory) or an SSD (Solid State Drive) using a flash memory. Data stored in the storage unit 31 will be described later with reference to FIG.
Since the number of measuring instruments that can be inspected by the inspection support apparatus 100 is assumed to be a very large number of several tens to several hundreds, the storage unit 31 in the processing terminal 30 includes a plurality of measuring instruments. Only instruments that are checked daily are stored. Moreover, when the measuring instrument to measure changes with days, it is also possible to replace the measuring instrument memorize | stored in the memory | storage part 31. FIG.
 処理部32は、記憶部31に記憶されたプログラムを実行することで、記憶部31からデータをロードし、ロードしたデータを演算して、記憶部31に演算結果を格納する。処理部32は、例えば、CPU(Central Processing Unit)である。具体的には、処理部32は、記憶部31に格納されるプログラムを実行して、音声認識処理、測定値認識処理、及び、点検支援処理を行う。各処理については、後述する。 The processing unit 32 loads the data from the storage unit 31 by executing the program stored in the storage unit 31, calculates the loaded data, and stores the calculation result in the storage unit 31. The processing unit 32 is, for example, a CPU (Central Processing Unit). Specifically, the processing unit 32 executes a program stored in the storage unit 31 to perform voice recognition processing, measurement value recognition processing, and inspection support processing. Each process will be described later.
 通信部33は、内耳マイク11の通信部18と同様の機能を有し、カメラ20及び音声入出力部10とデータ通信する。 The communication unit 33 has the same function as the communication unit 18 of the inner ear microphone 11 and performs data communication with the camera 20 and the voice input / output unit 10.
 表示部34は、例えば、Liquid Crystal Display(LCD)などの表示デバイスである。処理部32は、表示部34を駆動するための表示駆動信号を、表示部34に出力する。 The display unit 34 is a display device such as a Liquid Crystal Display (LCD), for example. The processing unit 32 outputs a display drive signal for driving the display unit 34 to the display unit 34.
 入力部35は、作業員5が手で操作する操作ボタンであり、操作ボタンの押下により生じる入力信号を、処理部32に出力する。入力信号とは、例えば、後述の音声認識処理又は計測器認識処理の開始又は停止入力、測定値の認識を確定する確定入力や、測定値を再認識させる再認識入力などである。 The input unit 35 is an operation button that is manually operated by the worker 5, and outputs an input signal generated by pressing the operation button to the processing unit 32. The input signal is, for example, a start or stop input of a voice recognition process or a measuring instrument recognition process, which will be described later, a confirmation input for confirming recognition of a measurement value, a re-recognition input for re-recognizing a measurement value, or the like.
 充電部36は、電池を有し、処理端末30を後述するクレイドルに配置したときに、クレイドルから供給された電気を電池に充電するとともに、記憶部31に格納される情報と、後述の点検結果格納装置200に格納される情報との同期を行う際の通信部として動作する。 The charging unit 36 includes a battery, and when the processing terminal 30 is placed in a cradle described later, the battery 36 charges the battery with electricity supplied from the cradle, and stores information stored in the storage unit 31 and an inspection result described later. It operates as a communication unit when performing synchronization with information stored in the storage device 200.
 本実施形態において、GPS衛星から緯度経度情報を必ずしも受信しなくても良いが、センサ37は、GPS衛星から緯度経度情報を受信して、処理端末30の位置を認識することも可能である。また、センサ37は、加速度センサを有しており、処理端末30が経度緯度情報に対して、どの向きに配置されるかを検出することができる。 In the present embodiment, the latitude / longitude information does not necessarily have to be received from the GPS satellite, but the sensor 37 can also receive the latitude / longitude information from the GPS satellite and recognize the position of the processing terminal 30. The sensor 37 has an acceleration sensor, and can detect in which direction the processing terminal 30 is arranged with respect to the longitude / latitude information.
 〔1.3.1〕音声認識処理
 処理部32は、音声入出力部10から送信され、通信部21によって受信された音声信号に対する音声認識を行う。処理部32は、音響モデル及び言語モデルを利用して、音声入出力部10から送信された音声信号より、作業員5が話した内容を文字データとして取り出す。音響モデルとは、認識対象の音素がそれぞれどのような周波数特性を持っているかを表しており、音素がどうような言葉に対応しているかが対応付けられている。処理部32は、この音響モデルを用いて言葉に対応する音素を認識することができる。言語モデルとは、各文言の出現確率を表すデータである。出現確率は、ある文言が認識されたことを前提に、その文言に続いて次に出現する文言が出る確率である。言語モデルを用いることにより、音響モデルのみに基づいて音声認識する場合に比べて、音声の認識効率が向上する。
[1.3.1] Voice Recognition Processing The processing unit 32 performs voice recognition on the voice signal transmitted from the voice input / output unit 10 and received by the communication unit 21. The processing unit 32 extracts the content spoken by the worker 5 as character data from the audio signal transmitted from the audio input / output unit 10 using the acoustic model and the language model. The acoustic model represents what frequency characteristics each phoneme to be recognized has, and is associated with what language the phoneme corresponds to. The processing unit 32 can recognize phonemes corresponding to words using this acoustic model. The language model is data representing the appearance probability of each wording. The appearance probability is the probability that the next appearing word will appear after that word on the assumption that a certain word is recognized. By using the language model, the speech recognition efficiency is improved as compared with the case of performing speech recognition based only on the acoustic model.
 図3A~図3Dは、点検対象となる計測器の一例を示す図である。図3A~図3Dには、圧力計G1及びG2、温度計G3,液面計G4が示される。 3A to 3D are diagrams showing an example of a measuring instrument to be inspected. 3A to 3D show pressure gauges G1 and G2, a thermometer G3, and a liquid level gauge G4.
 〔1.3.2〕計測器認識処理
 処理部32は、カメラ20から受信した画像情報から、後述する点検情報に含まれる圧力計G1,G2,温度計G3,液面計G4の識別情報(例えば、計測器の識別番号)を認識する。例えば、処理部32は、画像を一定の領域に分割し、分割領域を、2値化し、文字要素を抽出する。そして、処理部32は、抽出した文字要素の特徴を定量化したデータと、記憶部31に記憶された標準文字の特徴を定量化した特徴量データとをマッチングすることにより、画像に含まれる個別の文字を認識する。文字を認識することで、処理部32は、画像情報に含まれる計測器の識別情報を認識する。具体的には、カメラ20が圧力計G1,G2,温度計G3,液面計G4を撮影することによって、処理部は、圧力計G1の「PG-101」、圧力計G2の「PG-102」、圧力計G3の「TG-101」、液面計G4の「LG-101」をそれぞれ認識する。
[1.3.2] Measuring instrument recognition processing The processing unit 32 uses the image information received from the camera 20 to identify the pressure gauges G1, G2, thermometer G3, and liquid level gauge G4 included in the inspection information described later ( For example, the identification number of the measuring instrument) is recognized. For example, the processing unit 32 divides the image into certain regions, binarizes the divided regions, and extracts character elements. The processing unit 32 then matches the data obtained by quantifying the features of the extracted character elements with the feature amount data obtained by quantifying the features of the standard characters stored in the storage unit 31, thereby including individual images included in the image. Recognize the characters. By recognizing the character, the processing unit 32 recognizes the identification information of the measuring instrument included in the image information. Specifically, when the camera 20 photographs the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4, the processing unit “PG-101” of the pressure gauge G1 and “PG-102” of the pressure gauge G2. ”,“ TG-101 ”of the pressure gauge G3, and“ LG-101 ”of the liquid level gauge G4.
 〔1.3.3〕測定値認識処理
 処理部32は、圧力計G1,G2,温度計G3,液面計G4の計測器の識別番号(識別情報)を認識すると、認識した識別番号を所定の画像領域にある情報と対比することで、圧力計G1,G2,温度計G3,液面計G4を識別する。
 圧力計G1,G2,温度計G3の場合、処理部32は、画像領域にある指針N1~N3を画像処理して定量化したデータと、特徴量データとをパターンマッチングにより、指針N1~N3の存在やそれらの向きなどを認識する。すなわち、圧力計G1,G2,温度計G3の識別情報と対応付けられる圧力計G1,G2,温度計G3の測定範囲と、認識した指針N1~N3の向きとを認識する。また、圧力計G1,G2,温度計G3には計測範囲が文字で示されている。この文字を、計測器認識処理と同様に画像認識することで、処理部32は、圧力計G1,G2,温度計G3の測定範囲を画像認識する。例えば、図3A~図3Cに示すように、識別番号の下部に、圧力計G1,G2,温度計G3の指針N1~N3があることが予め判っている場合、処理部32は、認識した識別情報に対する下部の画像領域にある指針N1~N3の向きと、圧力計G1,G2,温度計G3の測定範囲とを画像認識する。また、図3Dに示す液面計G4の場合は、液面計G4の測定範囲と、この測定範囲内における液面N4の高さ位置とを画像認識する。
 すなわち、処理部32は、カメラ20が撮影した圧力計G1,G2,温度計G3,液面計G4の画像情報に基づいて圧力計G1,G2,温度計G3,液面計G4それぞれの識別番号及び各圧力計G1,G2,温度計G3,液面計G4の測定値を認識し、これらの測定値を各識別番号(PG-101、PG-102、TG-101,LG-101)と対応付けた上で記憶部31に記憶させる。
 以上、計測器が4つの場合について説明したが、実際には数十~数百もの計測器があり、これらの計測器においても処理部32により同様の認識が行われ、測定値が記憶部31に記憶される。
[1.3.3] Measurement value recognition processing When the processing unit 32 recognizes the identification numbers (identification information) of the measuring instruments of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4, the recognized identification number is predetermined. The pressure gauges G1 and G2, the thermometer G3, and the liquid level gauge G4 are identified by comparing with the information in the image area.
In the case of the pressure gauges G1, G2, and the thermometer G3, the processing unit 32 performs pattern matching between the data obtained by performing image processing on the pointers N1 to N3 in the image area and quantifying the data and the feature amount data. Recognize existence and their orientation. That is, the measurement ranges of the pressure gauges G1, G2, and the thermometer G3 associated with the identification information of the pressure gauges G1, G2, and the thermometer G3 and the orientations of the recognized hands N1 to N3 are recognized. In addition, the measurement ranges are indicated by letters in the pressure gauges G1, G2, and the thermometer G3. By recognizing an image of this character in the same manner as the measuring instrument recognition process, the processing unit 32 recognizes the measurement range of the pressure gauges G1, G2 and the thermometer G3. For example, as shown in FIGS. 3A to 3C, when it is known in advance that the pointers N1 to N3 of the pressure gauges G1 and G2 and the thermometer G3 are present below the identification number, the processing unit 32 recognizes the recognized identification. The direction of the pointers N1 to N3 in the lower image area with respect to the information and the measurement ranges of the pressure gauges G1 and G2 and the thermometer G3 are image-recognized. In the case of the level gauge G4 shown in FIG. 3D, the measurement range of the level gauge G4 and the height position of the liquid level N4 within this measurement range are image-recognized.
That is, the processing unit 32 identifies each of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 based on the image information of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 taken by the camera 20. Recognize the measured values of each pressure gauge G1, G2, thermometer G3, liquid level gauge G4, and correspond these measured values to each identification number (PG-101, PG-102, TG-101, LG-101) Then, the data is stored in the storage unit 31.
The case where there are four measuring devices has been described above. Actually, there are several tens to several hundreds of measuring devices, and in these measuring devices, the same recognition is performed by the processing unit 32, and the measured values are stored in the storage unit 31. Is remembered.
 次に、計測器の測定値の算出方法について説明する。
 図3A~図3Cに示すように、圧力計G1,G2,温度計G3には、各目盛位置にマーキングP1a,P2a,P3aがそれぞれ設けられており、図3Dに示すように液面計G4には、上限(+20%)と下限(-50%)との少なくとも一方にマーキングP4aが設けられている(図示例では、上限にマーキングP4a)。また、処理端末30には、識別番号PG-101、PG-102、TG-101に対応した目盛板、識別番号LG-101に対応したレベル表示が登録されている。これらの構成により、カメラ20が圧力計G1の識別番号「PG-101」を認識すると、処理部32は、識別番号「PG-101」の下部にある圧力計の指針N1を画像認識し、同様に圧力計G1から画像認識される圧力計の測定範囲「0~2MPa」を認識する。そして、マーキングP1aと指針N1の向きとから測定値「0.85MPa」を算出する。
 圧力計G2,温度計G3も同様に、マーキングP2aと指針N2の向きとから測定値「0.6MPa」を算出し、マーキングP3aと指針N3の向きとから温度「125℃」を算出する。また、液面計G4の場合、マーキングP4aと液面N4とから測定値「-20%」を算出する。
Next, a method for calculating the measurement value of the measuring instrument will be described.
As shown in FIGS. 3A to 3C, the pressure gauges G1, G2, and the thermometer G3 are provided with markings P1a, P2a, and P3a at the respective graduation positions. As shown in FIG. Is provided with a marking P4a on at least one of the upper limit (+ 20%) and the lower limit (−50%) (in the illustrated example, the marking P4a is the upper limit). In the processing terminal 30, a scale plate corresponding to the identification numbers PG-101, PG-102 and TG-101 and a level display corresponding to the identification number LG-101 are registered. With these configurations, when the camera 20 recognizes the identification number “PG-101” of the pressure gauge G1, the processing unit 32 recognizes an image of the pointer N1 of the pressure gauge located below the identification number “PG-101”. The pressure range of the pressure gauge recognized from the pressure gauge G1 is recognized as “0 to 2 MPa”. Then, the measured value “0.85 MPa” is calculated from the marking P1a and the direction of the pointer N1.
Similarly, the pressure gauge G2 and the thermometer G3 calculate the measured value “0.6 MPa” from the direction of the marking P2a and the pointer N2, and calculate the temperature “125 ° C.” from the direction of the marking P3a and the pointer N3. In the case of the liquid level gauge G4, the measured value “−20%” is calculated from the marking P4a and the liquid level N4.
 このように、処理部32は、カメラ20が撮影した圧力計G1,G2,温度計G3,液面計G4の画像情報に基づいて各圧力計G1,G2,温度計G3,液面計それぞれの識別情報及び各圧力計G1,G2,温度計G3,液面計G4の測定値を認識し、これらの測定値を各識別番号(PG-101、PG-102、TG-101,LG-101)と対応付けた上で記憶部31に記憶させる。
 また、マーキングの位置や個数は上述した例のみに限らず、図3Aの圧力計G1に示すように、さらに3つのマーキングP1b,P1c,P1dが目盛板にさらに設けられていても良い。この構成の場合、予め、マーキングP1bからマーキングP1cまでの距離D1及びマーキングP1aからマーキングP1dまでの距離D2を記憶部31に記憶させておく。そして、カメラ20が目盛板を撮影し、処理部32は、マーキングP1bからマーキングP1cまでの距離及びマーキングP1aからマーキングP1dまでの距離が記憶部31に記憶されている距離D1に近似しているか(すなわち、正面から計測器を撮影しているか)を判断する。近似している場合、処理部32は、マーキングP1aと指針N1の向きとから測定値を算出する。これにより、カメラ20は、指針N1の位置を正確に認識することができるため、より精度良く測定値を算出することが可能である。
As described above, the processing unit 32 determines the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge based on the image information of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4. The identification information and the measured values of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 are recognized, and these measured values are assigned to the identification numbers (PG-101, PG-102, TG-101, LG-101). And stored in the storage unit 31.
Further, the positions and the number of markings are not limited to the example described above, and three more markings P1b, P1c, and P1d may be further provided on the scale plate as shown in the pressure gauge G1 in FIG. 3A. In the case of this configuration, the distance D1 from the marking P1b to the marking P1c and the distance D2 from the marking P1a to the marking P1d are stored in the storage unit 31 in advance. Then, the camera 20 captures the scale plate, and the processing unit 32 has the distance from the marking P1b to the marking P1c and the distance from the marking P1a to the marking P1d approximate to the distance D1 stored in the storage unit 31 ( That is, it is determined whether the measuring instrument is photographed from the front. If approximate, the processing unit 32 calculates a measurement value from the marking P1a and the direction of the pointer N1. Thereby, since the camera 20 can recognize the position of the pointer N1 accurately, it is possible to calculate the measurement value with higher accuracy.
 〔1.3.4〕点検支援処理
 上述した点検情報は、圧力計G1,G2,温度計G3の正常値範囲の情報と、圧力計G1,G2,温度計G3の障害原因に関する障害原因情報とをさらに含んでいることが好ましい。
 処理部32は、点検支援処理として、圧力計G1,G2,温度計G3,液面計G4のうちの少なくとも一部の測定値が正常値範囲外であると判断した場合に、この計測器の測定値に基づいて想定される障害原因情報を作業員5に音声と画像とのうち少なくとも一方を出力することにより報知する。具体的には、障害原因情報として過去の事例が処理端末30に登録されており、測定値に基づいて考えられる項目(障害原因)が、表示部34に表示される。作業員5は、表示されている項目に応じて点検し、障害原因を特定する。障害原因の項目に関しては、後述の障害原因情報で説明する。
 さらに、障害原因情報は、測定値が正常値範囲外であると処理部32により判断された場合に、測定値に基づいて想定される追加して測定すべき追加計測器の識別番号(識別情報)を含み、処理部32が点検作業の項目に追加計測器の点検を追加することが好ましい。この構成では、記憶部31に追加計測器の識別番号が記憶されている。これにより、測定値が正常値範囲外である場合、点検作業の項目に、追加計測器の識別番号が表示と音声との少なくとも一方が実行され、作業員は表示された計測器を点検する。
[1.3.4] Inspection support processing The inspection information described above includes the normal value range information of the pressure gauges G1, G2 and the thermometer G3, and the failure cause information regarding the failure causes of the pressure gauges G1, G2 and the thermometer G3. It is preferable that it is further included.
When the processing unit 32 determines that at least a part of the measurement values of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 is outside the normal value range as the inspection support process, Failure cause information assumed based on the measured value is notified to the worker 5 by outputting at least one of voice and image. Specifically, past cases are registered in the processing terminal 30 as failure cause information, and items (failure causes) considered based on the measurement values are displayed on the display unit 34. The worker 5 checks according to the displayed item and identifies the cause of the failure. The cause of failure will be described in failure cause information described later.
Further, the failure cause information includes an identification number (identification information) of an additional measuring instrument to be additionally measured that is assumed based on the measured value when the processing unit 32 determines that the measured value is outside the normal value range. ), And the processing unit 32 preferably adds the inspection of the additional measuring instrument to the item of the inspection work. In this configuration, the identification number of the additional measuring instrument is stored in the storage unit 31. Thereby, when the measured value is outside the normal value range, at least one of the display number and the voice of the identification number of the additional measuring instrument is executed as the item of the inspection work, and the worker inspects the displayed measuring instrument.
 また、障害原因情報が、圧力計G1,G2,温度計G3,液面計G4の測定値履歴を含んでいることが好ましい。この場合、処理部32は、障害原因情報を参照して、測定値履歴が下降傾向又は上昇傾向であると判断した場合に、その下降傾向又は上昇傾向を支援情報として表示部34に表示と音声入出力部10から音声出力との少なくとも一方を実行させる。
 具体的には、測定値が正常値範囲内である場合でも、まず測定値履歴を参照する。測定値履歴は、例えば、図4に示すように、横軸が測定した時刻であり、縦軸が測定値である。前々回点検時(時刻:T1)の測定値M1と前回点検時(時刻:T2)の測定値M2と今回点検時(時刻:T3)の測定値M3とが表示されている。測定値M1,M2,M3はすべて上限値(HL)と下限値(LL)との範囲内であるが上昇傾向である。このとき、処理部32は、上昇傾向であることを、表示部34への表示と、音声入出力部10からの音声出力とのうち少なくとも一方を実行させる。さらには、処理部32は、3つの測定値M1,M2,M3に基づいて、上限値を超えるであろう時刻T4を外挿により推測する。推測された時刻T4は、表示部34に表示され、作業員5は、時刻T4までに装置の修理等の手当てが必要であることを知る。
 以上より、点検情報が障害原因情報を含むことにより、装置の問題を未然に解決することが可能である。また、計測器の測定値の微妙な変化によって異常か否かを判断する必要がある。この場合、記憶部31に測定値履歴が記憶されているため、作業員5が代わっても計測器の情報を次の作業員に確実に伝えることが可能である。
Moreover, it is preferable that the failure cause information includes the measurement value history of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4. In this case, when the processing unit 32 refers to the failure cause information and determines that the measurement value history has a downward trend or an upward trend, the processing unit 32 displays and voices the downward trend or the upward trend as support information on the display unit 34. At least one of voice output from the input / output unit 10 is executed.
Specifically, even when the measured value is within the normal value range, the measured value history is first referred to. In the measured value history, for example, as shown in FIG. 4, the horizontal axis represents measurement time, and the vertical axis represents the measured value. A measured value M1 at the time of previous inspection (time: T1), a measured value M2 at the time of previous inspection (time: T2), and a measured value M3 at the time of current inspection (time: T3) are displayed. The measured values M1, M2, and M3 are all within the range between the upper limit value (HL) and the lower limit value (LL), but are increasing. At this time, the processing unit 32 causes at least one of the display on the display unit 34 and the audio output from the audio input / output unit 10 to be in an upward trend. Furthermore, the processing unit 32 extrapolates a time T4 that will exceed the upper limit value based on the three measurement values M1, M2, and M3. The estimated time T4 is displayed on the display unit 34, and the worker 5 knows that treatment such as repair of the device is necessary by the time T4.
As described above, since the inspection information includes failure cause information, the problem of the apparatus can be solved in advance. In addition, it is necessary to determine whether or not there is an abnormality by a subtle change in the measurement value of the measuring instrument. In this case, since the measurement value history is stored in the storage unit 31, it is possible to reliably transmit information on the measuring instrument to the next worker even if the worker 5 is replaced.
 処理部32はさらに、点検支援処理として、処理部32は、圧力計G1,G2,温度計G3のうち、記憶部31にまだ記憶されていない未点検の未測定計測器がある場合、処理部32は、この未測定計測器の識別番号を表示部34に表示させる。また、音声入出力部10に、この未測定計測器の識別番号を支援情報として作業員5に音声出力させても良い。また、処理部32は、作業員5が測定不要な計測器(記憶部31に記憶されている計測器以外の計測器)を測定した場合、エラーメッセージを表示部34に表示させたり、エラー警報を音声入出力部10から出力させたりしても良い。
 点検支援処理の詳細は、記憶部31に格納される情報の説明、及び、処理フローとともに後述する。
The processing unit 32 is further provided as an inspection support process. When the processing unit 32 includes an uninspected unmeasured measuring instrument that is not yet stored in the storage unit 31 among the pressure gauges G1, G2, and the thermometer G3, the processing unit 32 32 displays the identification number of the unmeasured measuring instrument on the display unit 34. Further, the voice input / output unit 10 may cause the worker 5 to output the voice of the identification number of the unmeasured measuring instrument as support information. Further, the processing unit 32 displays an error message on the display unit 34 or an error alarm when the operator 5 measures a measuring instrument that does not require measurement (a measuring instrument other than the measuring instrument stored in the storage unit 31). May be output from the voice input / output unit 10.
Details of the inspection support process will be described later together with an explanation of information stored in the storage unit 31 and a processing flow.
 作業員5は、例えば、圧力計G1に対峙する。点検支援装置100は、圧力計の識別情報「PG-101」を文字認識するとともに、圧力計G1の計測値「0.8MPa」を画像認識すると、音声入出力部10に認識音を出力して、作業員5に計測値の認識を音声又は画像出力する。その後、自動で点検支援装置100に計測値「0.8MPa」を入力する。作業員5は、同様に圧力計G2に対峙することで、点検支援装置100に圧力計G2の測定値が入力される。このように、作業員5は、複数の計測器から測定値を入力した後で、処理端末30の表示部34で複数の入力値を確認して、入力部35により確定入力を行なうことで、処理端末30により自動測定値入力が作業員5によって確定される。
 なお、計測器ごとの測定値を入力した後に、入力部35により確定入力を行っても良い。また、確定入力の作業は必ずしも必要ではないが、入力部35により確定入力を行なうことで、確実に測定値を点検支援装置100に入力することできる。
The worker 5 faces the pressure gauge G1, for example. The inspection support apparatus 100 recognizes the pressure gauge identification information “PG-101” and outputs a recognition sound to the voice input / output unit 10 when recognizing the measurement value “0.8 MPa” of the pressure gauge G1. Then, the measurement value recognition is output to the worker 5 by voice or image. Thereafter, the measured value “0.8 MPa” is automatically input to the inspection support apparatus 100. Similarly, the operator 5 faces the pressure gauge G2, and the measured value of the pressure gauge G2 is input to the inspection support apparatus 100. As described above, the worker 5 inputs the measurement values from the plurality of measuring instruments, confirms the plurality of input values on the display unit 34 of the processing terminal 30, and performs the definite input by the input unit 35. The automatic measurement value input is confirmed by the operator 5 by the processing terminal 30.
In addition, after inputting the measured value for every measuring instrument, you may make a definite input with the input part 35. FIG. In addition, although a confirmation input operation is not necessarily required, the measurement value can be reliably input to the inspection support apparatus 100 by performing the confirmation input with the input unit 35.
 〔2〕点検結果格納装置
 次に、本実施形態に係る点検支援システムについて説明する。点検支援システムは、点検支援装置100と点検結果格納装置200とを備えている。
 図5は、点検結果格納装置の一例を示す図である。点検結果格納装置200は、上述した点検支援装置100から送信される点検結果を格納する情報処理装置であり、処理部210と、記憶部220と、通信部230と、2次記憶装置240と、ドライブ装置250と、入出力コントローラ260とを有する。点検結果格納装置200は、ネットワーク400を介して、クレイドル420に接続する。点検結果格納装置200は、クレイドル420を介して、処理端末30内の情報と同期をとることができる。クレイドル420は、ネットワーク400を介して点検結果格納装置200とデータの送受信が可能であり、且つ、電源430から供給される電力を点検支援装置100に供給する。
[2] Inspection Result Storage Device Next, an inspection support system according to the present embodiment will be described. The inspection support system includes an inspection support device 100 and an inspection result storage device 200.
FIG. 5 is a diagram illustrating an example of an inspection result storage device. The inspection result storage device 200 is an information processing device that stores the inspection result transmitted from the above-described inspection support device 100, and includes a processing unit 210, a storage unit 220, a communication unit 230, a secondary storage device 240, A drive device 250 and an input / output controller 260 are included. The inspection result storage device 200 is connected to the cradle 420 via the network 400. The inspection result storage device 200 can synchronize with the information in the processing terminal 30 via the cradle 420. The cradle 420 can transmit / receive data to / from the inspection result storage device 200 via the network 400, and supplies power supplied from the power source 430 to the inspection support device 100.
 処理部210は、例えば、CPUである。入出力コントローラ260は、処理部210と、他ユニットとの接続を制御するユニットである。入出力コントローラ260は、例えば、PCI Express(Peripheral Component Interconnect Express)などの規格に従って動作する。記憶部220は、データやプログラムを記憶する装置である。記憶部220は、例えば、DRAMである。 The processing unit 210 is, for example, a CPU. The input / output controller 260 is a unit that controls connection between the processing unit 210 and other units. The input / output controller 260 operates in accordance with a standard such as PCI Express (Peripheral Component Interconnect Express). The storage unit 220 is a device that stores data and programs. The storage unit 220 is, for example, a DRAM.
 2次記憶装置240は、記憶部220に格納されるプログラム及びデータを記憶するとともに、電源供給が無くても情報を保持可能な装置である。2次記憶装置240は、磁気ディスクを用いたディスクアレイ、又は、フラッシュメモリを用いたSSD等である。通信部230は、点検支援装置100に点検情報を送信するとともに、点検支援装置100の記憶部31に記憶された各測定値を受信する。具体的には、通信部230は、ネットワーク400に接続され、クレイドル420に接続された処理端末30と、データを送受信する。 The secondary storage device 240 is a device that can store programs and data stored in the storage unit 220 and can retain information even when power is not supplied. The secondary storage device 240 is a disk array using a magnetic disk, an SSD using a flash memory, or the like. The communication unit 230 transmits the inspection information to the inspection support device 100 and receives each measurement value stored in the storage unit 31 of the inspection support device 100. Specifically, the communication unit 230 transmits and receives data to and from the processing terminal 30 connected to the network 400 and connected to the cradle 420.
 ドライブ装置250は、例えば、CD-ROM(Compact Disc Read Only Memory)、DVD(Digital Versatile Disc)などの記憶媒体290を読み書きする装置である。ドライブ装置250は、記憶媒体290を回転させるモータや記憶媒体290上でデータを読み書きするヘッド等を含む。なお、記憶媒体290は、プログラムを格納することができる。ドライブ装置250は、ドライブ装置250にセットされた記憶媒体290からプログラムを読み出す。処理部210は、ドライブ装置250により読み出されたプログラムを、記憶部220又は2次記憶装置240に格納するとともに、通信部230及びクレイドル420を介して、処理端末30に送信する。そのため、処理端末30に格納されるプログラムは、記憶媒体290として提供することができる。 The drive device 250 is a device that reads and writes a storage medium 290 such as a CD-ROM (Compact Disc Only Memory), a DVD (Digital Versatile Disc), and the like. The drive device 250 includes a motor that rotates the storage medium 290, a head that reads and writes data on the storage medium 290, and the like. Note that the storage medium 290 can store a program. The drive device 250 reads a program from the storage medium 290 set in the drive device 250. The processing unit 210 stores the program read by the drive device 250 in the storage unit 220 or the secondary storage device 240 and transmits the program to the processing terminal 30 via the communication unit 230 and the cradle 420. Therefore, the program stored in the processing terminal 30 can be provided as the storage medium 290.
 図6は、記憶部のメモリマップの一例を示す図である。記憶部31に、点検情報600と、障害原因情報700と、点検結果情報800と、計測器又は装置の位置情報900と、音声及び画像の認識情報950と、プログラム990とが格納される。プログラム990は、処理部32によって実行され、クレイドル420を介して、点検結果格納装置200から送信される。音声及び画像の認識情報950は、音声認識、計測器認識、測定値認識に必要な情報である特徴量データ、言語モデル、音響モデル等である。以下に点検情報600、障害原因情報700、点検結果情報800、計測器又は装置位置情報900について説明する。 FIG. 6 is a diagram illustrating an example of a memory map of the storage unit. The storage unit 31 stores inspection information 600, failure cause information 700, inspection result information 800, measuring instrument or device position information 900, sound and image recognition information 950, and a program 990. The program 990 is executed by the processing unit 32 and transmitted from the inspection result storage device 200 via the cradle 420. The speech and image recognition information 950 includes feature amount data, a language model, an acoustic model, and the like, which are information necessary for speech recognition, measurement device recognition, and measurement value recognition. The inspection information 600, failure cause information 700, inspection result information 800, measuring instrument or device position information 900 will be described below.
 〔3〕点検情報
 図7は、点検情報の一例を示す図である。図7に示す点検情報600は、「行番号」、「計測器又は装置識別情報」、「正常値範囲」、「計測器測定値」、「装置点検項目」、及び「装置点検結果」がそれぞれ入力される行番号列601、計測器又は装置識別情報列603、正常値範囲列605、計測器測定値列607、装置点検項目列609、装置点検結果列611を有する。点検情報600の各行には、互いに対応関係があるデータが入力される。
[3] Inspection Information FIG. 7 is a diagram illustrating an example of inspection information. The inspection information 600 shown in FIG. 7 includes “line number”, “measurement device or device identification information”, “normal value range”, “measurement device measurement value”, “device inspection item”, and “device inspection result”. It has a row number column 601, a measuring instrument or device identification information column 603, a normal value range column 605, a measuring instrument measurement value column 607, an apparatus inspection item column 609, and an apparatus inspection result column 611. Data having a corresponding relationship is input to each line of the inspection information 600.
 点検情報600の行には、作業員が点検すべき点検項目が示されている。点検情報600には、作業員が、点検項目に対して点検支援装置100を用いて収集した点検結果が登録される。 In the line of inspection information 600, inspection items to be inspected by the worker are shown. In the inspection information 600, the inspection results collected by the operator using the inspection support apparatus 100 for the inspection items are registered.
 点検情報600には、点検支援装置100が、クレイドル420にセットすることで、前回の点検情報600が点検結果格納装置200に送信されるとともに、次回の点検情報600が、記憶部31に格納される。新たに格納された点検情報600には、作業員5が1度の点検作業で、点検すべき計測器の点検項目のデータが入力される。 In the inspection information 600, when the inspection support device 100 is set in the cradle 420, the previous inspection information 600 is transmitted to the inspection result storage device 200, and the next inspection information 600 is stored in the storage unit 31. The In the newly stored inspection information 600, data of inspection items of measuring instruments to be inspected by the operator 5 in one inspection operation is input.
 作業員5が、測定すべき計測器の点検を行なわない場合、すなわち、処理部32が、点検情報600に入力された計測器の点検項目のデータに対して、記憶部31にまだ記憶されていない未測定計測器があると判断した場合に、音声入出力部10及び表示部34のうち少なくとも一方を介して、作業員5に対して警告(警報)を出力することが好ましい。警告を出力するタイミングは、例えば、1)作業員5が、点検すべき装置又は計測器から一定距離だけ離れたことをセンサ37がGPSの緯度経度情報から認識したとき、2)作業員5が、未点検項目があるのに、入力部35を操作して作業完了をしたとき、3)未点検項目があるのに、点検支援装置100がクレイドル420にセットされたとき、4)各部屋の計測器の測定が終了したとき、などが挙げられる。
 上記1)はGPSを用いるため、地下に作業員5が居る場合は、警告出力するのが難しい場合があるため、上記2)~4)が好ましく、特に上記4)は、次に点検すべき部屋が遠く離れた場所に位置することもあるため、作業員5が次の部屋に行く前に、未測定計測器を認識することができる。そのため、時間のロスを及び体力の消耗を軽減させることができ、効果的である。
 ここで、上記4)の機能を有する点検支援装置の一例について説明する。
 複数の計測器が配置されている部屋(区画)の出入口の扉の内側に部屋番号(区画識別番号)が表示されている。カメラ20は、部屋内に表示された部屋番号を撮影する。また、処理部32は、部屋内に未測定計測器が残っていることを示す警告を支援情報として表示部34に表示させる。
 また、処理部32は、部屋内の各計測器の測定が全て完了したと判断した場合に、次に点検すべき装置が配置されている他の区画に割り当てられた部屋番号を表示部34に表示させることが好ましい。
When the operator 5 does not inspect the measuring instrument to be measured, that is, the processing unit 32 is still stored in the storage unit 31 with respect to the data of the inspection item of the measuring instrument input to the inspection information 600. When it is determined that there is no unmeasured measuring instrument, it is preferable to output a warning (alarm) to the worker 5 via at least one of the voice input / output unit 10 and the display unit 34. The timing for outputting the warning is, for example, 1) When the sensor 37 recognizes from the latitude / longitude information of the GPS that the worker 5 has moved away from the device or measuring instrument to be inspected by a certain distance 2) When the operation is completed by operating the input unit 35 even though there are uninspected items, 3) When the inspection support device 100 is set in the cradle 420 even though there are uninspected items, and 4) in each room For example, when the measurement of the measuring instrument is completed.
Since 1) uses GPS, it may be difficult to output a warning if there is a worker 5 in the basement. Therefore, 2) to 4) are preferred. Especially, 4) should be checked next. Since the room may be located far away, the unmeasured measuring instrument can be recognized before the worker 5 goes to the next room. Therefore, it is possible to reduce time loss and physical strength consumption, which is effective.
Here, an example of the inspection support apparatus having the function 4) will be described.
A room number (section identification number) is displayed inside the door of the entrance / exit of the room (section) where a plurality of measuring instruments are arranged. The camera 20 captures the room number displayed in the room. In addition, the processing unit 32 causes the display unit 34 to display a warning indicating that an unmeasured measuring instrument remains in the room as support information.
In addition, when the processing unit 32 determines that the measurement of each measuring instrument in the room is completed, the processing unit 32 displays the room number assigned to the other section where the device to be checked next is arranged on the display unit 34. It is preferable to display.
 作業員が点検支援装置100を用いて収集する点検項目には、「計測器の点検項目」と、計測器ではない「装置状態の点検項目」とがある。以下に、「計測器の点検項目」と、「装置状態の点検項目」とに分けて説明する。 The inspection items collected by the operator using the inspection support apparatus 100 include “inspection items for measuring instruments” and “inspection items for apparatus states” that are not measuring instruments. In the following, description will be made separately for "inspection items for measuring instruments" and "inspection items for apparatus status".
 〔3.1〕計測器の点検項目
 「計測器又は装置識別情報」は点検対象となる計測器又は装置を示し、「正常値範囲」は点検対象となる計測器の正常値の範囲を示す。
[3.1] Inspection item of measuring device “Measurement device or device identification information” indicates a measuring device or device to be checked, and “Normal value range” indicates a normal value range of the measuring device to be checked.
 点検支援装置100は、計測器識別情報をカメラ20で撮影した画像から認識すると、認識した計測器識別情報と同じ行にある「計測測定値」に認識した測定値を入力する。 When the inspection support apparatus 100 recognizes the measurement instrument identification information from the image captured by the camera 20, the inspection support apparatus 100 inputs the measurement value recognized in the "measurement measurement value" on the same line as the recognized measurement instrument identification information.
 認識した計測器識別情報とは、例えば、図3A~図3Dに示す計測器である圧力計G1及びG2、温度計G3の上部に表示される識別番号「PG-101」、「PG-102」、「TG-101」、「LG-101」である。認識した測定値とは、例えば、図3A~図3Dに示す圧力計G1,G2,温度計G3,液面計G4の計測値である。 The recognized measuring instrument identification information includes, for example, the identification numbers “PG-101” and “PG-102” displayed on the upper portions of the pressure gauges G1 and G2 and the thermometer G3 which are measuring instruments shown in FIGS. 3A to 3D. , “TG-101”, “LG-101”. The recognized measurement values are, for example, the measurement values of the pressure gauges G1, G2, the thermometer G3, and the liquid level gauge G4 shown in FIGS. 3A to 3D.
 「正常値範囲」は、画像認識した測定値が異常値か否かを判定するための基準値である。点検支援装置100は、認識した計測器測定値が正常値範囲外である場合、図9に示すような障害原因情報700を参照して、認識した計測器識別情報に対応付けられる障害原因を読み出して、表示部34に表示と音声入出力部10で音声出力とのうち少なくとも一方を実行する。点検支援装置100は、この処理を、計測器測定値の点検情報600に対する入力に応答して実行する。 “Normal value range” is a reference value for determining whether or not an image-recognized measurement value is an abnormal value. When the recognized measurement value of the measuring instrument is outside the normal value range, the inspection support apparatus 100 reads out the failure cause associated with the recognized measuring instrument identification information with reference to the failure cause information 700 as shown in FIG. Then, at least one of the display on the display unit 34 and the audio output by the audio input / output unit 10 is executed. The inspection support apparatus 100 executes this processing in response to an input to the measurement information inspection information 600.
 図7に示す例では、第2行目の計測器測定値「0.6MPa」が、正常値範囲「0.7~0.9MPa」を下回っている。そのため、処理部32は、作業員に対して障害原因を音声又は画像出力する。 In the example shown in FIG. 7, the measurement value “0.6 MPa” in the second row is below the normal value range “0.7 to 0.9 MPa”. Therefore, the processing unit 32 outputs the cause of the failure to the worker as a sound or an image.
 〔3.2〕装置状態の点検項目
 また、点検情報は、計測器以外の確認項目である計測器外点検項目、すなわち、装置点検項目を含んでいることが好ましい。「装置点検項目」は、作業員5が「計測器又は装置識別情報列」に入力される点検対象の装置に対する点検項目を示す。点検情報が装置点検項目を含んでいる場合、障害原因情報が、例えば、作業員5の視覚によって点検する点検項目である「ポンプからの油漏れ」や、作業員5の嗅覚によって点検する点検項目である「ポンプからの異臭」や、作業員5が振動計を用いて測定する「モーターケーシングの振幅」など、装置点検項目に対応した障害原因(他の障害原因)を含んでいる。処理部32は、装置点検項目に関する作業員5の音声が音声入出力部10に入力された場合、この音声に基づいて装置点検項目に関する点検結果を認識する。さらに、処理部32は、点検結果が装置の異常を意味すると判断した場合に、障害原因を、支援情報として表示部34に表示させることと、音声入出力部10から音声出力させることとの少なくとも一方を実行する。
[3.2] Inspection Item of Device State In addition, the inspection information preferably includes an inspection item outside the measuring instrument that is a confirmation item other than the measuring instrument, that is, an inspection item of the device. The “device inspection item” indicates an inspection item for the device to be inspected, which is input to the “measurement device or device identification information string” by the worker 5. When the inspection information includes an apparatus inspection item, the failure cause information is, for example, an inspection item to be inspected visually by the worker 5 "oil leak from the pump" or an inspection item to be inspected by the olfaction of the operator 5 Such as “Odor from pump” and “Motor casing amplitude” measured by the operator 5 using a vibration meter, etc. When the voice of the worker 5 regarding the device inspection item is input to the voice input / output unit 10, the processing unit 32 recognizes the inspection result regarding the device inspection item based on this voice. Further, when the processing unit 32 determines that the inspection result indicates an abnormality of the apparatus, the processing unit 32 displays at least the cause of the failure as support information on the display unit 34 and outputs the voice from the voice input / output unit 10. Run one.
 図8は、点検対象となる装置の一例を示す図である。図8に示す点検対象装置であるモータ装置300は、モーターケーシング305、及び、オイルピット310を有する装置である。図8に示すように、特に測定器を有さない装置も、点検対象となる。 FIG. 8 is a diagram showing an example of an apparatus to be inspected. A motor device 300 that is an inspection target device shown in FIG. 8 is a device having a motor casing 305 and an oil pit 310. As shown in FIG. 8, a device that does not have a measuring instrument is also an inspection target.
 図7に示すように、「装置点検結果」は、「装置点検項目(計測器外点検項目)」に対する点検結果である。例えば、装置点検項目「ポンプP101からの油漏れ」に対する点検結果は「有り」又は「無し」であり、装置点検項目「モーターケーシングの振幅」に対する点検結果は「50μm」である。 As shown in FIG. 7, “Equipment inspection result” is an inspection result for “Equipment inspection item (outside measuring instrument inspection item)”. For example, the inspection result for the device inspection item “oil leakage from the pump P101” is “present” or “not present”, and the inspection result for the device inspection item “motor casing amplitude” is “50 μm”.
 〔4〕障害原因情報
 図9は、障害原因情報の一例を示す図である。図9に示す障害原因情報700は、「行番号」、「計測器又は装置識別情報」、及び「障害原因情報」がそれぞれ入力される行番号列701、計測器又は装置識別情報列703、障害原因情報列705を有する。障害原因情報700の各行には、互いに対応関係があるデータが入力される。
[4] Failure Cause Information FIG. 9 is a diagram illustrating an example of failure cause information. The failure cause information 700 shown in FIG. 9 includes a row number column 701 to which “row number”, “measurement device or device identification information”, and “failure cause information” are input, a measurement device or device identification information column 703, a failure It has a cause information column 705. In each row of the failure cause information 700, data having a corresponding relationship is input.
 障害原因情報は、計測器が正常値範囲外を示す場合に生じ得る障害原因が入力される。例えば、圧力計PG-101の計測値が正常値範囲外となった場合、障害原因は「配管からの油漏れ」、「オイルピットへの液漏れ」、「オイルタンクの液レベルが低い」などがある。処理部32は、障害原因を音声入出力部10や表示部34を介して音声又は画像出力する。これにより、作業員5は、単に異常を音声又は画像出力されるだけではなく、音声又は画像出力と実際の装置の状態とを照らし合わせることにより、異常時に異常原因が何であるかを現場で確認することができる。特にこのような支援処理は、異常が出たときの対応処理を知らない作業員5にとって有用である。 In the failure cause information, the cause of failure that may occur when the measuring instrument is out of the normal value range is input. For example, when the measured value of the pressure gauge PG-101 is outside the normal value range, the cause of failure is “oil leakage from the piping”, “liquid leakage to the oil pit”, “the oil level in the oil tank is low”, etc. There is. The processing unit 32 outputs the cause of the failure as a sound or an image via the sound input / output unit 10 or the display unit 34. As a result, the worker 5 not only simply outputs the sound or image of the abnormality, but also checks the sound or the image output against the actual state of the device to check what is the cause of the abnormality at the time of the abnormality. can do. In particular, such support processing is useful for the worker 5 who does not know the response processing when an abnormality occurs.
 〔5〕点検結果情報
 図10は、点検結果情報の一例を示す図である。図10に示す点検結果情報800は、「行番号」、「計測器又は装置識別情報」、及び「点検結果」をそれぞれ入力する行番号列801、計測器又は装置識別情報列803、点検結果列805を有する。点検結果情報800の各行には、互いに対応関係があるデータが入力される。
[5] Inspection Result Information FIG. 10 is a diagram illustrating an example of inspection result information. The inspection result information 800 illustrated in FIG. 10 includes a row number column 801, a measuring device or device identification information column 803, and an inspection result column for inputting “row number”, “measurement device or device identification information”, and “inspection result”, respectively. 805. Data having a corresponding relationship is input to each row of the inspection result information 800.
 図10に示す例では、第3行目にある最新測定データ(第n回目のデータ、nは自然数)である計測器測定値「130℃」が、図7に示す正常値範囲内にある。しかしながら、過去点検時の測定データである第(n-1)回及び第(n-2)回のデータは、それぞれ「110℃」、「120℃」と上昇傾向にある。処理部32は、過去測定データと最新測定データとから補間曲線を生成し、生成した補間曲線が上昇傾向又は下降傾向にあるために、次回点検以降の測定値が、正常値範囲を超えると予測される場合、作業員5に、測定値が上昇傾向又は下降傾向であることを音声又は画像出力する。処理部32は、測定値が上昇傾向又は下降傾向であることを音声又は画像出力するとともに、上昇傾向又は下降傾向と判断された計測器に関する障害原因を作業員5に音声又は画像出力してもよい。 In the example shown in FIG. 10, the measurement value “130 ° C.” that is the latest measurement data (the nth data, n is a natural number) in the third row is within the normal value range shown in FIG. However, the (n-1) -th and (n-2) -th data, which are measurement data at the time of the past inspection, tend to rise to “110 ° C.” and “120 ° C.”, respectively. The processing unit 32 generates an interpolation curve from the past measurement data and the latest measurement data, and predicts that the measurement value after the next inspection exceeds the normal value range because the generated interpolation curve tends to increase or decrease. In the case where it is done, the worker 5 is sounded or outputted as an image indicating that the measurement value has an upward tendency or a downward tendency. The processing unit 32 outputs a sound or an image indicating that the measurement value has an upward trend or a downward trend, and also outputs a cause of failure related to the measuring instrument determined to be an upward trend or a downward trend to the worker 5 by voice or image output. Good.
 このように、測定値が正常範囲外となった場合のみ、音声又は画像出力するのではなく、将来的な異常を予測して作業員5に音声又は画像出力することで、測定値や装置が異常になる前に事前の対応が可能になる。特にこのような支援処理は、測定値から将来の装置の予測を行なえない作業員5にとって有用である。 As described above, only when the measurement value is out of the normal range, the sound value or the image is not output, but a future abnormality is predicted and the sound or image is output to the worker 5 so that the measurement value or the device is It is possible to respond in advance before it becomes abnormal. In particular, such support processing is useful for the worker 5 who cannot predict the future apparatus from the measured values.
 〔6〕計測器又は装置位置情報
 装置位置情報900は、必ずしも必要ではないが、上述したように、センサ37がGPS衛星から緯度経度情報を受信する場合に、記憶部31に装置位置情報900が格納されていることが好ましい。この場合、図11に示す計測器又は装置位置情報900は、「行番号」、「計測器又は装置識別情報」、及び「計測器又は装置位置」をそれぞれ入力する行番号列901、計測器又は装置識別情報列903、計測器又は装置位置列905を有する。計測器又は装置位置情報900の各行には、互いに対応関係があるデータが入力される。
[6] Measuring device or device position information The device position information 900 is not necessarily required. However, as described above, when the sensor 37 receives latitude / longitude information from a GPS satellite, the device position information 900 is stored in the storage unit 31. Preferably it is stored. In this case, the measuring instrument or device position information 900 shown in FIG. 11 includes a row number column 901 for inputting “row number”, “measuring device or device identification information”, and “measuring device or device position”. A device identification information column 903 and a measuring instrument or device position column 905 are included. Data corresponding to each other is input to each row of the measuring instrument or device position information 900.
 〔7〕点検支援処理フロー
 次に、本実施形態に係る点検支援方法について、図12~図14のフローチャートを用いて説明する。この点検支援方法は、処理端末30により実行され、図7の行番号601に示す順で計測器及び計測器以外の点検を進める。また、処理部32において、未測定計測器があると判断した場合の警告出力タイミングとして上記1)~4)を例に挙げたが、本実施形態において、上記4)に示した「各部屋の計測器の測定が終了したとき」を用いた点検支援方法について説明する。
 処理端末30には、点検結果格納装置200に格納される点検情報600、障害原因情報700、点検結果情報800、計測器又は装置位置情報900、音声及び画像認識情報950、プログラム990が、点検結果格納装置200から送信されて、それらの情報が格納されている。作業員5が、処理端末30の音声認識処理又は画像認識処理を開始することで、処理端末30は計測器の測定値の認識を開始する。このプログラム990は、カメラ20が撮影した画像情報に基づいて各計測器の識別番号(識別情報)及び測定値を認識する手順と、測定値を各計測器の識別番号と対応付けた上で記憶部31に記憶させる手順と、各計測器のうち、記憶部31にまだ記憶されていない未測定計測器の有無を判断する手順と、未測定計測器が有ると判断された場合に、未測定計測器の識別番号を支援情報として表示部34に表示させる手順と、を備えている。
[7] Inspection Support Processing Flow Next, the inspection support method according to the present embodiment will be described with reference to the flowcharts of FIGS. This inspection support method is executed by the processing terminal 30 and advances the inspection of the measuring instrument and the parts other than the measuring instrument in the order indicated by the line number 601 in FIG. In addition, the above-described 1) to 4) are given as examples of the warning output timing when it is determined that there is an unmeasured measuring instrument in the processing unit 32, but in this embodiment, “ An inspection support method using “when measurement by the measuring instrument is completed” will be described.
The processing terminal 30 includes inspection information 600 stored in the inspection result storage device 200, failure cause information 700, inspection result information 800, measuring instrument or device position information 900, sound and image recognition information 950, and a program 990. The information is transmitted from the storage device 200 and stored. When the worker 5 starts the voice recognition process or the image recognition process of the processing terminal 30, the processing terminal 30 starts to recognize the measurement value of the measuring instrument. This program 990 stores a procedure for recognizing the identification number (identification information) and measurement value of each measuring instrument based on the image information captured by the camera 20, and the measurement value in association with the identification number of each measuring instrument. The procedure to be stored in the unit 31, the procedure for determining the presence or absence of an unmeasured measuring instrument that is not yet stored in the storage unit 31 among the measuring instruments, and the determination that there is an unmeasured measuring instrument. And a procedure for displaying the identification number of the measuring instrument on the display unit 34 as support information.
 図12に示すように、作業員5は、クレイドル420から処理端末30を取る(ステップS01)。作業員5は部屋に入ると、まず、カメラ20により部屋番号を撮影する(第1撮影工程:ステップS02)。処理部32は、カメラ20で撮影した部屋番号(区画識別番号)が点検順番通りの部屋番号であるか否かを判断する(ステップS03)。撮影された部屋番号が点検順番通りの部屋番号ではない場合(ステップS03の「No」)、正しい部屋番号を、表示及び音声のうち少なくとも一方により報知する(ステップ04)。報知後、ステップ02に戻る。部屋番号が点検順番通りの部屋番号である場合(ステップS03の「Yes」)、装置の点検を行う(ステップS05)。 As shown in FIG. 12, the worker 5 takes the processing terminal 30 from the cradle 420 (step S01). When the worker 5 enters the room, first, the room number is photographed by the camera 20 (first photographing step: step S02). The processing unit 32 determines whether or not the room number (section identification number) captured by the camera 20 is the room number in the inspection order (step S03). When the photographed room number is not the room number in the inspection order (“No” in step S03), the correct room number is notified by at least one of display and sound (step 04). After the notification, the process returns to step 02. When the room number is the room number in the inspection order (“Yes” in step S03), the apparatus is inspected (step S05).
 このステップS05の詳細を図13により説明すると、まず、処理部32は、次に点検する装置が計測器を有するか否かの判断を行う(ステップS21)。計測器を有する場合(ステップS21の「Yse」)、作業員5が圧力計G1の前に立ち、カメラ20が圧力計G1の識別番号及び測定器を撮影する(撮影工程:ステップS22)。作業員5が撮影した計測器の画像情報に基づいて、処理端末30は認識した識別番号に対して所定の位置にある圧力計G1の指針N1を画像認識して、圧力計G1の測定値を認識する(認識工程:ステップS23)。処理部32は、カメラ20により認識された識別番号が点検順番通りの計測器であるか否かを判断する(ステップS24)。認識された識別番号が点検順番通りの計測器の識別番号ではない場合(ステップS24の「No」)、正しい計測器の識別番号(あるいは計測器の名称)を表示と音声出力とのうち少なくとも一方により報知する(ステップS25)。報知後、ステップS22に戻る。認識された識別番号が点検順番通りの計測器の識別番号である場合(ステップS24の「Yes」)、表示部34に識別番号及び測定値を表示する(ステップS26)。作業員5は、表示された識別番号及び測定値を確認し、識別番号及び測定値が正しければ「確定」の音声を発生する。処理部32において、所定時間内に作業員5の「確定」の音声が得られたかを判断する(ステップS27)。所定時間内に「確定」の音声が得られない場合や作業員5が「無効」と発声した場合、再点検が指示され(ステップS28)、ステップ22に戻る。
 次に、処理端末30は、測定値が基準値範内にあるか否かを判断する(ステップS29)。
The details of step S05 will be described with reference to FIG. 13. First, the processing unit 32 determines whether or not the device to be inspected next has a measuring instrument (step S21). When it has a measuring instrument (“Yse” in step S21), the worker 5 stands in front of the pressure gauge G1, and the camera 20 photographs the identification number and measuring instrument of the pressure gauge G1 (imaging process: step S22). Based on the image information of the measuring instrument photographed by the operator 5, the processing terminal 30 recognizes an image of the pointer N1 of the pressure gauge G1 at a predetermined position with respect to the recognized identification number, and obtains the measured value of the pressure gauge G1. Recognize (recognition process: step S23). The processing unit 32 determines whether or not the identification number recognized by the camera 20 is a measuring instrument according to the inspection order (step S24). When the recognized identification number is not the identification number of the measuring instrument in accordance with the inspection order (“No” in step S24), the correct identification number (or name of the measuring instrument) of the correct measuring instrument is displayed and / or voice output. (Step S25). After the notification, the process returns to step S22. When the recognized identification number is the identification number of the measuring instrument according to the inspection order (“Yes” in step S24), the identification number and the measured value are displayed on the display unit 34 (step S26). The worker 5 confirms the displayed identification number and measurement value, and if the identification number and measurement value are correct, the operator 5 generates a “confirmed” sound. In the processing unit 32, it is determined whether or not the “confirmed” voice of the worker 5 is obtained within a predetermined time (step S27). If the sound of “determined” is not obtained within a predetermined time or if the worker 5 utters “invalid”, a re-inspection is instructed (step S28), and the process returns to step 22.
Next, the processing terminal 30 determines whether or not the measured value is within the reference value range (step S29).
 測定値が正常値範囲内に無い場合(ステップS29の「No」)、処理端末30は、障害原因情報700を参照して、正常値範囲外の測定値を示す計測器に関する障害原因を、作業員に音声又は画像出力する(ステップS31)。測定値が正常値範囲内にある場合(ステップS29の「Yes」)、処理端末30は、図4に示すように、前回までの測定値履歴と今回の測定値とにより下降傾向又は上昇傾向であるか、さらに、次回以降の測定で測定値が正常値範囲外になるか否か判断する(ステップS30)。処理端末30は、測定値が次回以降の測定で正常値範囲内に無いと判断した場合(ステップS30の「No」)、処理端末30は、障害原因情報700を参照して、この計測器に関する障害原因を、作業員5に音声又は画像出力する(ステップS31)。 When the measured value is not within the normal value range (“No” in step S29), the processing terminal 30 refers to the failure cause information 700 to determine the cause of failure related to the measuring instrument indicating the measured value outside the normal value range. A voice or image is output to the member (step S31). When the measurement value is within the normal value range (“Yes” in step S29), the processing terminal 30 tends to decrease or increase according to the previous measurement value history and the current measurement value as shown in FIG. Further, it is determined whether or not the measured value is out of the normal value range in the next and subsequent measurements (step S30). When the processing terminal 30 determines that the measured value is not within the normal value range in the subsequent measurements (“No” in step S30), the processing terminal 30 refers to the failure cause information 700 and relates to this measuring instrument. The cause of the failure is output to the worker 5 by voice or image (step S31).
 測定値が次回点検以降の測定で正常値範囲内にある場合(ステップS30の「Yes」)、又は、ステップS31実行後、処理端末30は、測定値を識別番号と対応付けた上で確定して、測定値を記憶部31の点検情報600に入力し、点検結果が記憶される(記憶工程:ステップS32)。 When the measurement value is within the normal value range in the measurement after the next inspection (“Yes” in step S30), or after executing step S31, the processing terminal 30 confirms the measurement value in association with the identification number. Then, the measured value is input to the inspection information 600 of the storage unit 31, and the inspection result is stored (storage process: step S32).
 また、点検項目が計測器ではない場合(ステップS21の「No」)、図14に示すように、計測器以外の点検項目、すなわち、装置点検項目を確認する(ステップS31)。処理部32は、装置点検項目に関する作業員5の音声が音声入出力部に入力された場合に、この音声に基づいて装置点検項目に関する点検結果を入力する(ステップS32)。そして、処理部32は、点検結果が装置の異常を意味すると判断した場合(ステップS33の「Yes」)に、装置に関する障害原因を表示部34に表示させることと、音声入出力部10から音声出力させることとの少なくとも一方を実行する(ステップS34)。一方、点検結果が装置の正常を意味すると判断した場合(ステップS33の「No」)に、点検結果が記憶される(記憶工程:ステップS35)。 If the inspection item is not a measuring instrument (“No” in step S21), as shown in FIG. 14, inspection items other than the measuring instrument, that is, device inspection items are confirmed (step S31). When the voice of the operator 5 regarding the device inspection item is input to the voice input / output unit, the processing unit 32 inputs the inspection result regarding the device inspection item based on this voice (step S32). When the processing unit 32 determines that the inspection result indicates an abnormality of the device (“Yes” in step S33), the processing unit 32 causes the display unit 34 to display the cause of the failure related to the device, and the voice input / output unit 10 At least one of outputting is executed (step S34). On the other hand, when it is determined that the inspection result means that the apparatus is normal (“No” in step S33), the inspection result is stored (storage process: step S35).
 計測器あるいは計測器を有していない装置の点検結果が記憶部31に記憶された後、図13に示すように、処理部32は、部屋内に配置されている計測器及び計測器以外の点検項目のうち、記憶部31にまだ記憶されていない未測定計測器の有無、すなわち、点検情報に入力された全ての点検項目が点検されたか否かを判断する(判断工程:ステップS33)。全ての点検項目が点検されていない場合(ステップS33の「No」)、処理端末30は、音声入出力部10又は表示部34を介して、未測定計測器の識別番号を作業員に音声と画像出力とのうちの少なくとも一方により報知される(第1報知工程:ステップS34)。報知後、ステップS21に戻る。全ての点検項目が点検されている場合(ステップS33「Yes」)、部屋内の装置の点検が終了し、図12に示すように、カメラ20により退出時に部屋番号を撮影する(ステップS06)。処理部32は、この部屋の点検項目をすべて点検したかを判断し、点検項目が残っている場合(ステップS07の「No」)、ステップS05に戻る。点検項目が残っていない場合(ステップS07の「Yes」)、処理部32は、全ての部屋の点検が完了したかを判断する(ステップS08)。全ての部屋の点検が完了していない場合(ステップS08の「No」)、次に点検すべき装置が配置されている他の部屋に割り当てられた部屋番号(区画識別情報)が報知され(第2報知工程:ステップS09)、ステップS02に戻る。全ての部屋の点検が完了した場合(ステップS08の「Yes」)、作業員5は処理端末30をクレイドル420に置いて、点検を終えるように報知される(ステップS10)。処理部32は、処理端末30がクレイドル420に置かれたかを判断し、置かれていない場合(ステップS11の「No」)、ステップS10に戻る。処理端末30がクレイドル420に置かれた場合(ステップS11の「Yes」)、処理端末30が点検情報を点検結果格納装置200に送信することで、点検支援処理を終了する。
 以上、本発明の一実施形態の点検支援方法について説明したが、上記ステップは必ずしも全てが必要ではなく、点検支援方法は、少なくとも撮影工程と、認識工程と、記憶工程と、判断工程と、第1報知工程とを備えることが好ましい。
After the inspection result of the measuring instrument or the apparatus that does not have the measuring instrument is stored in the storage unit 31, as shown in FIG. 13, the processing unit 32 is other than the measuring instrument and measuring instrument arranged in the room. Among the inspection items, it is determined whether or not there are unmeasured measuring instruments that are not yet stored in the storage unit 31, that is, whether all the inspection items input to the inspection information have been inspected (determination step: step S33). If all the inspection items have not been inspected (“No” in step S33), the processing terminal 30 uses the voice input / output unit 10 or the display unit 34 to inform the operator of the identification number of the unmeasured measuring instrument. Notification is made by at least one of image output (first notification step: step S34). After the notification, the process returns to step S21. When all the inspection items have been inspected (step S33 “Yes”), the inspection of the device in the room is completed, and as shown in FIG. 12, the room number is photographed by the camera 20 when leaving (step S06). The processing unit 32 determines whether all the inspection items in the room have been inspected, and when the inspection items remain (“No” in step S07), the processing unit 32 returns to step S05. If no inspection items remain (“Yes” in step S07), the processing unit 32 determines whether inspection of all rooms has been completed (step S08). When the inspection of all the rooms has not been completed (“No” in step S08), the room number (section identification information) assigned to the other room where the apparatus to be inspected next is arranged is notified (No. 1). 2 Notification step: Step S09), the process returns to Step S02. When the inspection of all the rooms is completed (“Yes” in step S08), the worker 5 is notified to place the processing terminal 30 on the cradle 420 and finish the inspection (step S10). The processing unit 32 determines whether or not the processing terminal 30 is placed on the cradle 420. If not placed ("No" in step S11), the processing unit 32 returns to step S10. When the processing terminal 30 is placed on the cradle 420 (“Yes” in step S11), the processing terminal 30 transmits the inspection information to the inspection result storage device 200, thereby ending the inspection support process.
As described above, the inspection support method according to an embodiment of the present invention has been described. However, the above steps are not necessarily all necessary, and the inspection support method includes at least an imaging process, a recognition process, a storage process, a determination process, It is preferable to provide 1 alerting | reporting process.
 以上説明した実施形態は典型例として挙げたに過ぎず、その各実施形態の構成要素の組合せ、変形及びバリエーションは当業者にとって明らかであり、当業者であれば本発明の原理及び請求の範囲に記載した発明の範囲を逸脱することなく上述の実施形態の種々の変形を行えることは明らかである。 The embodiments described above are merely given as typical examples, and combinations, modifications, and variations of the components of each embodiment will be apparent to those skilled in the art, and those skilled in the art will understand the principles and claims of the present invention. Obviously, various modifications may be made to the embodiments described above without departing from the scope of the described invention.
 5  作業員
 10  音声入出力部
 20  カメラ
 30  処理端末
 31  記憶部
 32  処理部
 33  通信部
 34  表示部
 35  入力部
 36  充電部
 37  センサ
 50  ヘルメット
 100  点検支援装置
 200  点検結果格納装置
 300  モータ装置
 305  モーターケーシング
 310  オイルピット
 400  ネットワーク
 420  クレイドル
 600  点検情報
 700  障害原因情報
 800  点検結果情報
 900  装置位置情報
 950  音声及び画像認識情報
 990  プログラム
DESCRIPTION OF SYMBOLS 5 Worker 10 Voice input / output part 20 Camera 30 Processing terminal 31 Storage part 32 Processing part 33 Communication part 34 Display part 35 Input part 36 Charging part 37 Sensor 50 Helmet 100 Inspection support apparatus 200 Inspection result storage apparatus 300 Motor apparatus 305 Motor casing 310 Oil pit 400 Network 420 Cradle 600 Inspection information 700 Failure cause information 800 Inspection result information 900 Device position information 950 Audio and image recognition information 990 program

Claims (15)

  1.  複数の計測器を有する装置の点検作業を支援する点検支援装置であって、
     前記各計測器を撮影するカメラと;
     点検者による前記点検作業を支援する支援情報を表示する表示部と;
     測定すべき前記各計測器の識別情報を含む点検情報を記憶する記憶部と;
     前記カメラが撮影した前記各計測器の画像情報に基づいて前記各計測器それぞれの前記識別情報及び測定値を認識し、前記各測定値を前記各識別情報と対応付けた上で前記記憶部に記憶させ、
     さらに、前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器があると判断した場合に、前記未測定計測器の前記識別情報を前記支援情報として前記表示部に表示させる処理部と;
    を備えることを特徴とする点検支援装置。
    An inspection support device for supporting an inspection operation of a device having a plurality of measuring instruments,
    A camera for photographing each measuring instrument;
    A display unit for displaying support information for supporting the inspection work by the inspector;
    A storage unit for storing inspection information including identification information of each measuring instrument to be measured;
    Recognizing the identification information and measurement value of each measurement device based on the image information of each measurement device taken by the camera, and associating the measurement value with the identification information in the storage unit Remember,
    Further, when it is determined that there is an unmeasured measuring instrument not yet stored in the storage unit among the measuring instruments, the identification information of the unmeasured measuring instrument is displayed on the display unit as the support information. A processing unit;
    An inspection support apparatus comprising:
  2.  前記カメラが、前記各計測器が配置されている区画内に表示された区画識別情報をさらに撮影し;
     前記区画内に前記未測定計測器が残っている場合に、前記処理部が、前記未測定計測器が残っていることを示す警告を前記支援情報として前記表示部に表示させる;
    ことを特徴とする請求項1に記載の点検支援装置。
    The camera further photographs section identification information displayed in a section in which the measuring instruments are arranged;
    When the unmeasured measuring instrument remains in the section, the processing unit displays a warning indicating that the unmeasured measuring instrument remains on the display unit as the support information;
    The inspection support apparatus according to claim 1.
  3.  前記処理部は、前記区画内の前記各計測器の測定が全て完了したと判断した場合に、次に点検すべき前記装置が配置されている他の区画に割り当てられた前記区画識別情報を前記表示部に表示させる
    ことを特徴とする請求項2に記載の点検支援装置。
    When it is determined that the measurement of each of the measuring instruments in the section is completed, the processing unit displays the section identification information assigned to another section in which the device to be checked next is arranged. The inspection support apparatus according to claim 2, wherein the inspection support apparatus is displayed on a display unit.
  4.  音声を入力及び出力する音声入出力部をさらに備えることを特徴とする請求項1から請求項3のいずれか1項に記載の点検支援装置。 4. The inspection support apparatus according to claim 1, further comprising a voice input / output unit that inputs and outputs voice.
  5.  前記処理部が、前記音声入出力部に、前記未測定計測器の前記識別情報を音声で出力させることを特徴とする請求項4に記載の点検支援装置。 The inspection support apparatus according to claim 4, wherein the processing unit causes the voice input / output unit to output the identification information of the unmeasured measuring instrument by voice.
  6.  前記処理部は、前記測定値を前記音声入出力部から音声出力させ、かつ、前記測定値の記憶を許可する前記音声が前記点検者により前記音声入出力部に入力されたと判断した場合に、前記測定値を前記記憶部に記憶させることを特徴とする請求項4または請求項5に記載の点検支援装置。 When the processing unit determines that the voice that allows the measurement value to be output from the voice input / output unit and the voice that allows storage of the measurement value is input to the voice input / output unit by the inspector, The inspection support apparatus according to claim 4, wherein the measurement value is stored in the storage unit.
  7.  前記点検情報は、前記各計測器の正常値範囲の情報と、前記各計測器の障害原因に関する障害原因情報とをさらに含み;
     前記処理部は、前記各計測器のうちの少なくとも一部の前記測定値が、前記正常値範囲外であると判断した場合に、
     この計測器の前記測定値に基づいて想定される前記障害原因情報を、前記支援情報として前記表示部に表示させることと、前記音声入出力部から音声出力させることとの少なくとも一方を実行する;
    ことを特徴とする請求項4から請求項6のいずれか1項に記載の点検支援装置。
    The inspection information further includes information on a normal value range of each measuring instrument and fault cause information regarding a fault cause of each measuring instrument;
    When the processing unit determines that at least some of the measurement values of the measuring instruments are outside the normal value range,
    Executing at least one of displaying the cause-of-failure information assumed based on the measurement value of the measuring instrument on the display unit as the support information and outputting the sound from the voice input / output unit;
    The inspection support device according to any one of claims 4 to 6, wherein
  8.  前記障害原因情報は、前記測定値が前記正常値範囲外であると前記処理部により判断された場合に、前記測定値に基づいて想定される追加して計測すべき追加計測器の識別情報を含み;
     前記処理部が、前記点検作業の項目に前記追加計測器の点検を追加する;
    ことを特徴とする請求項7に記載の点検支援装置。
    The failure cause information includes identification information of an additional measuring instrument to be additionally measured that is assumed based on the measurement value when the processing unit determines that the measurement value is outside the normal value range. Including;
    The processing unit adds an inspection of the additional measuring instrument to the item of the inspection work;
    The inspection support apparatus according to claim 7.
  9.  前記障害原因情報は、前記各計測器の測定値履歴を含み;
     前記処理部は、前記障害原因情報を参照して、前記測定値履歴が下降傾向又は上昇傾向であると判断した場合に、
    前記下降傾向又は前記上昇傾向を、前記支援情報として前記表示部に表示させることと、前記音声入出力部から音声出力させることとの少なくとも一方を実行する;
    ことを特徴とする請求項7に記載の点検支援装置。
    The failure cause information includes a measurement value history of each measuring instrument;
    When the processing unit refers to the failure cause information and determines that the measurement value history is a downward trend or an upward trend,
    Executing at least one of displaying the downward trend or the upward trend on the display unit as the support information and outputting the voice from the voice input / output unit;
    The inspection support apparatus according to claim 7.
  10.  前記点検情報は、前記各計測器以外の確認項目である計測器外点検項目をさらに含み;
     前記障害原因情報が、前記計測器外点検項目に対応した他の障害原因をさらに含み;
     前記処理部は、
     前記計測器外点検項目に関する前記点検者の前記音声が前記音声入出力部に入力された場合に、この音声に基づいて前記計測器外点検項目に関する点検結果を認識し、
     さらに、前記点検結果が前記装置の異常を意味すると判断した場合に、他の障害原因を、前記支援情報として前記表示部に表示させることと、前記音声入出力部から音声出力させることとの少なくとも一方を実行する;
    ことを特徴とする請求項7に記載の点検支援装置。
    The inspection information further includes inspection items outside the measuring instrument which are confirmation items other than the measuring instruments;
    The failure cause information further includes another failure cause corresponding to the out-of-instrument inspection item;
    The processor is
    When the voice of the inspector regarding the inspection item outside the measuring instrument is input to the voice input / output unit, the inspection result regarding the inspection item outside the measuring instrument is recognized based on the voice,
    Further, when it is determined that the inspection result indicates an abnormality of the device, at least the other cause of failure is displayed on the display unit as the support information and the voice input / output unit outputs a sound. Run one;
    The inspection support apparatus according to claim 7.
  11.  複数の計測器を有する装置の点検作業を支援する点検支援装置と、この点検支援装置から送信される点検結果を格納する点検結果格納装置とを有する点検支援システムであって、
     前記点検支援装置が、
     前記各計測器を撮影するカメラと;
     点検者による前記点検作業を支援する支援情報を表示する表示部と;
     測定すべき前記各計測器の識別情報を含む点検情報を記憶する記憶部と;
     前記カメラが撮影した前記各計測器の画像情報に基づいて前記各計測器それぞれの前記識別情報及び測定値を認識し、前記各測定値を前記各識別情報と対応付けた上で前記記憶部に記憶させ、
     さらに、前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器があると判断した場合に、前記未測定計測器の前記識別情報を前記支援情報として前記表示部に表示させる処理部と;
    を備え、
     前記点検結果格納装置が、前記点検支援装置に前記点検情報を送信するとともに、前記点検支援装置の前記記憶部に記憶された前記各測定値を受信する通信部を有する;
    ことを特徴とする点検支援システム。
    An inspection support system having an inspection support device for supporting an inspection operation of a device having a plurality of measuring instruments, and an inspection result storage device for storing an inspection result transmitted from the inspection support device,
    The inspection support device is
    A camera for photographing each measuring instrument;
    A display unit for displaying support information for supporting the inspection work by the inspector;
    A storage unit for storing inspection information including identification information of each measuring instrument to be measured;
    Recognizing the identification information and measurement value of each measurement device based on the image information of each measurement device taken by the camera, and associating the measurement value with the identification information in the storage unit Remember,
    Further, when it is determined that there is an unmeasured measuring instrument not yet stored in the storage unit among the measuring instruments, the identification information of the unmeasured measuring instrument is displayed on the display unit as the support information. A processing unit;
    With
    The inspection result storage device includes a communication unit that transmits the inspection information to the inspection support device and receives the measured values stored in the storage unit of the inspection support device;
    An inspection support system characterized by that.
  12.  複数の計測器を備えた装置の、点検者による点検作業を支援する点検支援方法であって、
     前記各計測器を撮影して画像情報を得る撮影工程と;
     前記画像情報に基づいて、前記各計測器それぞれの識別情報及び測定値を認識する認識工程と;
     前記各測定値を前記各計測器の前記識別情報と対応付けた上で記憶する記憶工程と;
     前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器の有無を判断する判断工程と;
     前記判断工程において前記未測定計測器が有ると判断された場合に、前記未測定計測器の前記識別情報を前記点検者に報知する第1報知工程と;
    を備えることを特徴とする点検支援方法。
    An inspection support method for supporting an inspection work by an inspector of an apparatus having a plurality of measuring instruments,
    A photographing step of photographing each measuring instrument to obtain image information;
    A recognition step for recognizing identification information and measurement values of each measuring instrument based on the image information;
    A storage step of storing each measured value in association with the identification information of each measuring instrument;
    A determination step of determining whether there is an unmeasured measuring instrument that is not yet stored in the storage unit among the measuring instruments;
    A first notification step of notifying the inspector of the identification information of the unmeasured measuring instrument when it is determined in the determining step that the unmeasured measuring instrument is present;
    An inspection support method comprising:
  13.  前記記憶工程の前に、前記各計測器が配置されている区画内に表示された区画識別情報を撮影する第1撮影工程と;
     前記記憶工程の後に、前記区画内の全ての前記各計測器の測定が終了した後、前記区画内に表示された前記区画識別情報を撮影する第2撮影工程と;
    をさらに備え、
     前記区画内に前記未測定計測器が残っている場合に、前記第2撮影工程の直後に前記第1報知工程を実施する
    ことを特徴とする請求項12に記載の点検支援方法。
    A first imaging step of imaging the zone identification information displayed in the zone where each measuring instrument is arranged before the storing step;
    A second photographing step of photographing the section identification information displayed in the section after measurement of all the measuring instruments in the section is completed after the storing step;
    Further comprising
    The inspection support method according to claim 12, wherein when the unmeasured measuring instrument remains in the section, the first notification step is performed immediately after the second imaging step.
  14.  前記区画内の前記各計測器の測定が全て完了したと判断した場合に、次に点検すべき前記装置が配置されている他の区画に割り当てられた前記区画識別情報を前記点検者に報知する第2報知工程をさらに備える
    ことを特徴とする請求項13に記載の点検支援方法。
    When it is determined that the measurement of all the measuring instruments in the section is completed, the section identification information assigned to the other section where the apparatus to be checked next is arranged is notified to the inspector. The inspection support method according to claim 13, further comprising a second notification step.
  15.  装置の点検作業を支援する支援情報を表示する表示部と、前記装置に設けられた複数の計測器を撮影するカメラと、測定すべき前記各計測器の識別情報を含む点検情報を記憶する記憶部と、を有する点検支援装置に用いられる点検支援プログラムであって、
     前記カメラが撮影した画像情報に基づいて前記各計測器の前記識別情報及び測定値を認識する手順と;
     前記測定値を前記各計測器の前記識別情報と対応付けた上で前記記憶部に記憶させる手順と;
     前記各計測器のうち、前記記憶部にまだ記憶されていない未測定計測器の有無を判断する手順と;
     前記未測定計測器が有ると判断された場合に、前記未測定計測器の前記識別情報を前記支援情報として前記表示部に表示させる手順と;
    を備えることを特徴とする点検支援プログラム。
    Memory for storing inspection information including identification information of each measuring instrument to be measured, a display unit for displaying support information for supporting the inspection work of the apparatus, a camera for photographing a plurality of measuring instruments provided in the apparatus An inspection support program used for an inspection support apparatus having
    Recognizing the identification information and measurement value of each measuring instrument based on image information captured by the camera;
    A procedure for storing the measured value in the storage unit after associating the measured value with the identification information of each measuring instrument;
    A procedure for determining whether or not there is an unmeasured measuring instrument not yet stored in the storage unit among the measuring instruments;
    A procedure for displaying the identification information of the unmeasured measuring instrument on the display unit as the support information when it is determined that there is the unmeasured measuring instrument;
    An inspection support program comprising:
PCT/JP2011/072870 2010-10-05 2011-10-04 Inspection assistance device, inspection assistance system, method of assisting inspection, and inspection assistance program WO2012046726A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
BR112013006357-2A BR112013006357A2 (en) 2010-10-05 2011-10-04 inspection support apparatus, inspection support system, inspection support method, and inspection support program
KR1020137005404A KR101361934B1 (en) 2010-10-05 2011-10-04 Inspection assistance device, inspection assistance system, method of assisting inspection, and computer readable recording medium recording inspection assistance program
JP2011554321A JP5037732B2 (en) 2010-10-05 2011-10-04 Inspection support device, inspection support system, inspection support method, and inspection support program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2010225709 2010-10-05
JP2010-225709 2010-10-05

Publications (1)

Publication Number Publication Date
WO2012046726A1 true WO2012046726A1 (en) 2012-04-12

Family

ID=45927721

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2011/072870 WO2012046726A1 (en) 2010-10-05 2011-10-04 Inspection assistance device, inspection assistance system, method of assisting inspection, and inspection assistance program

Country Status (4)

Country Link
JP (1) JP5037732B2 (en)
KR (1) KR101361934B1 (en)
BR (1) BR112013006357A2 (en)
WO (1) WO2012046726A1 (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014085343A (en) * 2012-10-18 2014-05-12 Boeing Co Platform health monitoring system
JP2015061339A (en) * 2013-09-17 2015-03-30 株式会社日立製作所 Wire connection work support system
JP2015153342A (en) * 2014-02-19 2015-08-24 三菱電機株式会社 Facility inspection apparatus and facility inspection management system
JP2016153999A (en) * 2015-02-17 2016-08-25 横河電機株式会社 Management device, management system, management method, management program, and recording medium
JP2016529630A (en) * 2013-08-29 2016-09-23 モダストリ リミティド ライアビリティ カンパニー Detection system
JP2017041193A (en) * 2015-08-21 2017-02-23 Ihi運搬機械株式会社 Maintenance managing system and maintenance managing method of conveyance equipment
JP2017043436A (en) * 2015-08-25 2017-03-02 株式会社日立ビルシステム Elevator inspection support system
JP2017054391A (en) * 2015-09-11 2017-03-16 アイテック株式会社 Meter reading system and meter reading terminal
JP2018045655A (en) * 2016-09-16 2018-03-22 株式会社東芝 Monitoring device
JP2018106389A (en) * 2016-12-26 2018-07-05 川崎重工業株式会社 Field-data gathering system
WO2018158814A1 (en) * 2017-02-28 2018-09-07 日本電気株式会社 Inspection assistance device, inspection assistance method and recording medium
CN108732756A (en) * 2017-04-21 2018-11-02 发那科株式会社 The maintenance auxiliary device of shop equipment and safeguard auxiliary system
JP2019057041A (en) * 2017-09-20 2019-04-11 株式会社東芝 Monitoring device
JP2020072614A (en) * 2018-11-02 2020-05-07 株式会社近計システム Gas pressure monitoring device of gas insulation breaker
JP2020077045A (en) * 2018-11-05 2020-05-21 Necフィールディング株式会社 Information processing apparatus, determination method and program
JP2020187673A (en) * 2019-05-17 2020-11-19 株式会社関電工 Measurement recording support system
US11232530B2 (en) 2017-02-28 2022-01-25 Nec Corporation Inspection assistance device, inspection assistance method, and recording medium
JP2022064204A (en) * 2020-10-13 2022-04-25 横河電機株式会社 Device, method and program
US11380140B2 (en) 2017-02-28 2022-07-05 Nec Corporation Inspection assistance device, inspection assistance method, and recording medium

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6261872B2 (en) * 2013-03-27 2018-01-17 日立造船株式会社 Plant monitoring system
JP5650283B1 (en) * 2013-06-26 2015-01-07 セコム株式会社 Traveling work support system, portable terminal, and traveling work support method
KR20180033954A (en) * 2016-09-27 2018-04-04 전자부품연구원 Safety Management Method and System for a Gas Facilities with Analog Gauge using the Image Processing

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61231694A (en) * 1985-04-05 1986-10-15 株式会社日立製作所 Portable type telemetering data collector/processor
JPH0869595A (en) * 1994-08-31 1996-03-12 Hitachi Ltd Meter reading system
JPH0877484A (en) * 1994-09-09 1996-03-22 Hitachi Ltd Meter inspection system
JP2002245188A (en) * 2001-02-16 2002-08-30 Hitachi Engineering & Services Co Ltd Bidirectional inspection work support system for equipment
JP2003173196A (en) * 2001-12-05 2003-06-20 Matsushita Electric Ind Co Ltd Method and apparatus for synthesizing voice
JP2006302016A (en) * 2005-04-21 2006-11-02 Nippon Telegr & Teleph Corp <Ntt> Portable measurement device, measurement result collection system and measurement result collection method

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005242830A (en) 2004-02-27 2005-09-08 Toshiba Corp Remote monitoring support system, and mobile terminal device for remote monitoring support system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS61231694A (en) * 1985-04-05 1986-10-15 株式会社日立製作所 Portable type telemetering data collector/processor
JPH0869595A (en) * 1994-08-31 1996-03-12 Hitachi Ltd Meter reading system
JPH0877484A (en) * 1994-09-09 1996-03-22 Hitachi Ltd Meter inspection system
JP2002245188A (en) * 2001-02-16 2002-08-30 Hitachi Engineering & Services Co Ltd Bidirectional inspection work support system for equipment
JP2003173196A (en) * 2001-12-05 2003-06-20 Matsushita Electric Ind Co Ltd Method and apparatus for synthesizing voice
JP2006302016A (en) * 2005-04-21 2006-11-02 Nippon Telegr & Teleph Corp <Ntt> Portable measurement device, measurement result collection system and measurement result collection method

Cited By (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014085343A (en) * 2012-10-18 2014-05-12 Boeing Co Platform health monitoring system
JP2016529630A (en) * 2013-08-29 2016-09-23 モダストリ リミティド ライアビリティ カンパニー Detection system
JP2015061339A (en) * 2013-09-17 2015-03-30 株式会社日立製作所 Wire connection work support system
JP2015153342A (en) * 2014-02-19 2015-08-24 三菱電機株式会社 Facility inspection apparatus and facility inspection management system
JP2016153999A (en) * 2015-02-17 2016-08-25 横河電機株式会社 Management device, management system, management method, management program, and recording medium
JP2017041193A (en) * 2015-08-21 2017-02-23 Ihi運搬機械株式会社 Maintenance managing system and maintenance managing method of conveyance equipment
JP2017043436A (en) * 2015-08-25 2017-03-02 株式会社日立ビルシステム Elevator inspection support system
JP2017054391A (en) * 2015-09-11 2017-03-16 アイテック株式会社 Meter reading system and meter reading terminal
JP2018045655A (en) * 2016-09-16 2018-03-22 株式会社東芝 Monitoring device
JP2018106389A (en) * 2016-12-26 2018-07-05 川崎重工業株式会社 Field-data gathering system
WO2018158814A1 (en) * 2017-02-28 2018-09-07 日本電気株式会社 Inspection assistance device, inspection assistance method and recording medium
US11380140B2 (en) 2017-02-28 2022-07-05 Nec Corporation Inspection assistance device, inspection assistance method, and recording medium
US11003911B2 (en) 2017-02-28 2021-05-11 Nec Corporation Inspection assistance device, inspection assistance method, and recording medium
US11232530B2 (en) 2017-02-28 2022-01-25 Nec Corporation Inspection assistance device, inspection assistance method, and recording medium
JPWO2018158814A1 (en) * 2017-02-28 2019-12-12 日本電気株式会社 Inspection support device, inspection support method and program
JP2018181232A (en) * 2017-04-21 2018-11-15 ファナック株式会社 Plant facility maintenance support device and maintenance support system
US10838211B2 (en) 2017-04-21 2020-11-17 Fanuc Corporation Maintenance support device and maintenance support system for factory equipment
CN108732756B (en) * 2017-04-21 2021-11-09 发那科株式会社 Maintenance support device and maintenance support system for plant equipment
CN108732756A (en) * 2017-04-21 2018-11-02 发那科株式会社 The maintenance auxiliary device of shop equipment and safeguard auxiliary system
JP2019057041A (en) * 2017-09-20 2019-04-11 株式会社東芝 Monitoring device
JP2020072614A (en) * 2018-11-02 2020-05-07 株式会社近計システム Gas pressure monitoring device of gas insulation breaker
JP2020077045A (en) * 2018-11-05 2020-05-21 Necフィールディング株式会社 Information processing apparatus, determination method and program
JP2020187673A (en) * 2019-05-17 2020-11-19 株式会社関電工 Measurement recording support system
JP2022064204A (en) * 2020-10-13 2022-04-25 横河電機株式会社 Device, method and program
JP7222387B2 (en) 2020-10-13 2023-02-15 横河電機株式会社 Apparatus, method and program

Also Published As

Publication number Publication date
BR112013006357A2 (en) 2020-09-24
JP5037732B2 (en) 2012-10-03
KR20130028985A (en) 2013-03-20
KR101361934B1 (en) 2014-02-12
JPWO2012046726A1 (en) 2014-02-24

Similar Documents

Publication Publication Date Title
JP5037732B2 (en) Inspection support device, inspection support system, inspection support method, and inspection support program
JP6995792B2 (en) Building health assessment system
EP2558815B1 (en) On-board ultrasonic frequency spectrum and image generation
EP3746998B1 (en) Safety device inspection
JP2009032206A (en) Portable inspection device, portable inspection system, inspection method, and program
KR101778593B1 (en) A terminal for supporting the maintenance of the industry plant
US20160146707A1 (en) Collection of field measurement data using a pre-defined workflow
US20190378181A1 (en) Diagnosis cost output device, diagnosis cost output method, and computer-readable recording medium
US20220005178A1 (en) Information processing apparatus, information processing method, and information processing system
JP2021024704A (en) Vibration measurement system for elevator
JP2014002430A (en) Facility inspection system and measuring instrument for the same
JP2017173262A (en) Operation detection device, and information processing device
CN109508946B (en) Method for automatically informing an intended person and test and measurement device
JP2004177359A (en) Method and device for acoustically monitoring operating state of facility
KR101721682B1 (en) Apparatus and method for checking the safety inspection of a building in real-time
JP6568818B2 (en) River monitoring system, river monitoring method and river monitoring program
CN210721055U (en) Portable diagnostic device and system for a process plant
KR101342691B1 (en) Remote inspection device of the flow meter, trouble decision device and method using that remote inspection device
JP2016142621A (en) Water leakage detector
JP2009020075A (en) Method and system for estimating remaining life, and computer program and recording medium
JP2021144433A (en) Structure abnormality discrimination method and abnormality discrimination system
JP2006010631A (en) Sound information acquisition system, sound information acquiring device, noncontact diagnosis system, and noncontact diagnosis method
KR101796738B1 (en) Maintenance and safety management system for infrastructure of measuring instrument using mobile app
CN103217186A (en) Self evaluating transimitter
JP2020085485A (en) Pressure gauge inspection method and pressure gauge inspection device

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2011554321

Country of ref document: JP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11830658

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 20137005404

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 11830658

Country of ref document: EP

Kind code of ref document: A1

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112013006357

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 112013006357

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20130315