JP6779189B2 - Mobile terminal device, component deterioration judgment program - Google Patents

Description

The present invention relates to a technique for determining a wear deterioration state of an elevator component.

During maintenance work on the elevator, the condition of the parts that make up the elevator is inspected to check for deterioration such as wear. If it is confirmed that it has deteriorated, urge the customer to replace the part.

Conventionally, whether or not a part has deteriorated is visually confirmed by a field worker, and the worker makes the judgment.

As a prior art, a method is known in which the surface wear state of a sheet transport member is determined by irradiating the surfaces of the transport member and the drawing roller with laser light and determining the surface irregularities (for example). Patent Document 1).

JP-A-2009-292567

Conventionally, as described above, the worker visually confirms the parts, and the worker judges whether or not there is deterioration. Therefore, individual differences may occur, and in some cases, defective parts may be overlooked. In addition, when a part is to be replaced, the corresponding part is often not available immediately, and it may take time to replace the part. In this case, the parts in poor condition will continue to be used until the parts are replaced, which will adversely affect related parts such as other parts that come into contact with the parts.

Further, in the technique of Patent Document 1, the deterioration of the surface is determined by determining whether or not the unevenness of the surface is reduced. However, in the situation where the unevenness becomes large due to wear such as wear and peeling of the surface layer. Not considered. Further, no consideration is given to the deterioration determination of the cylindrical bearing member.

An object of the present invention is to prevent the determination of deterioration of parts of an elevator from being different for each operator.

In order to solve the above problems, a typical mobile terminal device of the present invention is a mobile terminal device having an image pickup unit, which projects an image currently being imaged by the image pickup section and includes parts of an elevator. A display unit that superimposes a frame that imitates a part or all of the outer shell of the component when viewed from a direction on the image at a fixed position and a fixed size, and the frame displayed by the display unit. , The storage unit that stores the still image captured by the imaging unit when the outer shell of the component projected in the image matches, and the still image stored in the storage unit are acquired, and the still image is obtained. based on the image, the derived degree of deterioration is a value indicating the wear range of parts as derived degradation degree, compared with the derived degree of degradation, the degradation degree limit is deterioration degree defined in advance that requires replacement to perform quality determination of the parts, have a, a determination unit for displaying the determination result on the display unit, the determination unit, the number of uses is a number of times the component is used by the operation of the elevator The measurement result, which is acquired as the number of acquisitions and used and is determined by the number of acquisitions and the degree of derivation deterioration , correlates with the number of times of use and the degree of deterioration in a graph area having the number of times of use and the degree of deterioration as two axes. a reference line connecting a straight line, if located in the part past usage defined by the reference line defined based on experience abnormal section of, determines that there is cause leading to the deterioration of parts, on the display unit The judgment result is displayed.

According to the present invention, it is possible to prevent the deterioration determination of the parts of the elevator from being different for each operator.
Issues, configurations and effects other than those described above will be clarified by the description of the following embodiments.

It is a figure which shows an example of the mobile terminal apparatus of embodiment and the usage situation. It is a figure which shows the hardware configuration example of the mobile terminal apparatus of embodiment. It is a block diagram of the mobile terminal apparatus of embodiment. It is a figure exemplifying the location and the display screen at the time of imaging of the mobile terminal apparatus of embodiment. It is a figure which shows the display screen example of the determination result of the mobile terminal apparatus of embodiment. It is a figure explaining the calculation method of the wear angle of an embodiment. It is a figure explaining the deterioration determination method of embodiment. It is a flowchart which shows the whole operation example of embodiment. It is a flowchart which shows the operation example of the deterioration determination processing of embodiment.

In the present embodiment, the deterioration of parts is determined by using the mobile terminal device possessed by the worker who maintains the elevator. In the present embodiment, the target component is imaged by using the camera attached to the mobile terminal device, and the quality of the target component is determined and displayed using the obtained captured image. The mobile terminal device of the present embodiment also displays information on the predicted exchange date based on the obtained captured image.

Further, in the present embodiment, it is determined whether or not there is a factor that leads to deterioration of parts such as contamination of foreign matter and insufficient cleaning. If there is a factor that leads to component deterioration, information indicating that the factor needs to be removed is displayed, and if there is no factor, information indicating that it is unnecessary is displayed.

Further, the mobile terminal device of the embodiment displays a frame for guiding the image to a suitable imaging distance and angle at the time of imaging. The operator moves the mobile terminal device so that the target component matches the frame, and takes an image at a specified position and a specified direction.

Hereinafter, this embodiment will be described with reference to the drawings.

FIG. 1 is a diagram showing an example of a mobile terminal device and a usage situation of the embodiment. The mobile terminal device 1 is a portable terminal device (computer) such as a smartphone or tablet possessed by an operator. The mobile terminal device 1 illuminates the target component 2 by turning on an LED light 170 (LED: Light emitting diode), and receives the reflected light by the CCD camera 160 (CCD: Charge coupled device) to receive the reflected light. To image. When taking an image in a bright environment, it is not necessary to turn on the LED light 170.

In the present embodiment, the target component 2 is a cylindrical flat plate member. The target component 2 is a three-dimensional member having a cylindrical surface extending from the upper surface S2 to the lower surface formed inside. This cylindrical surface is referred to as a cylindrical inner surface S1. Examples of the member having such a shape include an end plate provided in the brake portion of the elevator. The shape of the target component 2 and the application of the component are not limited to this. As long as it is an elevator part, it may have any shape and application. The elevator is an elevator installed in a customer facility such as a building, but may be an escalator, a moving walkway (auto line), or the like.

On the surface of the target component 2, a bronze layer is formed on the bare metal, and a coating layer is formed on the bronze layer. A wear portion 5 and a normal portion 6 are formed on the surface of the inner surface S1 of the cylinder. The worn portion 5 is a portion where the coating is peeled off to expose the bronze layer, or the bronze layer is peeled off to expose the bare metal. The normal portion 6 is a portion that is not worn, that is, a portion where a coating layer is formed. At the beginning of use, only the normal portion 6 is visually visible on the inner surface S1 of the cylinder, but with the use over time, the wear portion 5 is generated on the surface thereof. The wear range of the worn portion 5 gradually expands according to the number of times the target component 2 has been used (hereinafter referred to as the number of times of use) by the operation of the elevator.

A mark 21 is attached to the upper surface S2 of the target component 2. When performing a component inspection, as will be described later, the operator orbits the target component 2 and images the target component 2 a plurality of times while changing the location such as the position and orientation of the mobile terminal device 1. The mark 21 is a reference for enabling the operator to take an image at an accurate position and orientation. The mark 21 may be a portion formed in advance on the target part 2, such as a biz hole of a fastener or a stamp indicating the model number of the part, or a seal or the like is temporarily attached to the mark 21. The sticker may be the mark 21.

When a malfunction occurs in the elevator, the elevator monitoring device 3 notifies the surroundings of a warning by sounding an alarm, and sends a warning telegram to a maintenance center (not shown). Further, the elevator monitoring device 3 monitors each component provided in the elevator, counts the number of times the component is used, and accumulates the component. When the elevator monitoring device 3 receives the request message from the mobile terminal device 1, it returns the number of times the requested component has been used. In the case of the target component 2, the number of times the target component 2 is used is counted up each time the brake is applied. Further, when a part is replaced and becomes a new part, the count value of the number of times the part is used is initialized and becomes zero.

FIG. 2 is a diagram showing an example of the hardware configuration of the mobile terminal device 1. The mobile terminal device 1 includes a controller 101, peripheral devices such as a storage 140, a touch panel display 150, a CCD camera 160, and an LED light 170.

The controller 101 controls each hardware inside the mobile terminal device 1. The controller 101 has the following configuration.

The CPU 102 (CPU: Central Processing Unit) is a processing device that expands a program stored in a ROM 104 or a storage 140 into a RAM 103 and executes an operation. The CPU 102 comprehensively controls each hardware inside the controller 101 by executing a program. The RAM 103 is a volatile memory, which is a work memory when the CPU 102 processes. The RAM 103 temporarily stores necessary data while the CPU 102 calculates and executes the program.

The ROM 104 is a non-volatile memory and stores the firmware executed by the CPU 102. The storage I / F 105 (I / F: Interface) connects to the storage 140 and controls the input / output of data to and from the storage 140. The network I / F 106 is an interface board that controls wired / wireless communication performed with an external device. In the present embodiment, wireless communication is performed with the elevator monitoring device 3 or the server of the maintenance center, but communication via a wired medium may also be used. The communication standard is not limited here.

The panel I / F 107 outputs an image for display to the touch panel display 150, and inputs a signal indicating a contact position from the touch panel display 150. The CCD camera I / F 108 is an interface that outputs an image pickup instruction signal to the CCD camera 160 and inputs an image captured by the CCD camera 160. The LED light I / F 109 is an interface for controlling the lighting and extinguishing of the LED light 170.

The storage 140 is an auxiliary storage device such as a flash memory. The storage 140 non-volatilely stores a program executed by the CPU 102 and control data. Further, in the present embodiment, data such as a component deterioration determination program providing each function described below, an captured image, and a determination result described below are also stored in the storage 140.

The touch panel display 150 has a configuration in which an input unit of a touch panel is laminated on a flat display unit, displays information to an operator, detects a touch of the touch panel, identifies the position, and outputs the information to the CPU 102. The CCD camera 160 is a device that converts the brightness of an image obtained through a camera lens into an amount of electric charge and outputs an image as an electric signal. The LED light 170 is a device that turns on and off based on an instruction signal output from the CPU 102.

FIG. 3 is a block diagram showing an example of each function of the mobile terminal device 1. The mobile terminal device 1 includes a lighting unit 11, a display unit 12, an imaging unit 13, a synthesis unit 14, a determination unit 15, an exchange plan calculation unit 16, a guided image creation unit 17, and a storage unit 18. Each of these functions is realized by the controller 101 shown in FIG. 2 executing a component deterioration determination program and various programs previously introduced in the ROM 104 and the storage 140, and operating in cooperation with each peripheral device.

The lighting unit 11 has an LED light 170 and an LED light I / F 109, and lights up according to an operation of the operator on the touch panel display 150 to illuminate the target component 2. The display unit 12 has a touch panel display 150 and a panel I / F 107, and displays the image currently captured by the CCD camera 160 in real time. Hereinafter, the image obtained in real time will be referred to as a real-time image. Further, the display unit 12 displays a frame for guiding the mobile terminal device 1 to a specified position and a specified orientation, and displays a determination result.

The imaging unit 13 has a CCD camera 160 and a CCD camera I / F 108, and photoelectrically converts the image obtained through the camera lens into a predetermined file format to obtain a still image. The image pickup unit 13 stores the image file after the format conversion in the storage unit 18. The imaging unit 13 self-detects that the relative position and direction of the mobile terminal device 1 and the target component 2 have become a predetermined position or direction according to the operation of the operator, and images the image.

The imaging unit 13 images the same target component 2 from a plurality of locations. The operator moves the mobile terminal device 1 so as to orbit the target component 2, changes the location of the mobile terminal device 1, and takes an image when the mobile terminal device 1 reaches a specified position and a specified direction. Further, the imaging unit 13 assigns unique identification information to the file name and stores it in the storage unit 18 so that each of the plurality of captured images is an image targeting the same component.

The compositing unit 14 synthesizes a plurality of image files captured at different locations into one image. The compositing unit 14 joins the images by performing geometric transformation so that the feature points projected on each image coincide with each other. The compositing unit 14 performs a compositing process so that the entire 360 ° of the inner surface S1 of the cylinder becomes one image. The compositing unit 14 may be subjected to a smoothing filter treatment in order to remove noise, and may be subjected to a normalization treatment in order to eliminate differences such as luminance components for each image as much as possible. In addition to these, image processing is performed as needed.

The determination unit 15 analyzes the obtained composite image and determines whether the quality is good or bad in the current state and whether or not the parts need to be confirmed / cleaned. The determination unit 15 calculates the hue (Hue), saturation (Saturation), and brightness (Lightness) for each pixel of the obtained composite image, so that the pixel of interest belongs to the wear portion 5 or the normal portion 6. The carving is done. When it is separated from the one belonging to the worn portion 5, the determination unit 15 also determines whether it is a bronze layer or a bare metal. When the amount of light in the imaging environment is uniform, the brightness values of the obtained images are different from each other, and in the present embodiment, the order is the coating layer, the bronze layer, and the bare metal (of the coating layer). The highest brightness value). The determination unit 15 determines whether the pixel of interest belongs to the coating layer, the bronze layer, or the bare metal by using the difference in the brightness value and the difference in the hue.

After distinguishing which one the determination unit 15 belongs to, the determination unit 15 determines how much area the worn portion 5 occupies, and based on this, determines whether the quality is good or bad and whether confirmation / cleaning is necessary. In the present embodiment, the wear angle is used as an index indicating the range and area size of the wear portion 5, and it is determined that the larger the wear angle, the more deteriorated. The method of deriving the wear angle will be described later. As described above, in the present embodiment, an angle is adopted as a value indicating the degree of deterioration of the component, and this angle is derived to determine the deterioration.

The replacement plan calculation unit 16 calculates the scheduled replacement date based on the previous measurement result (the previous wear angle and the number of times of use calculated by the determination unit 15) and the current measurement result. The number of times the target component 2 has been used is acquired from the elevator monitoring device 3 shown in FIG. 1 by wireless communication via the network I / F 106. The number of times of use acquired here is a value of the cumulative number of times of use after the part is newly installed or replaced.

The guidance image creation unit 17 creates a guidance image including a frame, a guidance message, and the like. The frame is an image stored in the storage unit 18 in advance so that the operator can take an image in a normal position and direction, and the frame is an image of the outer shell of the elevator component when viewed from one direction. It is an image that imitates a part or all. Since the visual direction of each frame image is the imaging direction at the time of deterioration inspection, it is preferable that the portion easily deteriorated is projected in a preferable direction. The display unit 12 superimposes the guidance image created by the guidance image creation unit 17 on the real-time image obtained from the CCD camera 160 during the imaging operation.

The storage unit 18 includes the RAM 103 and the storage 140, and images the current measurement date, the determination result and the measurement result (wear angle and the number of times of use) by the determination unit 15, and the scheduled exchange date calculated by the exchange plan calculation unit 16. It is stored in association with a plurality of images. The storage unit 18 stores in advance a frame image (frame frame 151 and guide line 153 described later) and a message for guidance.

4 (A) and 4 (B) show the position and orientation of the mobile terminal device 1 when imaging the target component 2 on the left side, and display examples of the display unit 12 at the position and orientation on the right side. It is shown in the figure. In FIGS. 4A and 4B, the same target component 2 is imaged, but the locations are different from each other. Here, the state in which the position and orientation are adjusted to obtain the first image is shown in 4 (A), and after the first image is captured, the location is changed and the adjustment is made to obtain the second image. It is assumed that this state is shown in FIG. 4 (B).

The display unit 12 displays the frame frame 151 at a fixed position and a fixed size on the screen. Further, the display unit 12 displays the guide line 153 shown by the broken line. The guide line 153 is for guiding the mark 21 of the target component 2 to be located on the line, and is different for each location (see FIGS. 4 (A) and 4 (B)). ..

The display unit 12 displays a plurality of arrow lines 152 connecting the frame line of the frame frame 151 to the outer shell of the ellipse B (the boundary between the inner surface S1 of the cylinder and the upper surface S2) displayed on the display unit 12. The guidance image creation unit 17 extracts the shape of the ellipse B each time a real-time image is obtained from the CCD camera 160. For the extraction of this elliptical region, the existing method disclosed in Michele Fornaciari / Andrea Prati "Very fast ellipse detection for embedded vision applications" may be used. The guidance image creation unit 17 extracts the feature points of the parts projected in the real-time image, connects the feature points with the feature points on the frame frame 151, creates one or more arrow lines 152, and displays the feature points. Displayed in unit 12. By displaying the arrow line 152 in this way, the operator can easily determine which part is to be matched, and the mobile terminal device 1 is moved to which position and directed in which direction. It can be easily determined.

The display unit 12 displays messages 154 and 155 directed to the operator for guiding the user to a predetermined imaging position and orientation. The message 154 is a fixed message, but the message 155 is a message that is switched according to the relative position and relative orientation of the mobile terminal device 1 with respect to the target component 2. The guidance image creation unit 17 creates the message 155 by switching according to the size and position of the projected ellipse B, and the display unit 12 displays this. For example, when the size of the ellipse B is smaller than the frame frame 151, the guidance image creation unit 17 creates a message urging the mobile terminal device 1 to move closer to the target component 2, and when it is larger, creates a message urging the mobile terminal device 1 to move away. To do. When the center of gravity of the ellipse B is located on the right side of the center of gravity of the frame frame 151, the guidance image creation unit 17 creates a message prompting the mobile terminal device 1 to be held to the right, and when it is located to the left, it is held to the left. Create a message prompting you to. Further, when the center of gravity of the ellipse B is located above the center of gravity of the frame frame 151, the guidance image creating unit 17 creates a message prompting the mobile terminal device 1 to be held upward, and when it is located below, it faces downward. Create a message that encourages you to set up.

The operator adjusts the position and orientation of the mobile terminal device 1 according to the message and the display image created by the guidance image creation unit 17. More specifically, the operator moves the mobile terminal device 1 and adjusts the orientation so that the ellipse B matches the frame frame 151 and the mark 21 is located on the guide line 153.

When the specified imaging position and the specified orientation are obtained, the operator performs a predetermined imaging operation to image the target component 2. Alternatively, the imaging unit 13 may detect that the imaging unit 13 has reached the specified imaging position and orientation, and the imaging unit 13 may perform the imaging operation by itself. After imaging, as shown in FIG. 4B, the operator moves the mobile terminal device 1 to another location, adjusts the position and direction according to the above guidance display, and performs imaging from the other location. This is repeated, and imaging is performed from a plurality of locations so as to go around the target component 2.

In the above example, the mobile terminal device 1 is rotated to take a plurality of images, but the same image can be obtained even if the mobile terminal device 1 is fixed at a specific location and the target component 2 is rotated to take an image. Obtainable. Further, in the above example, the mobile terminal device 1 is moved according to the guidance display and adjusted so as to have a specified position and direction, but the mobile terminal device 1 is fixed and the target component 2 is moved and rotated according to the guidance display. Then, it may be adjusted so as to have a specified position and direction. In the above example, the frame frame 151 is a frame that imitates only the ellipse B that is a part of the outer shell of the target component 2, but may be a frame that imitates the entire outer shell of the target component 2.

5 (A) and 5 (B) are diagrams showing display examples of measurement results, determination results, and the like. After the imaging unit 13 images the target component 2, the captured image is decomposed into a hue component and a luminance component and separated into a normal portion 6 and a worn portion 5. Then, as shown in FIG. 5A, the display unit 12 displays the measurement date, the wear angle, the determination result, the number of times of use obtained from the elevator monitoring device 3, and the necessity of confirmation / cleaning. FIG. 5B is a display example when the inspection is performed on a different day from FIG. 5A.

Here, a method of calculating the scheduled exchange date by the exchange plan calculation unit 16 will be described with reference to FIGS. 5 (A) and 5 (B). It is assumed that the wear angle is 10A (50 °) and the number of times of use is 11A (600,000 times) on the measurement day 9A shown in FIG. 5A. Then, as a result of measurement on the measurement day 9B shown in FIG. 5 (B), it is assumed that the wear angle is 10B (100 °) and the number of times of use is 11B (1.1 million times). From the state of FIG. 5 (A) to the state of 5 (B), the number of days (measurement day 9B-measurement day 9A) has elapsed, and during that time, the operation has been performed for the number of times (number of uses 11B-number of uses 11A). As a result, the wear progresses by (wear angle 10B-wear angle 10A). The replacement plan calculation unit 16 uses the number of elapsed days (measurement day 9B-measurement day 9A), the number of times of use (number of times of use 11B-number of times of use 11A), and the wear angle (wear angle 10B-wear angle 10A). The number of days until the wear progresses further from the wear angle 10B of 5 (B) and reaches the wear limit value (120 ° in this example) defined in advance is calculated. The replacement plan calculation unit 16 obtains the scheduled replacement date by adding the calculated number of days until the wear limit is reached to the measurement date 9B. As shown in FIG. 5A, in the case of the first inspection, the scheduled replacement date is not displayed because there is no previous measurement result.

FIG. 6 is a diagram for explaining a method of calculating the wear angle. In the present embodiment, the inner surface S1 of the cylinder of the target component 2 is divided into predetermined widths and angles. This one divided section is called a detection band. The determination unit 15 determines for each detection zone whether the detection band of interest is the normal portion 6 or the wear portion 5, and whether the bare metal is exposed. In the present embodiment, if any luminance component or hue component determined to be worn is present in the detection band, the determination unit 15 treats the detection band as the wear portion 5. In addition to this, the determination unit 15 sets the wear portion 5 according to, for example, the ratio of the hue component and the luminance component determined to be worn and the hue component and the luminance component determined to be normal. It may be determined whether it is the normal part 6 or the normal part 6.

Further, in the present embodiment, the conventional image processing technique is used to perform geometric transformation so that the center point O in the circle becomes the viewpoint position when calculating the wear angle θ. The determination unit 15 calculates the wear angle θ based on the number of detection bands determined to be the wear portion 5. For example, when one detection band width corresponds to 2 ° and there are 25 detection bodies determined as wear portions 5, the wear angle θ is 50 °.

Next, the determination method of the determination unit 15 will be described. 7 (A) and 7 (B) are graphs in which the horizontal axis is the number of uses and the vertical axis is the wear angle (unit is degrees), and is a diagram showing the correlation between the number of uses and the wear angle. .. In FIGS. 7 (A) and 7 (B), the reference line is a straight line connecting the correlation between the number of times of use and the wear angle when used in a normal state, and is based on past experience of using the part. Determined based on. In addition, the lower region is defined as a normal section and the upper region is defined as an abnormal section across the reference line.

For example, as shown in the measurement result P1 of FIG. 7A, the determination unit 15 uniformly measures the wear angle when it is equal to or larger than the wear limit line (broken line in the figure, 120 ° in this example). Judge as defective. Further, even if the hue component and the luminance component identified as the bare metal are detected even a little, the determination unit 15 considers that the deterioration has progressed considerably, and uniformly determines that the defect is defective.

As shown in the measurement result P2 of FIG. 7A, the determination unit 15 may have foreign matter mixed in or insufficient cleaning if it is located in an abnormal section even if the measurement result does not exceed the wear limit line. Since it is possible that the product is used in an abnormal condition such as, it is judged that confirmation / cleaning is required.

Further, as shown in the measurement result P4 shown in FIG. 7B, even if the measurement result is located within the normal section, the inclination of the previous measurement result P3 and the current measurement result P4 is the inclination of the reference line. If it is larger than, it may be used in an abnormal state such as foreign matter mixed in or insufficient cleaning. Therefore, the determination unit 15 determines that confirmation / cleaning is required when the inclination of the previous measurement result and the current measurement result is larger than the inclination of the reference line.

FIG. 8 is a flowchart showing an operation example of the mobile terminal device 1. The display unit 12 of the mobile terminal device 1 first displays a screen for selecting a part to be inspected, and allows an operator to select which part to inspect (S001). The selection screen is a screen displaying a list of names, product numbers, etc. of parts to be inspected. The worker selects one of the parts from the list and selects the part to be inspected. In the present embodiment, the above-mentioned component 2 (cylindrical flat plate member for the brake of the elevator) will be described as an inspection target, but any component of the elevator can be inspected. Further, here, it is assumed that the identification code for identifying the part and the association between the identification code and the data related to the part are set in advance.

When the target component is selected, the lighting unit 11 lights the LED light 170 to illuminate the target component 2 (S002). Note that step S002 is an optional process, and lighting is unnecessary when the amount of light in the environment is sufficient.

The guidance image creation unit 17 recognizes whether or not the target component 2 is included in the real-time image obtained from the CCD camera 160 (S003). The guidance image creation unit 17 performs edge extraction processing or the like to extract feature points of each part projected in the real-time image. The guidance image creation unit 17 determines whether or not the feature points arranged in a similar manner to the feature points of the target component 2 registered in advance are in the real-time image. As a result, the guidance image creation unit 17 determines whether or not the target component 2 is reflected in the real-time image. In the case of an ellipse, the existing method disclosed in the above "Very fast ellipse detection for embedded vision applications" may be used. Step S003 is repeated until it is recognized that the target component 2 is reflected (S003: No loop).

When it is recognized that the target component 2 is reflected (S003: Yes), the guidance image creation unit 17 creates and displays the frame frame 151, the arrow line 152, the guide line 153, and the messages 154 and 155 shown in FIG. It is displayed on the unit 12 (S004). The display unit 12 superimposes and displays the guidance image created by the guidance image creation unit 17 on the real-time image obtained from the CCD camera 160.

The operator adjusts the position and orientation of the mobile terminal device 1 to the specified ones according to the guidance image. The imaging unit 13 determines whether the outer shell (ellipse B in this example) of the target component 2 in the real-time image coincides with the frame frame 151 and the mark 21 is located on the guide line 153, thereby determining whether the mark 21 is located on the guide line 153. It is determined whether 1 is in the specified position and the specified direction (S005). The processing of steps S003 and S004 is repeated until the specified position and the specified orientation are reached (S005: No loop). When the specified position or orientation is reached (S005: Yes), the imaging unit 13 takes an image and obtains a still image at this timing (S006). This imaging may be performed by an operator's operation, or may be performed by the imaging unit 13 itself. The imaging unit 13 stores the obtained captured image in the storage unit 18 (S007).

When the steps up to step S007 are completed, the operator moves the mobile terminal device 1 to the next location. For example, when the imaging at the location shown in FIG. 4A is completed, the mobile terminal device 1 is then moved to the location shown in FIG. 4B. The processes of steps S003 to S007 are repeated until imaging at all locations is completed (S008: No loop).

When the imaging at all locations is completed (S008: Yes), the compositing unit 14 acquires the image obtained this time from the storage unit 18 and performs an existing geometric transformation process to synthesize these images. Then, it is made into one composite image (S009). The determination unit 15 and the exchange plan calculation unit 16 perform deterioration determination processing based on the composite image (S010). The detailed operation of this deterioration determination process will be described later.

The determination unit 15 and the exchange plan calculation unit 16 store the calculated measurement result, determination result, and scheduled exchange date in the storage unit 18 (S011). The saved data and the captured image saved in step S007 are stored as historical data and as material data to be presented to the customer.

The display unit 12 displays the measurement result, the determination result, and the scheduled exchange date calculated by the determination unit 15 and the exchange plan calculation unit 16 (S012). This display is, for example, as shown in FIG. 5 above.

Next, the details of the deterioration determination process in step S010 will be described. FIG. 9 is a flowchart showing a detailed operation example of the deterioration determination process.

The determination unit 15 first performs an initialization process (S101). In step S101, for example, a pass / fail determination flag indicating the result of the pass / fail determination and a confirmation flag indicating the necessity of confirmation / cleaning are initialized. The initial value of the pass / fail judgment flag is a value indicating a good judgment, and the initial value of the confirmation flag is a value indicating that confirmation / cleaning is unnecessary.

The determination unit 15 calculates the angle of the wear portion 5 from the composite image (S102), and determines whether the wear angle is larger than the wear limit angle (120 ° in this example) (S103). When it is larger than the wear limit angle (S103: Yes), a value indicating a defect determination is set in the pass / fail determination flag (S120). Even when it is determined that the bare metal is exposed, a value indicating a defect determination is set in the quality determination flag.

The determination unit 15 operates the network I / F 106 to acquire the current number of times the brake has been used from the elevator monitoring device 3 (S104). The determination unit 15 determines whether the measurement result is located in the abnormal section shown in FIG. 7 based on the current wear angle and the acquired number of uses (S105). When it is located in the abnormal section (S105: Yes), the determination unit 15 sets a value indicating that confirmation / cleaning is required in the confirmation flag (S121).

The replacement plan calculation unit 16 acquires the previously measured wear angle and the previous number of uses from the storage unit 18 (S106), and uses the current measurement result and the previous measurement result to determine the rate of change (deterioration) of the measurement result. The degree of progress of) is calculated (S107). The rate of this change is shown as the slope of the dashed arrow in the example of FIG. 7B. When the calculated rate of change is larger than the rate of the reference (for example, the slope of the reference line in FIG. 7B) (S108: Yes), the replacement plan calculation unit 16 sets a value indicating that confirmation / cleaning is required. Set to the confirmation flag (S122).

The exchange plan calculation unit 16 calculates the scheduled exchange date (S109). For this calculation, as explained with reference to FIG. 5, the previous use count, the previous wear angle, the previous measurement date, the current use count, the current wear angle, the current measurement date, and the wear limit value ( In this example, 120 °) is used to calculate the scheduled replacement date.

After that, the process proceeds to step S011 of FIG. 8, and the storage unit 18 stores the value of the pass / fail judgment flag and the value of the confirmation flag as the judgment result, stores the current wear angle and the number of times of use as the measurement result, and is scheduled to be replaced. Remember. Each of these data is stored in association with each other as one record. Further, as shown in FIG. 5, the display unit 12 displays the pass / fail result based on the pass / fail determination flag, and displays the check / cleaning necessity result based on the confirmation flag. Further, the display unit 12 displays the current wear angle, the number of times of use, and the scheduled replacement date (S012).

If it is judged to be defective, the worker or the person in charge makes a parts replacement plan, proposes the parts replacement to the customer, and after obtaining the customer's consent, arranges the parts and carries out the parts replacement. Carry out the process. If it is a defect determination, each of the above steps is performed immediately. In addition, if the result is that confirmation / cleaning is required, the operator sufficiently confirms the presence of foreign matter and performs cleaning. Even if the judgment result is good, the worker or the person in charge makes a parts replacement plan based on the displayed replacement scheduled date, proposes the parts replacement to the customer, and after the customer's consent is obtained, Arrange parts. In this case, since the parts can be replaced in time for the scheduled replacement date, the parts can be replaced with a margin.

In the present embodiment, the previous measurement result is acquired to calculate the inclination, the scheduled replacement date, and the like, but the past measurement result may be acquired and used, not limited to the previous measurement result.

In this embodiment, foreign matter contamination and insufficient cleaning are taken up as examples of factors leading to component deterioration. These are just examples, and the causes of component deterioration include parts that are deformed over time and have frequent contact points, the number of times of use has increased or decreased significantly, high temperature environment, low temperature environment, and direct sunlight. There are various things such as being installed in an exposed environment. These items are also subject to confirmation.

In the present embodiment, the target component 2 is a cylindrical member, but since it has a circular shape, there is no portion that can be a feature point. Therefore, it is not possible to determine whether or not the image can be accurately captured at the specified position around the component by simply guiding the outer shell of the component to the frame. In addition, it cannot be determined whether or not all of 360 ° is captured in the image without excess or deficiency. In the present embodiment, in order to eliminate these problems, the frame frame 151 is matched with the component frame, and the mark 21 is set as a feature point, which is aligned with the guide line 153. With this implementation, it is possible to take an image at an accurate position and orientation. The mark 21 and the guide line 153 may be unnecessary when the component shape is such that the image can be imaged at an accurate position and direction only by matching the frames.

Further, in the present embodiment, a plurality of images are combined so as to become one image once, and deterioration determination processing is performed based on the combined image, but only one imaging (one image) is performed. If the component can determine deterioration, the image composition process is naturally unnecessary. Further, the determination unit 15 may perform the determination process with a plurality of images as they are, instead of the combined images. In addition, if each image processing such as enlargement / reduction, rotation, and translation is performed and the wear angle can be obtained accurately by each image processing, the mark 21 and the guide line 153 are unnecessary, and only the frame frame 151 and the arrow line 152 are used. It may be an implementation that displays.

A part or all of the data stored in the storage unit 18 may be stored in an external server.

According to this embodiment, the same determination result can be obtained regardless of who implements it, so that it is possible to prevent work defects due to oversight of component defects. Furthermore, by comparing the measurement results of the previous time and this time, it is possible to confirm the scheduled replacement date of the parts. This makes it possible to make a parts replacement plan with a margin.

As described in detail above, according to the present embodiment, it is possible to prevent the deterioration determination of the parts of the elevator from being different for each operator.

The present invention is not limited to the above-described embodiment, and includes various modifications. For example, the above-described embodiment has been described in detail in order to explain the present invention in an easy-to-understand manner, and is not necessarily limited to the one including all the described configurations. Further, it is possible to replace a part of the configuration of one embodiment with the configuration of another embodiment, and it is also possible to add the configuration of another embodiment to the configuration of one embodiment. Further, it is possible to add / delete / replace a part of the configuration of each embodiment with another configuration. Further, each of the above configurations, functions, processing units, processing means and the like may be realized by hardware by designing a part or all of them by, for example, an integrated circuit. Further, each of the above configurations, functions, and the like may be realized by software by the processor interpreting and executing a program that realizes each function. Information such as programs, tables, and files that realize each function can be placed in a memory, a hard disk, a recording device such as an SSD (Solid State Drive), or a recording medium such as an IC card, an SD card, or a DVD.

1: Mobile terminal device 2: Target component 3: Elevator monitoring device 11: Lighting unit 12: Display unit 13: Imaging unit 14: Synthesis unit 15: Judgment unit 16: Replacement plan calculation unit 17: Guidance image creation unit 18: Storage unit 101: Controller 102: CPU
103: RAM
104: ROM
106: Network I / F
107: Panel I / F
108: CCD camera I / F
109: I / F
140: Storage 150: Touch panel display 160: CCD camera 170: LED light

Claims (7)

A mobile terminal device having an imaging unit
A frame that imitates a part or all of the outer shell of the elevator when the part of the elevator is viewed from one direction while projecting the image currently being imaged by the image pickup unit, at a fixed position and a fixed size. A display unit that is superimposed on the image and
A storage unit that stores a still image captured by the imaging unit when the frame displayed by the display unit and the outer shell of the component projected in the image match.
Acquiring the still image stored in the storage unit, based on the still image, to derive the deterioration degree is a value indicating the wear range of the components as derived degradation degree, and the derived degree of degradation and requires replacement A determination unit that determines the quality of the component by comparing it with a deterioration degree limit value that is a predetermined degree of deterioration and displays the determination result on the display unit.
Have a,
The determination unit acquires the number of uses is a number of times said component is used by the operation of the elevator as the acquisition usage count, the obtained number of times of use and the derived deterioration degree and determined by the measurement results, the number of times of use and the deterioration degree An abnormality that is a reference line connecting the correlation between the number of times of use and the degree of deterioration in a graph area having two axes, respectively, and is determined by a reference line determined based on the past use experience of the part. when located section determines that there is cause leading to the deterioration of parts, and displays the determination result on the display unit, the portable terminal device. The mobile terminal device according to claim 1 , further
Based on the said acquired number of times of use when the derived degree of deterioration and the derivation deterioration degree derived in the past has been derived, and the derived degree of degradation and the acquisition use count that is obtained this time derived time, the deterioration degree A mobile terminal device having an exchange plan calculation unit that calculates a scheduled date for reaching the limit value and displays it on the display unit. The mobile terminal device according to claim 1 or 2 .
The determination unit is set to the position whose past the derived derived deterioration degree and the graph area of the derivation deterioration degree is determined by the acquisition use count when derived measurement results, the derived degree of deterioration and derived time If the straight line connecting the position of the graph area of the measurement result determined by the number of acquisitions and uses acquired this time is larger than the inclination of the reference line, it is determined that there is a factor leading to deterioration of the component, and the display unit is displayed. A portable terminal device that displays the judgment result. The mobile terminal device according to any one of claims 1 to 3 .
The component of the elevator is a three-dimensional member in which a cylindrical surface penetrating from the top surface to the bottom surface is formed inside.
The determination unit converts the range of the worn portion of the cylindrical surface into an angle with the center of the circle of the cylindrical surface as a viewpoint, and sets the angle as the derived deterioration degree. .. The mobile terminal device according to any one of claims 1 to 4 .
The display unit is a mobile terminal device that displays an arrow line connecting the frame and the outer shell of the component projected in the image. The mobile terminal device according to any one of claims 1 to 5.
In the graph area, a region where the degree of deterioration with respect to the number of times of use is equal to or greater than the degree of deterioration on the reference line is defined as the abnormal section.
A mobile terminal device characterized by . A component deterioration determination program to be executed by a computer having an imaging unit, a display unit, and a storage unit.
A frame that imitates a part or all of the outer shell of the elevator when the parts of the elevator are viewed from one direction while displaying the image currently being imaged by the image pickup unit on the display unit is fixed at a fixed position and With a fixed size, it is superimposed on the image and displayed on the display unit.
When the frame displayed by the display unit and the outer shell of the component projected in the image match, the still image captured by the imaging unit is stored in the storage unit.
The still image stored in the storage unit is acquired, and the still image is acquired.
Based on the still image, the degree of deterioration, which is a value indicating the wear range of the part, is derived as the degree of deterioration .
The quality of the component is determined by comparing the derived deterioration degree with the deterioration degree limit value , which is the deterioration degree defined in advance when replacement is required.
It is a process of displaying the determination result on the display unit .
In the quality determination, obtained as the acquired usage count the number of uses is a number of times the component is used by the operation of the elevator, the obtained number of times of use and the derived deterioration degree and determined by the measurement results, the deterioration degree of the number of times of use An abnormality that is a reference line connecting the correlation between the number of times of use and the degree of deterioration in a graph area having two axes, respectively, and is determined by a reference line determined based on the past use experience of the part. when located section determines that there is cause leading to the deterioration of parts, components deterioration determining program for executing the processing for displaying the determination result on the display unit to the computer.