CN108701346B

CN108701346B - Wiring inspection work support system

Info

Publication number: CN108701346B
Application number: CN201780003964.3A
Authority: CN
Inventors: 池田祐一; 白石忠道
Original assignee: Mitsubishi Electric Corp
Current assignee: Mitsubishi Electric Corp
Priority date: 2016-02-01
Filing date: 2017-01-24
Publication date: 2021-11-30
Anticipated expiration: 2037-01-24
Also published as: JP6516884B2; JPWO2017135107A1; WO2017135107A1; CN108701346A

Abstract

Target image data (D) obtained by a wiring state of an imaging standard used for image processing and coverage range data (E) including a coverage range corresponding to the shape of an inspection part are prepared, a target feature quantity obtained by performing a logical operation of the target image data (D) and the coverage range data (E) and a feature quantity obtained by performing a logical operation of image data (F) obtained from a camera terminal (12) and the coverage range data (E) by changing the rotation angle of the coverage range data (E) are calculated, and the difference between the feature quantity at the rotation angle with the smallest difference from the target feature quantity and the target feature quantity is compared with a determination threshold value as an evaluation value, thereby determining the wiring operation.

Description

Wiring inspection work support system

Technical Field

The present invention relates to a wire connection inspection work support system for supporting an inspection work of a wire connection portion in assembling an electrical equipment housing, an instrument control panel, or the like.

Background

In general, when manufacturing an equipment housing or a control panel having a large number of cable connection portions, an operator performs a wiring operation while referring to a design drawing and an operation instruction, and then inspects the cable connection portions visually by an inspector.

In this case, when the worker is unfamiliar with the wiring work, a wiring work error such as forgetting to connect the wires (not connected) or connecting an erroneous cable (miswiring) is likely to occur. In this case, the inspector needs to redo the wiring work after finding the abnormality, and the time taken until completion of the production may be prolonged.

Therefore, it is considered to introduce a wire inspection work support system having: the operator checks the wire connection portion by himself/herself after the operator performs the wire connection operation, and can immediately redo the operation if there is a failure, thereby checking the wire connection portion.

As a technique for inspecting the wire connection portion, there is the following technique: the position that the operator visually observes is captured by using the sight line tracking device and the imaging device, image processing is performed, and after characters are discriminated, the image is compared with data stored in advance, and the wire connecting portion is inspected (see patent document 1).

Further, there is a technique of photographing an appearance of a wire harness arranged on a drawing board using a photographing camera having a driving unit and determining whether the wire harness is good or not based on a photographed image (see patent document 2).

Documents of the prior art

Patent document 1: japanese patent laid-open No. 2015-

Patent document 2: japanese patent No. 3533492

Disclosure of Invention

Wiring operations such as fitting of cable connectors, cable wiring of a screwless terminal block, and connection of power cable terminals are performed inside the device housing or the control panel. In this case, due to reasons such as cost and prevention of foreign matter contamination, or due to restrictions on space, there are cases where characters or symbol labels as identification attributes are not added to the wired cable.

In patent document 1, when there is no character recognition tag at the time of inspecting the wire connecting portion, the application range is limited.

Further, in patent document 2, it is necessary to keep the distance between the imaging camera and the identification label surface constant so as not to cause image blurring at the time of imaging.

In addition, the cables and cable connectors inside the equipment housing or the control panel are sometimes arranged at positions and postures in various spaces having different mounting heights or angles. Since it is necessary to check the connection state of such power terminals and connectors on the control board, it is difficult to apply the above-mentioned patent document 2 in which the range of imaging conditions is limited.

The present invention has been made to solve the above-described problems, and an object thereof is to provide a wire connection inspection work support system that can be applied to a cable and a connector without a character recognition tag in a wire connection state inspection work after the cable is mounted in a tray such as an electrical device or a control panel.

The wiring inspection work support system of the present invention includes:

a work instruction unit that notifies the worker of the content of the work instruction;

a camera terminal capable of photographing an examination part;

a storage unit that holds target image data obtained by a wiring state of an imaging standard used for image processing, mask range data including a mask range corresponding to a shape of the examination portion, and a determination threshold;

a distance confirmation unit for setting an appropriate distance between the examination portion and the camera terminal and a position of the camera terminal;

an image processing unit that obtains a target feature amount by performing logical operation of target image data and coverage range data, performs logical operation of image data acquired from a camera terminal and the coverage range data by changing a rotation angle of the coverage range data, calculates a feature amount for each rotation angle, compares a difference between the target feature amount and the feature amount at the rotation angle at which the difference with the target feature amount is smallest, with a determination threshold value, and determines a wire connection operation; and

and a determination result notification unit configured to notify the operator of the determination result from the image processing unit.

According to the above-described wire connection inspection work support system, it is possible to apply the wire connection portion not displaying characters, and it is possible to inspect the wire connection portion existing in various positions and directions accurately at a high speed.

Drawings

Fig. 1 is a conceptual diagram illustrating an implementation of the wiring inspection work support system according to embodiment 1.

Fig. 2 is a perspective view showing the configuration of a camera terminal in the wiring inspection work support system according to embodiment 1.

Fig. 3 is a block diagram showing a system configuration showing interaction with an operator in the wiring inspection work support system according to embodiment 1.

Fig. 4 is a diagram illustrating an example of a job instruction screen displayed on the display.

Fig. 5 is a diagram showing an example of the job item list part.

Fig. 6 is a flowchart showing the operation of the wiring inspection work support system according to embodiment 1.

Fig. 7 is a perspective view showing the intersection of the laser beams from the right and left laser pointers.

Fig. 8 is a block configuration diagram showing the processing contents of the image processing unit.

Fig. 9 is a diagram showing an example of the setting screen.

Fig. 10 is a diagram showing an example of the job item list part.

Fig. 11 is a diagram showing an example of the target setting session.

Fig. 12 is a conceptual diagram illustrating an implementation of the wiring inspection work support system according to embodiment 2.

Fig. 13 is a perspective view showing the configuration of a camera terminal in the wiring inspection work support system according to embodiment 2.

Detailed Description

Embodiment 1.

Fig. 1 is a conceptual diagram illustrating an implementation of the wiring inspection work support system according to embodiment 1. The camera terminal 12 is connected to the wiring inspection work support system main body 10 via a cable 11. Further, the operator 47 carries the camera terminal 12 and performs the work. Fig. 1 shows a case where a computer with an integrated display is used in the wiring inspection work support system, but the display and the computer may be separated and connected by a cable for the display or by a wireless communication method such as WiFi (wireless fidelity). Further, the display may be a display worn by the worker through a head-mounted display. The cable 11 is a cable such as a USB cable that performs power supply and signal transmission. For signal transmission, the camera terminal 12 may be connected by a wireless communication method such as WiFi instead of the cable 11, and may be provided with a battery therein to supply power.

Fig. 2 is a perspective view showing the structure of the camera terminal 12, fig. 2 (a) is a perspective view showing the front surface of the camera terminal 12, and fig. 2 (B) is a perspective view showing the back surface of the camera terminal 12. The camera terminal 12 is provided with a camera and a control board inside, and as shown in fig. 2 (a), the front panel 20 includes a camera opening 22 for imaging, a right laser pointer 23 and a left laser pointer 24 for aiming, and a right illumination 25 and a left illumination 26 for enabling imaging in a dark place. As shown in fig. 2 (B), the rear panel 30 includes a green LED31, a yellow LED32, and a red LED33 each having the function of the determination result notifying unit 46, and a cable connection socket 34 into which the cable 11 for connecting the camera terminal 12 and the wiring inspection work support system main body 10 is fitted.

Fig. 3 is a block diagram showing a system configuration showing interaction with the operator 47 in the wiring inspection work support system according to the present embodiment. The wire connection inspection work support system includes a work instruction unit 41, a distance confirmation unit 42, a camera terminal 12, an image processing unit 44, a storage unit 45, a setting unit 49, and a determination result notification unit 46. Further, the camera terminal 12 images an object (connection portion) 48. Fig. 4 is a diagram showing an example of the work instruction screen 50 displayed on the display of the operation instruction unit 41 in the operation support system main body 10 for wire connection inspection. In the work item list 51, a list of work items and check boxes showing the completion or incompletion of each work item are displayed. Fig. 5 is a diagram showing an example of a job item list part in the job instruction screen 50 in fig. 4. Information of the site instructed by the current work is displayed on the work site display 52. Examples of the work site display include the electric equipment enclosure a, the substrate B, and the connector C.

The appearance of the work site is shown in the appearance display 53. That is, an image showing a part where an operator can recognize a work or the like is performed in the electric equipment casing is displayed. In the work key display 54, a work key is displayed so that the operator can understand the content of the work. The target image display 55 displays a target image that the operator should change the position or orientation of the camera terminal 12 to obtain. The image data captured by the camera terminal 12 is displayed on the captured result display 56. In the work instruction display 57, a message for transmitting the work content to the worker is displayed. In fig. 4, for example, "insert connector J into connector C" is shown. "and the like. The determination result display 58 is one of the determination result notification units 46, and can display the evaluation value calculated by the image processing unit 44 and the determination threshold value acquired from the storage unit 45 while conveying the determination result to the operator by the character display of OK or NG. As an example of the determination result display 58, the following display is given.

NG evaluation value: 169 decision threshold: less than 50

Further, the selection button 59, the setting button 60, the visual OK button 61, and the visual NG button 62 in fig. 4 are buttons that can be pressed by an operator on a touch panel of a display of the wiring inspection work support system main body 10 or pressed by moving a cursor with a mouse in the wiring inspection work support system main body 10. When the selection button 59 is pressed, data on the name of the work object is acquired from the storage unit 45, and a list of the work objects is displayed. When an item is selected from the list of the work targets, the work instruction content of the first work portion in the selected work target is displayed on the work instruction screen 50.

Next, when the setting button 60 is pressed, the items displayed on the working portion display 72, the appearance display 73, the work key display 74, and the work instruction display 77, which will be described later with reference to fig. 9, are displayed on the setting screen 70, and the target image data D, the coverage area data E, the determination threshold, and the data type work object name (for example, connection of the connector C) for identifying them, which are shown in fig. 8 and registered in the storage unit 45, can be set and registered in the storage unit 45.

When the visual OK button 61 is pressed, the determination result is set to OK according to the judgment of the operator, and the operation is shifted to the next operation site. When the visual NG button 62 is pressed, the determination result is set to NG according to the judgment of the operator, and the operation is ended. These buttons are prepared for performing the next job or ending the job according to the judgment of the operator when the judgment result of the image processing section 44 is not OK, such as when the set target image data D, the coverage area data E, and the judgment threshold are not appropriate.

Fig. 6 is a flowchart showing the operation of the wiring inspection work support system according to the present embodiment, and is divided into the operation on the operator side and the processing on the system side, and shows the operation with the lapse of time. When the work is started (step S0), the worker 47 first presses the selection button 59 of the work instruction screen 50 displayed on the display of the work support system main body 10 by the work instruction unit 41 (step S1). Since the operation instructing unit 41 of the wire check operation support system main body 10 displays the list of the operation targets (step S10), the operator 47 selects the operation target from the list (step S2). Thereafter, since the first work item of the selected work object is displayed by the work instruction unit 41 (step S11) and each work item in the work item list 51 shown in fig. 5 is in an uncompleted display state (no check mark), the operator 47 confirms the display content of the work instruction screen 50 (step S3).

As shown in fig. 1, the worker performs the wiring work at a portion such as the cable wiring portion 16 in the electrical equipment enclosure 15 (step S4). After the wiring work is performed, the camera terminal 12 is held by hand, the camera terminal 12 is brought close to the cable connection site 16 (step S5), and the camera terminal 12 is moved toward the cable connection site 16, for example, so that the cable connection site 16 enters the camera imaging range 13. The right laser pointer 23 and the left laser pointer 24 of the camera terminal 12 emit laser beams so as to intersect within the camera imaging range 13, and the operator adjusts the position and the direction of the camera terminal 12 so that the intersection of the laser beams from the right laser pointer 23 and the left laser pointer 24 coincides with the laser pointer intersection 37 on the target image display 55 displayed on the work instruction screen 50. Fig. 7 is a perspective view showing the intersection of the laser beams from the right laser pointer 23 and the left laser pointer 24. In the present embodiment, the right laser pointer 23 and the left laser pointer 24 themselves correspond to the distance confirmation unit 42.

Then, the operator 47 can set an appropriate distance between the object 48 and the camera terminal 12 and a predetermined position of the camera terminal 12 by the distance confirmation unit 42. The work instruction unit 41 displays a picture (target image display 55) of the object 48 together with a position at which the intersection 37 of the right laser pointer 23 and the left laser pointer 24 is aligned. The operator 47 can adjust the distance between the object 48 and the camera terminal 12 so that the intersection of the right laser pointer 23 and the left laser pointer 24 is aligned with the position indicated by the work instruction unit 41, and therefore, the work of adjusting the distance can be performed more efficiently. Further, since the intersection is aligned with a predetermined position in the field of view of the camera terminal 12, as will be described later, the image processing unit 44 does not need to consider enlargement or reduction, does not need to consider parallel movement, but only needs to consider rotational movement, and can determine the quality of the image more quickly and accurately. In addition, a plurality of 3 or more laser pointers may be provided.

In this way, the operator 47 brings the camera terminal 12 close to the cable connection site 16 (step S5), and performs image processing by the image processing unit 44 in the connection check work support system main body 10 to display the determination result (step S12).

The determination result is displayed on the determination result display 58 of the work instruction screen 50 and the green LED31, the yellow LED32, and the red LED33 of the camera terminal 12 by the determination result notification unit 46. When the image processing is performed and the determination result is displayed (step S12), in order to indicate that the examination is in progress, the determination result of the determination result display 58 indicates "under examination", the green LED31 is turned off, the yellow LED32 is turned on, and the red LED33 is turned off. If the determination result output from the image processing unit 44 is OK (good), the determination result display 58 displays "OK", updates the display of the evaluation value and the determination threshold, turns on the green LED31, turns off the yellow LED32, and turns off the red LED 33. Similarly, when the determination result output from the image processing unit 44 is NG (failure), the determination result display 58 displays "under inspection", updates the display of the evaluation value and the determination threshold value, turns off the green LED31, turns on the yellow LED32, and turns off the red LED 33.

The operator confirms that the result of the determination is "OK" based on the lighting state of the green LED31 or the determination result display 58 of the work instruction screen 50 (step S6), and presses the switch 27 provided on the grip 21 of the camera terminal 12 in order to confirm whether or not the next work item is present. At this time, if there is a next work item (yes), the work instruction unit 41 of the work-by-wire inspection support system main body 10 displays the corresponding work item in the work item list 51 in the completed display state (with a check mark), and displays a work instruction for the next work item (step S13). If there is no next work item ("no"), it indicates that all the items in the work item list 51 are in the completed state (the state in which all the check boxes are checked), and the worker completes the work (step S7). Here, instead of pressing the switch 27, it may be confirmed that the next work item is entered after a certain time has elapsed. In this case, the switch 27 is not required.

The operator 47 presses the NG button 62 to visually check if the determination result is "OK" even when the operator is not able to observe the cable connection portion again or adjust the position and direction of the camera terminal 12. At this time, "NG" is displayed in the determination result of the determination result display 58, the green LED31 is turned off, the yellow LED32 is turned off, the red LED33 is turned on, and the worker 47 interrupts the work. Thereafter, in order to perform the inspection again, the selection button 59 of the job instruction screen 50 is pressed (step 1).

Fig. 8 is a block configuration diagram showing the processing contents of the image processing unit 44. In fig. 6, when the image processing is performed and the determination result is displayed (step S12), the processing contents shown in fig. 8 are implemented. Fig. 8 shows a separate operation from the operation of connecting the connector C shown in fig. 4, and specifically, the wiring operation of the red wiring 65, the blue wiring 66, and the white wiring 67 will be described. First, target image data D, coverage area data E, and a determination threshold value are acquired from the storage unit 45. Here, the target image data D is an image obtained for the wiring state of the shooting standard used in the image processing. The coverage area data E is data including

coverage areas

68A, 68B, and 68C corresponding to the shape of the examination region. Next, masking processing of the target image data D is performed (step S21), and the average color Y of each region in the masking range of the target image data D is obtained. That is, in the red wiring 65A, the blue wiring 66A, and the white wiring 67A of the target image data D, the colors are extracted for the regions of the

coverage areas

68A, 68B, and 68C indicated by the coverage area data E, and the average color in each region is obtained. In the case of fig. 8, the average color of each region of red, blue, and white is obtained. Here, the region refers to a region corresponding to the coverage (for example, 68A, 68B, 68C) on the target image data D. In addition, the area average color refers to an average color in the coverage area on the target image data D. The method of obtaining the average color will be described later.

In the case where the same processing of the target image data D and the mask range data E is repeated, the processing for obtaining the average color may be performed only for the 1 st time, and the processing for the 2 nd time and thereafter may be omitted. The target image data D is an 8-bit RGB color image, and the coverage area data E is 1-bit image data. The resolution of the target image data D and the coverage area data E is the same as that of the image captured by the camera terminal 12.

When the image processing is performed and the determination result is displayed (step S12), the image data F is acquired from the camera terminal 12 (step S20). The image data F corresponds to the imaging result 56 in fig. 4, and shows a red wire 65, a blue wire 66, and a white wire 67 that are actually imaged by the camera terminal 12. With respect to the image data F and the data for the coverage area E, the data obtained by performing the rotation processing of the coverage area (step S22) from the coverage rotation angle list X is subjected to the coverage processing (step S23), and the average color of each area in each coverage area of the image data F acquired for shooting is obtained in the same manner as described above. The image data F is subjected to masking processing on data obtained by rotating the masking range data E by a predetermined angle, unlike the target image data D. That is, since the deviation in the rotational direction remains when the position is located at the intersection 37 of the right laser pointer 23 and the left laser pointer 24, the coverage area data E is rotated by a predetermined angle to perform the coverage processing so that the detection can be performed even if the deviation is a certain degree, and the average color of each region for each angle is obtained as in the case of the target image data D.

Each region average color includes more than 1 8-bit RGB value. In fig. 8, there are 3 groups of 8-bit RGB values for red, blue, and white. In the rotation process of the coverage range data E (step S22), the rotation process is performed for each angle included in the coverage rotation angle list X, and the average color of each region for each angle is obtained. The absolute value of the difference between the 8-bit RGB values of the average color Y for each region of the target image data D and the average color Z for each region of the image data F acquired by capturing at each angle is calculated, and the maximum value among these values is obtained (step S24). That is, in the case of fig. 8, the maximum difference among 3 of red, blue, and white at each angle is obtained. Then, the smallest value when the maximum values are compared with respect to the respective elements (respective rotation angles) of the covering rotation angle list X is obtained (step S25), and this is used as the evaluation value T. If the evaluation value T is equal to or less than the determination threshold value R, it is determined as OK (good), otherwise, it is determined as NG (bad) (step S26), and the determination result P is obtained and set in the determination result notification unit 46.

According to the wiring inspection work support system having the above-described feature, since the determination of the quality is performed based on the color information in the coverage area of the image data F, the system can be applied to a wiring portion where a character is not displayed. Further, the operator 47 can move the camera terminal 12 toward the object 48 to specify the distance and the position of the imaging portion and image the image, and the image processing unit 44 can appropriately cope with the deviation in the rotational direction of the image data F that is difficult to adjust by the operator 47, and can accurately inspect the connecting portion existing at various positions and directions at high speed.

In the covering rotation angle list X, for example, values arranged at intervals of 3 degrees in a range of ± 30 degrees are used. In this case, the elements are arranged at intervals of 3 degrees. In this way, the interval of the angles is enlarged to the extent that the determination of the quality can be normally performed, and the processing speed can be increased. In the masking process, logical operations (for example, product operations or product-sum operations) are performed on the input image data F and the input masking range data E, and only the image data F in the masking ranges 68A, 68B, and 68C are extracted. Further, in order to distinguish the range within the coverage area data E, label processing is performed, and the respective ranges are numbered (the

coverage areas

68A, 68B, and 68C are respectively numbered), so that the image data F of the respective extracted ranges can be identified. This enables the average color of the image data F in each range to be output as the feature value.

Here, the coverage area data E is 1-bit image data, and the

coverage areas

68A, 68B, and 68C are numbered by performing label processing. In contrast, a plurality of coverage range data may be used, and tag processing may be omitted by associating each coverage range data with a number. That is, in the case of fig. 8, the

coverage areas

68A, 68B, and 68C are registered as independent coverage area data, and tag processing is performed on the 3 data. In the process of obtaining the average color, the color that becomes the median value in the pixels in each range may be obtained, or different process contents such as the process may be further performed by determining whether or not the pixels in the preset color range are included by a predetermined ratio or more.

The image format of the target image data D and the image data F may be different image data formats such as CMYK images, for example, in addition to the 8-bit RGB color image. The image format of the coverage area data E may be an image data format other than a 1-bit image or data indicating coordinates on image data.

As described above, according to the present embodiment, the image processing unit 44 obtains color information of the coverage area by changing the rotation angle of the coverage area data E with a predetermined position as the rotation center in the image data F and the coverage area data E acquired from the camera terminal 12, and performing logical operation of the image data F and the coverage area data E, and calculates a feature amount including the color information for each rotation angle. Then, a feature amount at a rotation angle at which the target feature amount obtained by performing logical operation of the target image data D and the coverage area data E most matches (has the smallest difference between) the target feature amount is extracted, the difference between the feature amount and the target feature amount is obtained as an evaluation value T, and the evaluation value T is compared with a determination threshold value to determine whether the image is good or not.

The above operations are summarized with reference to fig. 3. First, the work instruction unit 41 notifies the worker 47 of the work instruction content (arrow 131). Next, the worker 47 adjusts the distance between the object 48 and the camera terminal 12 (arrow 132). In the present embodiment, the right laser pointer 23 and the left laser pointer 24 are distance confirmation units 42, and the distances are adjusted by using these. Next, the operator 47 moves the camera terminal 12 toward the object 48 (arrow 133). Then, the camera terminal 12 photographs the object 48 (arrow 134). Next, the image processing section 44 acquires image data from the camera terminal 12 (arrow 135), and acquires reference data from the storage section 45 (arrow 136). Next, the image processing unit 44 sets the determination result in the determination result notification unit 46 (arrow 137). Then, the determination result notification unit 46 notifies the operator 47 of the determination result (arrow 138).

Next, in fig. 4, when the setting button 60 is pressed, the setting unit 49 of the work-by-wire inspection work support system main body 10 displays a setting screen 70 as shown in fig. 9 on the display. The setting screen 70 displays a list of work items in the work item list 71, and when the addition button 83 is pressed, an item is added to the work item list 71. When the delete button 84 is pressed, the selected item can be deleted in the work item list 71. Fig. 10 is a diagram showing an example of the job item list 71.

When a work item of the work item list 71 is selected, an underline is displayed in the corresponding work item name as shown in fig. 10. In fig. 10, the columns of connector C are underlined. This clearly shows the item being selected, and updates the set contents in the work site display 72, the appearance display 73, the work key display 74, the target image 75, the work instruction display 77, and the determination result display 78. Here, the working site display 72 and the working instruction display 77 perform the same display as the working site display 52 and the working instruction display 57 in fig. 4. As an example of the determination result display 78, the following example is given.

Evaluation value in setting: judging a threshold value: less than 50

In this case, when the working site display 72 or the working instruction display 77 is pressed, the text of each column can be edited by inputting from the keyboard connected to the wire-connection inspection work support system main body 10, and the setting can be updated when the enter key is input. When the appearance display 73 and the job key display 74 are clicked, a file selection session can be opened and the displayed image can be changed. When the test button 80 is pressed, the operator 47 can start the operation of fig. 6 and perform the operation test by capturing the target image 75 with the camera terminal 12 only with respect to the setting content of the currently selected work item. When the ok button 81 is pressed, the setting contents are stored in the storage unit 45. When the cancel button 82 is pressed, the setting contents are discarded and the operation instruction screen 50 in fig. 4 is returned to.

Next, target settings such as setting of the coverage range and setting of the intersection target position of the laser pointer will be described. When the destination setting button 79 in the setting screen 70 of fig. 9 is pressed, the destination setting session 105 of fig. 10 is displayed. In the target setting session 105, the target image 75 is displayed on the coverage setting display 90, and the drawing contents of the coverage area indicated by the coverage setting part 103 are displayed in a superimposed manner on the target image 75. In the example shown in fig. 11, a cover range (cover setting portion 103) is set for the connector. When the shooting button 100 is pressed, the drawing contents of the coverage area are all cleared, the image acquired from the camera terminal 12 is set as the target image 75, and the display contents are updated.

When the coverage drawing buttons 91 to 93 are pressed, if a touch panel or a mouse cursor is used to perform a drawing in a state where the button is pressed on the coverage setting display 90, the coverage can be drawn. This enables the coverage area data E to be created. Similarly, when the cover erasing button 94 is pressed, the cover range can be erased. The sizes of the marks displayed by the covering drawing buttons 91 to 93 and the covering erasing button 94 are the thicknesses of the lines when the covering range is drawn and erased. That is, the size of the circle in the

buttons

91, 92, 93 is sequentially increased, and the thickness of the line is increased in this order. Further, when the determination threshold display 97 is pressed, the value of the determination threshold can be set between 0 and 255 as 8-bit values. The magnitude of the determination threshold is subjectively determined by each worker 47 at each site.

Since the setting of the coverage area is performed according to the judgment of the setting operator, the setting contents may be inappropriate, and the setting contents may not be accurately determined even if the intersection points of the right laser pointer 23 and the left laser pointer 24 are aligned. Therefore, after the target image 75, the coverage area, and the determination threshold are set, the update button 98 is pressed to update the good range map display 95. Then, as in the good range 104 shown in fig. 11, it is determined as OK (good) when the intersection of the right laser pointer 23 and the left laser pointer 24 is aligned with the vicinity of the target image 75. The good range map display 95 uses the target image 75 itself as an input image. That is, since the target image 75 is an image obtained by capturing a standard wiring state, the determination result must be OK. Then, the target image 75 is moved in parallel in the vertical and horizontal directions, simulation processing is performed by the image processing unit 44, and a range of parallel movement processing that is actually determined by the image processing unit 44 to be OK (good) is drawn to overlap the target image 75, thereby obtaining a good range 104. Further, the image processing unit 44 may determine a circumscribed rectangle of the good range 104 by making a determination, and display the size thereof on the good range value display 96. That is, the operator may operate the camera terminal 12 so that the intersection of the right laser pointer 23 and the left laser pointer 24 is aligned within the good range 104.

The setting operator sets the target image data D of the correct wiring state captured by the camera terminal 12, the coverage area data E, and the determination threshold value in the storage unit 45 by the setting unit 49, and registers the target image data D, the coverage area data E, and the determination threshold value in the storage unit 45 together with the determination threshold value. Then, the setting unit 49 actually makes the image processing unit 44 perform determination on the plurality of image data generated by parallel-moving and enlarging/reducing the target image data D. A good/bad range map showing a good range or a bad range is shown according to the determination result, or a good/bad range evaluation value is displayed in the good range value display 96. As described above, the setting operator can confirm the good or bad range map or the good range value display 96 and determine whether or not the set target image data D, the coverage area data E, and the determination threshold are appropriate data with a low possibility of erroneous determination, so that erroneous determination due to inappropriate setting contents can be prevented.

The setting operator can recognize the allowable range of the position to which the camera terminal 12 is moved and the possibility of erroneous determination by checking the good range map display 95 and the good range value display 96. For example, if the good range 104 is too small, the allowable range of the position of the camera terminal 12 becomes small, and even if the operator moves the camera terminal 12, the operator always takes a working time without determining OK (good). Further, when the good range 104 is too large or 2 or more portions exist, the possibility of erroneous determination increases. When clear button 99 is pressed, good range map display 95 and good range value display 96 are cleared. When the determination button 101 is pressed, the coverage range is set, and the screen returns to the setting screen 70. When the cancel button 102 is pressed, the contents of the edit of the coverage area are discarded, and the screen returns to the setting screen 70.

Embodiment 2.

Fig. 12 is a conceptual diagram illustrating an implementation of the wiring inspection work support system according to embodiment 2. In embodiment 1 described above, the wiring check work support system main body 10 and the camera terminal 12 are connected by a cable 11 or the like as shown in fig. 1, whereas in the present embodiment, a wiring check work support system main body 200 in which the wiring check work support system main body and the camera terminal are integrated is provided as shown in fig. 12. Fig. 12 shows a case where the camera terminal has a built-in battery, but a power cable may be connected.

Fig. 13 (a) is a perspective view showing a front surface portion of the camera terminal, and fig. 13 (B) is a perspective view showing a rear surface portion of the camera terminal. As shown in fig. 13, the wiring inspection work support system main body 200 includes a touch panel display 201 on the back panel 30 of the camera terminal, and displays the work instruction screen 50 and the setting screen 70 or a part thereof on the display. For example, when the display area of the display is narrow, only the target image display 55, the determination result display 58, and the like may be displayed.

In addition, the present invention can freely combine the respective embodiments within the scope of the present invention, or appropriately modify or omit the respective embodiments.

Claims

1. A wiring inspection work support system includes:

a camera terminal capable of photographing an examination part;

a storage unit that holds target image data obtained by a wiring state of an imaging standard used for image processing, coverage range data including a coverage range corresponding to a shape of the examination portion, and a determination threshold;

an image processing unit that calculates a target feature amount by performing logical operation between the target image data and the coverage range data, calculates a feature amount for each of the rotation angles by performing logical operation between image data acquired from the camera terminal by changing the rotation angle of the coverage range data and the coverage range data, compares a difference between the feature amount and the target feature amount at the rotation angle having the smallest difference with the target feature amount as an evaluation value, and determines a wiring work by comparing the evaluation value with the determination threshold value; and

and a determination result notification unit configured to notify the determination result from the image processing unit.

2. The system for supporting a work of checking a wire according to claim 1,

the wiring inspection work support system is provided with a distance confirmation unit for setting an appropriate distance between the inspection site and the camera terminal and a position of the camera terminal.

3. The system for supporting a work of checking a wire according to claim 2,

the camera terminal is positioned by aligning the intersection of the laser light emitted from the plurality of laser pointers with a predetermined position of the examination portion.

4. The system for supporting a work of checking a wire according to claim 3,

the image processing unit performs simulation determination on a plurality of image data generated by parallel-moving and enlarging/reducing the target image data, and obtains the range of the intersection of the laser beams based on the determination result.