JPWO2017135107A1 - Connection inspection work support system - Google Patents

Abstract

  Target image data (D) obtained by photographing a normal connection state for use in image processing and mask range data (E) including a mask range corresponding to the shape of the inspection location are prepared, and the target image data (D) Image data (F) and mask range data acquired from the camera terminal (12) by changing the target feature amount obtained by logically calculating the mask range data (E) and the rotation angle of the mask range data (E). The feature value obtained by performing the logical operation of (E) is calculated, and the difference between the feature value and the target feature value at the rotation angle at which the difference from the target feature value is the smallest is used as an evaluation value, and the determination threshold value is compared. By doing so, the connection work is judged.

Description

  The present invention relates to a connection inspection work support system that supports inspection work of cable connection points during assembly of an electrical equipment housing, an instrumentation control panel, and the like.

In general, when manufacturing equipment casings or control panels with many cable connection points, the operator performs the connection work while referring to the design drawings and work instructions, and then the inspection point is visually inspected by the inspector. Is done.
At this time, if the worker is not familiar with the connection work, a connection work mistake such as forgetting the connection (not connected) or connecting the wrong cable (incorrect connection) is likely to occur. In this case, it is necessary to redo the connection work after the inspector finds an abnormality, and the time required to complete the production may be extended.

Therefore, it is possible to introduce a connection inspection work support system with a function of inspecting the connection location so that the operator can inspect the connection location by himself / herself after the connection work, and immediately start again if there is a defect. Conceivable.
As a technique for inspecting the connection location, the position that the operator is viewing is imaged using a line-of-sight tracking device and an imaging device, image processing is performed, characters are identified, and compared with data stored in advance There has been a technique for inspecting a connection part by doing (see Patent Document 1).
In addition, there has been a technique for photographing the appearance of a wire harness arranged on a drawing board using a photographing camera having a drive unit and determining pass / fail based on a captured image (see Patent Document 2).

JP2015-60339 Japanese Patent No. 3533492

In the equipment housing and control panel, connection work such as cable connector fitting, cable connection with a screwless terminal block, or power cable terminal connection is performed. In that case, there are cases where the character or symbol label that is the identification attribute is not attached to the cable to be connected due to reasons such as cost, prevention of foreign matter contamination, or space limitations.
And in the said patent document 1, when there is no character identification label when test | inspecting a connection location, an application range is limited.

Furthermore, in Patent Document 2, it is necessary to keep the distance between the imaging camera and the identification label surface constant so that image blurring does not occur during imaging.
In addition, there are situations where the cables and cable connectors inside the device casing and the control panel are arranged in positions and postures in various spaces with different mounting heights and angles. Since it is necessary to inspect the connection state of such a power supply terminal and a connector on the control board, it is difficult to apply the above-described Patent Document 2 in which the imaging condition range is limited.

  The present invention has been made to solve the above-described problems, and in the inspection and inspection work of the cable connection state after mounting the cable in the panel such as an electric device or a control panel, the cable and the connector having no character identification label are also used. The object is to provide an applicable connection inspection work support system.

The wire connection inspection work support system according to the present invention,
A work instruction section for notifying workers of work instruction contents;
A camera terminal capable of photographing the inspection location;
A target image data obtained by photographing a normal connection state for use in image processing, mask range data including a mask range corresponding to the shape of the inspection location, and a storage unit that holds a determination threshold;
A distance confirmation unit for setting an appropriate distance between the inspection point and the camera terminal and the position of the camera terminal;
The target feature value is obtained by performing a logical operation on the mask image data for the target image data, and rotated by performing a logical operation on the image data acquired from the camera terminal and the mask image data by changing the rotation angle of the mask image data. The feature value is calculated for each angle, and the difference between the feature value and the target feature value at the rotation angle with the smallest difference from the target feature value is used as the evaluation value. An image processing unit for performing the determination;
A determination result notification unit that notifies the operator of the determination result from the image processing unit is provided.

  According to the connection inspection work support system as described above, the present invention can be applied to a connection portion where characters are not displayed, and connection portions existing in various positions and directions can be inspected quickly and accurately.

It is a conceptual diagram which shows the implementation condition of the connection inspection work assistance system by Embodiment 1. FIG. It is a perspective view which shows the structure of the camera terminal in the connection inspection work assistance system by Embodiment 1. FIG. It is a block diagram which shows the system configuration | structure which shows exchanges with the operator in the connection inspection work assistance system by Embodiment 1. FIG. It is a figure which shows an example of the work instruction | indication screen displayed on a display. It is a figure which shows an example of a work item list part. 3 is a flowchart showing the operation of the connection inspection work support system according to the first embodiment. It is a perspective view which shows the crossing location of the laser from a right side laser pointer and a left side laser pointer. It is a block block diagram which shows the processing content of an image process part. It is a figure which shows an example of a setting screen. It is a figure which shows an example of a work item list part. It is a figure which shows an example of a target setting dialog. It is a conceptual diagram which shows the implementation condition of the connection inspection work assistance system by Embodiment 2. It is a perspective view which shows the structure of the camera terminal in the connection inspection work assistance system by Embodiment 2. FIG.

Embodiment 1 FIG.
FIG. 1 is a conceptual diagram showing an implementation status of the connection inspection work support system according to the first embodiment. A camera terminal 12 is connected to the connection inspection work support system body 10 via a cable 11. Then, the worker 47 carries the camera terminal 12 and performs work. FIG. 1 shows a case where a display-integrated computer is used in the connection inspection work support system. However, the display and the computer are separated, and both are wireless communication such as a display cable or WiFi (Wireless Fidelity). You may make it connect by a means. Further, the display may be worn by the operator using a head mounted display. The cable 11 performs power supply and signal transmission such as a USB cable. Instead of the cable 11, it may be connected by wireless communication means such as WiFi for the purpose of signal transmission, and the camera terminal 12 may be supplied with power by incorporating a battery.

  2 is a perspective view showing a configuration of the camera terminal 12, FIG. 2A is a perspective view showing a front portion of the camera terminal 12, and FIG. 2B is a perspective view showing a rear portion of the camera terminal 12. . The camera terminal 12 has a camera and a control board installed therein. As shown in FIG. 2A, the front panel 20 has a camera opening 22 for photographing, a right laser pointer 23 for aiming, and A left laser pointer 24, a right illumination 25 and a left illumination 26 are provided to enable photographing in a dark place. Also, as shown in FIG. 2B, the rear panel 30 is connected to the connection inspection work support system main body 10 and the green LED 31, yellow LED 32, red LED 33, and camera terminal 12 that serve as the determination result notification unit 46. A cable connection socket 34 into which the cable 11 is fitted is provided.

  FIG. 3 is a block diagram showing a system configuration showing exchanges with the worker 47 in the connection inspection work support system according to the present embodiment. The connection inspection work support system includes a work instruction unit 41, a distance confirmation unit 42, a camera terminal 12, an image processing unit 44, a storage unit 45, a setting unit 49, and a determination result notification unit 46. Then, the camera terminal 12 images the object (connection point) 48. FIG. 4 shows an example of a work instruction screen 50 displayed on the display of the connection inspection work support system main body 10 by the work instruction unit 41. The work item list 51 displays a list of work items and a check box indicating the completion or incomplete state of each work item. FIG. 5 is a diagram showing an example of a work item list portion on the work instruction screen 50 in FIG. The work location display 52 displays information on the location where the current work instruction is given. As an example of the work location display, for example, the electrical equipment casing A, the board B, the connector C, and the like are displayed.

The appearance display 53 shows the appearance of the work location. That is, an image is displayed so that the worker can recognize which part of the electrical equipment casing is to be operated. The work procedure display 54 displays a work procedure so that the worker can understand the work contents. The target image display 55 displays a target image that the operator should take by changing the position and direction of the camera terminal 12. In the photographing result display 56, image data photographed by the camera terminal 12 is displayed. The work instruction display 57 displays a message that informs the worker of work contents. In FIG. 4, for example, “Connector J is inserted into connector C” is displayed. The determination result display 58 is one of the determination result notification units 46. The determination result is notified to the worker by OK or NG character display, the evaluation value calculated by the image processing unit 44, and the determination acquired from the storage unit 45. Displays the threshold. An example of the determination result display 58 is as follows.
NG evaluation value: 169 Judgment threshold value: 50 or less

  Further, the selection button 59, the setting button 60, the visual OK button 61, and the visual NG button 62 in FIG. 4 are used by the operator to press the touch panel on the display of the connection inspection work support system main body 10 or the mouse in the connection inspection work support system main body 10. The button can be used to move the cursor and press the corresponding button. When the selection button 59 is pressed, data related to the work target name is acquired from the storage unit 45 and a list of work targets is displayed. When an item is selected from the list of work objects, the work instruction content of the first work location in the selected work object is displayed on the work instruction screen 50.

  Next, when the setting button 60 is pressed, a setting screen 70 to be described later with reference to FIG. 9 is displayed, and items displayed on the work location display 72, the appearance display 73, the work procedure display 74, and the work instruction display 77 are displayed. Further, as shown in FIG. 8 registered in the storage unit 45, the target image data D, the mask range data E, the determination threshold value, and the work object name (for example, the connector C) for identifying these data sets. Are set so that they can be registered in the storage unit 45.

  When the visual OK button 61 is pressed, the determination result is set to OK by the operator's judgment, and the process proceeds to the next work location. When the visual NG button 62 is pressed, the determination result is set to NG at the operator's discretion and the work is finished. These buttons are used when the determination result by the image processing unit 44 is not OK, such as when the set target image data D, mask range data E, or determination threshold value is not appropriate. Or prepared to be able to finish the work.

  FIG. 6 is a flowchart showing the operation of the connection inspection work support system according to the present embodiment, and shows the operation over time divided into the operation on the operator side and the processing on the system side. When the work is started (step S0), the worker 47 first presses the selection button 59 on the work instruction screen 50 displayed on the display of the connection inspection work support system main body 10 by the work instruction unit 41 (step S1). . Since the work instruction unit 41 of the connection inspection work support system main body 10 displays a list of work objects (step S10), the worker 47 selects a work object from the list (step S2). Thereafter, the first work item of the work target selected by the work instruction unit 41 is displayed (step S11), and each work item in the work item list 51 as shown in FIG. 5 is displayed in an incomplete display state (no check mark). Therefore, the worker 47 confirms the display content of the work instruction screen 50 (step S3).

  As shown in FIG. 1, the worker performs the connection work at a place such as the cable connection place 16 in the electrical equipment housing 15 (step S4). After the connection work, the camera terminal 12 is held in the hand, the camera terminal 12 is brought close to the cable connection place 16 (step S5), and the camera terminal 12 is directed so that the cable connection place 16 enters the camera imaging range 13, for example. The right laser pointer 23 and the left laser pointer 24 of the camera terminal 12 emit laser beams so as to intersect within the camera imaging range 13, and the operator works at the intersection of the lasers from the right laser pointer 23 and the left laser pointer 24. The position and direction of the camera terminal 12 are adjusted so as to coincide with the position of the laser pointer intersection 37 on the target image display 55 displayed on the instruction screen 50. FIG. 7 is a perspective view showing the intersection of laser beams from the right laser pointer 23 and the left laser pointer 24. In the present embodiment, the right laser pointer 23 and the left laser pointer 24 themselves correspond to the distance confirmation unit 42.

The distance confirmation unit 42 allows the worker 47 to set an appropriate distance between the object 48 and the camera terminal 12 and a predetermined position of the camera terminal 12. The work instruction unit 41 indicates a position where the intersection point 37 of the right laser pointer 23 and the left laser pointer 24 is aligned together with a photograph of the object 48 (target image display 55). Since the worker 47 can adjust the distance between the object 48 and the camera terminal 12 so that the intersection of the right laser pointer 23 and the left laser pointer 24 matches the position indicated by the work instruction unit 41, the distance It is possible to make the work of combining them more efficient. Further, since the intersection point is set at a predetermined position in the field of view of the camera terminal 12, as will be described later, in the image processing unit 44, it becomes unnecessary to consider parallel movement in addition to enlargement / reduction, and only rotational movement. What is necessary is just to consider, and the quality determination can be made faster and more accurate. Three or more laser pointers may be installed.
In this way, the operator 47 brings the camera terminal 12 closer to the cable connection place 16 (step S5), while in the connection inspection work support system main body 10, the image processing unit 44 performs image processing and displays the determination result ( Step S12).

  The determination result is displayed on the determination result display 58 of the work instruction screen 50 and the green LED 31, yellow LED 32, and red LED 33 of the camera terminal 12 by the determination result notification unit 46. When the image processing is performed and the determination result is displayed (step S12), “inspection in progress” is displayed in the determination result of the determination result display 58, the green LED 31 is turned off, and the yellow LED 32 is turned off. Turns on and turns off the red LED 33. If the determination result output by the image processing unit 44 is OK (good), “OK” is displayed in the determination result on the determination result display 58, the evaluation value and the determination threshold are updated, and the green LED 31 is turned on. The yellow LED 32 is turned off and the red LED 33 is turned off. Similarly, if the determination result output by the image processing unit 44 is NG (defective), “inspection” is displayed on the determination result display 58, the display of the evaluation value and the determination threshold is updated, and the green LED 31 is changed. The LED is turned off, the yellow LED 32 is turned on, and the red LED 33 is turned off.

  The operator confirms that the determination result is “OK” from the lighting state of the green LED 31 or the determination result display 58 on the work instruction screen 50 (step S6), and checks whether there is a next work item. For this purpose, the switch 27 provided on the grip 21 of the camera terminal 12 is pressed. At this time, if there is a next work item (YES), the work instruction unit 41 of the connection inspection work support system main body 10 sets the corresponding work item in the work item list 51 to a display state of completion (with a check mark), and then A work instruction for the work item is displayed (step S13). If there is no next work item (NO), it indicates that all items in the work item list 51 are in a completed state (a state in which all check boxes are checked), and the worker completes the work ( Step S7). Here, instead of pressing the switch 27, it may be confirmed that a certain period of time has passed and the operation may proceed to the next work item. In that case, the switch 27 is unnecessary.

  If the operator 47 cannot confirm that the determination result is “OK” even after reviewing the cable connection location or adjusting the position and direction of the camera terminal 12, the operator 47 presses the visual NG button 62. At this time, “NG” is displayed as the determination result on the determination result display 58, the green LED 31 is turned off, the yellow LED 32 is turned off, and the red LED 33 is turned on. The worker 47 interrupts the work. In order to perform the inspection again after this, it starts by pressing the selection button 59 on the work instruction screen 50 (step 1).

  FIG. 8 is a block diagram showing the processing contents of the image processing unit 44. In FIG. 6, when the image processing is performed and the determination result is displayed (step S12), the processing content shown in FIG. 8 is performed. FIG. 8 shows an operation different from the operation of connecting the connector C shown in FIG. 4, and specifically, the operation of wiring the red wiring 65, the blue wiring 66, and the white wiring 67 will be described. It is. First, target image data D, mask range data E, and a determination threshold are acquired from the storage unit 45. Here, the target image data D is an image obtained by photographing a normal connection state for use in image processing. The mask range data E includes mask ranges 68A, 68B and 68C corresponding to the shape of the inspection location. Next, mask processing of the target image data D is performed (step S21), and each area average color Y in the mask range of the target image data D is obtained. That is, in each of the red wiring 65A, the blue wiring 66A, and the white wiring 67A of the target image data D, colors are extracted for the areas of the mask ranges 68A, 68B, and 68C indicated by the mask range data E, and the average color in each area is obtained. Ask for. In the case of FIG. 8, the average color of each area for each of red, blue, and white is obtained. Here, the area refers to a portion corresponding to a mask range (for example, 68A, 68B, 68C) on the target image data D. Each area average color refers to an average color in the mask range on the target image data D. The method for obtaining the average color will be described later.

  When the process for obtaining the average color is repeated for the same target image data D and mask range data E, the process can be performed only once and the second and subsequent processes can be omitted. The target image data D is an 8-bit RGB color image, and the mask range data E is 1-bit image data. The resolution of the target image data D and the mask range data E is the same as the resolution of the image captured by the camera terminal 12.

  Further, when image processing is performed and the determination result is displayed (step S12), the image data F is acquired from the camera terminal 12 (step S20). This image data F corresponds to the photographing result 56 of FIG. 4 and displays a red wiring 65, a blue wiring 66, and a white wiring 67 actually photographed by the camera terminal 12. For the image data F and the mask range data E, an image obtained by performing mask processing (step S23) on the image subjected to the mask range rotation processing (step S22) on the basis of the mask rotation angle list X, and capturing and acquiring the image. Each area average color in each mask range for data F is obtained in the same manner as described above. For the image data F, unlike the target image data D, the mask process is performed on the image obtained by rotating the mask range data E for each predetermined angle. That is, when alignment is performed at the intersection point 37 of the right laser pointer 23 and the left laser pointer 24, a deviation in the rotation direction remains. Therefore, in order to check even if there is some deviation, the mask range data E is set at a predetermined angle. Then, the mask processing is performed and the average color of each area for each angle is obtained in the same manner as in the case of the target image data D.

  Each area average color includes one or more 8-bit RGB values. In FIG. 8, there are 8-bit RGB values for three sets of red, blue, and white. In the rotation process (step S22) of the mask range data E, the process is performed for each angle included in the mask rotation angle list X, and the average color of each area for each angle is obtained. The absolute value of the difference is calculated for each 8-bit RGB value of each area average color Y with respect to the target image data D and each area average color Z with respect to the image data F captured and acquired for each angle, and among them, Is determined (step S24). In other words, in the case of FIG. 8, a value that maximizes the difference among the three of red, blue, and white at each angle is obtained. Then, when the maximum value is compared for each element (each rotation angle) of the mask rotation angle list X, a minimum value is obtained (step S25), and this is set as an evaluation value T. If the evaluation value T is equal to or less than the determination threshold R, the determination is OK (good), otherwise NG (bad) is determined (step S26), the determination result P is obtained, and set in the determination result notification unit 46. .

  According to the connection inspection work support system having the above-described features, the pass / fail determination is performed based on the color information in the mask range of the image data F. Therefore, the connection inspection work support system can also be applied to connection portions where no characters are displayed. In addition, the operator 47 points the camera terminal 12 toward the object 48 to determine the distance and the position of the shooting location, and performs image processing against a shift in the rotation direction of the image data F that is difficult for the operator 47 to adjust. The part 44 can cope with it appropriately, and the connection location which exists in various positions and directions can be test | inspected rapidly and accurately.

  For the mask rotation angle list X, for example, values arranged at intervals of 3 degrees in a range of ± 30 degrees are used. In this case, the above elements are arranged at intervals of 3 degrees. In this way, the processing speed can be improved by widening the angle interval to such an extent that normality can be determined normally. Here, the mask processing is performed on the input image data F and mask range data E by performing a logical operation (for example, a product operation or a product-sum operation) on the image data F and mask ranges 68A, 68B, 68C. Only the image data F is extracted. Further, a labeling process is performed to distinguish the ranges in the mask range data E, the respective ranges are numbered (numbers are assigned to the mask ranges 68A, 68B, 68C, respectively), and the extracted image data of each range F can be identified. As a result, the average color of the image data F in each range can be output as a feature amount.

Here, the mask range data E is 1-bit image data, and the mask ranges 68A, 68B, and 68C are numbered by performing a labeling process. On the other hand, by using a plurality of mask range data, the labeling process may be omitted by associating each mask range data with a number. That is, in the case of FIG. 8, the mask ranges 68A, 68B, and 68C are registered as different mask range data, and these three data are labeled respectively. In addition, the process for obtaining the average color may obtain a median color among the pixels in each range, and further determine whether or not the pixels in the preset color range are included in a predetermined ratio or more. May be replaced with different processing contents.
Further, the image formats of the target image data D and the image data F may be different image data formats such as CMYK images other than the 8-bit RGB color image. The image format of the mask range data E may be an image data format other than a 1-bit image or data indicating coordinates on the image data.

  As described above, according to the present embodiment, the image processing unit 44 changes the rotation angle of the mask range data E around the predetermined position in the image data F and the mask range data E acquired from the camera terminal 12. Thus, a feature amount composed of color information of the mask range obtained by performing a logical operation on the image data F and the mask range data E is calculated for each rotation angle. Then, a feature amount at a rotation angle that most closely matches (smallest difference) with the target feature amount obtained by logically calculating the mask range data E with respect to the target image data D is extracted, and this feature amount and the target feature amount are extracted. Is determined as an evaluation value T, and the evaluation value T is compared with a determination threshold value to perform pass / fail determination.

  The above operation will be summarized with reference to FIG. First, the work instruction unit 41 notifies the worker 47 of the work instruction content (arrow 131). Next, the operator 47 adjusts the distance between the object 48 and the camera terminal 12 (arrow 132). In the present embodiment, the right laser pointer 23 and the left laser pointer 24 are the distance confirmation unit 42, and the distance is adjusted by using these. Next, the worker 47 points the camera terminal 12 toward the object 48 (arrow 133). Then, the camera terminal 12 images the object 48 (arrow 134). Next, the image processing unit 44 acquires image data from the camera terminal 12 (arrow 135) and also acquires reference data from the storage unit 45 (arrow 136). Next, the image processing unit 44 sets a determination result for the determination result notification unit 46 (arrow 137). Then, the determination result notifying unit 46 notifies the operator 47 of the determination result (arrow 138).

  Next, when the setting button 60 is pressed in FIG. 4, the setting unit 49 of the connection inspection work support system main body 10 displays a setting screen 70 as shown in FIG. 9 on the display. The setting screen 70 displays a list of work items in the work item list 71, and adds an item to the work item list 71 when the add button 83 is pressed. When the delete button 84 is pressed, the item currently selected in the work item list 71 can be deleted. FIG. 10 is a diagram showing an example of the work item list 71.

When a work item in the work item list 71 is selected, an underline is displayed in the corresponding work item name as shown in FIG. In FIG. 10, an underline is drawn in the column of the connector C. As a result, the currently selected item is clearly indicated, and the set contents are updated in the work location display 72, appearance display 73, work procedure display 74, target image 75, work instruction display 77, and determination result display 78. Here, in the work location display 72 and the work instruction display 77, the same display as the work location display 52 and the work instruction display 57 in FIG. 4 is performed. Examples of the determination result display 78 include the following.
Under evaluation Evaluation value: Judgment threshold value: 50 or less At this time, when the work location display 72 or the work instruction display 77 is pressed, the text in each column can be edited by inputting from the keyboard connected to the connection inspection work support system body 10. The setting can be updated when the enter key is entered. When the appearance display 73 and the work procedure display 74 are clicked, a file selection dialog is opened, and an image to be displayed can be changed. When the test button 80 is pressed, only the setting contents of the currently selected work item can be taken by the worker 47 by photographing the target image 75 with the camera terminal 12 to start the work of FIG. it can. When the enter button 81 is pressed, the setting contents are stored in the storage unit 45. When the cancel button 82 is pressed, the setting contents are discarded and the process returns to the work instruction screen 50 in FIG.

  Next, target setting such as setting of a mask range and setting of an intersection target position of a laser pointer will be described. When the target setting button 79 on the setting screen 70 in FIG. 9 is pressed, a target setting dialog 105 in FIG. 10 is displayed. In the target setting dialog 105, the target image 75 is displayed on the mask range setting display 90, and the mask range drawing contents as shown in the mask setting location 103 are displayed on the target image 75 in an overlapping manner. In the example shown in FIG. 11, the mask range (mask setting location 103) is set in the connector. When the photographing button 100 is pressed, all the drawing contents in the mask range are cleared, the image acquired from the camera terminal 12 is set as the target image 75, and the display contents are updated.

  After the mask drawing buttons 91 to 93 are pressed, the mask range can be drawn by tracing down the mask range setting display 90 with a touch panel or a mouse cursor. Thereby, the mask range data E can be created. If the same operation is performed after the mask erase button 94 is pressed, the mask range can be erased. The size of the mark displayed on the mask drawing buttons 91 to 93 and the mask erasing button 94 is the thickness of the line when drawing and erasing the mask range. That is, in the buttons 91, 92, and 93, the sizes of the circles increase in order, and the thickness of the line increases in this order. When the determination threshold value display 97 is further pressed, the numerical value of the determination threshold value can be set between 0-255 which is an 8-bit value. The size of the determination threshold is determined by each worker 47 subjectively at each site.

  Since the setting of the mask range is performed by the determination of the setting operator, the setting contents may not be appropriate, and even if the intersections of the right laser pointer 23 and the left laser pointer 24 are matched, it may not be determined correctly. Therefore, after setting the target image 75, the mask range, and the determination threshold, the update button 98 is pressed to update the good range diagram display 95. Then, as in a good range 104 as shown in FIG. 11, it is shown which part of the target image 75 is aimed to be determined as OK (good) when the intersections of the right laser pointer 23 and the left laser pointer 24 are matched. The good range diagram display 95 uses the target image 75 itself as an input image. That is, since the target image 75 is an image of a normal connection state, the determination result must be OK. Then, the target image 75 is translated in the vertical and horizontal directions, the simulation processing is performed by the image processing unit 44, and the range of the parallel movement processing which is actually judged by the image processing unit 44 and is OK (good) is superimposed on the target image 75. To obtain a good range 104. Further, the circumscribing rectangle of the good range 104 can be determined by the image processing unit 44 and the size can be displayed on the good range value display 96. That is, the operator may operate the camera terminal 12 so that the intersection of the right laser pointer 23 and the left laser pointer 24 is aligned within the good range 104.

  The setting operator uses the setting unit 49 to set the target image data D, the mask range data E, and the determination threshold value of the correct connection state captured by the camera terminal 12 in the storage unit 45 and register them in the storage unit 45 together with the determination threshold value. . Then, the setting unit 49 causes the image processing unit 44 to actually determine a plurality of pieces of image data generated by parallel movement and enlargement / reduction of the target image data D. A pass / fail range diagram illustrating a pass or fail range based on the determination result is shown, or a pass / fail evaluation value is displayed on the pass range value display 96. As described above, the setting operator confirms the pass / fail range diagram or the pass range value display 96, and whether or not the set target image data D, mask range data E, and determination threshold are appropriate with a low possibility of erroneous determination. Therefore, it is possible to prevent erroneous determination due to inappropriate setting contents.

  By confirming the good range diagram display 95 and the good range value display 96, the setting operator can recognize the allowable range of the position where the camera terminal 12 is directed and the possibility of erroneous determination. For example, if the good range 104 is too small, the allowable range of the position of the camera terminal 12 becomes small, and even if the operator points the camera terminal 12, it is not easy to make an OK (good) determination, and work time is required. . If the good range 104 is too large or there are two or more locations, the possibility of erroneous determination is increased. When the clear button 99 is pressed, the good range diagram display 95 and the good range value display 96 are cleared. When the enter button 101 is pressed, the mask range is set and the setting screen 70 is returned. When the cancel button 102 is pressed, the edited contents of the mask range are discarded and the setting screen 70 is displayed again.

Embodiment 2. FIG.
FIG. 12 is a conceptual diagram showing an implementation status of the connection inspection work support system according to the second embodiment. In the first embodiment, the connection inspection work support system main body 10 and the camera terminal 12 are connected by the cable 11 or the like as shown in FIG. 1, whereas in this embodiment, the connection inspection is performed as shown in FIG. A connection inspection work support system main body 200 in which a work support system main body and a camera terminal are integrated is provided. Although FIG. 12 shows a case where a battery is built in the camera terminal, a power cable may be connected.

FIG. 13A is a perspective view showing the front part of the camera terminal, and FIG. 13B is a perspective view showing the back part of the camera terminal. As shown in FIG. 13, the connection inspection work support system main body 200 includes a touch panel display 201 on the back panel 30 of the camera terminal, and displays the work instruction screen 50 and the setting screen 70 or a part thereof on the display. For example, when the display area of the display is narrow, only the target image display 55 and the determination result display 58 may be displayed.
It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted.

The wire connection inspection work support system according to the present invention ,
And the camera terminal that is capable of taking a biopsy査箇office,
A target image data obtained by photographing a normal connection state for use in image processing, mask range data including a mask range corresponding to the shape of the inspection location, and a storage unit that holds a determination threshold ;
With obtaining the target feature amount by performing a logical operation of the mask range data to the targets image data, by the logical operation of the image data and the mask range data obtained from the camera terminal by changing the rotation angle of the mask range data By calculating the feature value for each rotation angle and using the difference between the feature value and the target feature value at the rotation angle with the smallest difference from the target feature value as the evaluation value, the connection work is performed by comparing this evaluation value with the judgment threshold value. An image processing unit for determining
Those having a judgment result notification section to notify the judgment result from the image processing unit.

Next, target setting such as setting of a mask range and setting of an intersection target position of a laser pointer will be described. When the target setting button 79 on the setting screen 70 in FIG. 9 is pressed, the target setting dialog 105 in FIG. 11 is displayed. In the target setting dialog 105, the target image 75 is displayed on the mask range setting display 90, and the mask range drawing contents as shown in the mask setting location 103 are displayed on the target image 75 in an overlapping manner. In the example shown in FIG. 11, the mask range (mask setting location 103) is set in the connector. When the photographing button 100 is pressed, all the drawing contents in the mask range are cleared, the image acquired from the camera terminal 12 is set as the target image 75, and the display contents are updated.

Claims (3)

A work instruction section for notifying workers of work instruction contents;
A camera terminal capable of photographing the inspection location;
A target image data obtained by photographing a normal connection state for use in image processing, mask range data including a mask range corresponding to the shape of the inspection location, and a storage unit that holds a determination threshold;
A distance confirmation unit for setting an appropriate distance between the inspection location and the camera terminal and the position of the camera terminal;
A logical operation of the mask range data and the image data acquired from the camera terminal by changing the rotation angle of the mask range data while obtaining a target feature amount by performing a logical operation of the mask range data on the target image data By calculating the feature amount for each rotation angle, the difference between the feature amount and the target feature amount at the rotation angle with the smallest difference from the target feature amount is used as an evaluation value. An image processing unit that determines the connection work by comparing the determination threshold;
A connection inspection work support system comprising a determination result notifying unit for notifying the operator of a determination result from the image processing unit. The connection inspection work support system according to claim 1, wherein the camera terminal is positioned by matching an intersection of laser beams emitted from a plurality of laser pointers with a predetermined position of the inspection location. The connection according to claim 2, wherein the image processing unit performs simulation determination on a plurality of image data generated by parallel translation and enlargement / reduction of the target image data, and obtains the range of the intersection of the lasers based on the determination result. Inspection work support system.

Images