JP2012247700A - Wiring work support device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To allow insertion/extraction work of a connector plug terminal to/from a connector adapter terminal to be effectively supported at a low system price.SOLUTION: In a wiring work support device 1, an adapter position detection marker recognition processing unit 121 recognizes an adapter position detection marker 21 in accordance with image information of a connector connection board 2 imaged by a camera 4 before a connector plug terminal 30 is inserted to or extracted from a connector adapter terminal 21 of the connector connection board 2. A support information generation processing unit 124 generates image patterns of a coordinate grid K1 and a target grid K2 on the basis of position coordinates of the adapter position detection marker 21 in the image and preliminarily stored definition information and work order information, and the image patterns are displayed by superposing the image on a display device 5.

Description

  The present invention relates to a wiring work support apparatus and method for supporting connector plug insertion / removal work with respect to a connector connection board in which a large number of connector adapters are unitized.

  In recent years, the number of optical fiber cords accommodated in an optical fiber wiring module such as an IDM (Integrated Distribution Module) or FTM (Fiber Termination Module) has increased with an increase in subscribers to the optical fiber network. For example, a communication facility building in an urban area can accommodate 4000 or 1000 cores. Therefore, in order to efficiently maintain and manage such a large number of optical fiber cords, a connector connection board is disposed on the front surface of the optical fiber wiring module. The connector connection board is provided with a number of connector adapter terminals (hereinafter referred to as connector adapters), and optical fiber cord connector plug terminals (hereinafter referred to as connector plugs) are selectively inserted into and removed from these connector adapters. Therefore, it is possible to smoothly and flexibly respond to the start, stop, and change of use of the FTTH service.

  In recent years, with the progress of semiconductor integration density, it has become possible to improve the performance and miniaturization of personal computers (hereinafter referred to as PCs), and image recognition, etc. that had to be relied on stationary PCs (desktop PCs). This image processing function can be executed even in a portable PC such as a notebook PC or a mobile PC. Furthermore, as for information display means, a display for a desktop PC or a display attached to a notebook PC has been mainly used in the past, but recently, a head-mounted display (HMD), a USB monitor or the like is small and portable. A display device is being used. In particular, the HMD can create a state in which a display of several tens of inches is installed just a few meters away just by wearing it like glasses, and is attracting attention as a display at work because both hands are free. Yes. Under such an environment, a so-called AR (Augmented reality) technology for giving virtual information to a video or an image captured by a video camera has been developed (see, for example, Non-Patent Document 1).

  By the way, in order to connect a large number of connector plugs, the connector connection board unitizes a large number of connector adapters as described above, and freely connects or disconnects the connector plugs to and from any of these connector adapters. It is possible. However, because of high-density mounting, there is a high possibility that human errors such as erroneous connection and disconnection of connector plugs will occur. For this reason, the operator needs to pay careful attention to the connector plugs and adapters scheduled for insertion / extraction work and perform the confirmation work a plurality of times. As a result, it becomes difficult to carry out the insertion / extraction work unless the working time is increased or a specific experience / skill is possessed, and it is difficult to suppress the labor cost.

  Therefore, a light emitting element such as an LED (Light Emitting Diode) is arranged in the vicinity in association with each connector adapter, and the light emitting element corresponding to the connector adapter to be connected is turned on or blinked. A proposal has been made to improve the insertion / extraction workability of the connector plug by presenting the adapter position to be removed (see, for example, Patent Document 1).

JP 2010-97712 A

Ronald T. Azuma, “A Survey of Augmented Reality”, Presence-Teleoperators and Virtual Environments, 6,4 (August 1997), 355-385

  However, in the insertion / extraction work support method using a light emitting element as described above, it is necessary to provide a light emitting element in association with each connector adapter. For this reason, even if a relatively inexpensive LED is used, an appropriate cost is required for realization, resulting in an increase in system cost. In particular, connector connection boards used in urban areas are expected to have several tens of millions of connector adapter terminals in order to cope with the further increase in the number of FTTH subscribers in the future, and the system is extremely expensive. Become.

  The present invention has been made paying attention to the above circumstances, and the purpose thereof is wiring that can effectively support the insertion / extraction operation of the connector plug terminal with respect to the connector adapter terminal while keeping the system price low. To provide a work support apparatus and method.

  In order to achieve the above object, one aspect of the present invention provides a connector connection board provided with a plurality of connector adapter terminals and a first marker for detecting the connector adapter terminals, with respect to the plurality of connector adapter terminals. In the wiring work support apparatus or method for supporting the selective insertion / extraction work of the connector plug terminal, the attribute information of the first marker, the first marker, and the first marker are associated with the identification information of the first marker. Information representing a relative positional relationship with the plurality of connector adapter terminals is stored. Prior to the above insertion / extraction operation, input of work order information for designating a connector adapter terminal and a connector plug terminal to be an object of the insertion / extraction operation is accepted. In this state, first image information obtained by imaging a region including the plurality of connector adapter terminals and the first marker of the connector connection board is acquired from the camera, and based on the stored attribute information of the first marker. In addition, the first marker is recognized from the acquired first image information. Next, based on the position coordinates of the recognized first marker in the first image information, the stored position definition information, and the input work order information, the first image A first image pattern representing the position of the plurality of connector adapter terminals in the information and a second image pattern representing the position of the connector adapter terminal designated as the target of the insertion / extraction operation are generated, respectively. The first and second image patterns are superimposed on the first image information and displayed on the display means.

  Therefore, the display means superimposes on the image of the connector connection board actually imaged, and the first image pattern indicating the position of each connector adapter terminal and the first image pattern indicating the position of the connector adapter terminal to be inserted and removed. Two image patterns are displayed. For this reason, even when a large number of connector adapter terminals are arranged on the connector connection board, the operator can clearly recognize the position of the connector adapter terminal to be inserted and removed by the first and second image patterns. it can.

One aspect of the present invention is characterized by comprising the following aspects.
In the first aspect, when a plurality of connector plug terminals on hold are accommodated in the retention unit in a state where unique identification information is displayed, the plurality of connector plug terminals accommodated in the retention unit Second image information obtained by collectively capturing the unique identification information is acquired from the camera. Then, the unique identification information of the plurality of connector plug terminals is recognized from the acquired second image information, and the recognized unique identification information is set as an object of insertion / extraction work by the inputted work order information. Each is checked against the specified connector plug terminal identification information. Then, the unique identification information that matches the identification information of the connector plug terminal that is the subject of the insertion / extraction operation is detected, and the information indicating the accommodation position in the holding portion of the connector plug terminal corresponding to the detected unique identification information is described above. This is displayed on the display means.

  In this way, when selecting a connector plug terminal, even if a large number of connector plug terminals are held in the holding section, the operator can select a connector plug to be inserted and removed from the large number of connector plug terminals. Terminals can be selected accurately and quickly, so that a correct connector plug terminal can always be inserted into and removed from the connector adapter terminal in a short time.

  In the second aspect, when the insertion / removal operation of the connector plug terminal with respect to the connector adapter terminal is performed using the insertion / removal tool to which the second marker for detecting the tool position is attached, first, the insertion / removal tool and the connector connection board are used. The third image information obtained by imaging the area to be included is acquired from the camera, and the first and second markers are recognized from the acquired third image information. Next, based on the position coordinates of the recognized first marker in the third image information, the stored position definition information, and the input work order information, the target of the insertion / extraction operation is determined. The position coordinates in the third image information of the designated connector adapter terminal are calculated. At the same time, the position coordinates in the third image information of the image representing the recognized second marker are calculated. Then, the calculated position coordinates of the connector adapter terminal to be inserted / extracted are compared with the position coordinates of the second marker to determine whether or not these position coordinates match, and this determination result is expressed. Information is displayed on the display means.

  In this way, when the connector plug terminal is inserted into or removed from the connector adapter terminal, the operator is shown whether or not the connector plug terminal is about to be inserted into or removed from the correct connector adapter terminal. Therefore, it is possible to prevent the connector plug terminal from being inserted into or removed from the wrong connector adapter terminal.

  In the third aspect, when facility information storage means for storing wiring information indicating the use state of the connector adapter terminal is provided in association with identification information of the plurality of connector adapter terminals provided on the connector connection board. After the insertion / extraction operation of the connector plug terminal to be inserted / extracted with respect to the connector adapter terminal to be inserted / extracted, information for updating the wiring information related to the connector adapter terminal to be inserted / extracted is generated, and the generated update information The wiring information stored in the facility information storage means is updated based on the above.

  If it does in this way, when the insertion / extraction operation | work of the connector plug terminal with respect to a connector adapter terminal is complete | finished, the wiring information memorize | stored in the equipment information storage means will be updated automatically. This eliminates the need for the operator to separately update the wiring information after the completion of the insertion / extraction operation, so that the wiring information in the facility information storage means can always be kept up-to-date, and the work load on the operator can be reduced. Can be reduced.

In the fourth aspect, only when it is determined that the respective position coordinates match as a result of the determination, the insertion / extraction tool is controlled so that the locked state of the insertion / extraction tool is released to enable the insertion / extraction operation. It is a thing.
In this way, even if the connector plug terminal is inserted into or removed from the wrong connector adapter terminal, the insertion / extraction tool is controlled so as not to operate, so that erroneous insertion / extraction work can be reliably prevented.

  That is, according to one aspect of the present invention, it is possible to provide a wiring work support apparatus and method capable of effectively supporting the insertion / extraction work of the connector plug terminal with respect to the connector adapter terminal while keeping the system price low. .

The block diagram which shows the structure of the wiring work assistance apparatus which concerns on one Embodiment of this invention. The figure which expanded and showed a part of connector connection board. The structure of an insertion / extraction tool is shown, (a) is the side view, (b) is the front view which expanded and showed the front-end | tip part. The figure which shows an example of the definition information memorize | stored in the definition information database provided in the wiring operation | work assistance apparatus shown in FIG. The figure which shows an example of the equipment information memorize | stored in an equipment database. The flowchart which shows the process sequence and processing content of the connector insertion assistance process by the wiring operation | work assistance apparatus shown in FIG. The flowchart which shows the process sequence and processing content of the adapter position detection marker recognition process among the connection processes shown in FIG. FIGS. 7A and 7B show a display example of a coordinate grid and a target grid by the connection process shown in FIG. 6, wherein FIG. 7A shows a state before display of the grid, and FIG. The flowchart which shows the process sequence and processing content of an adapter / plug corresponding | compatible determination process among the connection processes shown in FIG. The flowchart which shows the process sequence and processing content of the connector removal assistance process by the wiring operation | work assistance apparatus shown in FIG.

Embodiments according to the present invention will be described below with reference to the drawings.
(Constitution)
FIG. 1 is a block diagram showing the configuration of a wiring work support apparatus and peripheral devices according to an embodiment of the present invention, and 1 shows the wiring work support apparatus. Reference numeral 2 denotes a connector connection board, 3 denotes an insertion / extraction tool, 4 denotes a camera, 5 denotes a display device, 6 denotes a management computer device, and 7 denotes an equipment database (equipment DB).

  For example, as shown in FIG. 2, the connector connection board 2 has a large number of connector adapter terminals 21 arranged in a matrix, and an adapter position detection marker 22 is installed on the frame portion that holds the connector adapter terminal group 21. ing. The adapter position detection marker 22 is a combination of a plurality of figures having different shapes and colors. The shape is a circle, triangle, heart, or the like, and the color is red, blue, green, or the like. In FIG. 2, only one adapter position detection marker 22 is shown for simplicity of illustration, but a plurality (for example, two) of adapter position detection markers 22 are provided.

  On the other hand, the connector plug terminal group that is the target of the insertion / extraction operation is in a state of being held (unused) in the holding portion while being connected to the IDM. Each of the connector plug terminals is displayed with a two-dimensional code for identifying the connector plug terminal, for example, a QR code. The QR code can be read by the camera 4 while being held in the holding section. ing.

  For example, as shown in FIG. 3, the insertion / extraction tool 3 has a structure in which the connector plug terminal 30 is gripped by the tool tip 31 in accordance with a pulling operation of the lever 33. A tip marker 32 is provided at the tool tip 31. When the insertion tool 3 is operated to insert / remove the connector plug terminal 30 with respect to the connector adapter terminal 21 of the connector connection board 2, the tip marker 32 is relative to the connector adapter terminal 21 of the connector connection board 2. Is used to detect. Further, the insertion / extraction tool 3 includes a lock mechanism portion 34. The lock mechanism 34 locks the connector plug terminal 30 so that the connector plug terminal 30 cannot be inserted or removed when the connector plug terminal 30 is to be inserted into or removed from the wrong connector adapter terminal 21. The insertion / extraction tool 3 includes a signal processing / interface unit 35, and transmits / receives control signals regarding operations to / from the management computer device 6 through the signal processing / interface unit 35.

The camera 4 uses a solid-state image sensor such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor). The reserved portions (not shown) are individually or simultaneously imaged and the image information is output.
The display device 5 includes, for example, a head-mounted display (HMD), and is used to display a wiring work support image necessary for each work process before starting the wiring work and during the wiring work.

  In the facility DB 7, a plurality of types of wiring information related to the connector adapter terminal 21 are stored in association with coordinate numbers that uniquely identify each connector adapter terminal 21 of the connector connection board 2. FIG. 5 shows an example of the stored information. In FIG. 5, a plurality of types of wiring information are illustrated as information A, information B, information C,. The wiring information includes, for example, attribute information, provision service information, construction information, facility information, and the like of the subscriber to whom each connector adapter terminal 21 is assigned.

  The management computer device 6 is composed of a general-purpose personal computer, and is based on a function of performing management processing such as registration, deletion or update for the wiring information stored in the facility DB 7 and the wiring information stored in the facility DB 7. Thus, it has a function of managing the connection state of the connector plug terminal 30 to the connector adapter terminal 21.

  By the way, the wiring work support apparatus 1 is configured as follows. That is, the wiring work support apparatus 1 is composed of a portable personal computer such as a notebook or tablet personal computer or a smart phone, and includes an interface unit 11, a control unit 12, and a storage unit 13. .

  The interface unit 11 includes an imaging information input unit 111, a display information output unit 112, and a facility information input / output unit 113. The imaging information input unit 111 performs processing for capturing image information of the connector connection board 2 and the like captured by the camera 4 from the camera 4 under the control of the control unit 12. The display information output unit 112 performs processing for causing the display device 5 to display the wiring work support image information generated by the control unit 12. The display facility information input / output unit 113 communicates with the management computer device 6 under the control of the control unit 12, thereby receiving necessary wiring information from the facility DB 7 and storing it in the facility DB 7. A process of transmitting information for updating the wired information is performed.

  The storage unit 13 is provided with a definition information database (definition information DB) 131. The definition information DB 131 stores the attribute information of the adapter detection marker 22 and information representing the positional relationship between the adapter detection marker 22 and each connector adapter terminal 21 in association with the identification information of the adapter detection marker 22. .

  FIG. 4 shows an example of the definition information stored in the definition information DB 131. This definition information is associated with the marker identification number, the marker shape / marker color combination information, the marker dimension, the inter-marker distance, and the origin reference. The marker number, the drawing offset value of the coordinate grid, and the drawing quantity are stored. Here, the drawing offset value of the coordinate grid defines a drawing reference point of the coordinate grid with respect to the center point of the adapter detection marker 22 that has been image-recognized. For example, XX mm in the x direction and XX in the y direction. It is defined as mm. The drawing quantity defines the number of coordinate grids to be drawn, and is set, for example, as 16 rows × 63 columns for IDM and 4 rows × 25 columns for FTM. Further, the definition information DB 131 stores image patterns of the coordinate grid and the target grid as information necessary for generating a display image to which AR (Augmented reality) technology is applied.

  Further, the definition information DB 131 also stores attribute information of the tip marker 32 provided on the insertion / extraction tool 3 and QR codes of the connector plug terminals 30. The attribute information of the tip marker 32 is defined by a combination of marker shape and color.

The control unit 121 includes, for example, a CPU (Central Processing Unit) and a DSP (Digital Signal Processor). As a necessary processing function for carrying out the embodiment of the present invention, an adapter position detection marker recognition processing unit 121, an insertion / extraction A tool tip marker recognition processing unit 122, a plug identification code recognition processing unit 123, and a support information generation processing unit 124 are provided.
These processing units 121 to 124 are realized by causing the CPU or DSP to execute an application program stored in a program memory in the storage unit 13.

  The adapter position detection marker recognition processing unit 121 determines whether the adapter position detection marker stored in the definition information DB 131 is stored in the process of checking the position of the connector adapter terminal 21 to be inserted / removed prior to the connector terminal insertion / removal operation. Based on the attribute information, that is, information on the combination of the marker shape and the marker color, an image representing the adapter position detection marker 22 is recognized from the image information of the connector connection board 2 captured by the imaging information input unit 111. Perform the process.

  The plug identification code recognition processing unit 123 stores the hold taken in by the imaging information input unit 111 in the process of selecting the connector plug terminal 30 to be inserted / removed from the IDM holding unit where the plurality of connector plug terminals 30 are held. The image of the QR code of each connector plug terminal is recognized from the captured image information of the part.

  The insertion / removal tool tip marker recognition processing unit 122 is stored in the definition information DB 131 in a process in which an operator attempts to insert / remove the connector plug terminal 30 selected in the connector plug terminal selection process with respect to the connector adapter terminal 21. Based on the attribute information of the adapter position detection marker (information of the combination of the marker shape and the marker color) and the attribute information of the insertion / extraction tool tip marker 32 (information of the combination of the marker shape and the marker color) An image representing the adapter position detection marker 22 and an image of the insertion / extraction tool tip marker 32 are extracted from the image information including both the connector connection board 2 and the insertion / extraction tool 3 captured in the information input unit 111 in one screen. Each process is recognized.

The support information generation processing unit 124 has the following processing functions.
(1) The position coordinates in the captured image of the image representing the adapter position detection marker recognized by the adapter position detection marker recognition processing unit 121 are calculated. Based on the information indicating the positional relationship between the marker and the coordinate grid stored in the definition information DB 131, that is, the information indicating the marker number serving as a reference, the drawing offset value of the coordinate grid, and the drawing quantity, An image pattern of a coordinate grid representing the position of the connector adapter terminal 21 is generated. At the same time, based on the identification information of the connector adapter terminal to be inserted / removed input as work order information prior to the work, an image pattern of the target grid representing the position of the connector adapter terminal to be inserted / removed in the captured image is generated. To do. Then, the augmented reality image information is generated by superimposing the generated image pattern of the coordinate grid and the target grid on the captured image information, and the position of the connector adapter terminal to be inserted / extracted is determined based on the generated augmented reality image information. A process of outputting to the display information output unit 112 to display on the display device 5 as wiring work support information for use in the display.

  (2) The QR code of each connector plug terminal recognized by the plug identification code recognition processing unit 123 is compared with the QR code of the connector plug terminal to be inserted / removed input as work order information prior to work. And the code | cord | chord which corresponds with the QR code of the connector plug terminal of insertion object is detected from the QR code of each recognized connector plug terminal. Next, an image pattern representing the position of the connector plug terminal corresponding to the detected QR code in the captured image is generated, and augmented reality image information in which the generated image pattern is superimposed on the captured image is generated. . Then, a process of outputting the generated augmented reality image information to the display information output unit 112 so as to be displayed on the display device 5 as wiring work support information for confirming the holding position of the connector plug terminal to be inserted and removed.

  (3) The position coordinates in the captured image of the image representing the adapter position detection marker 22 recognized by the insertion / extraction tool tip marker recognition processing unit 122 are calculated. Then, based on the information representing the positional relationship between the marker and the coordinate grid stored in the definition information DB 131 and the identification information of the connector adapter terminal to be inserted / removed input as work order information, the insertion / removal target in the captured image Calculate the position coordinates of the connector adapter terminal. At the same time, the position coordinates in the captured image of the image representing the insertion / extraction tool tip marker 32 recognized by the insertion / extraction tool tip marker recognition processing unit 122 are calculated. Then, the calculated position coordinate of the connector adapter terminal to be inserted / extracted is compared with the position coordinate of the tip marker 32 to determine whether or not these position coordinates match. Is output to the display information output unit 112 so as to be displayed on the display device 5. At the same time, a process of outputting a control signal for releasing the lock state of the lock mechanism 34 of the insertion / extraction tool 3 to the installation information input / output unit 113 to the insertion / extraction tool 3 via the management computer device 6.

  (4) After completion of the insertion / extraction operation of the connector plug terminal 30 with respect to the connector adapter terminal 21, information for updating the wiring information related to the connector adapter terminal 21 to be inserted / extracted is generated, and the generated update information is used for management. Processing to output to the facility information input / output unit 113 to be sent to the facility DB 7 via the computer device 6.

(Operation)
(1) Connector Plug Terminal Insertion Support FIG. 6 is a flowchart showing the procedure and processing contents of the connector plug terminal insertion support process for the connector adapter terminal.
In this connector plug terminal insertion support process, first, an operation for inputting work order information by an operator is accepted. Then, with the input of the work order information as a trigger, first, support is provided for the operator to confirm the position of the connector adapter terminal to be inserted into the connector connection panel 2. Next, the work of selecting the connector plug terminal to be connected to the connector adapter terminal to be inserted from the connector plug terminal group held in the IDM is supported. Subsequently, the operator supports the operation of inserting the selected connector plug terminal to be inserted into the connector adapter terminal to be inserted using the insertion / extraction tool 3, and is finally stored in the facility DB 7. Among the existing wiring information, a process of updating the wiring information related to the connector adapter terminal that is the insertion work target is performed.

(1-1) Input of work order information The operator designates a connector adapter terminal and a connector plug terminal to be inserted by operating the management computer device 6, for example. For example, the operation order information designation operation reads out the wiring information of each connector adapter terminal stored in the equipment DB 7 and displays it in a list, and the connector adapter terminal to be inserted from the displayed wiring information. And the identification code of the connector plug terminal to be inserted / extracted is input.

  When an operation for specifying work order information is performed in the management computer device 6, the work order information is transferred from the management computer device 6 to the wiring work support device 1. In the wiring work support apparatus 1, when the wiring order information is received by the facility information input / output unit 113, the control unit 12 takes in the work order information in step S <b> 11 and stores it in the definition information DB 131 in the storage unit 13. .

(1-2) Support for confirming the position of the connector adapter terminal to be inserted When the designation input of the work order information is completed, the operator directs the camera 4 toward the connector connection panel 2 and starts an imaging operation of the panel surface. Let First, in step S12, the wiring work support apparatus 1 captures captured image information of the connector connection board 2 captured by the camera 4 using the imaging information input unit 111.

  Next, in step S13, the wiring work support apparatus 1 activates the adapter position detection marker recognition processing unit 121 to recognize the adapter position detection marker image from the captured image information of the connector connection board 2. I do. FIG. 7 is a flowchart showing the processing procedure and processing contents.

  That is, first, in step S131, the captured image information is read from the imaging information input unit 111 by a predetermined size while shifting the position. For each of the read images, the adapter position detection marker 22 stored in the definition information DB 131 is read. Image matching processing is performed based on the combination information of shape and color (step S132), and it is determined whether there is an image pattern of the corresponding shape and color (step S133). If there is only one type of shape of the adapter position detection marker 22, the presence / absence of an image corresponding to the adapter position detection marker 22 is determined only by the combination of colors. As a result of the determination process, when an image corresponding to the adapter position detection marker 22 is detected, the coordinates of the center position of the detected adapter position detection marker 22 in the captured image are set as the origin reference (x = 0). , Y = 0) (step S134).

  Subsequently, the wiring work support apparatus 1 activates the support information generation processing unit 124 in step S14, and the support information generation processing unit 124 stores the recognition result of the adapter position detection marker 22 and the definition information DB 131. Based on the drawing position offset amount and the drawing quantity of the coordinate grid, an image pattern of the coordinate grid K1 is generated, and the generated image pattern is superimposed on the captured image of the connector connection board 2.

  For example, if the connector connection board 2 is configured as shown in FIG. 2 and the coordinate grid drawing position offset amount is defined as x = -30 and y = -50 as illustrated in FIG. The position coordinates corresponding to x = -30 and y = -50 from the detected origin reference are the center position coordinates of the connector adapter terminal in the first row and first example (upper left in FIG. 2) in the captured image. To do. Then, an image pattern of the coordinate grid K1 is generated on the basis of the center position coordinates of the connector adapter terminal of the first example in the first row and information representing the drawing quantity stored in the definition information DB 131, and the coordinate grid K1 The image pattern is superimposed on the captured image of the connector connection board 2.

  At the same time, based on the identification information of the connector adapter terminal of the insertion work target designated and input in the work order information designation process of (1-1), the insertion work from the generated coordinate grid K1. A coordinate grid corresponding to the target connector adapter terminal is selected, and an image pattern for the target grid K2 is further superimposed on the selected coordinate grid.

FIG. 8 shows an example of a captured image of the connector connection board 2 on which the image patterns of the coordinate grid K1 and the target grid K2 are superimposed. (A) is a captured image before superposition, and (b) is after superposition. Each captured image is shown.
The support information generation processing unit 124 supports the confirmation of the position of the connector adapter terminal to be inserted with the captured image information of the connector connection board 2 on which the image patterns of the coordinate grid K1 and the target grid K2 are superimposed. Output as support image information from the display information output unit 112 to the display device 5 for display. Therefore, the operator can confirm the position of the connector adapter terminal to be inserted in the connector connection panel 2 prior to the start of the insertion work by viewing the support image displayed on the display device 5. Become.

(1-3) Supporting the operation of selecting a connector plug terminal to be inserted and inserted The operator uses the insertion / removal tool 3 after confirming the position of the connector adapter terminal to be inserted in the connector connection panel 2. An operation of selecting a connector plug terminal to be inserted from the connector plug terminal group held in the IDM holding section is performed.

  In this operation, the operator first directs the camera 4 to the IDM holding portion, and images the QR code of the connector plug group accommodated in the holding portion. Then, the image information of the connector plug group including the QR code imaged by the camera 4 is taken into the imaging information input unit 111 of the wiring work support apparatus 1.

  When the captured image information is captured, the wiring work support apparatus 1 activates the plug identification code recognition processing unit 123 in step S15, and the plug identification code recognition processing unit 123 first extracts each connector from the captured captured image information. Each QR code image of the plug terminal is recognized. Then, the recognized QR code image is converted into a QR code.

  Next, the wiring work support apparatus 1 activates the support information generation processing unit 124 in step S16, and the support information generation processing unit 124 converts each of the QR codes converted into the work order information of (1-1). It is compared with the QR code of the connector plug terminal to be inserted input in the input process to determine whether or not they match. If a matching QR code is found as a result of this determination, the position coordinates in the captured image of the connector plug terminal corresponding to the matching QR code are calculated. Then, an image pattern representing the position of the connector plug terminal to be inserted is superimposed on the calculated position coordinates on the captured image, and the captured image information on which the image pattern is superimposed is used as the connector plug to be inserted. It is displayed on the display device 5 as support image information for supporting the terminal selection work. If no matching QR code is found, a message to that effect is generated and displayed on the display device 5 in step S17.

  Accordingly, the operator can easily and quickly identify the connector plug terminal to be inserted from among the many connector plug terminals held in the IDM holding section, and the insertion / removal tool 3 can be used for the insertion. The connector plug terminal to be attached can be always accurately selected and gripped.

(1-4) Support of work for inserting and inserting the connector plug terminal into the connector adapter terminal When the connector plug terminal to be inserted is gripped using the insertion / extraction tool 3, the operator subsequently uses this insertion / extraction tool 3, The operation of attaching the gripped connector plug terminal to be inserted into the connector adapter terminal to be inserted into the connector connection panel 2 is performed.

  In the course of this work, the wiring work support apparatus 1 activates the insertion / extraction tool tip marker recognition processing unit 122, and first inputs the definition information from the definition information DB 131 and the work order information (1-1) in step S18. The identification information of the inserted connector adapter terminal to be inserted is read. The definition information read at this time includes the information indicating the combination of the shape and color of the adapter position detection marker 22 and the information indicating the positional relationship between the marker 22 and the coordinate grid, and the shape of the insertion / extraction tool tip marker 32. And information indicating a combination of colors.

Subsequently, in step S19, the insertion / extraction tool tip marker recognition processing unit 122 determines whether the connector plug terminal held by the insertion / extraction tool 3 is about to be correctly inserted into the insertion target connector adapter terminal as follows. Judgment.
That is, first, imaging that is captured by the imaging information input unit 111 based on information indicating the combination of the shape and color of the adapter position detection marker 22 and information indicating the positional relationship between the marker 22 and the coordinate grid. From the image information, the adapter position detection marker 22 provided on the connector connection board 2 is recognized. Then, using the recognized position coordinates in the captured image of the adapter position detection marker 22 as the reference origin, the position coordinates in the captured image of the connector adapter terminal to be inserted are calculated.

  At the same time, based on the information indicating the combination of the shape and color of the insertion / extraction tool tip marker 32, the insertion / extraction tool tip marker 32 is recognized from the imaged image information, and the recognized insertion / extraction tool tip marker 32 in the captured image. The position coordinates of are calculated. FIG. 9 is a flowchart showing the processing procedure and processing contents.

  That is, first, in step S191, the captured image information is read by a predetermined size while shifting the position, and the read image is converted from the RGB format to the HSV format by color separation. Then, H (Hue), S (Saturation), and V (Value) elements necessary for recognizing the insertion / extraction tool tip marker 32 are extracted from the converted HSV format image in steps S192, S193, and S194, respectively. To do. Subsequently, in step S195, a process of recognizing the insertion / extraction tool tip marker 32 from the captured image based on the extracted elements of each HSV is performed.

  When it is confirmed in step S196 that the insertion / extraction tool tip marker 32 has been recognized, the detected position coordinate of the insertion / extraction tool tip marker 32 recognized in step S197 is the same as the position coordinate of the adapter position detection marker 22. Convert to the coordinate value of. Further, the distance between the adapter position detection marker 22 and the insertion / extraction tool tip marker 32, that is, the separation distance between the connector connection board 2 and the insertion / extraction tool tip 31 is calculated. The distance between the connector connection board 2 and the insertion / extraction tool tip 31 can be determined by applying a method such as triangulation using a plurality of adapter position detection markers 22 included in the captured image information. is there.

  Then, when it is detected that the separation distance between the connector connection board 2 and the insertion / extraction tool tip 31 has become zero, the wiring work support apparatus 1 subsequently activates the support information generation processing unit 124. In this state, the position coordinates of the connector adapter terminal to be inserted detected from the captured image are compared with the position coordinates of the insertion / extraction tool tip marker 32 in the same coordinate system, and whether these position coordinates match. Is determined in step S20. If the position coordinates do not match, it is determined that the tip of the insertion / extraction tool 3 does not face the connector adapter terminal to be inserted, and a message to that effect is generated and displayed on the display device 5 in step S21. . Therefore, the operator can recognize from the display message that the connector adapter terminal to which the connector plug terminal is to be inserted is incorrect.

  On the other hand, if the two position coordinates coincide with each other, it is determined that the tip of the insertion / extraction tool 3 faces the connector adapter terminal to be inserted, and a message to that effect is displayed on the display device 5 so that the operator Prompts the connector plug terminal to be inserted.

(1-5) Update of Facility DB 7 When the insertion of the connector plug terminal 30 into the connector adapter terminal 21 to be inserted is completed, the support information generation processing unit 124 obtains wiring information regarding the connector adapter terminal 21 to be inserted. Generate information to update. Then, the generated update information is transmitted from the facility information input / output unit 113 to the management computer device 6. As a result, the management computer device 6 updates the wiring information related to the corresponding connector adapter terminal 21 in the facility DB 7.
That is, when the connector plug terminal 30 is inserted into the connector adapter terminal 21, wiring information related to the corresponding connector adapter terminal 21 in the facility DB 7 is automatically updated.

  The end of the insertion work can also be recognized by the support information generation processing unit 124 of the wiring work support apparatus 1 when the operator inputs an end command to the management computer device 6. However, the present invention is not limited to this, and the support information generation processing unit 124 recognizes the detection information from the management computer device 6 and notifies the wiring work support device 1 that the connector plug terminal 30 has been detached from the insertion / extraction tool 3. You may make it do.

(2) Connector Plug Terminal Removal Support FIG. 10 is a flowchart showing a procedure and details of processing for supporting the work of removing the connector plug terminal from the connector adapter terminal. In the figure, steps corresponding to those in FIG. 6 will be described with the same reference numerals.

(2-1) Input of work order information The operator designates a connector adapter terminal and a connector plug terminal to be removed in the management computer device 6, for example. The designation operation of the connector adapter terminal to be removed and the connector plug terminal is performed by displaying a list of wiring information stored in the equipment DB 7 and selecting and specifying the connector adapter terminal to be removed from the list. .

  The work order information designated in the management computer device 6 is transferred from the management computer device 6 to the wiring work support device 1. In the wiring work support apparatus 1, when the wiring order information is received by the facility information input / output unit 113, the control unit 12 takes in the work order information in step S <b> 11 and stores it in the definition information DB 131 in the storage unit 13. .

(2-2) Support of work for confirming position of connector adapter terminal to be removed When the input of the work order information is finished, the operator points the camera 4 toward the connector connection board 2 and starts an imaging operation of the board surface. . First, in step S12, the wiring work support apparatus 1 captures captured image information of the connector connection board 2 captured by the camera 4 using the imaging information input unit 111.

  Next, in step S13, the wiring work support apparatus 1 activates the adapter position detection marker recognition processing unit 121 to recognize the adapter position detection marker image from the captured image information of the connector connection board 2. I do. The adapter position detection marker recognition process is performed according to the procedure shown in FIG. 7 as in the case of the insertion work.

  Subsequently, the wiring work support apparatus 1 activates the support information generation processing unit 124 in step S14, and the support information generation processing unit 124 stores the recognition result of the adapter position detection marker 22 and the definition information DB 131. Based on the drawing position offset amount and the drawing quantity of the coordinate grid, an image pattern of the coordinate grid K1 is generated, and the generated image pattern is displayed on the captured image of the connector connection board 2 as shown in FIG. Superimpose.

  At the same time, based on the identification information of the connector adapter terminal to be extracted that is specified and input in the process of specifying the work order information in (2-1), the connector adapter to be extracted from the generated coordinate grid K1. A coordinate grid corresponding to the terminal is selected, and an image pattern for the target grid K2 is further superimposed on the selected coordinate grid as shown in FIG. 8B.

  Then, the support information generation processing unit 124 supports the confirmation of the position of the connector adapter terminal to be removed from the image information of the connector connection board 2 on which the image patterns of the coordinate grid K1 and the target grid K2 are superimposed. The image information is output from the display information output unit 112 to the display device 5 and displayed. Therefore, the operator can confirm the positions of the connector adapter terminal and the plug terminal to be removed from the connector connection board 2 before starting the removal work.

(2-3) Supporting the operation of selecting the connector plug terminal to be removed When the operator confirms the position of the connector adapter terminal to be removed from the connector connection board 2, the connector connection board 2 is used using the insertion / extraction tool 3. The connector plug terminal inserted into the connector adapter terminal is gripped.

  At this time, an image of the connector connection board 2 including the connector plug terminal to be removed is captured by the camera 4, and the captured image information is taken into the imaging information input unit 111 of the wiring work support apparatus 1. When the captured image information is captured, the wiring work support apparatus 1 activates the plug identification code recognition processing unit 123 in step S15, recognizes the QR code image of the connector plug terminal to be removed from the captured captured image information, The recognized QR code image is converted into a QR code.

Next, the wiring work support apparatus 1 activates the support information generation processing unit 124 in step S16. Then, the support information generation processing unit 124 determines whether or not the converted QR code matches with the QR code of the connector plug terminal to be removed specified in advance by the work order information. If the QR codes match as a result of this determination, the position coordinates in the captured image of the connector plug terminal corresponding to the matched QR code are calculated. Then, an image pattern representing the position of the connector plug terminal to be removed is superimposed on the calculated position coordinates on the captured image, and the captured image information on which the image pattern is superimposed is displayed on the display device 5. If the QR codes do not match, a message to that effect is generated and displayed on the display device 5 in step S17.
Therefore, the operator can easily and quickly confirm the presence and position of the connector plug terminal to be removed.

(2-4) Support for removing connector plug terminal from connector adapter terminal When the insertion / extraction tool 3 is brought close to the connector connection board 2 to hold the connector plug terminal to be removed, the connector connection board 2 including the insertion / extraction tool 3 Are captured by the camera 4, and the captured image information is captured by the imaging information input unit 111 of the wiring work support apparatus 1.

  The wiring work support apparatus 1 activates the insertion / extraction tool tip marker recognition processing unit 122, and first, definition information from the definition information DB 131 in step S18, and a connector adapter terminal and a connector plug terminal to be removed designated in advance as work order information. Read the identification code. The definition information read at this time includes the information indicating the combination of the shape and color of the adapter position detection marker 22 and the information indicating the positional relationship between the marker 22 and the coordinate grid, and the shape of the insertion / extraction tool tip marker 32. And information indicating a combination of colors.

Subsequently, in step S19, the insertion / extraction tool tip marker recognition processing unit 122 determines whether or not the tip portion 31 of the insertion / extraction tool 3 is correctly facing the connector plug terminal to be extracted as follows.
That is, first, based on the information indicating the combination of the shape and color of the insertion / extraction tool tip marker 32, the insertion / extraction tool tip marker 32 is recognized from the imaged image information, and the recognized insertion / extraction tool tip marker 32 in the captured image is displayed. Calculate the position coordinates. The process of recognizing the insertion / extraction tool tip marker 32 and calculating the position coordinates is performed according to the procedure shown in FIG.

  That is, first, in step S191, the captured image information is read by a predetermined size while shifting the position, and the read image is converted from the RGB format to the HSV format by color separation. Then, H (Hue), S (Saturation), and V (Value) elements necessary for recognizing the insertion / extraction tool tip marker 32 are extracted from the converted HSV format image in steps S192, S193, and S194, respectively. To do. Subsequently, in step S195, a process of recognizing the insertion / extraction tool tip marker 32 from the captured image based on the extracted elements of each HSV is performed. When it is confirmed in step S196 that the insertion / extraction tool tip marker 32 has been recognized, the detected position coordinate of the insertion / extraction tool tip marker 32 recognized in step S197 is the same as the position coordinate of the adapter position detection marker 22. Convert to the coordinate value of. Further, the distance between the adapter position detection marker 22 and the insertion / extraction tool tip marker 32, that is, the separation distance between the connector connection board 2 and the insertion / extraction tool tip 31 is calculated.

  When it is detected that the separation distance between the connector connection board 2 and the insertion / extraction tool tip 31 has become zero, the wiring work support apparatus 1 subsequently activates the support information generation processing unit 124. In this state, the position coordinate of the connector adapter terminal to be extracted is calculated from the captured image, and the calculated position coordinate of the connector adapter terminal to be extracted and the position coordinate of the insertion / extraction tool tip marker 32 are compared. Then, in step S20, it is determined whether or not these position coordinates match. If the position coordinates do not match as a result of this determination, it is determined that the tip 31 of the insertion / extraction tool 3 does not face the connector adapter terminal to be extracted, and a message to that effect is generated in step S21 to display the display device. 5 is displayed. Therefore, the operator can recognize from this display message that an incorrect connector plug terminal is being removed.

  On the other hand, it is assumed that the two position coordinates coincide. If it does so, it will judge that the front-end | tip of the insertion / extraction tool 3 is facing the connector adapter terminal of extraction object, and will display the message to that effect on the display device 5. FIG. At the same time, in step S31, a control signal for unlocking is transmitted from the facility information input / output unit 113 to the management computer device 6 to release the lock state of the lock mechanism 34 of the insertion / extraction tool 3. Thus, the connector plug terminal can be removed by the insertion / extraction tool 3.

(2-5) Update of facility DB 7 When the connector plug terminal removal operation is completed, the support information generation processing unit 124 generates information for updating the wiring information related to the connector adapter terminal 21 from which the connector plug terminal has been removed. To do. Then, the generated update information is transmitted from the facility information input / output unit 113 to the management computer device 6. As a result, the management computer device 6 updates the wiring information related to the corresponding connector adapter terminal 21 in the facility DB 7.
That is, when the connector plug terminal 30 is removed from the connector adapter terminal 21 to be removed, the wiring information regarding the corresponding connector adapter terminal 21 in the facility DB 7 is automatically updated.

  As described above in detail, in this embodiment, prior to the insertion / extraction operation of the connector plug terminal 30 with respect to the connector adapter terminal 21 of the connector connection board 2, the adapter position detection marker recognition processing unit 121 causes the camera to be connected to the camera. The adapter position detection marker 21 is recognized from the image information of the connector connection board 2 imaged by 4. The support information generation processing unit 124 then uses the coordinate grid K1 and the target grid based on the position coordinates of the adapter position detection marker 21 in the captured image and the definition information and work order information stored in advance. An image pattern of K2 is generated, and this image pattern is superimposed on the captured image and displayed on the display device 5.

  Therefore, the image pattern of the coordinate grid K1 and the target grid K2 representing the position of each connector adapter terminal 21 and the position of the connector adapter terminal to be inserted / extracted is superimposed on the actually imaged image of the connector connection board 2. Will be displayed. That is, the work support information to which the augmented reality technology is applied is displayed. For this reason, even when a large number of connector adapter terminals 21 are arranged on the connector connection board 2, the operator clearly recognizes the position of the connector adapter terminal to be inserted / extracted prior to the insertion / extraction operation of the connector plug terminal. It becomes possible.

  Further, when the insertion / extraction tool 3 is used to grasp the connector plug terminal 30 to be inserted / extracted, the QR code attached to the connector plug terminal to be inserted / extracted is recognized from the captured image, and the recognized QR code is The information indicating the collation result is displayed by collating with the QR code of the connector plug terminal to be inserted / removed which has been input as work order information in advance.

  Therefore, when attempting to grip the connector plug terminal 30 to be inserted / extracted using the insertion / extraction tool 3, the operator can check whether the connector plug terminal 30 to be gripped is a terminal to be inserted / extracted. This effect is particularly effective when a large number of connector plug terminals are retained in the IDM retaining portion, and a connector plug terminal to be inserted is selected and gripped from among the large number of connector plug terminals.

  Furthermore, when trying to insert / remove the connector plug terminal 30 with respect to the connector adapter terminal 21 to be inserted / extracted using the insertion / extraction tool 3, the tip marker 31 provided on the insertion / extraction tool 3 is recognized from the captured image and the captured image is displayed. The position coordinates of the connector adapter terminal to be inserted / removed calculated from the adapter position detection marker included in the captured image, the definition information, and the position order information are similarly calculated. And the result is displayed on the display device 5.

  Therefore, when the connector plug terminal is inserted into and removed from the connector adapter terminal, the operator is shown whether or not the connector plug terminal is about to be inserted into and removed from the correct connector adapter terminal. For this reason, it is possible to prevent the connector plug terminal from being inserted into or removed from the wrong connector adapter terminal.

  Further, after the insertion or removal of the connector plug terminal is completed, information for updating the wiring information related to the connector adapter terminal 21 in which the connector plug terminal is inserted or removed is generated, and the generated management information It transmits to the computer apparatus 6 and it updates the wiring information regarding the corresponding connector adapter terminal 21 of equipment DB7.

  Therefore, when the connector plug terminal 30 is inserted into or removed from the connector adapter terminal 21 to be inserted or removed, the wiring information regarding the corresponding connector adapter terminal 21 in the facility DB 7 is automatically updated. For this reason, it is not necessary for the operator to separately perform an operation for updating the wiring information after the insertion / extraction operation is completed, thereby reducing the workload of the operator. In addition, the wiring information of the facility DB 7 can always be kept up-to-date.

Furthermore, the position coordinate of the connector adapter terminal to be removed on the captured image is compared with the position coordinate of the insertion / extraction tool tip marker 32, and when these position coordinates match, an unlock signal is transmitted to insert / extract the extraction tool. The lock state of the third lock mechanism 34 is released.
For this reason, even if it is attempted to remove the connector plug terminal from the wrong connector adapter terminal, the insertion / extraction tool is controlled so as not to operate, so that an erroneous removal operation can be reliably prevented.

  The present invention is not limited to the above embodiment. For example, in the above-described embodiment, the lock state of the lock mechanism 34 of the insertion / extraction tool 3 is controlled to be released only when the connector plug terminal is extracted from the correct connector adapter terminal to be extracted. However, even when the connector plug terminal is inserted into the correct connector adapter terminal to be inserted, the lock state of the lock mechanism 34 of the insertion / extraction tool 3 may be controlled to be released.

  Further, the lock mechanism 34 of the insertion / extraction tool 3 may be controlled also when the connector plug terminal held in the IDM holding portion is gripped by using the insertion / extraction tool 3. In this case, the wiring work support apparatus 1 images the range including the insertion tool 3 and the IDM holding portion with the camera 4. Then, the position coordinates of the tip marker 32 provided on the insertion / extraction tool 3 and the position coordinates of the connector plug terminal to be inserted are detected from this imaging screen, and only when these position coordinates match, the management computer A control signal for unlocking is transmitted to the device 6 to unlock the lock mechanism 34 of the insertion / extraction tool 3. If it does in this way, even if an operator tries to hold | grip the connector plug terminal other than insertion object with the insertion / extraction tool 3, it can be made impossible to hold.

  Furthermore, in the above-described embodiment, the wiring work support device 1 is provided separately from the management computer device 6 and the facility DB 7, and the wiring work support control is performed. May be given. That is, the management computer device 6 and the wiring work support device 1 can be integrated.

  In addition, the configuration of the wiring work support device, the support processing procedure and the support processing contents in each work process, the configuration of the adapter position detection marker and the tip marker of the insertion / extraction tool, and the like can be variously modified without departing from the gist of the present invention. Can be implemented.

  In short, the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. Further, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 1 ... Wiring work assistance apparatus, 2 ... Connector connection board, 3 ... Insertion / extraction tool, 4 ... Camera, 5 ... Display device, 6 ... Management computer apparatus, 7 ... Equipment database (equipment DB), 11 ... Interface unit, 12 control Unit: 13 ... Storage unit, 21 ... Connector adapter terminal group, 22 ... Adapter position detection marker, 30 ... Connector plug terminal, 31 ... Tool tip, 32 ... Tip marker, 111 ... Imaging information input unit, 112 ... Display information Input unit 113 ... Equipment information input / output unit 121 ... Adapter position detection marker recognition processing unit 122 ... Insertion / extraction tool tip marker recognition processing unit 123 ... Plug identification code recognition processing unit 124 ... Support information generation processing unit 131 ... definition information database (definition information DB).

Claims (10)

Wiring work support for supporting selective insertion / extraction of connector plug terminals with respect to the plurality of connector adapter terminals in a connector connection board provided with a plurality of connector adapter terminals and a first marker for detecting the connector adapter terminals. A device,
Definition in which attribute information of the first marker and position definition information representing a relative positional relationship between the first marker and the plurality of connector adapter terminals are stored in association with the identification information of the first marker. Information storage means;
Prior to the insertion / extraction operation, means for receiving input of work order information for designating a connector adapter terminal and a connector plug terminal to be the target of the insertion / extraction operation;
Means for acquiring, from a camera, first image information obtained by imaging an area including the plurality of connector adapter terminals and a first marker of the connector connection board;
Means for recognizing the first marker from the acquired first image information based on the attribute information of the first marker stored in the definition information storage means;
Based on the position coordinates in the first image information of the recognized first marker, the position definition information stored in the definition information storage means, and the input work order information, the first Means for generating a first image pattern representing the position of the plurality of connector adapter terminals and a second image pattern representing the position of the connector adapter terminal designated as the target of the insertion / extraction operation in the image information of
Means for generating composite image information in which the generated first and second image patterns are superimposed on the first image information, and causing the display means to display the generated composite image information. Wiring work support device. When a plurality of pending connector plug terminals are accommodated in the retention portion in a state where unique identification information is displayed, unique identification information of the plurality of connector plug terminals accommodated in the retention portion is displayed. Means for acquiring from the camera second image information captured in a batch;
Means for recognizing unique identification information of each of the plurality of connector plug terminals from the acquired second image information;
Each of the recognized unique identification information is collated with the identification information of the connector plug terminal specified as the target of the insertion / extraction operation by the work order information, and coincides with the identification information of the connector plug terminal as the target of the insertion / extraction operation And a means for displaying on the display means information indicating the accommodation position of the connector plug terminal corresponding to the detected unique identification information in the holding portion. The wiring work support apparatus according to claim 1. When an insertion / extraction operation of the connector plug terminal with respect to the connector adapter terminal is performed using an insertion / extraction tool having a second marker for tool position detection, an image including an area including the insertion / extraction tool and the connector connection board is imaged. Means for acquiring the image information of 3 from the camera;
Means for recognizing the first and second markers from the acquired third image information based on the attribute information of the first and second markers stored in the definition information storage means;
Based on the position coordinates in the third image information of the recognized first marker, the position definition information stored in the definition information storage means, and the input work order information, the insertion / extraction operation Means for calculating a position coordinate in the third image information of the connector adapter terminal designated as the target of;
Means for calculating a position coordinate in the third image information of an image representing the recognized second marker;
A determination unit that compares the calculated position coordinates of the connector adapter terminal to be inserted and removed and the position coordinates of the second marker, and determines whether or not these position coordinates match;
The wiring work support apparatus according to claim 1, further comprising: a unit that displays information representing a determination result by the determination unit on the display unit. In association with the identification information of a plurality of connector adapter terminals provided in the connector connection board, when there is provided equipment information storage means for storing wiring information representing the use state of the connector adapter terminal,
After completion of the insertion / extraction operation of the connector plug terminal of the insertion / extraction operation target with respect to the connector adapter terminal of the insertion / extraction operation target, information for updating wiring information regarding the connector adapter terminal of the insertion / extraction operation target is generated, and the generated update 4. The wiring work support apparatus according to claim 1, further comprising means for updating wiring information stored in the facility information storage means based on information.   It further comprises means for controlling the insertion / extraction tool so as to enable the insertion / extraction operation by releasing the locked state of the insertion / extraction tool only when it is determined by the determination means that the respective position coordinates match. The wiring work support apparatus according to claim 3. Wiring work support for supporting selective insertion / extraction of connector plug terminals with respect to the plurality of connector adapter terminals in a connector connection board provided with a plurality of connector adapter terminals and a first marker for detecting the connector adapter terminals. A method,
A process of storing attribute information of the first marker and position definition information representing a relative positional relationship between the first marker and the plurality of connector adapter terminals in association with the identification information of the first marker. When,
Prior to the insertion / extraction operation, a process of receiving input of work order information for designating the connector adapter terminal and the connector plug terminal to be the target of the insertion / extraction operation;
Obtaining a first image information obtained by imaging a region including the plurality of connector adapter terminals and a first marker of the connector connection board from a camera;
Recognizing the first marker from the acquired first image information based on the attribute information of the first marker stored in the definition information storage means;
Based on the position coordinates in the first image information of the recognized first marker, the position definition information stored in the definition information storage means, and the input work order information, the first Generating a first image pattern representing the position of the plurality of connector adapter terminals and a second image pattern representing the position of the connector adapter terminal designated as the target of the insertion / extraction operation in the image information of
Generating composite image information obtained by superimposing the generated first and second image patterns on the first image information, and displaying the generated composite image information on a display unit. Wiring work support method. When a plurality of pending connector plug terminals are accommodated in the retention portion in a state where unique identification information is displayed, unique identification information of the plurality of connector plug terminals accommodated in the retention portion is displayed. A process of acquiring second image information captured in a batch from the camera;
A process of recognizing the unique identification information of the plurality of connector plug terminals from the acquired second image information,
Each of the recognized unique identification information is collated with the identification information of the connector plug terminal specified as the target of the insertion / extraction operation by the work order information, and coincides with the identification information of the connector plug terminal as the target of the insertion / extraction operation And a step of displaying on the display means information indicating the accommodation position of the connector plug terminal corresponding to the detected unique identification information in the holding portion. The wiring work support method according to claim 6. When an insertion / extraction operation of the connector plug terminal with respect to the connector adapter terminal is performed using an insertion / extraction tool having a second marker for tool position detection, an image including an area including the insertion / extraction tool and the connector connection board is imaged. The process of acquiring the image information of 3 from the camera,
Recognizing the first and second markers from the acquired third image information based on the attribute information of the first and second markers stored in the definition information storing step;
Based on the position coordinates in the third image information of the recognized first marker, the position definition information stored in the definition information storage process, and the input work order information, the insertion / extraction operation Calculating the position coordinates in the third image information of the connector adapter terminal designated as the target of
Calculating a position coordinate in the third image information of an image representing the recognized second marker;
A determination process of comparing the calculated position coordinates of the connector adapter terminal of the insertion / extraction operation target with the position coordinates of the second marker and determining whether or not these position coordinates match;
The wiring work support method according to claim 6, further comprising a step of displaying information representing a determination result in the determination step on the display unit. In association with the identification information of a plurality of connector adapter terminals provided in the connector connection board, when there is provided equipment information storage means for storing wiring information representing the use state of the connector adapter terminal,
After completion of the insertion / extraction operation of the connector plug terminal of the insertion / extraction operation target with respect to the connector adapter terminal of the insertion / extraction operation target, information for updating the wiring information regarding the connector adapter terminal of the insertion / extraction operation target is generated, and the generated update The wiring work support method according to claim 6, further comprising a step of updating the wiring information stored in the facility information storage unit based on the information.   The method further includes a step of controlling the insertion / extraction tool so as to enable the insertion / extraction operation by releasing the locked state of the insertion / extraction tool only when it is determined by the determination process that the position coordinates coincide with each other. The wiring work support method according to claim 8, characterized in that:

Images