JP2018180868A - Image processing device and manufacturing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce work burden causing when assembling control boards and the like designed by electrical design CAD.SOLUTION: A worker terminal 10 is an image processing device connected so as to be communicable with a camera 21 and a display 22. The same includes a controller 11 for: obtaining, from the camera 21, a first photographed image obtained from photographing a position to attach a component disposed in the real space; obtaining the virtual image of a first component included in a drawing created by electrical design CAD; and positioning the first photographed image and the drawing, and thereafter displaying onto a display with an overlapping image obtained from overlapping the virtual image on the position in the first photographed image where it corresponds to the position of the first component within the drawing.SELECTED DRAWING: Figure 3

Description

  The present invention relates to an image processing apparatus and a manufacturing system, and more particularly to an image processing apparatus and a manufacturing system used together with a CAD (Computer-Aided Design) for performing an electrical design of a control panel, a power distribution board, a wire harness and the like.

  CAD (hereinafter, referred to as "electrical design CAD") for performing electrical design of a control panel, a power receiving / distribution panel, a wire harness, etc. (hereinafter referred to as "control panel etc." collectively) is known. See Patent Document 1). In this type of electrical design CAD, a parts list that can list necessary parts, a layout of parts, and the like are created, and a worker who assembles a control panel or the like performs an assembly operation while referring to these.

  Also, in recent years, so-called augmented reality technology has gained popularity (see, for example, Patent Document 1). In this technique, since the virtual image is superimposed in the real space, the user can experience an object that does not actually exist in the real space. Patent Document 1 discloses that a user corrects the size, length, and the like of a virtual object in a virtual space.

JP, 2014-109802, A

"ECAD (registered trademark) DCX" catalog, Wacom, January 2017

  By the way, since the drawings such as the parts list and the wiring diagram created by CAD for electrical design are very specialized and complicated, to assemble the control panel etc. based on these drawings Skilled skill was required.

  Therefore, one of the objects of the present invention is to provide an image processing apparatus and a manufacturing system using a technology for reducing the burden of assembling the control panel or the like designed by the electrical design CAD.

  An image processing apparatus according to the present invention is an image processing apparatus communicably connected to an imaging unit and a display unit, and the imaging unit is configured to capture a first captured image formed by imaging a component installation destination disposed in a physical space. And a virtual image of the first part included in the drawing created by the electrical design CAD, and the first captured image and the drawing are aligned, and the first image in the drawing is acquired. The image processing apparatus may include a control unit that causes the display unit to display a superimposed image formed by superimposing the virtual image on a position on the first captured image corresponding to a position of a component.

  According to the present invention, a virtual image of a part included in a drawing created by CAD for electrical design can be displayed in the real space, so that even a skilled worker can carry out an assembly operation of a control panel etc. It will be.

  In the image processing apparatus, the control unit acquires, from the imaging unit, a second captured image obtained by imaging the component attachment destination after the first component is attached to the component attachment destination. The unit corrects the arrangement of the first component in the drawing based on a recognition unit that recognizes the position of the first component in the second captured image, and the position recognized by the recognition unit. And a correction unit. According to this, it is possible to correct the drawing based on the actual arrangement when the position where the worker actually arranged the part on the control panel is different from the position in the drawing.

  In the image processing apparatus, the control unit acquires a third captured image obtained by capturing the first component from the imaging unit, and the recognition unit is configured to obtain the third captured image in the third captured image. The component is recognized, and the control unit determines whether or not the type of the component indicated by the first component matches the type defined in the drawing as the type of the first component. The correction unit may correct the information of the first part in the drawing when the result of the determination is negative. According to this, when the type of parts actually arranged (or arranged) by the worker on the control panel is different from the type of parts defined on the drawing, the parts actually arranged (or arranged) It is possible to correct the drawing based on the type.

  In the image processing apparatus, the drawing includes information indicating an assembly order of a plurality of parts, and the control unit selects each of the plurality of parts as the first part in the order according to the assembly order. Every time the selection is made, the first captured image is acquired from the imaging unit, and a virtual image of the first component included in the drawing created by the electrical design CAD is acquired, and the first captured image and the first captured image A process of aligning a drawing and displaying a superimposed image formed by superimposing the virtual image on a position on the first captured image corresponding to the position of the first part in the drawing on the display unit It is good also as execution. According to this, it is possible for the worker to attach all the parts without omission in the correct order without particularly worrying about the order only by following the instruction of the image processing apparatus.

  A manufacturing system according to the present invention is a manufacturing system including a wearable terminal having the imaging unit and the display unit, and an image processing apparatus according to the present invention.

  According to the present invention, the virtual image of the part included in the drawing created by the electrical design CAD can be displayed in the real space, so that the control panel can be used without misplacement of the part even if it is not a skilled worker. Etc. can be implemented.

  In addition, when the position where the worker actually arranges the component on the control panel is different from the position on the drawing, it is possible to correct the drawing based on the actual arrangement.

  Furthermore, based on the type of parts actually arranged (or arranged) when the type of parts actually arranged (or arranged) by the operator on the control panel is different from the type of parts defined on the drawing. It is possible to correct the drawing.

  Furthermore, by simply following the instruction of the image processing apparatus, the worker can attach all the parts without omission in particular without worrying about the order.

It is a figure showing control board 1 by an embodiment of the invention. It is a figure which shows the structure of the drawing data produced by CAD for electrical design by embodiment of this invention. It is a figure which shows the functional block of the worker terminal and head mounted display by embodiment of this invention. It is a flowchart which shows the process of the control part shown in FIG. It is a flowchart which shows the detail of the work content instruction | indication process shown in FIG. (A) is a figure which shows the example of the image acquired by step S4 of FIG. 4, (b) is a figure which shows an example of the image displayed on the display 22 by FIG.5 S23, c) shows an example of an image acquired in step S13 of FIG. It is a flowchart which shows the detail of the components discrimination | determination process shown in FIG. It is a figure which shows an example of the several sheets of image which artificial intelligence is made to learn by FIG.7 S30. It is a flowchart which shows the detail of the type | mold substitution process shown in FIG. It is a flowchart which shows the detail of the attachment position confirmation process shown in FIG. It is a flowchart which shows the detail of the components arrangement | positioning change process shown in FIG.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings. In the following, the outline of the control panel and the CAD for electrical design will be described first, and then the image processing apparatus according to the present embodiment will be described in detail.

  FIG. 1 is a view showing the control panel 1. As shown in the figure, the control panel 1 includes a chassis 2 having one or more openings 2a, a plurality of components 3 disposed in the openings 2a, and a terminal block 4 disposed below the chassis 2. And a plurality of wires 5 connecting the plurality of components 3 and the terminal block 4. Each component 3 is electrically connected to each other or to the outside through the terminal block 4.

  The installation of the plurality of components 3 to the control panel 1 is performed by a worker at an assembly plant of the control panel 1 or at a use site of the control panel 1. The operator performs this mounting operation while referring to the drawing data created by the electrical design CAD.

  FIG. 2 is a diagram showing the configuration of drawing data created by the electrical design CAD. The drawing data is created for each type of part attachment destination such as the control panel 1, and is stored in advance in a drawing database 12a (see FIG. 3) described later in association with a different drawing ID for each drawing data. Ru.

  As shown in FIG. 2, the drawing data includes a plurality of types of drawings such as a parts list, a layout, and a circuit diagram. Among these, the parts list shows a list of all parts to be attached to the control panel 1 (including the parts 3 and the wiring 5 shown in FIG. 1. The same applies hereinafter). As shown in FIG. , Type (model number, model number, SKU, etc. In the following description, the type is assumed), and information such as the mounting order to the control panel 1 (order of assembling a plurality of parts) is included. Further, the layout drawing is a diagram showing the place in the control panel 1 where each component is to be installed, and as shown in FIG. 2, the diagram of each component is superimposed and displayed on a diagram imitating the control panel 1 It has become a thing.

  Specifically, the installation work of the parts performed by the operator with reference to such drawing data is performed in the following flow. That is, the operator first refers to the bill of materials to determine the parts to be attached next. Then, the determined part is taken out from the part storage arranged near the part attachment destination (control board 1). Next, the operator refers to the layout drawing and mounts the taken-out parts on the control panel 1 in accordance with the part layout shown in the layout drawing. This makes it possible to attach a large number of parts to a predetermined place in a predetermined order.

  However, since the actual work is very complicated, there may be a mistake such as an error in the arrangement or mounting order of parts, especially when the operator is not skilled. Also, there may be cases where workers intentionally do not work according to drawings for convenience of the site (that is, cases where parts different from parts defined in the bill of material are used, cases where they are not arranged according to the layout drawing, etc.) In such a case, a mismatch will occur between the actual item and the drawing. The image processing apparatus according to the present embodiment solves various problems associated with the work of attaching a component to such a component attachment destination.

  The outline of the control panel and the CAD for electrical design has been described above. Next, an image processing apparatus according to the present embodiment will be described.

  FIG. 3 is a view showing a worker terminal 10 which is an image processing apparatus according to the present embodiment, and a head mounted display 20 which is attached to the head of the worker and used.

  The worker terminal 10 is prepared for the worker to confirm the parts list and layout described above, and is typically a desktop computer, but a notebook computer, a tablet terminal, etc. The function of the worker terminal 10 may be mounted on the head mounted display 20 when using the head mounted display 20 having a high function.

  As shown in FIG. 3, the worker terminal 10 functionally includes a control unit 11, a storage unit 12, a communication unit 13, an input unit 14, and an output unit 15.

  The control unit 11 is a central processing unit of the worker terminal 10. In addition, the storage unit 12 is configured by a main storage device configured to include a dynamic random access memory (DRAM) and the like, and an auxiliary storage device configured to include a hard disk and the like. The control unit 11 is configured to execute each process described below by reading and executing a program stored in the storage unit 12.

  The control unit 11 functionally includes a recognition unit 11 a and a correction unit 11 b. The recognition unit 11a has a function of recognizing a component present in the captured image and the position of the component in the captured image, and the correction unit 11b is in the case where there is a mismatch between the drawing and the result of the mounting operation In addition, it has the function of correcting the drawing in accordance with the result of the mounting operation. The details of the control unit 11 including the details of these functional units will be collectively described later.

  In the storage unit 12, a drawing database 12a and an image database 12b are constructed. The drawing database 12a is a database for storing the drawing data (drawing data created by the electrical design CAD) described with reference to FIG. The image database 12b includes a plurality of images obtained by photographing each part defined in the drawing data by changing angles, illumination, etc., and a virtual image of each part defined in the drawing data It is a database storing a plurality of images obtained by changing the angle, lighting, and the like of the control board 1 in a completed state (a state in which attachment of all parts is completed) and the control board 1 in a completed state. The information stored in these databases is used by the processing described later that the control unit 11 performs.

  The communication unit 13 has a communication function such as, for example, a wired LAN, a wireless LAN, or Bluetooth (registered trademark), and is configured to be able to mutually communicate with an external computer. The control unit 11 communicates with an external computer (not shown) via the communication unit 13.

  The input unit 14 is configured by input means such as a keyboard and a mouse. Further, the output unit 15 is configured by an output unit such as a display or a speaker. The control unit 11 receives an operation by the worker or presents information to the worker via the input unit 14 and the output unit 15.

  The head mounted display 20 is a type of wearable terminal used by being worn on human beings, and as shown in FIG. 3, various sensors (not shown) such as a camera 21 (imaging unit), a display 22 (display unit), and a position sensor ) Is configured. There are various types of wearable terminals known as a head mounted display, but any device can be used as the head mounted display 20 according to the present embodiment. For example, a video transmission type may be used to obtain an external field of view by projecting the appearance of the outside on the display 22 through the camera 21. Alternatively, it is possible to directly view the outside by making the display 22 translucent. A transparent type may be used. Also, instead of the head mounted display 20, another type of wearable terminal such as a smart watch may be used. In any case, the camera 21 and the display 22 according to the present embodiment are configured to operate under control of the control unit 11 of the worker terminal 10.

  Hereinafter, the function of the control unit 11 according to the present embodiment will be described in detail.

  First, the processing performed by the control unit 11 according to the present embodiment can be roughly divided into work content instruction processing (see FIG. 6 described later), part identification processing (see FIG. 7), and model replacement processing (FIG. 8), installation position confirmation process (see FIG. 9), and part arrangement change process (see FIG. 10), and overall process for controlling the execution order of these processes (see FIG. 10) (See FIG. 4).

  The work content instruction process acquires from the camera 21 a first captured image formed by imaging the control board 1 (part installation destination) disposed in the real space, and also generates a virtual image of the part to be attached to the image database 12b. Registration from the first captured image and the drawing, and superimposing a virtual image on the position of the first captured image corresponding to the position of the part in the drawing. This is a process of causing the display 22 to display the resulting superimposed image. The object used for alignment may be anything as long as it appears in the first captured image before and after attachment of the part to be attached, for example, a part of the chassis 2 shown in FIG. Or any other feature point may be extracted from the captured image as an object. When the control unit 11 executes the work content instruction process, the worker can easily know the arrangement of the parts to be attached.

  In the part discrimination process, the part in the third captured image formed by photographing the part selected by the worker as the mounting object is recognized by the recognition unit 11a, and the type of the recognized part is defined in the drawing. It is a process of determining whether or not it matches the type of part. The type substitution process is a process of correcting the type of the part on the drawing by the correction unit 11b when the result of the determination is negative. When the control unit 11 executes these processes, the type of part actually arranged (or arranged) by the operator on the control panel is actually different from the type of the part defined on the drawing. It is possible to modify the drawing based on the type of part placed (or placed).

  In the attachment position confirmation process, the position of the part in the second captured image obtained by photographing the control board 1 after the attachment of the part is recognized by the recognition unit 11a, and whether the recognized position is as shown in the drawing It is a process to confirm. In addition, the part layout change process is a process of correcting the position of the part in the drawing by the correction unit 11b based on the recognized position when it is determined that the layout is not arranged as shown in the drawing as a result of confirmation. is there. When the control unit 11 executes these processes, the drawing is corrected based on the actual arrangement when the position where the worker actually arranges the part on the control panel 1 is different from the position in the drawing. Becomes possible.

  Next, with reference to FIG. 3 and the process flow of the control unit 11, the above-described respective processes performed by the control unit 11 will be described in more detail.

  FIGS. 4, 5, and 7 to 10 show the process flow of the control unit 11. FIG. Referring first to FIG. 4, the control unit 11 first accepts the selection of the drawing ID by the worker (step S1). Then, the drawing data is read from the drawing database 12a based on the received drawing ID (step S2), and the part having the first mounting order described in the parts list is selected as the part of interest (first part) Step S3).

  Subsequently, the control unit 11 acquires an image (first captured image) of the control panel 1 from the camera 21 (step S4). Thereafter, the control unit 11 executes work content instruction processing (step S5).

  FIG. 5 shows the details of the work content instruction process executed in step S5. As shown in the figure, the control unit 11 that has started the work content instruction process first recognizes an object included in the first captured image acquired from the camera 21 in step S4 (step S20). Next, the control unit 11 acquires a virtual image of the component of interest from the image database 12b (step S21), and determines the display position of the virtual image based on the object recognized in step S20 and the drawing data (step S22). That is, the display position of the virtual image is determined based on the position of the object in the first captured image and the relative position of the object and the component of interest in the drawing. Then, based on the determination result, a superimposed image formed by superimposing the virtual image of the component of interest on the first captured image is displayed on the display 22 (step S23).

  6 (a) is a view showing an image P1 which is an example of the first captured image acquired in step S4 of FIG. 4, and FIG. 6 (b) is displayed on the display 22 in step S23 of FIG. 1 shows an example of an image P2 which is an example of the superimposed image to be displayed. An area A shown in the image P1 indicates the position at which the component of interest is attached. The control unit 11 determines an area A in which the virtual image of the component of interest is to be displayed, with the chassis 2 and the attached component 3a as an object. Then, in this area A, the virtual image V of the component of interest is displayed as the image P2.

  As described above, when the control unit 11 executes the work content instruction process, the virtual image of the part included in the drawing created by the electrical design CAD can be displayed in the real space. Even if this is the case, the control board 1 can be assembled without making a mistake in the arrangement of parts. When displaying the virtual image V, it is preferable to display the part name and model also in the display 22. By doing this, the worker can easily take out the part of interest from the parts storage.

  Returning to FIG. 4, the control unit 11 that has finished the work content instruction process then acquires an image (third captured image) from the camera 21 again (step S6). This image acquisition is performed in a state where the worker places the part of interest taken out of the parts storage in front of the camera 21. Therefore, the third captured image is an image obtained by capturing the component of interest. After that, the control unit 11 executes a part discrimination process (step S7).

  FIG. 7 shows the details of the part discrimination process performed in step S7. Step S30 indicated by a broken line in the figure is processing that is executed in advance as pre-processing. Specifically, the control unit 11 reads out, from the image database 12b, a plurality of images captured by changing angles, lighting, etc., for all parts that may be used, and learns using artificial intelligence (AI) Let it be done (step S30).

  FIG. 8 is a view showing an example of a plurality of images to be learned using artificial intelligence in step S30. In the same drawing, five images obtained by photographing at five angles are shown for the power relay (model: G2R-1-S) included in the relay G2R series of Omron (registered trademark). As in this example, the control unit 11 reads a plurality of images of each part from the image database 12b and causes them to be learned using artificial intelligence (AI) together with their types.

  The processes after step S31 are executed subsequently to step S6 shown in FIG. Specifically, the control unit 11 first recognizes, by the recognition unit 11a, the component of interest and the model thereof in the third captured image acquired from the camera 21 in step S6 (step S31). The recognition of the part of interest is performed by, for example, image recognition, and the recognition of the type is performed by, for example, character recognition. Next, using the artificial intelligence learned in step S30, the control unit 11 extracts one or more parts having a high degree of coincidence with the recognized noted part and the appearance (step S32), and each of the extracted one or more parts Are compared with the type recognized in step S31 (step S33). As a result, it is determined whether or not there is a match in model among the parts extracted in step S32 (step S34). If there is, the information on the matched parts is returned, and the parts determination processing is ended. On the other hand, if not, information indicating that there is no relevant part is returned, and the part determination processing is ended.

  Returning to FIG. 4, the control unit 11 that has completed the part identification process determines the presence / absence of the corresponding part based on the result returned from the part identification process (step S8). As a result, when it is determined that there is no relevant part, for example, a warning is issued on the display 22 or the like, and the process returns to step S6. This warning is, for example, the contents such as "The part presented can not be recognized." On the other hand, when it is determined that the corresponding part is present, the control unit 11 determines whether the part returned from the part determination processing and the target part are of the same type (step S10). This determination may be performed, for example, by comparing the type of the part returned from the part discrimination process with the type of the noted part described in the parts list. As a result of the determination in step S10, when it is determined that the type is not the same type, the type replacement process is called (step S11). This type substitution process is performed in parallel in multitasking. After calling the type substitution process, the process moves to step S12. On the other hand, when it is determined in step S10 that the type is the same type, the control unit 11 transfers the process to step S12 without calling the type substitution process.

  FIG. 9 shows the details of the type substitution process called in step S11. As shown in the figure, the control unit 11 first causes the operator to select whether or not to apply the same process to all parts of the same type as the part of interest (step S40). Then, the approval by the supervisor of the worker is accepted (step S41), and it is determined whether the approval has been made (step S42). The processing in steps S41 and S42 may be performed, for example, by displaying an approval button and a disapproval button on an upper PC (not shown) via the communication unit 13 and depending on which one is pressed. It is suitable.

  For example, the control unit 11 in the case where it is determined in step S42 that the notification is denied is issued a warning on the display 22 or the like (step S43), and the type replacement process is ended. The warning is, for example, "The type replacement has been denied by the superior". On the other hand, when it is determined in step S42 that the control is approved, the control unit 11 determines whether the selection result in step S40 is applied (step S44).

  When it is determined in step S44 that the part is not applied, the control unit 11 replaces the type associated with the component of interest in the parts list with the type included in the information returned in the part identification processing (step S45). End the type substitution process. Thus, when the parts list is corrected, the correction contents are automatically reflected on other drawings by the function of the electrical design CAD (step S46). For example, the diagrams of the parts contained in the layout are updated with diagrams according to the type.

  On the other hand, when it is determined in step S44 that the application is applied, the control unit 11 includes in the information returned in the parts identification process the model associated with the noted part and all parts of the same type as the noted part in the parts list. (Step S47), and the type replacement process is completed. Thereafter, as in step S46, the correction content is automatically reflected on the other drawings (step S48).

  As described above, the control unit 11 further executes the part discrimination process and the type substitution process, whereby the types of parts actually arranged (or arranged) by the operator on the control panel 1 are defined on the drawing. If it is different from the type of, it is possible to modify the drawing based on the type of part actually placed (or placed).

  Returning to FIG. 4, in step S12, the control unit 11 waits for the attachment completion of the component of interest (step S12). It is preferable that the determination of the attachment completion be performed, for example, according to the operation of the worker in the input unit 14. When the attachment of the component of interest is completed, the control unit 11 acquires an image (second captured image) of the control panel 1 from the camera 21 (step S13), and executes an attachment position confirmation process (step S14).

  FIG. 6C is a diagram showing an image P3 which is an example of the second captured image acquired in step S13 of FIG. As shown in the figure, in the typical image P3, the component of interest 3b is displayed at the same position as the virtual image V. However, in some cases, the worker may place the component of interest at a position different from the position indicated by the virtual image V. In such a case, the attachment position confirmation process and the component arrangement change process are processes for correcting the drawing in accordance with the actual arrangement.

  FIG. 10 shows the details of the attachment position confirmation process executed in step S14. Step S50 shown by a broken line in the figure is processing that is executed in advance as pre-processing. Specifically, the control unit 11 reads from the image database 12b a plurality of completed images captured at different angles, illuminations, and the like, and learns them using artificial intelligence (AI) (step S50). Here, the completed image is an entire image of the control panel 1 in a state in which all parts are attached.

  The processes after step S51 are executed subsequently to step S13 shown in FIG. Specifically, using the learning result learned in step S50, the control unit 11 first uses the completed image in the vicinity (on the drawing) of the component of interest of the second captured image acquired from the camera 21 in step S13. The degree of approximation is calculated (step S51). That is, the state of the area where the component of interest is to be arranged is compared between the actual image and the completed image prepared in advance, and the degree of approximation is calculated.

  Next, the control unit 11 determines whether the calculated degree of approximation is equal to or greater than a predetermined value (step S52). And when it determines with it being more than predetermined value, the information which shows arrangement | positioning as drawing is returned, and an attachment position confirmation process is complete | finished. On the other hand, when it is determined that the value is not the predetermined value or more, the control unit 11 acquires the image of the component of interest from the image database 12b (step S53), and based on the acquired image of the component of interest, the component of interest in the second captured image Are searched (step S54). Then, based on the search result, the coordinates of the position at which the component of interest is actually arranged are acquired (step S55), information indicating the acquired coordinates is returned, and the attachment position confirmation process is ended.

  Returning to FIG. 4, next, the control unit 11 determines whether or not the component of interest has been arranged as illustrated based on the information returned from the attachment position confirmation process (step S15). As a result of the determination, if it is determined that the components are not arranged as shown in the drawing, the part arrangement change processing is called (step S16). The component placement change processing is performed in parallel in multitasking. After calling the part arrangement change process, the process moves to step S17. On the other hand, when it is determined in step S15 that the components are arranged as shown in the drawing, the control unit 11 shifts the processing to step S17 without calling the component allocation change processing.

  FIG. 11 shows the details of the part placement change process called in step S16. As shown in the figure, first, the control unit 11 receives an approval by the supervisor of the worker (step S60), and determines whether or not the approval has been made (step S61). In the processes of steps S60 and S61, as in the processes of steps S41 and S42 shown in FIG. 9, for example, an approval button and a disapproval button are displayed on an upper PC (not shown) via the communication unit 13, It is preferable to carry out depending on which one is pressed.

  For example, the control unit 11 when it is determined in step S61 that the notification is denied is issued a warning on the display 22 or the like (step S62), and the component placement change processing is ended. This warning is, for example, "The change of the part arrangement has been denied by the superior". On the other hand, when it is determined in step S61 that the object has been approved, the control unit 11 corrects the position of the component of interest in the layout drawing using the coordinates returned in the attachment position confirmation process (step S63). As described above, when the control unit 11 further executes the attachment position check process and the part arrangement change process, the position where the worker actually arranges the part on the control panel 1 is different from the position in the drawing, It is possible to correct the drawing based on the actual arrangement.

  Returning to FIG. 4, in step S17, the control unit 11 determines whether or not the installation has been completed for all parts defined in the parts list. As a result, when it is determined that the process has not ended, the process returns to step S3, and the part to be attached next in the mounting order described in the parts list is selected as a new notable part (first part) The process after step S4 is repeated. In this manner, by selecting each of the plurality of components as the component of interest in the order in which the control unit 11 is defined in the parts list in the order of installation, the worker simply follows the instruction of the worker terminal 10, in particular It becomes possible to attach all parts without omission in the correct order without worrying about the order. On the other hand, when it is determined in step S17 that the process is ended, the control unit 11 ends the entire process.

  As described above, according to the present embodiment, since the virtual image of the part included in the drawing created by the electrical design CAD can be displayed in the real space, the part is not a skilled worker Assembling work of the control panel etc. can be carried out without making a mistake in the arrangement of

  In addition, when the position where the worker actually arranges the component on the control panel is different from the position on the drawing, it is possible to correct the drawing based on the actual arrangement.

  Furthermore, based on the type of parts actually arranged (or arranged) when the type of parts actually arranged (or arranged) by the operator on the control panel is different from the type of parts defined on the drawing. It is possible to correct the drawing.

  Furthermore, by simply following the instruction of the image processing apparatus, the worker can attach all the parts without omission in particular without worrying about the order.

  The preferred embodiments of the present invention have been described above, but the present invention is not limited to these embodiments in any way, and the present invention can be implemented in various aspects without departing from the scope of the present invention. Of course.

  For example, in the above-described embodiment, the control panel is illustrated as the component mounting destination, but the present invention can be suitably applied to a case where a power distribution panel, a wire harness, or the like is used as the component mounting destination.

Reference Signs List 1 control panel 2 chassis 2a opening 3 parts 4 terminal block 5 wiring 10 worker terminal 11 control unit 11a recognition unit 11b correction unit 12 storage unit 12a drawing database 12b image database 13 communication unit 14 input unit 15 output unit 20 head mounted display 21 Camera 22 Display P1 to P3 Image V Virtual Image

Claims (9)

An image processing apparatus communicably connected to an imaging unit and a display unit, the image processing apparatus comprising:
While acquiring from the image pickup unit a first pickup image obtained by picking up an image of a part attachment destination disposed in the real space;
Acquire a virtual image of the first part included in the drawing created by CAD for electrical design,
A superimposed image formed by aligning the first captured image and the drawing and superimposing the virtual image on a position on the first captured image corresponding to the position of the first component in the drawing An image processing apparatus comprising: a control unit to be displayed on the display unit. The control unit acquires, from the imaging unit, a second captured image formed by imaging the component attachment destination after the first component is attached to the component attachment destination.
The control unit
A recognition unit that recognizes the position of the first part in the second captured image;
The image processing apparatus according to claim 1, further comprising: a correction unit that corrects the arrangement of the first component on the drawing based on the position recognized by the recognition unit. The image processing apparatus according to claim 2, wherein the correction unit corrects the arrangement of the first component on the drawing according to a user's instruction. The control unit acquires, from the imaging unit, a third captured image formed by imaging the first component.
The recognition unit recognizes the first part in the third captured image;
The control unit determines whether or not the type of the part indicated by the first part matches the type predefined in the drawing as the type of the first part,
The image processing apparatus according to claim 2, wherein the correction unit corrects the information of the first part in the drawing when the result of the determination is negative. The image processing apparatus according to claim 4, wherein the correction unit corrects the information of the first part in the drawing according to a user's instruction. The drawing includes information indicating an assembly order of a plurality of parts,
The control unit
Each of the plurality of parts is selected as the first part in the order according to the assembly order, each time the selection is made,
While acquiring the first captured image from the imaging unit,
Acquiring a virtual image of the first part included in the drawing created by the electrical design CAD,
A superimposed image formed by aligning the first captured image and the drawing and superimposing the virtual image on a position on the first captured image corresponding to the position of the first component in the drawing The image processing apparatus according to any one of claims 1 to 5, wherein the processing to be displayed on the display unit is executed. The image processing apparatus according to any one of claims 1 to 6, wherein the part attachment destination is a control panel. The image processing apparatus according to any one of claims 1 to 6, wherein the part attachment destination is a wire harness. A wearable terminal having the imaging unit and the display unit;
A manufacturing system comprising: the image processing apparatus according to any one of claims 1 to 8.