JP6381144B2 - Imaging processing device - Google Patents

Description

The present invention relates to a compact imaging processing apparatus capable of imaging an object and performing inspection processing.

  At the factory production site, inspections for products are routinely performed. Among them, since the appearance inspection requires a large number of people, automation has been conventionally performed.

In Patent Document 1, an inspection object is illuminated by an illumination unit and imaged by an imaging unit, and an image processing apparatus different from these performs data communication with the illumination unit and the imaging unit to control the illumination unit. A configuration is described in which a captured image is input to determine the quality of an object.

  Patent Document 2 describes a configuration in which a single object is inspected using a plurality of cameras.

Patent Document 1: JP-A-2006-65875
Patent Document 2: JP-A-7-103905

However, if the imaging unit and the image processing apparatus are configured separately as described in Patent Document 1, there is a problem in that the entire apparatus is enlarged and the cost is increased.

In addition, if there is one feature extraction unit that processes images for a plurality of cameras, as described in Patent Document 2, the processing for images captured by each camera is processed one by one in order. However, there is a problem that it takes time and the system becomes complicated.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-described problems and to realize a compact imaging processing apparatus that can independently inspect and process captured images and that can be easily handled such as installation.

In order to solve the above problems, the present invention is an imaging processing apparatus that images one object and performs an inspection process,
An imaging unit for obtaining a captured image obtained by imaging the one object;
An inspection unit for obtaining an inspection result by an inspection process based on the captured image;
A control unit that controls at least the imaging unit;
A transmission unit that transmits the captured image, the inspection result, and imaging processing device identification information that identifies itself;
An illumination unit that illuminates the one object , a reception unit,
A housing that houses the imaging unit, the inspection unit, the control unit, the receiving unit, and the transmitting unit ;
The receiving unit receives control information for the illumination unit and the imaging unit via a wireless LAN, and the control unit controls the illumination unit and the imaging unit based on the control information, respectively .
The control unit provides an imaging processing device that transmits the control information selected based on the gloss and color of the one object and the imaging angle to the illumination unit via Bluetooth. It is.

With this configuration, it is possible to realize a compact imaging processing apparatus that can easily inspect captured images and that is easy to handle such as installation. In addition, the illumination unit and the imaging unit can be controlled separately. For example, if the illumination unit is operated and the imaging unit is deactivated, the imaging processing device can be used as a simple illumination device, Use of the imaging processing device can expand the range of use such as oblique shooting and backlight shooting. Furthermore, the control information can be easily transmitted even if the illumination unit is away from the control unit.

The imaging processing device specifying information may be configured to be an imaging time when the captured image is obtained.

With this configuration, when a plurality of imaging processing devices capture and inspect a single object, it is possible to easily identify a plurality of imaging processing devices that have captured the single target.

The inspection unit may be configured to perform an inspection process on an object by learning a plurality of non-defective products and a plurality of defective products, or by learning a plurality of non-defective products.

With this configuration, the adjustment work at the production site can be simplified, and a compact inspection unit can be realized.

An inclination angle detection unit that detects an inclination angle of the imaging unit may be further provided, the inclination angle detection unit may include at least an acceleration sensor, and the transmission unit may transmit the inclination angle.

With this configuration, it is possible to detect the inclination of the imaging processing apparatus, and to facilitate the adjustment of the installation angle of the imaging processing apparatus or the inspection process that corrects the detected inclination angle.

With the imaging processing apparatus of the present invention, it is possible to realize a compact imaging processing apparatus that can easily inspect captured images and that can be easily handled such as installation.

It is a figure explaining the usage example of the imaging processing apparatus in Example 1 of this invention. It is a figure explaining the structure of the imaging processing apparatus in Example 1 of this invention. It is a figure explaining the usage example of the imaging processing apparatus in Example 3 of this invention. It is a figure explaining the structure of the imaging processing apparatus in Example 3 of this invention. It is a figure explaining the usage example of the imaging processing apparatus in Example 4 of this invention.

  A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram illustrating an example of use of an imaging processing apparatus according to Embodiment 1 of the present invention. FIG. 2 is a diagram illustrating the configuration of the imaging processing apparatus according to the first embodiment of the present invention.

  As illustrated in FIG. 1, the imaging processing apparatus 20 according to the first embodiment includes a housing 21. The imaging processing device 20 images the object 1 and inspects the object 1 based on the captured image. Moreover, the captured image can be transmitted to the information terminal 3 and displayed together with the inspection processing apparatus specifying information for specifying the inspection result and itself. As shown in FIG. 2, the housing 21 houses an imaging unit 211, an inspection unit 212, a storage unit 213, a transmission unit 214, and a control unit 216. In addition, a lens is provided on the object side of the imaging unit 211 as necessary.

  The imaging processing device 20 images the object 1 with the imaging unit 211. The object 1 can be a variety of objects such as mechanical parts, printed boards, electronic parts, and pharmaceuticals. The imaging unit 211 is configured by a CMOS sensor and captures a color image. The resolution is arbitrary, but in the first embodiment, the resolution is 640 × 480 pixels. This is because communication band congestion by the transmission unit 214 described later is taken into consideration. The control unit 216 determines from the captured image that the object 1 has been arranged at a position where the imaging processing device 20 can capture an image, or detects it using a sensor (not shown) or the like, and instructs the imaging unit 211 to use an electronic shutter or the like. To capture the image. At this time, the captured image obtained by the imaging unit 211 capturing the target object 1 is stored in the storage unit 213. In the storage unit 213, an ID is previously stored as imaging processing device specifying information for specifying the imaging processing device 20, and can be referenced from the outside. The ID is specified by the user and stored in the storage unit 213, or if not specified, the ID is automatically identified by a MAC address or the like and stored in the storage unit 213.

  In the first embodiment, the imaging unit 211 is configured with a CMOS sensor, but is not necessarily limited thereto and can be changed as appropriate. For example, it may be composed of a CCD sensor or an infrared sensor. In addition, although a color image is captured, it may be configured to capture a monochrome image. Further, in the first embodiment, the resolution of the imaging unit 211 is configured to be 640 × 480 pixels. However, the resolution is not necessarily limited thereto, and can be appropriately changed depending on the convenience of the apparatus. For example, it may be composed of 1000 × 1000 pixels or 320 × 240 pixels.

  The captured image is input to the inspection unit 212 and subjected to inspection processing. The inspection unit 212 is configured by artificial intelligence called a support vector machine. The support vector machine can perform inspection by learning a plurality of non-defective products and defective products of the object 1 in advance and setting boundaries thereof before performing actual inspection processing. The content of the inspection process can vary depending on the object 1. For example, a defect inspection, a misalignment inspection, a presence inspection, and the like can be performed.

  Here, the inspection unit 212 performs determination or classification on the input image by calculating similarity with the non-defective image or class classification.

  In the first embodiment, the inspection unit 212 is configured by a support vector machine, but is not necessarily limited thereto, and can be changed as appropriate. For example, the inspection unit 212 may be configured by linear discrimination, naive Bayes, Bayes network, or convolutional neural network (CNN).

  In the first embodiment, a plurality of non-defective products and defective products of the object 1 are learned in advance, but the present invention is not necessarily limited to this and can be changed as appropriate. For example, a plurality of good products may be learned.

  The captured image, the inspection result, and the imaging processing device specifying information are transmitted from the transmission unit 214 via the wireless LAN. Any destination can be selected. For example, it may be a computer such as a personal computer or an information terminal such as a smartphone, that is, any device that can be connected to a wireless LAN. In the first embodiment, the captured image, the inspection result, and the imaging processing device specifying information are transmitted to the information terminal 3 and displayed. Displaying “x” on the screen of the information terminal 3 in FIG. 1 indicates that the inspection result is defective.

  In the first embodiment, transmission is performed from the transmission unit 214 via the wireless LAN. However, the configuration is not necessarily limited thereto, and can be changed as appropriate. For example, it may be transmitted by Bluetooth (registered trademark, the same applies hereinafter) or may be configured to be transmitted by wire.

  As described above, in the first embodiment, the imaging unit and the inspection unit are not configured differently as in the prior art, but the imaging unit 211, the inspection unit 212, the storage unit 213, the control unit 216, and the transmission unit 214. Are integrated and housed in the same housing 21, the captured image can be inspected independently and a compact configuration can be achieved.

  In the first embodiment, the imaging unit 211, the inspection unit 212, the storage unit 213, the transmission unit 214, and the control unit 216 are integrated and housed in the same casing 21, but the present invention is not limited to this. However, it can be changed as appropriate. For example, the storage unit may be externally attached with a removable SD card or the like. It suffices that at least the imaging unit 211, the inspection unit 212, the control unit 216, and the transmission unit 214 are integrated and housed in the same casing 21.

As described above, in the first embodiment, an imaging processing apparatus that images one object and performs inspection processing, an imaging unit that obtains an image captured from the one object, and an inspection based on the captured image An inspection unit that obtains an inspection result by processing, a control unit that controls at least the imaging unit, and a transmission unit that transmits the captured image, the inspection result, and imaging processing device identification information that identifies itself By using the imaging processing apparatus characterized by the above, it is possible to realize a compact imaging processing apparatus that can independently inspect and process a captured image and that is easy to handle.

  The second embodiment of the present invention is different from the first embodiment in that it has a function of storing an imaging time as imaging processing apparatus specifying information and transmitting it together with a captured image and an inspection result. In other words, the image capturing time is stored together with the captured image in the storage unit 213, and the stored image capturing time is transmitted from the transmission unit together with the captured image and the inspection result. It is desirable to grasp the imaging time to the millisecond unit in consideration of the production process in the factory. That is, the imaging time is grasped and stored and transmitted as 0 year 0 month 0 day 0 hour 0 minute 0 second 0 millisecond.

  When there are a plurality of processes and the plurality of imaging processing apparatuses 20 capture and inspect the same object in each of these processes, in the external device to which the imaging time is transmitted, the same target of the same process is determined by the imaging time. The imaging processing device 20 that images the object 1 can be identified.

  As described above, in the second embodiment, since the imaging processing device specifying information is configured to be the imaging time when the captured image is obtained, the same information can be obtained without assigning an ID to each imaging processing device in advance. It is possible to specify an imaging processing apparatus that images the object.

  The third embodiment of the present invention is different from the first or second embodiment in that the imaging processing apparatus includes an illumination unit and a reception unit. A third embodiment will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram illustrating an example of use of the imaging processing apparatus according to the third embodiment of the present invention. FIG. 4 is a diagram illustrating the configuration of the imaging processing apparatus according to the third embodiment of the present invention.

As illustrated in FIG. 3, the imaging processing device 30 according to the third embodiment includes a housing 31 and an illumination unit 32. The imaging processing device 30 images the object 1 and inspects the object 1 based on the captured image. In addition, the captured image can be transmitted to the information terminal 3 and displayed together with the inspection result and the imaging processing device specifying information. As shown in FIG. 4, the housing 31 houses an imaging unit 311, an inspection unit 312, a storage unit 313, a transmission unit 314, a reception unit 315, and a control unit 316. Further, the illumination unit 32 in the third embodiment is attached to the housing 31. A lens is provided on the object side of the imaging unit 311 as necessary.

  The imaging processing device 30 images the object 1 with the imaging unit 311. The object 1 can be a variety of objects such as mechanical parts, printed boards, electronic parts, and pharmaceuticals. The imaging unit 311 is configured by a CMOS sensor and captures a color image. The resolution is arbitrary, but in the third embodiment, the resolution is 640 × 480 pixels. This is because the congestion of the communication band in the transmission unit 314 described later is taken into consideration. The control unit 316 determines from the captured image that the object 1 has been arranged at a position where the imaging processing device 30 can capture an image, or detects it using a sensor (not shown) or the like, and instructs the imaging unit 311 to use an electronic shutter or the like. Go and take an image. A captured image obtained by imaging the object 1 by the imaging unit 311 is stored in the storage unit 313. At that time, the imaging time may be stored in the storage unit 313 together with the captured image.

  In the third embodiment, the imaging unit 311 is configured with a CMOS sensor. However, the imaging unit 311 is not necessarily limited to this and can be appropriately changed. For example, it may be composed of a CCD sensor or an infrared sensor. Further, a monochrome image may be captured instead of a color image. Furthermore, in the third embodiment, the resolution of the imaging unit 311 is configured to be 640 × 480 pixels. However, the resolution is not necessarily limited thereto, and can be appropriately changed depending on the convenience of the apparatus. For example, it may be composed of 1000 × 1000 pixels or 320 × 240 pixels.

  The captured image is input to the inspection unit 312 and subjected to inspection processing. The inspection process is performed by artificial intelligence called a support vector machine. The support vector machine can perform an inspection by learning a plurality of non-defective products and defective products of the object 1 in advance and setting boundaries thereof before performing an actual inspection process. The content of the inspection process can vary depending on the object 1. For example, a defect inspection, a misalignment inspection, a presence inspection, and the like can be performed.

  Here, the inspection unit 312 performs determination or classification on the input image by calculating the similarity with the non-defective image or performing class classification.

  In the third embodiment, the inspection unit 312 is configured by a support vector machine, but is not necessarily limited thereto and can be changed as appropriate. For example, the inspection unit 312 may be configured using linear discrimination, simple base, Bayes network, or convolutional neural network (CNN).

  In the third embodiment, a plurality of non-defective products and defective products of the object 1 are learned in advance, but the present invention is not necessarily limited to this and can be changed as appropriate. For example, a plurality of good products may be learned.

  The captured image, the inspection result, and the imaging processing device specifying information are transmitted from the transmission unit 314 via the wireless LAN. For example, when there are a plurality of processes and a plurality of imaging processing apparatuses 30 capture and inspect the same object 1 in each process, a plurality of imaging processes are performed in which the same object 1 is imaged by the imaging processing apparatus specifying information. The device 30 can be identified. In the third embodiment, the captured image, the inspection result, and the imaging processing device specifying information are transmitted to the information terminal 3 and displayed. “X” displayed on the screen of the information terminal 3 in FIG. 3 indicates that the inspection result is defective. Although not shown, the imaging time may be displayed as the imaging processing device specifying information. In Example 3, although the smart phone is comprised as the information terminal 3 which is an external device, it is not necessarily limited to this and can be changed suitably. For example, a tablet may be used, and a personal computer or a server may be used.

  In the third embodiment, the illumination unit 32 and the reception unit 315 are provided as described above. The receiving unit 315 can receive control information for controlling at least the illumination unit 32 and the imaging unit 311. The control unit 316 controls the illumination unit 32 and the imaging unit 311 based on this control information. At that time, control information is transmitted from the control unit 316 to the illumination unit 32 by Bluetooth.

Specifically, the lighting unit 32 can be controlled to be turned on or off, its illuminance, color, or the like. Items to be controlled are selected according to the gloss and color of the object 1 and the imaging angle. In addition, the imaging unit 311 can control imaging or non-imaging, shutter speed, and the like. The item to be controlled is selected according to the moving speed of the object 1 and the imaging angle. Control information for the illumination unit 32 and the imaging unit 311 is received by the reception unit 315 via the wireless LAN.

  The control information received by the receiving unit 315 may be transmitted from the information terminal 3, for example. The information terminal 3 can select an appropriate one from a smartphone, a tablet, a personal computer, a server, or the like.

  In the third embodiment, the control information is transmitted from the control unit 316 to the illumination unit 32 by Bluetooth. However, the present invention is not limited to this, and can be appropriately changed depending on the convenience of the apparatus. For example, it may be configured to transmit by wireless LAN, or may be configured to transmit by wire. Further, the information terminal 3 is configured to transmit to the receiving unit 315 via the wireless LAN. However, the information terminal 3 is not necessarily limited thereto, and can be appropriately changed depending on the convenience of the apparatus. For example, it is good also as a structure which transmits by Bluetooth, and it is good also as a structure which transmits by wire.

  Here, it is assumed that a plurality of imaging processing devices 30 are used to image and inspect the object 1 from a plurality of angles. In this case, the imaging unit 311 of one imaging processing device 30 is controlled to image the object 1 and the illumination unit 32 is turned off, and the imaging unit 311 of the other imaging processing device 30 is not imaged. If the illumination unit 32 is controlled to be turned on with respect to the object 1, the one image processing apparatus 30 can image the object 1 with illumination light from the other image processing apparatus 30. That is, the other imaging processing device 30 can be used as a simple lighting device.

  Moreover, the structure of the illumination part 32 can be selected arbitrarily. For example, it is possible to select ring illumination in which LEDs are arranged in a circle, dome illumination in which LEDs are arranged in a dome shape, or coaxial epi-illumination, and the like. It can be attached to the body 31.

  As described above, the third embodiment further includes an illumination unit and a reception unit, the reception unit receives control information for the illumination unit and the imaging unit, and the control unit is configured to perform the illumination based on the control information. By controlling each of the image pickup unit and the image pickup unit, a compact image pickup processing device including an illumination unit is realized, and by transmitting control information from the outside, the image pickup unit and the illumination unit can be controlled, and the use range can be reduced. Can be enlarged.

  The fourth embodiment of the present invention is different from the third embodiment in that the illumination unit is not attached to the housing and is provided at any place other than the imaging processing apparatus. Example 4 will be described with reference to FIG. FIG. 5 is a diagram for explaining an application example of the imaging processing apparatus according to the fourth embodiment of the present invention.

  The imaging processing device 40 images the object 1 and performs an inspection process. During imaging, the illumination unit 42 illuminates the object 1. The obtained captured image, inspection result, and imaging processing device specifying information are transmitted. In the fourth embodiment, the information can be displayed on the information terminal 3 by transmitting to the information terminal 3.

  The fourth embodiment also includes an illumination unit 42, a receiving unit (not shown), an imaging unit, a storage unit, and a control unit. The receiving unit can receive control information for controlling the illumination unit 42 and the imaging unit. The control unit controls the illumination unit 42 and the imaging unit based on this control information. At that time, control information is transmitted from the control unit to the illumination unit 42 by Bluetooth.

Specifically, the lighting unit 42 can be controlled to be turned on or off, its illuminance, or hue. Items to be controlled are selected according to the gloss and color of the object 1 and the imaging angle. In addition, it is possible to control imaging, non-imaging, shutter speed, and the like for the imaging unit. The item to be controlled is selected according to the moving speed of the object 1 and the imaging angle.

As the information terminal 3, a smart phone, a tablet, a personal computer, a server, or the like can be used. Control information for the illumination unit 42 and the imaging unit is transmitted to the reception unit via the wireless LAN.

  In the fourth embodiment, the control information is transmitted from the control unit to the illumination unit by Bluetooth. However, the present invention is not limited to this, and can be appropriately changed depending on the convenience of the apparatus. For example, it may be configured to transmit by wireless LAN, or may be configured to transmit by wire. In addition, although the information terminal 3 is configured to transmit to the receiving unit via the wireless LAN, the information terminal 3 is not necessarily limited thereto, and can be appropriately changed depending on the convenience of the apparatus. For example, it is good also as a structure which transmits by Bluetooth, and it is good also as a structure which transmits by wire.

  The illumination unit 42 can be arbitrarily selected in its structure and installed at an arbitrary location. For example, ring illumination in which LEDs are arranged in a circle, dome illumination in which LEDs are arranged in a dome shape, or coaxial epi-illumination can be selected, and these can be exchanged for any object. Can be provided at any angle or distance.

  Thus, in Example 4, by setting the illumination unit separately from the imaging processing device, the illumination angle and distance can be freely changed with respect to the object, and from the control unit of the imaging processing device. The illumination unit can be controlled.

  The fifth embodiment of the present invention is different from the first to fourth embodiments in that it further includes a tilt angle detection unit that detects the tilt angle of the imaging unit. Example 5 will be described.

  The tilt angle detection unit includes at least two axes of acceleration sensors housed in the housing. These acceleration sensors can detect the inclination angle of the imaging unit by a known method. In the fifth embodiment, the tilt angle detection unit includes at least two axes of acceleration sensors. However, the configuration is not necessarily limited to this and can be changed as appropriate. For example, a configuration in which a geomagnetic sensor is added to the acceleration sensor, or a configuration in which a gyro sensor is added to the acceleration sensor may be used.

  The detected inclination angle can be transmitted to the information terminal 3 or the like at an arbitrary timing from the transmission unit. Thereby, the inclination angle can be known by the information terminal 3 or the like when the imaging processing apparatus is attached to a stand or the like, and the attachment inclination angle can be obtained by manually or automatically moving the stand or the like to which the imaging processing apparatus is attached. Can be adjusted easily. In addition, the information terminal 3 or the like can recognize the imaging angle of the imaging processing apparatus from this inclination angle. For example, when the central server receives picked-up images picked up at a plurality of pick-up angles from a plurality of pick-up processing devices, the inclination angle is used to identify the pick-up angle of each pick-up processing device and to determine the overall quality of the object 1 It can be used for determination.

  As described above, in the fifth embodiment, the imaging processing apparatus can be accurately attached by detecting the inclination angle of the imaging unit of the imaging processing apparatus, and the imaging angle of the imaging processing apparatus can be recognized by an external device. Therefore, it is possible to realize a compact imaging processing apparatus that can inspect and process captured images independently and that is easy to handle such as installation.

The imaging processing apparatus according to the present invention can be widely used in the field of product inspection in factories.

1: Object 3: Information terminal 20: Imaging processing device 21: Housing 211: Imaging unit 212: Inspection unit 213: Storage unit 214: Transmission unit 216: Control unit 30: Imaging processing device 31: Housing 32: Illumination unit 311: Imaging unit 312: Inspection unit 313: Storage unit 314: Transmission unit
315: Reception unit 316: Control unit 40: Imaging processing device 41: Housing 42: Illumination unit

Claims (4)

An imaging processing apparatus that images an object and performs an inspection process,
An imaging unit for obtaining a captured image obtained by imaging the one object;
An inspection unit for obtaining an inspection result by an inspection process based on the captured image;
A control unit that controls at least the imaging unit;
A transmission unit that transmits the captured image, the inspection result, and imaging processing device identification information that identifies itself;
An illumination unit that illuminates the one object , a reception unit,
A housing that houses the imaging unit, the inspection unit, the control unit, the receiving unit, and the transmitting unit ;
The receiving unit receives control information for the illumination unit and the imaging unit via a wireless LAN, and the control unit controls the illumination unit and the imaging unit based on the control information, respectively .
The image processing apparatus according to claim 1, wherein the control unit transmits the control information selected based on gloss and color of the one object and an imaging angle to the illumination unit via Bluetooth .   The imaging processing apparatus according to claim 1, wherein the imaging processing apparatus specifying information is an imaging time when the captured image is obtained. The measurement part, by learning a plurality of non-defective and a plurality of defective products, or by learning a plurality of non-defective, claims and performs inspection processing with respect to the object 1 or 2 The imaging processing device according to any one of the above. Further comprising an inclination angle detecting section for detecting the inclination angle of the imaging unit, the tilt angle detecting unit has at least an acceleration sensor, according to claim 1 to 3 wherein the transmission unit, characterized in that transmitting the tilt angle The imaging processing device according to any one of the above.

Images