JP6303219B1 - Image processing system and image processing method - Google Patents

Abstract

A highly reliable inspection is realized by comprehensively determining a plurality of inspection results from a plurality of compact imaging processing apparatuses. An image processing system that performs image processing by capturing an image of an object, and includes a plurality of image processing devices 10a to 10d that image and inspect the object 1 from a plurality of arbitrary angles. , Receiving the tilt angles from the imaging processing devices 10a to 10d, recognizing the imaging angles of the imaging processing devices 10a to 10d with respect to one object, and a plurality of captured images from the plurality of imaging processing devices 10a to 10d and An image processing system comprising: a central server 2 that receives information including an inspection result and performs comprehensive determination. [Selection] Figure 1

Description

The present invention relates to an image processing system and an image processing method in which a plurality of image pickup processing devices pick up an image of a target object, inspect it, and integrate these to make a determination.

  At the factory production site, inspections for products are routinely performed. Among them, since the appearance inspection requires a lot of manpower, an automatic approach has been conventionally performed.

In Patent Document 1, an inspection object is illuminated by an illumination unit and imaged by an imaging unit, and an image processing apparatus different from these performs data communication with the illumination unit and the imaging unit to control the illumination unit. A configuration is described in which a captured image is input to determine the quality of an object.

  Further, Patent Document 2 describes a configuration in which the same object is inspected using a plurality of cameras.

Patent Document 1: JP-A-2006-65875
Patent Document 2: JP-A-7-103905

However, if the imaging unit and the image processing apparatus are configured separately as described in Patent Document 1, there is a problem in that the entire apparatus is enlarged and the cost is increased.

In addition, if there is one feature extraction unit that processes images for a plurality of cameras, as described in Patent Document 2, the processing for images captured by each camera is processed one by one in order. In addition to the time required, installation and adjustments are required while switching the cameras, so that it takes time to adjust the operation and the system is complicated.

SUMMARY OF THE INVENTION An object of the present invention is to solve the above-described problems and realize a highly reliable inspection by comprehensively judging a plurality of inspection results from a plurality of compact imaging processing apparatuses.

In order to solve the above-described problems, the present invention is an image processing system that captures an image of an object and performs image processing.
A plurality of imaging processing devices for imaging and inspecting the one object from a plurality of arbitrary angles;
Receiving the tilt angle from the imaging processing device, recognizing the imaging angle of the imaging processing device with respect to one object, and receiving information including a plurality of captured images and inspection results from the plurality of imaging processing devices. And a central server for comprehensive judgment ,
The imaging processing apparatus provides an image processing system including at least an acceleration sensor, detecting the tilt angle, and transmitting the detected inclination angle to the central server .

With this configuration, it is possible to realize a highly reliable inspection by comprehensively determining a plurality of inspection results from a plurality of compact imaging processing devices , and the imaging processing device can easily detect an imaging angle.

The central server may be configured to recognize an active imaging processing device based on the presence or absence of information from the imaging processing device.

With this configuration, the imaging processing apparatus can be freely added or removed, and the system can be easily constructed or changed.

It is good also as a structure provided with the display apparatus which displays the some captured image and test result from each imaging processing apparatus which the said central server received according to the said imaging angle.

With this configuration, it is possible to easily grasp the overall quality state of the object based on the display on the display device.

In order to solve the above problems, the present invention is an image processing method for imaging an object and performing image processing,
Imaging the one object with a plurality of imaging processing devices from a plurality of arbitrary angles, respectively, and inspecting each;
Receiving the tilt angle transmitted from the imaging processing device, and recognizing the imaging angle of the imaging processing device with respect to one object;
A step in which the central server receives information including a plurality of captured images and inspection results transmitted from the plurality of imaging processing devices and performs a comprehensive determination;
Equipped with a,
The imaging processing apparatus provides an image processing method characterized in that it includes at least an acceleration sensor, detects the tilt angle, and transmits it to the central server .

With this configuration, it is possible to realize a highly reliable inspection by comprehensively determining a plurality of inspection results from a plurality of compact imaging processing devices , and the imaging processing device can easily detect an imaging angle.

According to the image processing system and the image processing method of the present invention, it is possible to achieve a highly reliable inspection by comprehensively determining a plurality of inspection results from a plurality of compact imaging processing apparatuses.

It is a figure explaining the example of the image processing system in Example 1 of this invention. It is a figure explaining the structural example of the imaging processing apparatus in Example 1 in this invention. It is a figure explaining the example of the image processing system in Example 2 of this invention. It is a figure explaining the example of the image processing system in Example 3 of this invention.

  A first embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a diagram illustrating an example of an image processing system according to the first embodiment of the present invention. FIG. 2 is a diagram illustrating a configuration example of the imaging processing apparatus according to the first embodiment of the present invention.

  In the first embodiment, the imaging processing devices 10a to 10d image the object 1 from a plurality of angles, and inspect each of them. As this angle, an arbitrary angle suitable for the inspection of the object 1 can be selected. That is, the imaging processing device 10a captures images from diagonally upper right, the imaging processing device 10b images from diagonally upper left, and the imaging processing device 10c captures images from the left side so that the three-dimensional object 1 can be captured from many angles. Then, the imaging processing device 10d captures an image from the right side and performs an inspection based on the captured images. Then, the imaging processing devices 10 a to 10 d transmit information including each captured image and the inspection result to the central server 2. The tilt angle of the imaging processing device 10 is configured to detect the tilt angle of the imaging unit 111 (see FIG. 2) with respect to the gravity axis, and is detected when the imaging processing devices 10a to 10d are installed. Is transmitted to the integrated server 2 as will be described later.

The central server 2 receives the inclination angles of the imaging processing devices 10a to 10d and recognizes the imaging angles of the imaging processing devices 10a to 10d. In addition, each captured image and inspection result are received, each inspection result is weighted, and complex image processing is performed on the captured image as necessary to make a comprehensive determination. Then, the information including the captured image and the inspection result received by the central server 2, and the imaging angle and the comprehensive determination result recognized by the central server 2 are transmitted and displayed on the information terminal 3 (FIG. Only images and test results are shown.) Alternatively, the comprehensive determination result made by the central server 2 may be transmitted to a production process control device in a factory to eliminate or repair defective products.

  In the first embodiment, all of the imaging processing apparatuses 10a to 10d are configured to transmit the respective inclination angles to the integrated server 2. However, the present invention is not necessarily limited to this and can be appropriately changed. For example, the imaging processing apparatus 10 with a known imaging angle such as a horizontal plane may be configured not to detect and transmit the tilt angle.

(Imaging processing device)
As illustrated in FIG. 2, the imaging processing apparatus 10 (10a to 10d) according to the first exemplary embodiment includes a housing 11 and an illumination unit 12. The imaging processing device 10 (10a to 10d) illuminates the object 1 with the illuminating unit 12, images the object 1, and inspects the object 1 based on the captured image. In addition, information including the captured image and the inspection result and the tilt angle are transmitted to the central server 2. The casing 11 houses an imaging unit 111, an inspection unit 112, a storage unit 113, a transmission unit 114, a reception unit 115, a control unit 116, and an inclination angle detection unit 117. In addition, a lens is provided on the object side of the imaging unit 111 as necessary.

  The storage unit 113 may be externally attached to the housing 11 in a removable form such as an SD card. It is only necessary that at least the imaging unit 111, the inspection unit 112, the transmission unit 114, the reception unit 115, the control unit 116, and the inclination angle detection unit 117 are integrated and housed in the housing 11. Thereby, the imaging processing apparatus 10 can be comprised compactly.

  The imaging processing apparatus 10 images the object 1 with the imaging unit 111. The object 1 can be a variety of objects such as mechanical parts, printed boards, electronic parts, and pharmaceuticals. The imaging unit 111 is configured by a CMOS sensor and captures a color image. The resolution is arbitrary, but in the first embodiment, the resolution is 640 × 480 pixels. This is because communication band congestion in the transmission unit 114 described later is taken into consideration. The control unit 116 determines from the captured image that the object 1 is disposed at a position where the object 1 can be imaged by the imaging processing device 10 (10a to 10d), or detects it with a sensor or the like (not shown) and An instruction such as a shutter is given to capture an image. A captured image obtained by the imaging unit 111 capturing the object 1 is stored in the storage unit 113. In the storage unit 113, an ID for specifying the imaging processing device 10 is stored in advance as imaging processing device specifying information, and can be transmitted from the transmission unit 114 to the central server 2 at an arbitrary timing. The ID is specified by the user and stored in the storage unit 113, or if not specified, the ID is automatically identified by a MAC address or the like and stored in the storage unit 113. Further, the imaging time may be stored and transmitted instead of the ID as the imaging processing device specifying information or added to the ID.

  That is, the information to be transmitted from the imaging processing device 10 (10a to 10d) to the central server 2 is to transmit imaging processing device specifying information such as its own ID and imaging time in addition to the tilt angle, the captured image, and the inspection result. Can do.

  In the first embodiment, the imaging unit 111 is configured with a CMOS sensor. However, the imaging unit 111 is not necessarily limited to this and can be appropriately changed. For example, it may be composed of a CCD sensor or an infrared sensor. In addition, a color image may not be captured, and a monochrome image may be captured. Furthermore, in the first embodiment, the resolution of the imaging unit 111 is configured to be 640 × 480 pixels. However, the resolution is not necessarily limited to this, and can be appropriately changed depending on the convenience of the apparatus. For example, it may be composed of 1000 × 1000 pixels or 320 × 240 pixels.

  The captured image is input to the inspection unit 112 and inspected. The inspection is performed by an artificial intelligence called a support vector machine. The support vector machine can perform inspection by learning a plurality of non-defective products and defective products of the object 1 in advance and setting boundaries thereof before performing actual inspection. The contents of the inspection can vary depending on the object 1. For example, a defect inspection, a misalignment inspection, a presence inspection, and the like can be performed.

  Here, the inspection unit 112 performs determination or classification on the input image by calculating similarity with the non-defective image or class classification.

  In the first embodiment, the inspection unit 112 is configured by a support vector machine. However, the present invention is not necessarily limited to this and can be changed as appropriate. For example, the inspection unit 112 may be configured using linear discrimination, naive Bayes, Bayes network, or convolutional neural network (CNN).

  In the first embodiment, a plurality of non-defective products and defective products of the object 1 are learned in advance, but the present invention is not necessarily limited to this and can be changed as appropriate. For example, a plurality of good products may be learned.

  Information including the tilt angle, the captured image, and the inspection result is transmitted from the transmission unit 114 to the integrated server 2 via the wireless LAN. In the integrated server 2, the imaging angle of the imaging processing device 10 (10a to 10d) can be recognized by the inclination angle. Specifically, when the imaging processing apparatus 10 (10a to 10d) is newly installed, the integrated server 2 transmits a command to the imaging processing apparatus 10 (10a to 10d) to detect the tilt angle and control The server 2 is transmitted. The central server 2 receives the tilt angle and recognizes the imaging angle. At that time, when the object 1 is installed with an inclination, the inclination angle is corrected and the imaging angle is recognized. In addition, in the case of an angle that cannot be determined only by the transmitted inclination angle, for example, an angle of 50 ° and an angle of 230 °, the central server 2 receives an image from the imaging processing device 10 (10a to 10d), and the target The imaging angle is recognized by analyzing the imaging state of the object 1 (for example, the direction in which the object 1 enters the screen).

  The tilt angle detection unit 117 includes two-axis acceleration sensors, and can detect the tilt angle with respect to the gravity axis in the imaging unit 111 by a known method. By transmitting this inclination angle from the transmission unit 114 to the central server 2, the central server 2 can recognize the imaging angle of each imaging processing device 10 (10a to 10d) as described above. By recognizing the imaging angle, the inspection result can be weighted according to the imaging angle. As will be described later, the inspection results of the imaging processing device 10 (10a to 10d) imaged from the side of the object 1 are emphasized, and the inspection results of the imaging processing device 10 (10a to 10d) imaged from obliquely above are referred to. A comprehensive determination can be derived by weighting the degree.

  In addition, in Example 1, although it comprised so that the acceleration sensor for 2 axes | shafts might be provided, it is not necessarily limited to this and can be changed suitably. For example, an acceleration sensor and a geomagnetic sensor may be provided, or an acceleration sensor and a gyroscope may be provided. That is, it may be configured to include at least an acceleration sensor.

(Display device (information terminal))
A captured image, an inspection result, an imaging angle, and a comprehensive determination result are transmitted from the central server 2 to the information terminal 3 by wireless LAN and displayed. The information terminal 3 in FIG. 1 shows a state where captured images and inspection results captured by each imaging processing device are displayed. Displaying “x” on the captured image indicates that the inspection result is defective. In addition, an imaging angle (not shown) and a comprehensive determination result are displayed.

  The information terminal 3 can display the captured image and the inspection result of the imaging processing device 10 (10a to 10d) according to each imaging angle. That is, the captured image 30a obtained by imaging the object 1 from the upper right side of the imaging processing device 10a is displayed on the upper right side of the photograph 1A, which is a non-defective image in the information terminal 3, and the captured image 30b obtained by the imaging processing device 10b from the upper left side. Is displayed on the upper left of the photograph 1A, the captured image 30c captured from the left side by the imaging processing device 10c is displayed on the left side of the photograph 1A, and the captured image 30d captured by the imaging processing device 10d from the right side is a photograph. Display on the right side of 1A.

In this way, by displaying the captured image and the inspection result according to each imaging angle, the position and angle of the captured image with respect to the object 1 can be easily understood, and the inspection result of each imaging processing apparatus can be quickly grasped. be able to.

  In the first embodiment, “×” is displayed for defective products for the inspection result, but the present invention is not necessarily limited to this, and can be changed as appropriate. For example, “◯” may be displayed for a non-defective product, or both “X” for a defective product and “◯” for a good product may be displayed. Further, instead of “x” and “◯”, the characters may be displayed, or the background color may be changed for display.

Moreover, in Example 1, although the smart phone is used as the information terminal 3, it is not necessarily limited to this and can be changed suitably. For example, a tablet or a personal computer may be used. The information terminal 3 is not necessarily required and may be provided only when necessary. Further, if it is not necessary to transmit control information to be described later, a display device such as an LED display may be used as the information terminal 3, and at least a function as a display device may be provided.

(Lighting control)
Control information for the illumination unit 12 and the imaging unit 111 can be transmitted from the information terminal 3 to the central server 2 via the wireless LAN. Then, the control information received by the central server 2 is transmitted to the imaging processing apparatus 10 (10a to 10d) via the wireless LAN. In the imaging processing apparatus 10 (10a to 10d), the receiving unit 115 can receive this control information. The control unit 116 controls the illumination unit 12 and the imaging unit 111 based on this control information. At that time, control information is transmitted from the control unit 116 to the illumination unit 12 by Bluetooth (registered trademark, the same applies hereinafter).

Specifically, the lighting unit 12 can be controlled to be turned on or off, its illuminance, or hue. Items to be controlled are selected according to the gloss and color of the object 1 and the imaging angle. In addition, the imaging unit 111 can control imaging or non-imaging, shutter speed, and the like. The item to be controlled is selected according to the moving speed of the object 1 and the imaging angle.

  In the first embodiment, the control information is transmitted from the control unit 116 to the illumination unit 12 by Bluetooth. However, the present invention is not limited to this, and can be changed as appropriate according to the convenience of the apparatus. For example, it may be configured to transmit by wireless LAN, or may be configured to transmit by wire. In addition, the information terminal 3 is configured to transmit to the central server 2 and from the central server 2 to the reception unit 115 via the wireless LAN. However, the information terminal 3 is not necessarily limited thereto, and can be appropriately changed depending on the convenience of the apparatus. . For example, it is good also as a structure which transmits by Bluetooth, and it is good also as a structure which transmits by wire.

  Moreover, in Example 1, although the illumination part 12 was set as the structure attached to the housing | casing 11, it is not necessarily limited to this, It can change suitably. For example, you may isolate | separate from the housing | casing 11, ie, the imaging processing apparatus 10 (10a-10d), and you may install in the place different from the imaging processing apparatus 10 (10a-10d).

  Here, the imaging unit 111 of one imaging processing device 10 (for example, the imaging processing device 10a) is controlled so as to capture the object 1 and the illumination unit 12 is turned off, and the other imaging processing device 10 is controlled. If the imaging unit 111 (for example, the imaging processing device 10b) is controlled to be non-imaging and the illumination unit 12 is turned on, the dark field illumination by the illumination light from the other imaging processing device 10 (imaging processing device 10b) is performed. One imaging processing device 10 (imaging processing device 10a) can image the object 1. That is, the other imaging processing device 10 (imaging processing device 10b) can be used as a simple lighting device.

  Moreover, the structure of the illumination part 12 can be selected arbitrarily. For example, it is possible to select ring illumination in which LEDs are arranged circumferentially, dome illumination in which the shape in which the LEDs are arranged has a dome shape, or coaxial epi-illumination. Then, they are attached to the casing 11 of the imaging processing apparatus 10 (10a to 10d) so that they can be replaced, or the illumination unit 12 is not attached to the casing 11 and can be removed from the imaging processing apparatus 10 (10a to 10d). It is configured so as to be provided in the place

(Master server)
Comprehensive determination in the central server 2 is performed by weighting each inspection result and performing comprehensive image processing on the captured image as necessary to make a comprehensive determination. In the weighting in the first embodiment, one point is given and the score is added for each of the inspection results that are determined to be defective. If the sum total is two or more, the overall determination is determined as defective.

  In the first embodiment, one of the inspection results determined to be defective is given a point and the score is added. However, the present invention is not necessarily limited to this, and can be changed as appropriate. For example, weights may be given to the inspection results of the imaging processing apparatuses 10c and 10d that capture images from the side, and two points may be given if these inspection results are defective. That is, the weighting value for the inspection result may be changed depending on the imaging angle.

  As described above, the central server 2 performs complex image processing on the captured image as necessary. This is because the inspection processing capability of the imaging processing apparatus 10 (10a to 10d) has a limit, and more complicated image processing is performed by the integrated server 2, whereby a highly reliable determination can be realized. Complex image processing includes, for example, processing when it is necessary to make a fine mesh for region segmentation for feature quantity extraction, stereo image processing using two or more imaging processing devices, and the like.

  Further, the central server 2 can recognize the imaging processing device 10 (10a to 10d) in operation based on the presence / absence of transmission information from the imaging processing device 10 (10a to 10d). That is, when the imaging processing device 10 (10a to 10d) is provided and the central server 2 receives at least the imaging processing device identification information, it recognizes that a new imaging processing device 10 (10a to 10d) has been added. Further, if there is a certain period during which no information is transmitted from the imaging processing apparatus 10 (10a to 10d) provided so far, it is considered that the imaging processing apparatus 10 (10a to 10d) has been removed. That is, the central server 2 can recognize the imaging processing device 10 (10a to 10d) in operation based on the presence / absence of information from each imaging processing device 10 (10a to 10d). When the central processing server 2 newly recognizes the imaging processing device 10 (10a to 10d) in operation, as described above, a command is transmitted to the imaging processing device 10 (10a to 10d) to detect the tilt angle and control The server 2 is transmitted. The central server 2 receives the tilt angle and recognizes the imaging angle. At that time, if the object 1 is installed with an inclination, the inclination is corrected and recognized. Further, in the case of an angle that cannot be determined only by the tilt angle, for example, an angle of 50 ° and an angle of 230 °, the central server 2 receives an image from the imaging processing device 10 (10a to 10d) and The imaging state is recognized by analyzing the imaging state (for example, the direction in which the object 1 enters the screen).

  In the first embodiment, the configuration is such that when at least the imaging processing device identification information is received by the central server 2, it is recognized that a new imaging processing device 10 (10a to 10d) has been added. It is not limited and can be changed as appropriate. For example, if the central server 2 newly receives information such as a captured image, an inspection result, and an inclination angle in addition to the imaging processing device specifying information, a new imaging processing device 10 (10a to 10d) is added. It is good also as a structure to recognize. In other words, the central server 2 can recognize the imaging processing device 10 in operation based on the presence / absence of information from each imaging processing device 10.

As described above, in the first embodiment, an image processing system that images one object and performs image processing,
A plurality of imaging processing devices for imaging and inspecting the one object from a plurality of arbitrary angles;
Receiving the tilt angle from the imaging processing device, recognizing the imaging angle of the imaging processing device with respect to one object, and receiving information including a plurality of captured images and inspection results from the plurality of imaging processing devices. And a central server that performs comprehensive determination, and achieves highly reliable inspection by comprehensively determining a plurality of inspection results from a plurality of compact imaging processing devices. be able to.

An image processing method for imaging an object and performing image processing,
Imaging the one object with a plurality of imaging processing devices from a plurality of arbitrary angles, respectively, and inspecting each;
Receiving the tilt angle transmitted from the imaging processing device, and recognizing the imaging angle of the imaging processing device with respect to one object;
A step in which the central server receives information including a plurality of captured images and inspection results transmitted from the plurality of imaging processing devices and performs a comprehensive determination;
By the image processing method characterized by comprising the above, it is possible to achieve a highly reliable inspection by comprehensively judging a plurality of inspection results from a plurality of compact imaging processing apparatuses.

  The second embodiment of the present invention is different from the first embodiment in that the imaging processing apparatus includes two units. A second embodiment will be described with reference to FIG. FIG. 3 is a diagram illustrating an example of an image processing system according to the second embodiment of the present invention.

  In the second embodiment, the imaging processing device 10 (10a, 10b) images the object 1 from a plurality of angles, and inspects each. As this angle, an arbitrary angle suitable for the inspection of the object 1 can be selected. That is, in order to efficiently capture the three-dimensional object 1, the imaging processing device 10a captures an image from diagonally upper right, and the imaging processing device 10b captures an image from diagonally upper left. Then, the imaging processing apparatus 10 (10a, 10b) transmits information including the respective inclination angles, captured images, and inspection results to the central server 2.

The central server 2 receives the respective inclination angles of the imaging processing devices 10 (10a, 10b) and recognizes the imaging angles of the imaging processing devices 10 (10a, 10b). In addition, each captured image and inspection result are received, each inspection result is weighted, and complex image processing is performed on the captured image as necessary to make a comprehensive determination. Then, the information including the captured image and the inspection result received by the central server 2, and the imaging angle and the comprehensive determination result recognized by the central server 2 are transmitted and displayed on the information terminal 3 (in FIG. Only images and test results are shown.) Alternatively, the comprehensive determination result made by the central server 2 may be transmitted to a production process control device in a factory to eliminate or repair defective products.

  In the second embodiment, all the imaging processing apparatuses 10 (10a, 10b) are configured to transmit the respective inclination angles to the integrated server 2. However, the present invention is not necessarily limited to this, and can be changed as appropriate. For example, the imaging processing apparatus 10 (10a, 10b) having a known imaging angle such as a horizontal plane may be configured not to detect and transmit the tilt angle.

  In the information terminal 3, the captured image and the inspection result are displayed according to each imaging angle. That is, the captured image 30a obtained by imaging the object 1 from the diagonally upper right corner is displayed on the upper right side of the photograph 1A, which is a non-defective image, and the captured image 30b captured by the imaging processor 10b from the diagonally upper left corner is displayed in the photograph 1A. Display in the upper left. Displaying “x” on the captured image indicates that the inspection result is defective. In addition, an imaging angle (not shown) and a comprehensive determination result are displayed.

  In the second embodiment, “×” is displayed for the defective product as the inspection result. However, the inspection result is not necessarily limited to this, and can be changed as appropriate. For example, “◯” may be displayed for a non-defective product, or both “X” for a defective product and “◯” for a good product may be displayed. Further, instead of “x” and “◯”, the characters may be displayed, or the background color may be changed for display.

  In addition, in Example 2, although the smart phone is used as the information terminal 3, it is not necessarily limited to this but can change suitably. For example, a tablet or a personal computer may be used. The information terminal 3 is not necessarily required and may be provided only when necessary. Further, if it is not necessary to transmit control information to the central server 2, a display device such as an LED display may be used as the information terminal 3.

  As described above, in the second embodiment, by including a display device that displays a plurality of captured images and inspection results from the respective imaging processing devices received by the central server according to the imaging angle, the target of the captured image The position and angle with respect to the object can be easily understood, and the inspection result of each imaging processing apparatus can be quickly grasped.

  The third embodiment of the present invention is different from the first and second embodiments in that the imaging processing apparatus includes six units. A third embodiment will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of an image processing system according to the third embodiment of the present invention.

  In the third embodiment, the imaging processing apparatus 10 (10a to 10f) images the object 1 from a plurality of angles, and performs an inspection. That is, the imaging processing device 10a captures an image of the object 1 from diagonally upper right, the imaging processing device 10b images from diagonally upper left, the imaging processing device 10c captures from the left side, and the imaging processing device 10d captures from the right side. Then, the imaging processing device 10e captures an image from diagonally lower left, and the imaging processing device 10f captures an image from diagonally lower right. Then, the imaging processing apparatus 10 (10a to 10f) transmits information including the respective inclination angles, the captured image, and the inspection result to the central server 2.

The central server 2 receives the inclination angles of the imaging processing devices 10 (10a to 10f) and recognizes the imaging angles of the imaging processing devices 10 (10a to 10f). In addition, each captured image and inspection result are received, each inspection result is weighted, and complex image processing is performed on the captured image as necessary to make a comprehensive determination. Then, the information including the captured image and the inspection result received by the central server 2 and the imaging angle and the comprehensive determination result recognized by the central server 2 are transmitted and displayed on the information terminal 3 (in FIG. Only images and test results are shown.) Alternatively, the comprehensive determination result made by the central server 2 may be transmitted to a production process control device in a factory to eliminate or repair defective products.

  In the third embodiment, all of the imaging processing apparatuses 10 (10a to 10f) are configured to transmit the respective inclination angles to the integrated server 2. However, the present invention is not necessarily limited to this and can be changed as appropriate. For example, the imaging processing device 10 (10a to 10f) having a known imaging angle such as a horizontal plane may be configured not to detect and transmit the tilt angle.

  In the information terminal 3, the captured image and the inspection result are displayed according to each imaging angle. That is, the captured image 30a obtained by imaging the object 1 from the diagonally upper right corner is displayed on the upper right side of the photograph 1A, which is a non-defective image, and the captured image 30b captured by the imaging processor 10b from the diagonally upper left corner is displayed in the photograph 1A. A captured image 30c displayed on the upper left side and captured by the imaging processing device 10c from the left side is displayed on the left side of the photograph 1A, and a captured image 30d captured by the imaging processing device 10d from the right side is displayed on the right side of the photograph 1A. The captured image 30e captured by the imaging processing apparatus 10e from the lower left corner is displayed at the lower left of the photograph 1A, and the captured image 30f captured by the imaging processing apparatus 10f from the lower right corner is displayed at the lower right of the photograph 1A. . Displaying “x” on the captured image indicates that the inspection result is defective. In addition, an imaging angle (not shown) and a comprehensive determination result are displayed.

  In the third embodiment, “×” is displayed for defective products for the inspection result, but the present invention is not necessarily limited to this and can be changed as appropriate. For example, “◯” may be displayed for a non-defective product, or both “X” for a defective product and “◯” for a good product may be displayed. Further, instead of “x” and “◯”, the characters may be displayed, or the background color may be changed for display.

  In addition, in Example 2, although the smart phone is used as the information terminal 3, it is not necessarily limited to this but can change suitably. For example, a tablet or a personal computer may be used. The information terminal 3 is not necessarily required and may be provided only when necessary. Further, if it is not necessary to transmit control information to the central server 2, a display device such as an LED display may be used as the information terminal 3.

  As described above, in the third embodiment, by including a display device that displays a plurality of captured images and inspection results from each imaging processing device received by the central server according to the imaging angle, the target of the captured image The position and angle with respect to the object can be easily understood, and the inspection result of each imaging processing apparatus can be quickly grasped.

  A fourth embodiment of the present invention will be described. The fourth embodiment is different from the first to third embodiments in that an imaging device is provided in addition to a plurality of imaging processing devices.

  The imaging apparatus according to the fourth embodiment may be a camera or an imaging processing apparatus having imaging and inspection functions. That is, it is only necessary that the captured image can be transmitted to the integrated server via the wireless LAN. Specifically, the imaging device is configured by a CMOS sensor and captures a color image. The resolution is arbitrary, but in the fourth embodiment, the resolution is 640 × 480 pixels. This is because the congestion of the communication band when transmitting to the central server is taken into consideration. Moreover, a lens and an illuminating device can be provided as needed.

  In the fourth embodiment, the imaging device is configured with a CMOS sensor, but is not necessarily limited thereto, and can be changed as appropriate. For example, it may be composed of a CCD sensor or an infrared sensor. In addition, a color image may not be captured, and a monochrome image may be captured. Furthermore, in the fourth embodiment, the resolution of the imaging apparatus is configured to be 640 × 480 pixels, but is not necessarily limited thereto, and can be changed as appropriate according to the convenience of the apparatus. For example, it may be composed of 1000 × 1000 pixels or 320 × 240 pixels.

  The imaging device is provided at a place where it is easy to look down, such as directly above the object, and images the entire object in a bird's-eye view. The imaging device takes a bird's-eye view of the entire object at the time at which each imaging processing device has taken an image and inspected it, and stores it in the central server. The stored bird's-eye view image can be displayed on the information terminal or the display device together with the captured image of the imaging processing device and the inspection result. Based on this bird's-eye view image, for example, when the imaging processing apparatus misses a defect such as a scratch, it is possible to easily follow up the inspection result. Here, the imaging time may be transmitted to the central server and stored together with the overhead image. Thereby, the follow-up investigation of the inspection result can be performed more easily.

  The central server accumulates the overhead image captured by the imaging device together with the captured image from each imaging processing device, the inspection result, the imaging time, and the like. Then, when analyzing an inspection error such as missing a defect or over-inspection, it is possible to analyze a bird's-eye view image when the inspection error occurs based on the inspection result and imaging time, and to trace the cause.

  In the fourth embodiment, the bird's-eye view image obtained when the imaging processing apparatus has taken an image and inspected is stored and accumulated in the central server. However, the present invention is not necessarily limited to this and can be changed as appropriate. For example, you may comprise so that an overhead image may always be taken and accumulate | stored at the time of operation of a production process.

  In the fourth embodiment, the imaging apparatus is configured to capture an overhead image of the object. However, the present invention is not necessarily limited to this and can be changed as appropriate. For example, it may be configured to image the serial number assigned to the object, or may be configured to image the pair of objects when there is a pair of objects with the object. Good. In other words, a reference image for performing a follow-up survey of the inspection result may be captured.

  As described above, the fourth embodiment further includes an imaging device that images the one object, and the imaging device is configured to transmit at least the captured image to the central server, thereby facilitating the follow-up examination of the inspection result. Can be done.

The image processing system and the image processing method in the present invention can be widely used in the inspection field.

1: Object 2: Integrated server 3: Information terminals 10a to 10f: Imaging processing device 11: Housing 12: Illumination unit 1A: Photograph of non-defective image 30a to 30f: Captured image 111: Imaging unit 112: Inspection unit 113: Storage Unit 114: transmission unit 115: reception unit 116: control unit 117: inclination angle detection unit

Claims (4)

An image processing system for imaging an object and performing image processing,
A plurality of imaging processing devices for imaging and inspecting the one object from a plurality of arbitrary angles;
Receiving the tilt angle from the imaging processing device, recognizing the imaging angle of the imaging processing device with respect to one object, and receiving information including a plurality of captured images and inspection results from the plurality of imaging processing devices. And a central server for comprehensive judgment ,
The image processing apparatus includes at least an acceleration sensor, detects the tilt angle, and transmits the detected inclination angle to the central server . The image processing system according to claim 1 , wherein the central server recognizes an active imaging processing apparatus based on presence / absence of information from the imaging processing apparatus. 3. The image processing system according to claim 1, further comprising a display device that displays a plurality of captured images and inspection results received by the central server from the respective imaging processing devices in accordance with the imaging angle. An image processing method for imaging an object and performing image processing,
Imaging the one object with a plurality of imaging processing devices from a plurality of arbitrary angles, respectively, and inspecting each;
Receiving the tilt angle transmitted from the imaging processing device, and recognizing the imaging angle of the imaging processing device with respect to one object;
A step in which the central server receives information including a plurality of captured images and inspection results transmitted from the plurality of imaging processing devices and performs a comprehensive determination;
Equipped with a,
The image processing apparatus includes at least an acceleration sensor, detects the tilt angle, and transmits the detected inclination angle to the central server .

Images