JP2010016556A - Button recognition unit, and button recognition method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To acquire information of various button structures to improve precision of determination about inside or outside for buttons, and sew buttons to a sewn object with high quality using a sewing machine. <P>SOLUTION: A button recognition unit has a coaxial epi-illumination system 5 which emits light perpendicular to the top surface of a button 2, a liquid crystal display panel 10 which emits light from the bottom of the button 2, an oblique illumination system 7 which emits light obliquely to the top surface of the button 2, and a camera 3 which images a front illumination image, an oblique illumination image and a transmission illumination image. In addition, the button recognition unit also has an image processor 12 which determines a color of the top surface of the button 2 using the front illumination image, determines transmittance of the button 2 using the front illumination image and the transmission illumination image, adjusts illumination conditions of each of the illumination systems corresponding to the color and transmittance of the button 2, and acquires structure information of the button 2 using the front illumination image, the oblique illumination image and the liquid crystal display panel 10 to perform determination about inside or outside for the imaging target button 2 using each of the illumination images, the structure information and reference images of the imaging target button 2. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a button recognition device and a button recognition method, and more particularly, to a button recognition device and a button recognition method that acquire configuration information of a button and discriminate between the front and the back.

  2. Description of the Related Art Conventionally, when a button is sewn to a sewing product by an automatic button sewing device, a button recognition device that distinguishes the front and back of the button has been used.

  For example, Patent Document 1 describes an automatic button sewing device including a button detection device for detecting the front and back of a button. This button detection device is disposed so as to be able to advance and retract at a position where it can be engaged with the upper surface of the button held by the button knob foot when the button knob foot is raised, and is engaged with the edge and center of the button upper surface. A button detecting means capable of matching, and a discriminating means for discriminating the front and back of the button by the vertical displacement of the button detecting means.

  The automatic button detection device includes, for example, a button presence / absence detection lever and a button front / back detection lever as button detection means. Such an automatic button detection device is based on whether or not the button presence / absence detection lever is pushed up by the edge of the button when the button knob foot is raised after the button is supplied to the button knob foot by the button supply arm. The presence or absence of a button on the button knob foot is detected. In addition, the automatic button detection device uses a button shape in which the center part on the front surface of the button is recessed and the center part on the back surface is flat. The button front / back is discriminated based on whether or not the button front / back detection lever is pushed up.

  Patent Document 2 discloses a button supply unit that sequentially discharges the buttons stored in the button storage unit from the button discharge port after selecting the front and back of the button by generating predetermined vibrations in the button storage unit and the movement path. The button supply apparatus provided is described, This button supply apparatus is provided with the button selection mechanism in the middle of a movement path | route. And in this button selection mechanism, the normal button uses the shape that the front surface is recessed and the back surface is flat, and the button with the back surface facing downward is allowed to pass, but the front surface is on the lower side. The button which faces is adapted to drop downward in the button storage part. Thereby, the button supply device discriminates the front and back of the button, and sequentially discharges only the button whose surface faces upward from the button discharge port.

  Further, Patent Literature 3 describes a button sewing direction setting device including an image pickup unit that picks up an upper surface of a button supplied to a sewing machine and acquires a front image. This button sewing direction setting device arranges a button at a predetermined angle in a planar shape on the sewing machine based on a front image acquired by an imaging means and a standard image recorded in advance for the button. It comes to supply.

  Further, as described in Patent Document 3, the conventional button supply device is provided with a button transport unit having a lock pin that is locked to the threading hole of the button. By rotating the button from the top surface of the button placed on the pin and pressing it onto the locking pin to lock the locking pin in the threading hole of the button, the button is tilted to a predetermined angle in the planar shape. The machine is held in a state and supplied to the sewing machine.

Japanese Patent No. 2659073 Japanese Patent Laid-Open No. 10-194435 Japanese Patent Publication No. 2-023197

  However, according to the automatic button detection device described in Patent Document 1 and the button supply device described in Patent Document 2, the front and back of the button are discriminated by the depression of the center portion on the surface of the button and the flat surface of the back surface. For example, for a button that can be distinguished only by a stamp or an image formed on the surface instead of the shape, the front and back cannot be distinguished. For this reason, the above-described conventional automatic button detection device and button supply device have a problem that, for example, they cannot cope with front / back discrimination of a wide variety of buttons having the same front / back surface shape.

  Further, according to the button sewing direction setting device described in the cited document 3, it is possible to determine the front and back of the button also by a stamp or image formed on the surface of the button. When formed of a material that reflects light, it may be difficult to distinguish the background image from the button image in the acquired front image depending on the color and pattern of the button. Furthermore, according to the button sewing direction setting device described above, when the button is made of a transparent or translucent material, it is sufficient to compare the button with a standard image recorded in advance for the button. In some cases, a forward image could not be acquired. For this reason, this button sewing direction setting device has a problem that it cannot cope with the discrimination of a wide variety of buttons, for example, formed of a reflective material or a transparent or translucent material. It was.

  Moreover, the conventional button supply apparatus cannot exclude a button with poor manufacturing accuracy when the button is held by the locking pin. For example, when a button with poor accuracy of the threading hole formation position is placed on the button transport unit, the button is pressed onto the locking pin by the rotating device without the locking pin being locked to the threading hole. Thus, there is a problem that the locking pin may be broken.

  The present invention has been made in view of these points, and can acquire various types of button configuration information to improve the accuracy of discriminating the front and back of the button, and the button can be applied to the sewing product with a good finish by the sewing machine. It is an object of the present invention to provide a button recognition device and a button recognition method capable of sewing a button.

  In order to achieve the above object, the button recognition device according to the first aspect of the present invention is characterized in that a coaxial epi-illumination device that irradiates irradiation light perpendicularly to the front surface of the button and a rear surface side of the button. A state where irradiation light is irradiated by the transmission illumination device that irradiates irradiation light from the rear surface of the button, an oblique illumination device that irradiates irradiation light from the oblique direction to the front surface of the button, and the coaxial incident illumination device The front illumination image of the front surface of the button, the oblique illumination image of the front surface of the button in the state irradiated with the oblique illumination device, and the irradiation light irradiated with the transmission illumination device The configuration information of the button is acquired using an imaging device that respectively captures a transmission illumination image of the front surface of the button, the front illumination image, the oblique illumination image, and the transmission illumination image. Bright image, in that an image processing apparatus for discriminating the front and back of the button by using the configuration information and pre-recorded standard image of the button.

  Here, the button configuration information includes the button to be imaged such as the button's external shape, uneven shape, outer diameter, center position, plane shape, and threading hole position, diameter, center position, etc. This refers to information on various elements.

  According to the first aspect of the present invention, not only the front illumination image but also the transmitted illumination image and the oblique illumination image can be used to accurately obtain the button configuration information. That is, the button recognizing device can acquire configuration information about the concavo-convex shape of the front surface of the button by imaging the front surface of the button with the imaging device in a state where the button is illuminated by the oblique illumination device. In addition, the button recognition device captures the front surface of the button with the imaging device in a state where the button is irradiated with the transmissive illumination device, thereby acquiring high-accuracy configuration information about the threading hole formation position in the button of the opaque body. can do.

  The button recognition device according to claim 2 is characterized in that, in the button recognition device according to claim 1, the image processing device determines the color of the front surface of the button using the front illumination image. And determining the translucency of the button using the front illumination image and the transmitted illumination image, and adjusting the illumination condition of each illumination device according to the determined color and translucency of the button. .

  According to the second aspect of the present invention, the color information of the front surface of the button is acquired, the button is classified according to the light transmittance of the button, and the irradiation condition in each lighting device is determined according to the color and the light transmittance of the button. Can be set. Thereby, since each illumination image of a clearer button can be acquired, more highly accurate information can be acquired about a wide variety of buttons.

  According to a third aspect of the present invention, there is provided a button recognition apparatus according to the second aspect, wherein the oblique illumination for the button is performed according to the color of the button determined by the image processing apparatus. By adjusting the position of the device, a position adjusting device is provided that adjusts the angle of the irradiation light emitted from the oblique illumination device to the front surface of the button.

  According to the third aspect of the invention, the irradiation of the front surface of the button from the oblique illumination device is performed by adjusting the position of the oblique illumination device with respect to the button by the position adjusting device according to the color of the button. The angle of light can be adjusted. As a result, the oblique illumination device can more clearly project the concavo-convex shape of the front of the button, so it is possible to obtain more accurate configuration information for a wide variety of buttons, and the accuracy of front / back discrimination is further improved. Can be made.

  The button recognition device according to claim 4 is characterized in that, in the button recognition device according to claim 2 or 3, a display device that displays a background color of the button is used as the transparent illumination device. The display device is characterized in that the color of irradiation light to be irradiated is set according to the color of the button determined by the image processing device.

  According to the fourth aspect of the present invention, since the display device as the transmission illumination device can change the color of the irradiation light, the color of the irradiation light from the display device can be changed according to the color of the button. Thus, it is possible to set a background color that can more easily separate the button portion and the background portion in the front illumination image. As a result, the front surface of the button can be projected more clearly by the coaxial epi-illumination device, so that more accurate configuration information can be obtained for a wide variety of buttons, and the accuracy of front / back discrimination can be further improved. it can.

  The button recognition device according to claim 5 is characterized in that, in the button recognition device according to any one of claims 2 to 4, a background pattern of the button is displayed as the transparent illumination device. Using the display device, the display device sets the background pattern in accordance with the translucency of the button determined by the image processing device.

  According to the fifth aspect of the present invention, since the display device as the transmissive illumination device can change the background pattern to be displayed, the background pattern displayed by the display device is changed according to the transparency of the button. Thus, it is possible to set a background pattern that can easily separate the button portion and the background portion in the front illumination image. As a result, the front surface of the button can be projected more clearly by the coaxial epi-illumination device, so that more accurate configuration information can be obtained for a wide variety of buttons, and the accuracy of front / back discrimination can be further improved. it can.

  A feature of the button recognition method according to the invention of claim 6 is that a front illumination image acquisition step of irradiating irradiation light perpendicularly to the front surface of the button and capturing a front illumination image of the front surface of the button by an imaging device. A transmission illumination image acquisition step of irradiating irradiation light from the rear surface of the button and capturing a transmission illumination image of the front surface of the button by the imaging device; and irradiating irradiation light from an oblique direction to the front surface of the button Then, an oblique illumination image acquisition step of capturing an oblique illumination image of the front surface of the button by the imaging device, and the configuration information of the button using the front illumination image, the oblique illumination image, and the transmitted illumination image And an image processing step of discriminating the front and back of the button using each illumination image, the configuration information, and a standard image of the button recorded in advance.

  According to the sixth aspect of the present invention, not only the front illumination image but also the transmitted illumination image and the oblique illumination image can be used to obtain the button configuration information with high accuracy. That is, the button recognition method according to the present invention obtains configuration information about the concavo-convex shape of the front surface of the button by imaging the front surface of the button in a state where irradiation light is obliquely applied to the front surface of the button. Can do. In addition, the button recognition method acquires high-accuracy configuration information on the threading hole formation position, etc., in the button of the opaque body by imaging the front surface of the button with irradiation light from the rear surface of the button. Can do.

  A feature of the button recognition method according to claim 7 is the button recognition method according to claim 6, wherein color information of the front surface of the button is acquired using the front illumination image, and the front image and the button Using the transmitted illumination image, the buttons are classified according to the transparency of the buttons, and the illumination conditions of the illumination devices are adjusted according to the color and the transparency of the buttons.

  According to the seventh aspect of the invention, the color information on the front surface of the button is acquired, the buttons are classified according to the translucency of the button, and the illumination in each illumination image acquisition process is performed according to the color and translucency of the button. Conditions can be set. Thereby, since each illumination image of a clearer button can be acquired, more highly accurate information can be acquired about a wide variety of buttons.

  The button recognition method according to an eighth aspect of the present invention is characterized in that, in the button recognition method according to the seventh aspect of the present invention, in the oblique illumination image acquisition step, the button is recognized according to the color of the button. By adjusting the position where the irradiation light is irradiated, there is a position adjustment step of adjusting the angle of the irradiation light irradiated on the front surface of the button.

  According to the eighth aspect of the present invention, the front surface of the button is irradiated obliquely by adjusting the irradiation position for irradiating the button with the irradiation light in the oblique illumination image acquisition step according to the color of the button. The irradiation angle of the irradiation light can be adjusted. As a result, in the oblique illumination image acquisition step, an oblique illumination image in which the uneven shape on the front surface of the button is more clearly projected can be acquired, so that more accurate configuration information is acquired for a wide variety of buttons. And the accuracy of front / back discrimination can be further improved.

  The button recognition method according to claim 9 is characterized in that, in the button recognition method according to claim 7 or 8, in the front illumination image acquisition step, according to the color of the button. The point is to set the background color.

  According to the ninth aspect of the present invention, since the background color of the button can be set according to the color of the button, the button portion and the background portion can be more easily separated in the front illumination image. It is possible to set a background color like this. As a result, a clearer front illumination image can be acquired in the front illumination image acquisition step, so that more accurate configuration information can be acquired for a wide variety of buttons, and the accuracy of front / back discrimination is further improved. be able to.

  The button recognition method according to claim 10 is characterized in that in the button recognition method according to any one of claims 7 to 9, the translucency of the button in the front illumination image acquisition step. The background pattern of the button is set according to the above.

  According to the invention described in claim 10, since the background pattern of the button can be set in accordance with the transparency of the button, the background pattern capable of separating the button portion and the background portion in the front illumination image is set. It becomes possible. As a result, a clearer front illumination image can be acquired in the front illumination image acquisition step, so that more accurate configuration information can be acquired for a wide variety of buttons, and the accuracy of front / back discrimination is further improved. be able to.

  The button recognition method according to claim 11 is characterized in that, in the button recognition method according to claim 10, the button is classified as being made of a transparent material according to the translucency of the button. The background pattern of the button is set as a periodic pattern, and the background pattern of the button part is distorted and visually recognized by transmitting the button. The button part is separated and the outline of the button is obtained.

  According to the eleventh aspect of the present invention, when a front illumination image is acquired for a button made of a transparent material, the background portion and the button portion are more clearly defined by making the background pattern a periodic pattern. The button outline contour can be extracted separately.

  As described above, according to the button recognition device of the present invention, it is possible to determine the front and back of the button based on high-precision configuration information for a wide variety of buttons, and to improve the determination accuracy of the front and back. In addition, it is possible to remove defective buttons by using the configuration information, or to arrange the buttons by tilting them at a predetermined angle in a planar shape, and to sew the buttons to the sewing product with a good finish.

  Further, according to the button recognition device of the present invention, it is possible to discriminate a button with poor manufacturing accuracy by acquiring highly accurate configuration information about the formation position of the threading hole in the opaque button. Occurrence of troubles such as breakage of the sewing needle due to contact of the sewing needle with the button without passing through the threading hole can be prevented.

  In addition, according to the button recognition method according to the present invention, for a wide variety of buttons, the front and back of the button can be determined based on highly accurate configuration information, the front and back determination accuracy can be improved, The configuration information can be used to eliminate defective buttons, or the buttons can be tilted at a predetermined angle in the planar shape, and the buttons can be sewn to the sewing product with a good finish.

  In addition, according to the button recognition method according to the present invention, it is possible to determine a button with poor manufacturing accuracy by acquiring highly accurate configuration information about the formation position of the threading hole in the button of the opaque body. Occurrence of troubles such as broken stitches caused by the sewing needle of the sewing machine contacting the button without passing through the threading hole can be prevented.

  Hereinafter, an embodiment of a button recognition apparatus according to the present invention will be described with reference to FIGS.

  FIG. 1 is a schematic side sectional view showing a button recognition device according to the present embodiment, and FIG. 2 is a block diagram showing a configuration of the button recognition device of FIG.

  As shown in FIGS. 1 and 2, in the button recognition device 1 according to the present embodiment, the camera 3 as an imaging device that acquires an image of the front surface (upper surface) of the button 2 is in front of the button 2 (upward in FIG. 1). The camera 3 acquires an image of the upper surface of the button 2.

  A coaxial epi-illumination device 5 for irradiating irradiation light perpendicular to the upper surface of the button 2 is disposed above the button 2 and between the button 2 and the camera 3. The coaxial epi-illumination device 5 is disposed at a position outside the imaging region of the image on the upper surface of the button 2 acquired by the camera 3 and the half mirror 5a disposed above the button 2, and the button 2 in the half mirror 5a. And a light source 5b for irradiating the lower surface facing the irradiation light. The half mirror 5a is arranged at a predetermined angle with respect to the light source 5b and the button 2 so that the irradiation light emitted from the light source 5b is reflected on the lower surface and irradiated perpendicularly to the upper surface of the button 2. . The coaxial epi-illumination device 5 can irradiate the button 2 with irradiation light from the upper surface side facing the camera 3.

  The camera 3 acquires a front illumination image by capturing an image of the upper surface of the button 2 in a state in which irradiation light is irradiated on the upper surface of the button 2 by coaxial epi-illumination. It is possible to project colors and patterns such as letters and figures.

  Above the button 2 and between the button 2 and the coaxial epi-illumination, an oblique illumination device 7 that irradiates irradiation light obliquely with respect to the upper surface of the button 2 is disposed. The oblique illumination device 7 has a pair of light sources 7 a that are arranged at positions deviating from the image capturing area of the camera 3 and that irradiate the upper surface of the button 2 with oblique irradiation light. Both the light sources 7a are arranged at positions where the upper surface of the button 2 is irradiated at the same irradiation angle from symmetrical positions on the upper right side and upper left side with respect to the button 2.

  Further, the button recognition device 1 adjusts the position of the oblique illumination device 7 with respect to the button 2, thereby adjusting the irradiation angle of the irradiation light emitted from the oblique illumination device 7 to the upper surface of the button 2. It has. In the present embodiment, the position adjusting device 9 can adjust the irradiation angle of the irradiation light irradiated on the upper surface of the button 2 by adjusting the height position of the oblique illumination device 7 with respect to the upper surface of the button 2. It can be done.

  The camera 3 is configured to acquire an oblique illumination image by capturing an image of the upper surface of the button 2 in a state where the upper surface of the button 2 is irradiated with irradiation light by the oblique illumination device 7. An uneven shape such as a stamp formed on the upper surface of the film can be projected. Prior to imaging by the camera 3, the position adjustment device 9 determines the color of the button 2 according to the color of the button 2 determined using the front illumination image acquired by the coaxial incident illumination device 5. By adjusting the height position, the irradiation angle of the irradiation light irradiated on the upper surface of the button 2 from both light sources 7a of the oblique illumination device 7 is adjusted.

  On the lower surface side of the button 2, a liquid crystal display panel 10 is provided as a transmissive illumination device that emits irradiation light from the lower surface of the button 2, and the liquid crystal display panel 10 is an illumination device that emits irradiation light from the lower surface of the button 2. As well as a mounting table on which the button 2 is mounted. Further, the display by the liquid crystal display panel 10 functions as a background when acquiring a front illumination image or an oblique illumination image.

  The camera 3 can acquire a transmitted illumination image by capturing an image of the upper surface of the button 2 in a state where the liquid crystal display panel 10 emits irradiation light from below the button 2. Two silhouettes are projected.

  The button recognition device 1 also includes an image processing device 12 that performs various processes on the front illumination image, the oblique illumination image, and the transmitted illumination image acquired by the camera 3. The image processing device 12 determines the color of the upper surface of the button 2 using the front illumination image, and the button 2 is an opaque body or translucent according to the translucency of the button 2 using the front illumination image and the transmission illumination image. The body 2 or the transparent body is further classified, and further, the configuration information is obtained by measuring the configuration of the button 2 using the front illumination image, the oblique illumination image, and the transmission illumination image, and the configuration information is obtained. Based on this, the front and back of the button 2 is discriminated.

  The image processing device 12 includes a CPU 15 that controls each unit of the image processing device 12, an image memory 16 that records a front illumination image, an oblique illumination image, and a transmitted illumination image, and an upper surface of the button 2 for collating with each illumination image. The first recording memory 17 in which standard images and the like are recorded in advance, and the work memory 18 which is a temporary storage location of image data for the CPU 15 to perform image processing. The camera 3 is connected to the image memory 16 via an analog / digital converter (A / D converter) 19, and each image data of the front illumination image, the oblique illumination image, and the transmitted illumination image acquired by the camera 3 is After being digitized by the A / D converter 19, it is recorded in the image memory 16.

  In addition, the image processing apparatus 12 includes a camera control unit 21 that controls the camera 3, a coaxial incident illumination control unit 22 that controls the coaxial incident illumination device 5, and an oblique illumination control that controls the oblique illumination device 7. A unit 23, a position adjustment control unit 25 that controls the position adjustment device 9, and a panel control unit 26 that controls the liquid crystal display panel 10.

  Further, the image processing device 12 controls the lighting devices 5, 7, 10 and the position adjusting device 9 in order to acquire the respective lighting images by the lighting devices 5, 7, 10. , A process for classifying the buttons 2 according to translucency using the front illumination image and the transmitted illumination image, and a process for acquiring the configuration information of the button 2 using each illumination image and discriminating the front and back of the button 2 An image processing program for performing The image processing program is recorded in the second recording memory 28.

  Then, the image processing apparatus 12 reads out the image processing program from the second recording memory 28 by the CPU 15 and outputs control information to each of the control units 21, 22, 23, 25, and 26. 23, 25, and 26 irradiate the button 2 with the illumination devices 5, 7, and 10, adjust the height position of the oblique illumination device 7 with the position adjustment device 9, and press the button 2 with the camera 3. It is supposed to take an image. Further, the image processing device 12 uses the CPU 15 to determine the color of the button 2 using the front illumination image, acquires the color information, measures the configuration of the button 2, and acquires the configuration information of the button 2, The front and back of the button 2 are discriminated.

  At this time, the image processing device 12 sets the background color of the button 2 by the display on the liquid crystal display panel 10 according to the color of the button 2 determined based on the front illumination image data of the front illumination image. . In addition, the image processing device 12 uses the image data of the front illumination image and the transmitted illumination image to select the button 2 displayed by the liquid crystal display panel 10 according to the type of the button 2 classified according to the translucency of the button 2. A background pattern is set. Further, the image processing device 12 determines the height position of the oblique illumination device 7 to be adjusted by the position adjustment device 9 according to the color of the button 2 determined based on the image data of the front illumination image and the transmission illumination image. It is supposed to be.

  The CPU 15 is connected to a sewing machine control unit 30 that controls each unit of the sewing machine via an interface (I / F) 20, and the CPU 15 of the image processing device 12 displays the configuration information of the button 2 and the discrimination result of the front and back sides. The data is output to the sewing machine control unit 30 via the I / F 20. When the determination result that the surface of the button 2 is facing upward is input, the sewing machine control unit 30 has a planar shape based on the configuration information of the inclination of the planar button 2 in the input configuration information of the button 2. The arrangement angle of the button 2 is corrected, and the button 2 is sewn to the sewing product. On the other hand, when the determination result that the back surface of the button 2 is facing upward is input, the sewing machine control unit 30 removes the button 2 and places the next button 2 to be imaged on the liquid crystal display panel 10. It is supposed to be set.

  Next, a button recognition method using the button recognition device 1 according to the present embodiment will be described with reference to FIGS.

  FIG. 3 is a flowchart showing each step of the button recognition method according to the present embodiment.

  As shown in FIG. 3, first, the CPU 15 in the image processing device 12 of the button recognition device 1 performs a transmitted illumination image acquisition step of acquiring a transmitted illumination image (ST1).

  In this transmitted illumination image acquisition step, first, the CPU 15 of the image processing device 12 reads an image processing program from the second recording memory 28, controls the liquid crystal display panel 10 via the panel control unit 26, and is controlled by the liquid crystal display panel 10. A predetermined background pattern is displayed by a predetermined color and light amount. At this stage of the transmitted illumination image acquisition process, the image processing device 12 does not recognize the translucency, color, or the like of the button 2 that is the imaging target, so first displays a white plain pattern on the liquid crystal display panel 10. Thereafter, the CPU 15 takes an image of the upper surface of the button 2 with the camera 3 while the button 2 is irradiated with white irradiation light from below the button 2 placed on the liquid crystal display panel 10 by the liquid crystal display panel 10. Thus, a transmitted illumination image is acquired. Then, the CPU 15 digitizes the transmitted illumination image data of the transmitted illumination image by the A / D converter 19 and then records it in the image memory 16.

  At this time, when the button 2 is made of an opaque material, the camera 3 can acquire a transparent illumination image with a clear silhouette. In addition, when the button 2 is made of a transparent material, the irradiation light from the liquid crystal display panel 10 passes through the button 2, so that the transmitted illumination image acquired by the camera 3 is entirely white. Therefore, the camera 3 cannot acquire a transmitted illumination image in which a clear silhouette of the button is projected. Further, when the button 2 is made of a translucent material, the transmitted illumination image acquired by the camera 3 has a low contrast, mottled brightness, and the shape of the button 2 is obscured. A transmitted illumination image in which a clear silhouette of a button is projected cannot be acquired.

  Subsequently, after the transmitted illumination image acquisition step, the CPU 15 uses the transmitted illumination image data to determine the button 2 outer diameter / center position, the number of threading holes / outer diameter / center position / formation position, etc. A first measurement step of measuring the configuration and acquiring configuration information is performed (ST2).

  In this first measurement step, as shown in FIG. 4, first, the CPU 15 of the image processing device 12 sets a threshold value for dividing the transmitted illumination image data into a background portion and a button portion, and binary values are set. (ST101). In the binarized image data obtained by performing the binarization processing on the transmitted illumination image data, for example, the portion where the irradiation light from the liquid crystal display panel 10 reaches the camera 3 is 0, and the portion that does not reach is 1. Here, as a threshold value used in the first measurement process, when the background portion and the button portion are separated from each other in the transmitted illumination image data, the button 2 made of an opaque material whose translucency is almost 0%. For the button 2 made of an opaque material, it is desirable to adjust the value so that it is difficult to extract the outline. Then, the CPU 15 outputs the binarized image data of the transmitted illumination image subjected to the binarization process to the work memory 18.

  Subsequently, the CPU 15 performs noise processing on the binarized image data (ST102). As noise processing, by performing an opening process for setting 1 adjacent to 0 to 0, and a closing process for setting 0 adjacent to 1 to 1, the removal of fine noise components, line breaks, and hole filling are performed. .

  Next, the CPU 15 performs a process of extracting the outline of the button 2 using the binarized image data (ST103). As a process for extracting the outline contour line, a labeling process for classifying a pixel set by adding a number (label) to a set of connected pixels in an image is performed, and a boundary line of each pixel set is traced. Thus, the outer contour line of the button 2 can be extracted. Here, when the image data is only the background, it is assumed that the number of labels is 0 and labels are added. In this case, when the button 2 is opaque, 1 is added as a label, but the button 2 is transparent and only the background cannot be obtained at all, or a set of fragmented pixels is acquired. Will be given a number of 0, 2 or more as the number of labels.

  Thereafter, in the step of extracting the outline contour, the CPU 15 determines whether or not the outline contour has been normally extracted by determining the number of labels added in the process of extracting the outline contour of the button 2. (ST104). Thereby, when the CPU 15 determines that the outline of the button 2 cannot be normally extracted (No in ST104), the CPU 15 determines that the button 2 to be imaged is a transparent body or a translucent body, The first measurement process using the transmitted illumination image data is completed.

  Here, in the process of ST103, if the button 2 is a transparent body, the irradiation light from the liquid crystal display panel 10 passes through the button 2 and reaches the camera 3, so the camera in the transmitted illumination image acquisition step 3 cannot project the silhouette of button 2. For this reason, at the stage where the binarization processing (ST101) and noise processing (ST102) are completed, the binary image data of the transmitted illumination image data only exists in the background portion, so the CPU 15 extracts the outline contour line. In the step (ST103), since the outline outline of the button 2 cannot be normally extracted and the number of labels is 1, it is determined that the button 2 is a transparent body and classified (No in ST104).

  Further, when the button 2 is a semi-transparent body, the irradiation light from the liquid crystal display panel 10 by the button 2 is not sufficiently blocked, so that the transmitted illumination image displayed by the camera 3 in the transmitted illumination image acquisition process has a low contrast. It may become. Even in such a case, since the number of labels is 1 at the stage where the binarization process (ST101) and the noise process (ST102) are completed, the button 2 is 1 as in the case of the transparent body. Therefore, it is determined that the outer contour line 2 cannot be normally extracted (No in ST104).

  Further, when the button 2 is a semi-transparent body and the thickness of the button 2 is not uniform, the transmissivity of the irradiation light of the liquid crystal display panel 10 that transmits the button 2 is not uniform. In the transmitted illumination image acquired by the above, the density is mottled or the change in density becomes gradual. For this reason, for example, when binarization processing (ST101) or noise processing (ST102) is performed by the CPU 15, a set of a plurality of fragmented pixels is formed as an image of the button 2, and labeling processing in the outline contour extraction processing is performed. In (ST103), two or more labels are added, and the CPU 15 determines that the number of labels is two or more, so that the button 2 to be imaged is made of a translucent material. It can be determined that the outer contour of the button 2 cannot be sufficiently extracted depending on the transmitted illumination image (No in ST104). Note that it may be determined that the button 2 is a semi-transparent body by detecting whether the extracted outline of the button 2 is circular or a point on a steep outer periphery.

  If the CPU 15 determines that the outer contour line of the button 2 has been normally extracted in the step of extracting the outer contour line (Yes in ST104), the CPU 15 performs a process of extracting the outer contour line of the threading hole. (ST105). In the process of extracting the outline of the threading hole, after removing the background from the binary image data of the transmitted illumination image, the labeling process is performed again, and the boundary line of the detected button part is traced, thereby The outline of the through hole is extracted.

  Next, the CPU 15 detects the outer diameter of the button 2 using the binarized image data, acquires the center position of the button 2 (ST106), and then is subjected to a labeling process in the process of extracting the outline of the threading hole. The number of threading holes is acquired using the binarized data (ST107).

  Next, the CPU 15 determines whether or not the process of acquiring the outer diameter and the center position is completed for all the number of threading holes detected in ST107 (ST108). At this time, if the CPU 15 determines that the process of acquiring the outer diameter and the center position for all the threading holes has not been completed (No in ST108), the CPU 15 uses the binarized image data. Is detected and the center position of the threading hole is obtained (ST109), and the configuration information regarding the outer diameter / center position of the button 2 and the number, outer diameter, center position, and forming position of the threading hole is interfaced. The data is output to the sewing machine control unit 30 via the (I / F) 20. Further, this information is stored in the work memory 18 for use in the front / back discrimination process. Thereafter, CPU 15 determines again whether or not the process of obtaining the outer diameters and center positions of all the threading holes detected in ST108 has been completed (ST108).

  On the other hand, if the CPU 15 determines that the acquisition of the outer diameters and center positions of all the threading holes has ended (Yes in ST108), the CPU 15 ends the first measurement process using the transmitted illumination image data.

  Then, CPU15 performs the front illumination image acquisition process which acquires a front illumination image (ST3).

  In this front illumination image acquisition step, first, the CPU 15 of the image processing device 12 controls the liquid crystal display panel 10 via the panel control unit 26 based on the image program, and the liquid crystal display panel 10 uses a predetermined color and light amount. A predetermined background pattern is displayed. At this stage of the front illumination image acquisition process, the liquid crystal display panel 10 is used as a background panel, so a black plain pattern is displayed. Then, the CPU 15 irradiates the button 2 with irradiation light perpendicularly from above the button 2 placed on the liquid crystal display panel 10 by the coaxial incident illumination device 5, and the camera 3 covers the upper surface of the button 2. A color front illumination image is acquired by imaging. In this front illumination image acquisition step, the shape of the button 2 and the pattern such as characters and figures described on the upper surface are displayed. Then, the CPU 15 digitizes the front illumination image data of the front illumination image by the A / D converter 19 and then records it in the image memory 16.

  Next, the CPU 15 performs a color discrimination process for discriminating colors by acquiring color information using the front illumination image data (ST4).

  In this color discrimination step, as shown in FIG. 5, first, the same process as the step (ST103) of extracting the outer contour of the button 2 in the first button measurement step (ST2) again for the front illumination image data. And the outline of the button 2 in the front illumination image data is extracted (ST201).

  Subsequently, the CPU 15 sets the value of the number of labels attached by the labeling process in the process in ST103 described above and the number of labels attached by the labeling process in the outer contour extraction process of the front illumination image data (ST201). Based on this, it is determined whether or not the button 2 to be imaged is a transparent body (ST202). In this determination, it is determined that the button 2 is a transparent body when the number of labels by the labeling process in both steps ST103 and ST201 is 0 (Yes in ST202).

  At this time, if the CPU 15 determines that the button 2 is not a transparent body (No in ST202), the CPU 15 determines that the button 2 is an opaque body or a translucent body, and uses the transmitted illumination image data and the front illumination image data. Thus, a sampling area for obtaining the color information of the button 2 is set (ST203). Next, the CPU 15 calculates an average value of the RGB values for each pixel in the sampling area (ST204), and further calculates the RGB value of each pixel in the sampling area as hue information of hue, brightness, and saturation. After conversion to expression (ST205), the hue and lightness color information is digitized based on the Munsell color system to obtain color information, which is output and stored in the work memory 18 (ST206). The acquisition process ends. The color information acquired here is used in the height position adjustment step (ST9) and the front / back discrimination step (ST13) of the oblique illumination device.

  On the other hand, if the CPU 15 determines that the button 2 to be imaged is a transparent body (Yes in ST202), the CPU 15 cannot acquire the color information, and thus ends the color information acquisition process.

  Next, the CPU 15 determines whether or not the color information can be acquired in the color information acquisition step (ST4) because the button 2 is made of an opaque body or a translucent body (ST5), and determines that it cannot be acquired. If it does (No in ST5), the button 2 is classified as a button made of a transparent material, the outer diameter / center position of the button 2 made of a transparent material, the number of threading holes, A second measurement step of measuring the configuration such as the outer diameter, the center position, and the formation position and acquiring the configuration information is performed (ST6).

  In the second measurement step, as shown in FIG. 6, first, the CPU 15 sets the background pattern of the button 2 displayed on the liquid crystal display panel 10 (ST301). As the background pattern, for example, a periodic pattern such as a horizontal stripe pattern shown in FIG. 7 (1), an oblique stripe pattern shown in FIG. 7 (2), or a checkered pattern shown in FIG. 7 (3) is used.

  Subsequently, the CPU 15 displays the background pattern set in the background pattern setting step (ST301) by the liquid crystal display panel 10 via the panel control unit 26 (ST302).

  Further, the CPU 15 shoots the front illumination image by the camera 3 via the camera control unit 21 while irradiating the button 2 with the coaxial epi-illumination device 5 via the coaxial epi-illumination control unit 22 while irradiating the irradiation light to the button 2. Data is acquired (ST303). Then, the CPU 15 records the front illumination image data in the image memory 16.

  Next, the CPU 15 performs a process of extracting the outline of the button 2 using the front illumination image data acquired in the step (ST303) of acquiring the front illumination image of the second measurement step (ST6) (ST304). .

  Here, the irradiation light from the liquid crystal display panel 10 is always refracted when it passes through the transparent button 2 and is emitted into the air. Further, the irradiation light transmitted through the transparent button 2 may cause a perspective distortion depending on the shape of the button 2, and is diffused if the convex lens condition is satisfied by the button 2, and is condensed if the concave lens condition is satisfied. It becomes. For this reason, on the acquired front illumination image data, the background pattern displayed on the liquid crystal display panel 10 is imaged as it is with a periodic pattern. On the other hand, the button portion is disturbed in the periodicity of the background pattern. As a result, the background and the button 2 can be separated and the outer diameter contour line of the button 2 can be extracted by tracking the boundary line between the periodic part and the non-periodic part of the captured pattern. .

  In this step of extracting the outer diameter contour of the button 2 (ST304), since the period information of the pattern of the background pattern is known, for example, the front illumination image data is subjected to Fourier transform to obtain a frequency component, and the frequency component of the background portion. After deleting only, the inverse Fourier transform is performed to restore the original front illumination image data. Thereby, the front illumination image data of only the button part as shown in FIG. 8 is obtained. Then, with respect to the front illumination image data of only the button part, the boundary line between the background part and the button part is traced to obtain binary image data as shown in FIG. Extract lines.

  Then, the CPU 15 detects whether or not the extracted outline of the button 2 is circular or has a point on the steep outer periphery in the outer diameter outline extraction process (ST304) of the button 2. Thus, it is determined whether or not the outer contour line has been normally extracted (ST305). If it is determined that the outer contour line cannot be normally extracted (No in ST305), the second measurement step (ST6) is performed. finish.

  On the other hand, when CPU 15 determines that the outline contour has been successfully extracted (Yes in ST305), it performs a process of extracting the contour line of the threading hole (ST306). In this threading hole contour line extracting step, the threading hole contour line can be extracted by the same method as ST305 using the front illumination image data of only the button part acquired in ST304 shown in FIG. it can. Further, after obtaining the binarized image data shown in FIG. 9 by the method equivalent to ST305, the outline of the threading hole may be extracted by the method equivalent to ST105 using the binarized image data.

  After that, the CPU 15 detects the outer diameter of the button 2 using the binarized image data, acquires the center position of the button 2 (ST307), and is then subjected to a labeling process in the threading hole contour line extracting step. The number of threading holes is acquired using the binarized data (ST308).

  Next, CPU 15 determines whether or not the process of acquiring the outer diameter and the center position is completed for all the number of threading holes detected in ST308 (ST309). At this time, if the CPU 15 determines that the process of acquiring the outer diameter and the center position for all of the threading holes has not been completed (No in ST309), the CPU 15 uses the binarized image data. The center position of the threading hole is detected (ST310), and the configuration information regarding the outer diameter / center position of the button 2 and the number / outer diameter / center position / formation position of the threading hole is interfaced ( (I / F) 20 to the sewing machine control unit 30. Further, this information is stored in the work memory 18 for use in the front / back discrimination process. Thereafter, CPU 15 determines again whether or not the process of acquiring the outer diameter and the center position is completed for all the number of threading holes detected in ST308 (ST309).

  On the other hand, when CPU 15 determines that the acquisition of the outer diameter and the center position for all of the threading holes has been completed (Yes in ST309), it ends the second measurement process.

  On the other hand, if the CPU 15 determines that the color information has been acquired in the color information acquisition step (ST4) (Yes in ST5), the determination in ST104 is positive in the first button measurement step (ST2). (Yes in ST104), it is determined whether or not the outer contour line of the button 2 has been extracted (ST7). If it is determined that the outer contour line of the button 2 could not be extracted (No in ST7), the outer diameter / center position of the button 2 made of a translucent material, the number of threading holes, A third measurement step of measuring the configuration such as the outer diameter, the center position, and the formation position and acquiring the configuration information is performed (ST8).

  In the third measurement step, as shown in FIG. 10, first, the CPU 15 sets the background pattern of the button 2 displayed on the liquid crystal display panel 10 (ST401). The background pattern is set so that the background color is more easily separated from the color of the button 2 determined in the color determination step of ST4. For example, when processing is performed using a color image in the third measurement step, a color that has a complementary color relationship with the color of the button 2 may be set as the background color. In the third measurement step, when a color image is converted into a gray image and processing is performed using the gray image, a color that increases the density difference between the background portion and the button portion may be set as the background color. Further, white or black may be switched according to the color of the button 2.

  Subsequently, the CPU 15 displays the background pattern set in the background pattern setting step (ST401) by the liquid crystal display panel 10 via the panel control unit 26 (ST402). Then, the CPU 15 captures a front illumination image by the camera 3 via the camera 3 unit while irradiating the button 2 with the coaxial epi-illumination device 5 via the coaxial epi-illumination control unit 22 while irradiating the irradiation light to the button 2. Data is acquired (ST403), and this front illumination image data is recorded in the image memory 16.

  Next, CPU15 performs the process which extracts the external outline of the button 2 using the front illumination image data acquired in the process (ST403) which acquires the front illumination image of a 3rd measurement process (ST8) (ST404). .

  In the step of extracting the outline of the button 2 (ST404), when the front illumination image data is used as a color image, the background color is set in the background pattern setting step (ST401). Therefore, based on the color information of the background pattern, the outline of the button 2 can be extracted by dividing the button 2 and the background area and tracking the boundary line. Further, when the color image of the front illumination image is converted into a grayscale image, and the contour outline of the button 2 is extracted using the grayscale image, the background portion, the button portion, and the button portion are previously set in the background pattern setting step (ST401). Therefore, the contrast between the background portion and the button portion is high. Therefore, by obtaining a threshold value using a dynamic threshold value acquisition algorithm such as a discriminant analysis method and performing binarization processing on the gray image of the front illumination image, image data similar to the transmission illumination image data is obtained. Can be obtained. After that, as in ST103, the front illumination image data is labeled, and the outline of the button 2 is extracted by tracking the boundary line between the background and the button 2.

  Then, the CPU 15 detects whether or not the extracted outer contour line of the button 2 is circular or has a steep outer peripheral point in the step of extracting the outer contour line of the button 2 (ST404). Then, it is determined whether or not the outline contour has been successfully extracted (ST405), and when it is determined that it cannot be normally extracted (No in ST405), the third measurement step (ST8) is terminated. To do.

  On the other hand, when CPU 15 determines that the outline contour has been successfully extracted (Yes in ST405), CPU 15 performs a process of extracting the outline of the threading hole (ST406). This threading hole contour line extracting step can extract the threading hole contour line using the same method as the step of extracting the outer contour line of the button 2 in ST404.

  Thereafter, the CPU 15 detects the outer diameter / center position of the button 2 using the front illumination image data (ST407), and acquires the number of threading holes using the front illumination image data (ST408).

  Next, the CPU 15 determines whether or not the process of acquiring the outer diameter and the center position is completed for all the number of threading holes detected in ST408 (ST409), and when it is determined that the process has not been completed. (No in ST409), the outer diameter of the threading hole is detected using the front illumination image data, the center position of the threading hole is obtained (ST410), the outer diameter / center position of the button 2, the thread Configuration information regarding the number, outer diameter, center position, and formation position of the through holes is output to the sewing machine control unit 30 via the interface (I / F) 20. Further, this information is stored in the work memory 18 for use in the front / back discrimination process. Thereafter, CPU 15 determines again whether or not the process of acquiring the outer diameter and the center position is completed for all the number of threading holes detected in ST408 (ST409).

  On the other hand, when CPU 15 determines that the acquisition of the outer diameter and the center position has been completed for all the threading holes (Yes in ST409), CPU 3 ends the third measurement process.

  Then, the CPU 15 determines that the outer contour of the button 2 has been extracted when the second measurement process (ST6) is completed, when the third measurement process (ST8) is completed, or in the first button measurement process of ST2. In this case (Yes in ST7), the angle of the irradiation light irradiated on the upper surface of the button 2 is adjusted by adjusting the position where the oblique illumination device 7 irradiates the button 2 with the irradiation light (ST9). .

  In the position adjustment process of the oblique illumination device 7, as shown in FIG. 11, first, the CPU 15 reflects light on the upper surface of the button 2 based on the color information of the button 2 determined in the color determination process (ST4). Rate (ST501), and from the calculated reflectance, the irradiation angle (θ) of the irradiation light irradiated from the oblique illumination device 7 for enabling imaging of the uneven shape such as the inclination and inscription of the upper surface of the button 2 and The amount of light is acquired (ST502). Here, θ is set larger as the lightness of the color of the upper surface of the button 2 is lower and the reflectance is lower (see FIG. 1). In other words, the higher the lightness of the color of the upper surface of the button 2 and the higher the reflectance, the brighter it is. For the color, θ is set smaller and the amount of light is set larger. Such a relationship between the reflectance, θ, and the amount of light can be calculated in advance through experiments and recorded in the first recording memory 17 as a table. Then, the CPU 15 calculates the height position of the oblique illumination device 7 so that the irradiation light from the oblique illumination device 7 is irradiated on the upper surface of the button 2 by the calculated θ (ST503), and the set oblique shape While outputting the height position of the illuminating device 7 to the position adjustment control part 25, the light quantity is output to the oblique illumination control part 23 (ST504), and a position adjustment process is complete | finished.

  Subsequently, the CPU 15 performs processing for acquiring an oblique illumination image by imaging the upper surface of the button 2 with the camera 3 in a state where the oblique illumination device 7 irradiates the upper surface of the button 2 with irradiation light (ST10).

  In this oblique illumination image acquisition step, the CPU 15 adjusts the height position of the oblique illumination device 7 based on the height position inputted by the position adjustment control unit 25 and also inputted by the oblique illumination control unit 23. The light amount of the oblique illumination device 7 is adjusted based on the light amount, and the upper surface of the button 2 is irradiated with the irradiation light of the scattered light at a predetermined angle by the oblique illumination device 7 from above the button 2 by the height position and the light amount. . Then, the CPU 15 captures the upper surface of the button 2 with the camera 3 via the camera control unit 21 in a state where the upper surface of the button 2 is irradiated with the oblique illumination device 7, and a dark field image of the oblique illumination image. To get. In this oblique illumination image acquisition process, in particular, the uneven shape on the upper surface of the button 2 is displayed.

  Thereafter, the CPU 15 performs a process of synthesizing the front illumination image acquired in ST3, ST303, or ST403 with the front illumination image acquired in the oblique illumination image acquisition process of ST10 (ST11). .

  In this image composition step, for example, as shown in FIG. 12A, the CPU 15 performs the oblique illumination image shown in FIG. 12B captured in the oblique illumination image acquisition step ST10 on the imaging target button 2. , ST3, ST303, or ST403 is combined with the front illumination image as shown in FIG. 12C acquired in the front illumination image acquisition step. Here, in the dark field image of the oblique illumination image acquired in the oblique illumination image acquisition step (ST10), when the button 2 to be photographed is a transparent body, the characters described on the upper surface of the button 2, A pattern such as a figure is projected white on the upper surface of the button 2 as the irradiation light from the oblique illumination device 7 is scattered. However, when the button 2 is an opaque body, the image described on the upper surface of the button 2 is not projected, and the uneven shape on the upper surface of the button 2 is projected. On the other hand, in the front illumination image, in particular, an image of the upper surface of the button 2 is displayed. Thereby, the CPU 15 synthesizes the oblique illumination image and the forward illumination image, and generates a composite image in which the image described on the upper surface of the button 2 and the uneven shape are projected as shown in FIG. .

  Further, the CPU 15 performs a process of detecting a pattern such as a character described on the upper surface of the button 2 or a pattern such as a character formed by a concavo-convex shape using the composite image in the image composition step (ST11) (ST12). ).

  In this image detection step, the CPU 15 performs a labeling process on the composite image data, tracks the pattern outline of the pattern on the upper surface of the button 2, and extracts the pattern outline. Subsequently, the CPU 15 obtains the center of gravity for each label of the pattern, detects the center position of the pattern, and uses the information on the center position of the pattern as the outer shape, the uneven shape, the outer diameter and the center position of the button 2 of each button 2. Further, it is added to configuration information such as the position, outer diameter, and center position of the threading hole. Thereby, when there is a pattern on the surface of the button 2, it is possible to adjust the angle in the planar shape of the button 2 so that the direction of the pattern is aligned in the plurality of buttons 2 when the button 2 is sewn to the sewing product. It becomes.

  Then, the CPU 15 determines and measures the color information stored in the work memory 18 using the transmitted illumination image, the front illumination image, and the oblique illumination image of the button 2 to be imaged acquired in ST1 to ST12. And the front and back of the button 2 is discriminated using the configuration information (ST13).

  In this front / back discrimination step, as shown in FIG. 13, first, the CPU 15 determines the angle in the planar shape of the button 2 and the center position of the button 2 based on the configuration information of the button 2 stored in the work memory 18. Obtain (ST601).

  In the step of obtaining the angle in the planar shape of the button 2, when two threading holes are formed for one button 2, the plane is determined by the inclination of a straight line connecting the center positions of the two threading holes. Get the angle of the button 2 in the shape. When three threading holes are formed on each vertex of the equilateral triangle with respect to one button 2, it passes through the center position of any one of the three threading holes and the other 2 The angle of the button 2 in the planar shape is acquired by the inclination of the straight line perpendicular to the straight line connecting the two threading holes. When four threading holes are formed for one button 2, any one of the four threading holes is selected and formed closest to the selected threading hole. A straight line that connects the center positions of the threaded hole and the selected threading hole is used as a reference. Further, the other three threading holes that are not selected are connected to the threading holes formed closest to each other by a straight line, and an average is adopted in consideration of the inclination of each straight line. Get the angle of button 2.

  In the step of acquiring the center position of the button 2, the center of gravity of the outline outline of the button 2 is set as the center position of the button 2.

  Subsequently, the CPU 15 determines the number of threading holes in the button 2 (ST602).

  Here, when the number of threading holes is two, first, it is determined whether or not the standard image of the button 2 to be compared with the composite image of the button 2 to be imaged is rotated in two directions (ST603). If it is determined that the image has not been rotated in two directions (No in ST603), the composite image and the standard image are matched to obtain a correlation value (ST604), and then the standard image is rotated 180 ° ( (ST605) It is determined again whether the standard image has been rotated in two directions (ST603). In this way, the correlation value between the composite image for two directions and the standard image is obtained.

  If the number of threading holes is three, it is first determined whether or not the standard image has been rotated in three directions (ST606). If it is determined that the standard image has not been rotated in three directions (No in ST606). After the correlation between the composite image and the standard image is obtained (ST607), the standard image is rotated by 120 ° (ST608), and it is determined again whether the standard image is rotated in three directions. (ST606). In this way, the correlation value between the composite image for three directions and the standard image is obtained.

  If the number of threading holes is four, first, it is determined whether or not the standard image has been rotated in four directions (ST609). If it is determined that the standard image has not been rotated in four directions (No in ST609). After the correlation between the composite image and the standard image is obtained (ST610), the standard image is rotated by 90 ° (ST611), and it is determined again whether the standard image is rotated in four directions. (ST609). In this way, correlation values between the composite image for four directions and the standard image are obtained.

  Further, for each direction, CPU 15 determines the maximum value of each correlation value as an evaluation value (ST612), and compares a threshold value set in advance to determine the front and back of button 2 with the evaluation value. Then, it is determined whether or not the correlation value is larger (ST613). When the image data on the surface of the button 2 is registered as a standard image, when the CPU 15 determines that the correlation value is larger than the threshold value (Yes in ST613), the CPU 15 becomes an imaging target. Button 2 is determined that the front surface is directed upward (ST614), and when the correlation value is determined to be smaller than the threshold value (No in ST613), button 2 has the back surface directed upward. (ST615). At this time, if the button 2 to be imaged is a defective product such as a lack of the outer peripheral edge and the correlation value is smaller than the threshold value, the button 2 Is determined to be facing upward.

  After determining the front and back of the button 2 to be imaged, the CPU 15 outputs the determination result of the front and back, the color information, and the configuration information to the sewing machine control unit 30 via the I / F 20 (ST616).

  The sewing machine control unit 30 removes the button 2 if the back side of the button 2 is directed upward based on the input discrimination result of the button 2, and the surface of the button 2 is directed upward. If there is, the formation position of the threading hole and the outer diameter of the threading hole are confirmed based on the input configuration information of the button 2. When the sewing machine control unit 30 determines that the formation position of the threading hole is shifted or the outer diameter of the threading hole is small, such a button 2 is also removed, and the normal button 2 is assumed. When the determination is made, the angle of the button 2 in the planar shape is adjusted based on the configuration information, and an operation of sewing on the sewing product is performed.

  According to this embodiment, by using not only the front illumination image but also the transmitted illumination image and the oblique illumination image, the outer shape / outer diameter / center position / upper surface uneven shape of the button 2, the number of threading holes / outside Configuration information such as diameter, center position, and formation position can be obtained with high accuracy. That is, the button recognizing device 1 can acquire configuration information about the uneven shape of the upper surface of the button 2 by imaging the upper surface of the button 2 with the camera 3 in a state where the button 2 is irradiated by the oblique illumination device 7. it can. In addition, the button recognition device 1 captures the upper surface of the button 2 with the camera 3 in a state where the button 2 is irradiated with the liquid crystal display panel 10, so that the threading hole forming position in the opaque button 2 is highly accurate. Configuration information can be acquired.

  Therefore, the button recognition device 1 according to the present embodiment can determine the front and back of the button 2 based on highly accurate configuration information for a wide variety of buttons 2, and can improve the front and back discrimination accuracy. The defective button 2 can be removed by using the configuration information, or the button 2 can be arranged at a predetermined angle in the planar shape, and the button 2 can be sewn to the sewing product with a good finish by the sewing machine. .

  Further, the button recognition device 1 can determine the button 2 with poor manufacturing accuracy by acquiring highly accurate configuration information about the threading hole forming position in the opaque button 2, so that the sewing machine can be sewn. Occurrence of troubles such as broken stitches due to the needle contacting the button 2 without passing through the threading hole can be prevented.

  Further, the button recognition device 1 acquires the color information of the upper surface of the button 2, classifies the button 2 according to the translucency of the button 2, and each lighting device 5, 7, according to the color and translucency of the button 2. 10 can be set. Thereby, since each illumination image of the clearer button 2 can be acquired, more highly accurate information can be acquired for a wide variety of buttons 2.

  Furthermore, by adjusting the position of the oblique illumination device 7 with respect to the button 2 by the position adjusting device 9 according to the color of the button 2, the angle of the irradiation light emitted from the oblique illumination device 7 to the upper surface of the button 2. Can be adjusted. As a result, the oblique illumination device 7 can more clearly project the uneven shape of the upper surface of the button 2, so that more accurate configuration information can be obtained for a wide variety of buttons 2, and the accuracy of front / back discrimination Can be further improved.

  Further, since the liquid crystal display panel 10 can change the color of the irradiation light, the button portion and the background in the front illumination image can be changed by changing the color of the irradiation light from the liquid crystal display panel 10 according to the color of the button 2. It is possible to set a background color that can more easily separate the portion. For example, the button 2 made of an opaque material is set to a black background color, and the button 2 made of a translucent material is set to a background color that is complementary to the color of the button 2 or in the front illumination image. By setting the color that increases the contrast between the button portion and the background portion as the background color, the background portion and the button portion can be more clearly separated, and the outline of the button 2 can be extracted. As a result, the coaxial epi-illumination device 5 can display the upper surface of the button 2 more clearly, so that more accurate configuration information can be acquired for a wide variety of buttons 2 and the accuracy of front / back discrimination is further improved. Can be made.

  In addition, since the liquid crystal display panel 10 can change the background pattern to be displayed, changing the background pattern displayed by the liquid crystal display panel 10 in accordance with the transparency of the button 2 makes it possible to change the button 2 in the front illumination image. It is possible to set a background pattern that can be separated from the background. For example, for the button 2 made of an opaque material, a solid background pattern is displayed on the liquid crystal display panel 10, and for the button 2 made of a transparent material, a periodic pattern background pattern is displayed on the liquid crystal display panel 10. Thus, the background portion and the button portion can be more clearly separated, and the outline of the button 2 can be extracted. Thereby, since the upper surface of the button 2 can be projected more clearly by the coaxial epi-illumination device 5, more accurate configuration information can be acquired for a wide variety of buttons 2, and the accuracy of front / back discrimination is further improved. Can be made.

  In addition, this invention is not limited to the said embodiment, A various change is possible as needed.

  For example, in the embodiment, each measurement process such as the first measurement process, the second measurement process, and the third measurement process is performed in a state where one button is placed on the liquid crystal display panel 10. A plurality of specific types of buttons may be placed on the liquid crystal display panel 10, and the plurality of buttons may be measured by one imaging during each measurement process.

  In the above embodiment, in order to determine and classify whether the button 2 is made of an opaque material, a semi-transparent material, or a transparent material, Judgment is made using the number of labels attached in the labeling process, but the presence or absence of pixels recognized as shadow parts other than the background in the transmitted illumination image data acquired in ST1, and the image recognized as shadow parts You may classify each of an opaque body, a semi-transparent body, and a transparent body based on the translucency detected by the translucency of the light with respect to a background part.

Schematic side sectional view showing an embodiment of a button recognition device according to the present invention The block diagram which shows the structure of the button recognition apparatus of FIG. The flowchart which shows one Embodiment of the button recognition method which concerns on this invention. The flowchart which shows the 1st measurement process in the button recognition method shown in FIG. The flowchart which shows the color information acquisition process in the button recognition method shown in FIG. The flowchart which shows the 2nd measurement process in the button recognition method shown in FIG. (A)-(c) is a top view which shows the front illumination image acquired in the 2nd measurement process shown in FIG. The top view which shows the case where the background part of the front illumination image shown in FIG. 7 is removed FIG. 8 is a plan view showing the case where the front illumination image from which the background portion in FIG. The flowchart which shows the 3rd measurement process in the button recognition method shown in FIG. The flowchart which shows the position adjustment process of the oblique illumination apparatus in the button recognition method shown in FIG. (A)-(d) is a top view which shows each illumination image used in the button synthetic | combination process in the button recognition method shown in FIG. The flowchart which shows the front / back determination process in the button recognition method shown in FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Button recognition apparatus 2 Button 3 Camera 5 Coaxial epi-illumination apparatus 5a Half mirror 5b Light source 7 Oblique illumination apparatus 7a Light source 9 Position adjustment apparatus 10 Liquid crystal display panel 12 Image processing apparatus 15 CPU
16 image memory 17 first recording memory 18 work memory 19 A / D converter 21 camera control unit 22 coaxial incident illumination control unit 23 oblique illumination control unit 25 position adjustment control unit 26 panel control unit 28 second recording memory 30 sewing machine control unit

Claims (11)

A coaxial epi-illumination device that irradiates irradiation light perpendicularly to the front surface of the button;
A transmissive illumination device that is disposed on the rear surface side of the button and that emits irradiation light from the rear surface of the button;
An oblique illumination device for irradiating the front surface of the button with irradiation light from an oblique direction;
A front illumination image of the front surface of the button in a state irradiated with irradiation light by the coaxial incident illumination device, an oblique illumination image of the front surface of the button in a state irradiated with irradiation light by the oblique illumination device, and An imaging device that captures a transmitted illumination image of the front surface of the button in a state in which irradiation light is irradiated by the transmitted illumination device;
The button configuration information is acquired using the front illumination image, the oblique illumination image, and the transmitted illumination image, and the button is used using each illumination image, the configuration information, and a pre-recorded standard image of the button. A button recognition device comprising: an image processing device that discriminates the front and back of the image.   The image processing device determines the color of the front surface of the button using the front illumination image, determines the translucency of the button using the front illumination image and the transmitted illumination image, and determines the determined button The button recognition device according to claim 1, wherein an illumination condition of each of the illumination devices is adjusted according to a color and a translucency of the button.   The angle of the irradiation light emitted from the oblique illumination device to the front surface of the button by adjusting the position of the oblique illumination device with respect to the button according to the color of the button determined by the image processing device. The button recognizing device according to claim 2, further comprising a position adjusting device for adjusting the position. As the transmitted illumination device, using a display device that displays the background color of the button,
4. The button recognition device according to claim 2, wherein the display device sets a color of irradiation light to be emitted according to the color of the button determined by the image processing device. 5. As the transmitted illumination device, using a display device that displays a background pattern of the button,
The button according to any one of claims 2 to 4, wherein the display device sets the background pattern in accordance with the translucency of the button determined by the image processing device. Recognition device. A front illumination image acquisition step of irradiating irradiation light perpendicularly to the front surface of the button and capturing a front illumination image of the front surface of the button by an imaging device;
A transmission illumination image acquisition step of irradiating irradiation light from the rear surface of the button and capturing a transmission illumination image of the front surface of the button by the imaging device;
An oblique illumination image acquisition step of irradiating the front surface of the button with irradiation light from an oblique direction and capturing an oblique illumination image of the front surface of the button by the imaging device;
The button configuration information is acquired using the front illumination image, the oblique illumination image, and the transmitted illumination image, and the button is used using each illumination image, the configuration information, and a pre-recorded standard image of the button. And a button recognition method comprising: an image processing step of discriminating between the front and back sides. Using the front illumination image to obtain color information on the front of the button,
Using the front image and the transmitted illumination image, classify the buttons according to the transparency of the buttons,
The button recognition method according to claim 6, wherein an illumination condition of each of the illumination devices is adjusted according to a color and translucency of the button.   Position adjustment for adjusting the angle of irradiation light irradiated on the front surface of the button by adjusting the position of irradiation of the button with irradiation light in the oblique illumination image acquisition step according to the color of the button The button recognition method according to claim 7, further comprising a step.   The button recognition method according to claim 7 or 8, wherein, in the front illumination image acquisition step, a background color of the button is set according to a color of the button.   The button recognition method according to any one of claims 7 to 9, wherein, in the front illumination image acquisition step, a background pattern of the button is set according to the translucency of the button.   When the button is classified as being made of a transparent material according to the translucency of the button, a background pattern of the button is set to a periodic pattern, and the button portion is transmitted through the button. The background pattern of the button is separated from the background part and the button part in the front illumination image by utilizing the fact that the background pattern of the button is distorted and visually recognized, and the outline contour line of the button is acquired. Button recognition method.

Images