JP2017092131A - Image generation apparatus, mounting device and image generation method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To generate a full focus image of a component by a simple and light-weight configuration.SOLUTION: An image generation device (50) includes a component imaging unit (51) for imaging a component (P) a plurality of times, while moving the focal position by means of a liquid lense (55) capable of changing the refractive index, and an image generation unit (54) for generating the full focus image of a component from a plurality of captured image focused at different positions of the component. By changing the refractive index of the liquid lens, different positions of the component can be focused, and the full focus image can be generated even when the distance of the component imaging unit and a subject is fixed.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an image generation apparatus, a mounting apparatus, and an image generation method for generating an omnifocal image of a subject.

  2. Description of the Related Art Conventionally, as this type of image generation apparatus, an apparatus that generates an omnifocal image from a plurality of captured images focused on different positions with respect to a subject is known (see, for example, Patent Document 1). The image generation apparatus described in Patent Document 1 captures a plurality of captured images in which the distance between the subject and the imaging unit is changed while the subject is separated or approached from the imaging unit. Then, image processing is performed on a plurality of captured images, and a plurality of captured images after image processing are combined to generate an omnifocal image in which each pixel constituting the subject image in the captured image is focused. doing.

JP 2012-023340 A

  In the image generation device described in Patent Document 1, a drive mechanism that moves either the imaging unit or the object is essential in order to capture a plurality of images having different focal positions. However, when the imaging unit and the object are moved by the drive mechanism, there are problems that the apparatus configuration becomes complicated, the weight increases, and further maintenance is required.

  SUMMARY An advantage of some aspects of the invention is that it provides an image generation apparatus, a mounting apparatus, and an image generation method capable of generating an omnifocal image with a simple and lightweight configuration.

  An image generation apparatus according to the present invention is an image generation apparatus that generates an omnifocal image of a subject from a plurality of captured images focused on different positions of the subject, and a focal position by a liquid lens having a variable refractive index. An imaging unit that images the subject a plurality of times while moving the image, and an image generation unit that generates an omnifocal image of the subject from a plurality of captured images captured by the imaging unit.

  An image generation method of the present invention is an image generation method for generating an omnifocal image of a subject from a plurality of captured images focused on different positions of the subject, and a focal position by a liquid lens having a variable refractive index. A step of imaging the subject a plurality of times by the imaging unit while moving the image, and a step of generating an omnifocal image of the subject from the plurality of captured images captured by the imaging unit.

  According to these configurations, by changing the refractive index of the liquid lens, the subject can be focused on different positions without changing the distance between the imaging unit and the subject. For this reason, the subject can be imaged a plurality of times, and an omnifocal image can be generated from the plurality of captured images. Since a drive mechanism for moving either the imaging unit or the subject is unnecessary, an omnifocal image can be generated with a simple and lightweight configuration.

  In the image generation apparatus of the present invention, the distance between the imaging unit and the subject is fixed, and the imaging unit makes the amount of light irradiated to the position constant when focusing on a different position of the subject. According to this configuration, even when the distance between the imaging unit and the subject is fixed, when the focus on the subject having a height difference is changed, the focused position can be illuminated with the same amount of irradiation light.

  In the image generation apparatus of the present invention, the imaging unit makes the amount of irradiation light constant by adjusting the brightness of illumination. According to this configuration, the amount of irradiation light can be adjusted with a simple configuration. In addition, the tact time can be shortened compared to a configuration in which the shutter is adjusted.

  In the image generation apparatus of the present invention, a height sensor that measures the top surface height of the subject is provided, and the imaging unit varies the focal position of the liquid lens based on the top surface height of the subject. According to this configuration, the focal position of the liquid lens can be adjusted in a shorter time than autofocus.

  In the image generation device of the present invention, an image correction unit that corrects a subject image in each captured image captured during conveyance of the subject and matches the coordinate position of the subject image between the plurality of captured images. The image generation unit generates an omnifocal image of the subject from the plurality of corrected captured images. According to this configuration, an omnifocal image can be generated from a captured image that is captured while the subject is being conveyed, and the tact time can be shortened.

  In the image generation device of the present invention, the image generation unit calculates the height of the subject based on the omnifocal image. According to this configuration, the subject can be recognized three-dimensionally from the omnifocal image.

  The mounting apparatus of the present invention includes the above-described image generation apparatus and a mounting head that conveys the component as the subject to a predetermined position on the board, and based on the omnifocal image generated by the image generation apparatus, A mounting head mounts the component on the substrate. According to this configuration, the height of the component as the subject can be obtained from the omnifocal image, and the component can be accurately mounted on the substrate.

  According to the present invention, by changing the refractive index of the liquid lens, it is possible to capture a plurality of captured images focused on different positions without changing the distance between the imaging unit and the subject. By synthesizing a plurality of captured images, an omnifocal image can be generated with a simple and lightweight configuration.

It is an upper surface schematic diagram of the mounting apparatus of this Embodiment. It is explanatory drawing of the imaging principle of the imaging part which uses a drive mechanism. It is explanatory drawing of the imaging principle of the imaging part which uses a liquid lens. It is a schematic diagram of the image generation apparatus of this Embodiment. It is a figure which shows the captured image of this Embodiment. It is a figure which shows an example of the flowchart of this Embodiment. It is a figure which shows an example of the imaging operation of this Embodiment.

  Hereinafter, the mounting apparatus of the present embodiment will be described with reference to the accompanying drawings. FIG. 1 is a schematic top view of the mounting apparatus of the present embodiment. FIG. 2 is an explanatory diagram of the imaging principle of the imaging unit using the drive mechanism. FIG. 3 is an explanatory diagram of the imaging principle of the imaging unit using a liquid lens. In this embodiment, an example in which the image generation apparatus for an omnifocal image is applied to a mounting apparatus will be described, but the present invention can be applied to apparatuses other than the mounting apparatus as long as the image generation apparatus is provided.

  As shown in FIG. 1, the mounting apparatus 1 is configured to mount a component P (see FIG. 4) supplied from a component supply apparatus 10 such as a tape feeder on a mounting surface of a substrate W by a mounting head 40. ing. A substrate transport unit 21 is disposed substantially along the X-axis direction at the center of the base 20 of the mounting apparatus 1. The board transport unit 21 loads and positions the substrate W before component mounting from one end side in the X-axis direction below the mounting head 40, and unloads the substrate W after component mounting from the other end side in the X-axis direction. In addition, on the base 20, a large number of component supply devices 10 are arranged side by side in the X-axis direction on both sides of the board conveyance unit 21.

  A tape reel 11 is detachably mounted on the component supply apparatus 10, and a carrier tape (not shown) in which a large number of components P are packaged is wound around the tape reel 11. Each component supply device 10 feeds components P in order toward a delivery position picked up by the mounting head 40 by rotation of a sprocket wheel provided in the device. At the delivery position of the mounting head 40, the cover tape on the surface is peeled off from the carrier tape, and the component P in the pocket (not shown) of the carrier tape is exposed to the outside. In the present embodiment, the tape feeder is exemplified as the component supply apparatus 10, but it may be configured by a ball feeder or the like.

  On the base 20, an XY moving unit 30 that moves the mounting head 40 in the X-axis direction and the Y-axis direction is provided. The XY moving unit 30 includes a pair of Y-axis tables 31 extending in parallel with the Y-axis direction and an X-axis table 32 extending in parallel with the X-axis direction. The pair of Y-axis tables 31 are supported by support portions (not shown) erected at the four corners of the base 20, and the X-axis table 32 is movable on the pair of Y-axis tables 31 in the Y-axis direction. Is installed. On the X-axis table 32, a mounting head 40 is installed so as to be movable in the X-axis direction. The mounting head 40 is reciprocated between the component supply device 10 and the substrate W by the XY moving unit 30.

  The mounting head 40 has a plurality of (three in the present embodiment) head portions 42 each having a nozzle 41. The head unit 42 moves the nozzle 41 up and down in the Z-axis direction by a Z-axis motor (not shown) and rotates the nozzle 41 around the Z-axis by a θ motor (not shown). Each nozzle 41 is connected to a suction source (not shown) and sucks and holds the component P by a suction force from the suction source. The nozzle 41 of the mounting head 40 is not limited to the nozzle 41 described above, and may be configured by a gripper nozzle, for example, as long as the component P can be taken out from the component supply apparatus 10 and mounted on the substrate W. .

  The mounting head 40 includes a light emitting unit and a light receiving unit, receives a reflected light and measures a distance thereof, a height sensor 43, a substrate imaging unit 44 that images a BOC (Board Offset Correction) mark on the substrate W, A nozzle imaging unit 45 that images the mounting operation of the component P by the nozzle 41 and a laser recognition unit (not shown) that can recognize the component P sucked by the nozzle 41 are provided. The height sensor 43 measures the height (distance) from the mounting head 40 to the measurement object. The board imaging unit 44 recognizes the position, tilt, expansion and contraction, etc. of the board W based on the captured image of the BOC mark. Further, the laser recognition unit (not shown) includes a light receiving unit and a light emitting unit along one horizontal direction, and the nozzle 41 that sucks the component P in the laser beam is moved up and down or rotated. The height dimension Z of the part P, the X and Y dimensions (width dimensions), and the suction displacement of the part P with respect to the nozzle 41 can be recognized. Based on these recognition results, correction information for the mounting position of the component P on the substrate W is generated. In the nozzle imaging unit 45, the parts P before and after being picked up by the nozzles 41 are imaged, and the parts P before and after being mounted on the substrate W are imaged, and these images are stored as traceability information. Further, the suction position of the component P is recognized from the captured image of the component P before suction by the nozzle 41.

  In addition, the base 20 of the mounting apparatus 1 is equipped with an image generation apparatus 50 that captures the component P adsorbed by the nozzle 41 a plurality of times and generates an omnifocal image. The image generation device 50 is provided with a component imaging unit 51 (imaging unit) that images the component P adsorbed by the nozzle 41 from below. The component imaging unit 51 captures a plurality of captured images while focusing on different positions with respect to the component P. Then, by generating an omnifocal image from a plurality of captured images, the inclination of the component P and the height of the component P are recognized, and correction information such as the suction position and movement amount of the nozzle 41 based on these recognition results Is generated. Note that the image generation device 50 may be provided in the mounting head 40.

  In addition, the mounting apparatus 1 is provided with a control unit 60 (see FIG. 4) that performs overall control of each part of the apparatus. The control unit 60 includes a processor that executes various processes, a memory, and the like. The memory is composed of one or a plurality of storage media such as a ROM (Read Only Memory) and a RAM (Random Access Memory) depending on the application. The memory stores a production program used in actual production, an omnifocal image generation program, a captured image correction program, and the like.

  2A-2C and FIGS. 3A-3C are examples in which the mounting head 40 is provided with an imaging unit 71 and an imaging unit 81 including a liquid lens 83. FIG. Here, a general imaging method when generating an omnifocal image will be described. As shown in FIG. 2A, when generating an omnifocal image of the subject O, a linear guide 77 and a slider 78 are usually used to move an imaging unit 71 including an imaging element 72, a lens 73, and an illumination 74. A drive mechanism 76 is required. By moving the slider 78 along the linear guide 77 in the separating direction or the approaching direction with respect to the subject O, the imaging unit 71 captures a plurality of captured images of the subject O. Since the plurality of captured images are images captured while changing the distance from the subject O to the imaging unit 71, the plurality of captured images are focused on different positions with respect to the subject O.

  For example, as shown in FIG. 2B, when the separation distance from the subject O to the imaging unit 71 is L1, the light (reflected light) from the point P1 of the subject O passes through the lens 73 and the imaging surface 75 of the imaging element 72. Is imaged. Further, light from a point P2 on the upper surface side of the point O of the subject O is imaged on the back side of the imaging surface 75 of the imaging element 72 through the lens 73. That is, at the separation distance L1, a captured image focused on the point P1 of the subject O is captured. In the captured image focused on the point P1 of the subject O, the lower surface side of the subject O is clearly taken and gradually becomes blurred from the lower surface side of the subject O toward the upper surface side.

  On the other hand, as shown in FIG. 2C, when the separation distance from the subject O to the imaging unit 71 is L2, the light (reflected light) from the point P1 of the subject O passes through the lens 73 and the imaging surface of the imaging device 72. The image is formed in front of 75. Further, light from a point P2 on the upper surface side of the point O of the subject O is imaged on the imaging surface 75 of the imaging element 72 through the lens 73. That is, at the separation distance L2, a captured image focused on the point P2 of the subject O is captured. In the captured image focused on the point P2 of the subject O, the upper surface side of the subject O is clearly taken and gradually becomes blurred toward the lower surface side of the subject O.

  An omnifocal image is generated by combining a plurality of captured images focused on different positions with respect to the subject O. However, in such a configuration, a drive mechanism such as the linear guide 77 and slider 78 and a drive source such as a motor are required to move the imaging unit 71 away from or close to the subject O, so that the device configuration is complicated. As a result, there is a problem that the weight of the apparatus increases. Therefore, as shown in FIG. 3A, by using a liquid lens 83 in the imaging unit 81, a plurality of captured images focused on different positions of the subject O are captured without changing the distance between the imaging unit 81 and the subject O. Like to do.

  For example, as shown in FIG. 3B, when the refractive index (interface shape) of the liquid lens 83 is varied, light from the point P1 of the subject O is imaged on the imaging surface 85 of the image sensor 82, and from the point P2 of the subject O. Is formed on the back side of the imaging surface 85 of the imaging element 82. When the refractive index of the liquid lens 83 is varied as shown in FIG. 3C, light from the point P1 of the subject O is imaged in front of the imaging surface 85 of the image sensor 82, and from the point P2 of the subject O. Light is imaged on the imaging surface 85 of the image sensor 82. In this way, by changing the refractive index of the liquid lens 83, a captured image focused on the points P1 and P2 of the subject O is captured.

  The mounting apparatus 1 according to the present embodiment applies the imaging unit 81 including the liquid lens 83 to the component imaging unit 51 (see FIG. 1) to capture the component P (see FIG. 4) and generate an omnifocal image. doing. The mounting apparatus 1 handles a component P from which a solder ball 92 protrudes from a package 91 (see FIG. 4), such as a BGA (Ball Grid Array). The exact height of the ball 92 needs to be determined. However, in the imaging unit 81 shown in FIG. 3, the height difference of the subject O does not appear in the omnifocal image as an accurate contrast, and it is difficult to obtain the accurate height of the solder ball 92 (see FIG. 4) from the omnifocal image. .

  For example, in the case of the imaging unit 71 shown in FIG. 2, since the distance from the illumination 74 to the subject O is varied, there is no variation in the amount of irradiation light with respect to the position where the subject O is in focus. For example, the point P1 of the subject O is focused in FIG. 2B and the point P2 of the subject O is focused in FIG. 2C, but the distances La and Lb from the points P1 and P2 of the subject O to the illumination 74 are the same. The amount of light emitted from the illumination 74 to each point P1, P2 of the subject O is constant. For this reason, the picked-up image focused on the points P1 and P2 of the subject O can be picked up with the same brightness.

  On the other hand, in the case of the imaging unit 81 shown in FIG. 3, since the distance from the illumination 84 to the subject O is fixed, the amount of irradiation with respect to the position where the subject O is focused varies. For example, the point P1 of the subject O is focused in FIG. 3B and the point P2 of the subject O is focused in FIG. 3C, but the distances La and Lb from the points P1 and P2 of the subject O to the illumination 84 are different. Therefore, the amount of light applied to the points P1 and P2 of the subject O varies. As described above, the imaging unit 81 using the liquid lens 83 can have a simple and lightweight configuration, but it is difficult to accurately add contrast to the captured image.

  For this reason, in the component imaging unit 51 of the present embodiment, when the subject O is focused on a different position, the amount of light applied to the position is adjusted to be constant. Thereby, while making the components imaging part 51 simple and lightweight structure, when focusing on each position of the components P, it can image with fixed brightness. In addition, by generating an omnifocal image from a plurality of captured images captured by the component imaging unit 51, it is possible to accurately add contrast of light and darkness to the omnifocal image, and to obtain the height of the solder ball 92 with high accuracy. Can do.

  Hereinafter, with reference to FIG. 4 and FIG. 5, the image generation apparatus mounted on the mounting apparatus will be described in detail. FIG. 4 is a schematic diagram of the image generation apparatus according to the present embodiment. FIG. 5 is a diagram illustrating a captured image of the present embodiment. In the present embodiment, a component imaging unit will be described as an example of the imaging unit of the image generation device. However, the imaging unit of the image generation device may be a substrate imaging unit and a nozzle imaging unit. That is, the imaging unit including the liquid lens may be provided on the base 20 or the mounting head 40. When the imaging unit is provided on the base 20, the imaging target is the nozzle 41 or the component P attracted to the nozzle 41. When the mounting head 40 is provided with an imaging unit, the imaging target is the substrate W, the component P mounted on the substrate W, or the component P supplied to the suction position of the component supply device 11. Note that the generation of an omnifocal image is the same regardless of whether the imaging unit is provided on the base 20 or the mounting head 40, and therefore, an embodiment in which the imaging unit is provided on the base 20 will be described.

  As illustrated in FIG. 4, the image generation device 50 captures the component P being conveyed by the mounting head 40 (see FIG. 1) from below with the component imaging unit 51, and omnifocal images of the component P from the plurality of captured images. Is configured to generate Since the distance in the height direction between the component imaging unit 51 and the component P is fixed, the component imaging unit 51 captures the component P a plurality of times while moving the focal position by the liquid lens 55 having a variable refractive index. doing. In addition, when the component imaging unit 51 captures the component P, the brightness of the illumination 56 is adjusted according to the focal position of the liquid lens 55 so that the amount of light applied to the focused position of the component P is constant. (This is referred to as illumination adjustment means). As the liquid lens 55, for example, a telecentric lens having a small angle of view is used.

  In this case, the brightness of the illumination 56 is adjusted by a table or graph showing the relationship between the focal position (refractive index) of the liquid lens 55 and the brightness of the illumination 56 when the amount of irradiation light is constant. The brightness of the illumination 56 may be adjusted so that the luminance of the point of interest set at the end of the component P is constant. In this way, by adjusting the brightness of the illumination 56, even when the distance between the component imaging unit 51 and the component P is fixed, the focus is adjusted when the focus on the component P having a difference in height is changed. Can be illuminated with the same amount of irradiation. In addition, the tact time can be shortened compared to a configuration in which the amount of irradiation light is adjusted by adjusting the shutter of the illumination 56.

  A height sensor 52 is provided near the component imaging unit 51, and the height of the upper surface of the component P is measured by the height sensor 52. The height sensor 52 provided on the base 20 side has the same function as the height sensor 43 provided on the mounting head 40 described above. The component imaging unit 51 varies the focal position of the liquid lens 55 with reference to the height of the upper surface of the component P measured by the height sensor 52. As a result, the focal position of the liquid lens 55 can be adjusted in a shorter time than autofocus. When the captured image is captured by the image sensor 57 of the component imaging unit 51, the captured image is output to the memory 61 of the control unit 60. At this time, since the component imaging unit 51 captures the component P being conveyed, the component images (subject images) are misaligned in the plurality of captured images.

  For this reason, the image generation device 50 is provided with an image correction unit 53 that corrects the component images in each captured image and matches the coordinate positions of the component images among the plurality of captured images. As illustrated in FIG. 5, for example, the image correction unit 53 extracts a component image from each captured image, and moves the center C of the component image to the center coordinates of the captured image. In this way, all the pixels of each component image are corrected so as to be positioned at the same coordinate in each captured image. In this case, the image correction unit 53 reads the head position of the mounting head 40 (see FIG. 1) at the time of imaging from an encoder or the like, and corrects the component image based on the head position at the time of imaging of each captured image.

  Returning to FIG. 4, the image generation device 50 is provided with an image generation unit 54 that generates an omnifocal image in which all pixels are in focus from a plurality of corrected captured images. The image generation unit 54 generates an omnifocal image from a plurality of captured images using an existing algorithm (for example, an algorithm described in JP 2012-023340 A). For example, the contrast value of each pixel is obtained from a plurality of captured images, and the contrast value of the same pixel is compared between the plurality of captured images. Thereby, a focused pixel (see FIG. 5) is specified in each captured image, and an omnifocal image is generated by combining these pixels.

  In addition, the image generation unit 54 calculates the height of the component P based on the omnifocal image. In this case, since each pixel of the omnifocal image is captured with the same amount of irradiation light, the height of the component P is accurately calculated from the contrast from the omnifocal image. By calculating the protruding length of the solder ball 92 protruding from the package 91 of the component P, the component P is recognized three-dimensionally from the omnifocal image. Therefore, it is possible to accurately mount the component P on which the solder balls 92 such as BGA protrude from the mounting head 40 on the substrate W. Further, an omnifocal image can be generated from the captured image captured while conveying the component P, and the tact time can be shortened.

  Image generation processing will be described with reference to FIGS. 6 and 7. FIG. 6 is a diagram illustrating an example of a flowchart of the present embodiment. FIG. 7 is a diagram illustrating an example of an imaging operation according to the present embodiment. In the description of FIG. 6, the reference numerals of FIG. 4 are used as appropriate.

  As shown in FIG. 6, first, an imaging process for the component P is performed. In the imaging process, the refractive index of the liquid lens 55 is varied, and the mounting apparatus 1 (see FIG. 1) focuses on the back of the component P being conveyed (see step S01 and FIG. 7A). Next, the brightness of the illumination 56 is adjusted in accordance with the focal position of the liquid lens 55 so that a predetermined irradiation light amount is obtained with respect to the focused position (step S02). Next, the component P being conveyed is imaged with a predetermined irradiation light amount in a state where the focus is in the back of the component P (step S03). Next, it is determined whether or not the number of imaging for the component P is equal to or greater than a predetermined number (step S04).

  If the number of times of imaging is less than the predetermined number of times (No in step S04), the refractive index of the liquid lens 55 is changed so that the focused position (in-focus position) is moved from the back of the component P to the front. (Step S05). Then, the processing from step S02 to step S04 is repeated until the number of times of imaging reaches a predetermined number. As a result, a plurality of picked-up images focused on different positions with respect to the component P being conveyed are captured while the in-focus position is moved from the back to the front with respect to the component P (see FIG. 7B). Since the component P being transported is imaged, positional deviation occurs in the component images in the plurality of captured images (see FIG. 5).

  On the other hand, when the number of times of imaging is equal to or greater than the predetermined number of times (Yes in step S04), an omnifocal image generation process is performed. In the image generation process, correction is performed so that the center C of the component images in the plurality of captured images moves to the center coordinates of the captured images (step S06). Thereby, the pixel of the component image in each captured image is aligned at the same position among a plurality of captured images. Next, an omnifocal image is generated by combining the focused pixels of the plurality of captured images (step S07). At this time, since each pixel of the omnifocal image is imaged with the same amount of irradiation light, the height difference of the solder ball 92 appears in the omnifocal image as an accurate contrast. Then, the height of the solder ball 92 of the component P is accurately calculated based on the omnifocal image (step S08).

  As described above, according to the mounting apparatus 1 of the present embodiment, by changing the refractive index of the liquid lens 55, the position different from the component P without changing the distance between the component imaging unit 51 and the component P. Is focused on. For this reason, the component P can be imaged a plurality of times, and an omnifocal image can be generated from the plurality of captured images. Since a drive mechanism for moving either the component imaging unit 51 or the component P is unnecessary, an omnifocal image can be generated with a simple and lightweight configuration.

  In addition, this invention is not limited to the said embodiment, It can change and implement variously. In the above-described embodiment, the size, shape, and the like illustrated in the accompanying drawings are not limited to this, and can be appropriately changed within a range in which the effect of the present invention is exhibited. In addition, various modifications can be made without departing from the scope of the object of the present invention.

  For example, in the present embodiment, the image generation apparatus 50 has been described with respect to the configuration for generating an omnifocal image from a plurality of captured images of a component being conveyed that has been captured by the component imaging unit 51. The image generation device may be configured to generate an omnifocal image of a subject from a plurality of captured images focused on different positions of the subject. For example, the image generation device may generate an omnifocal image by imaging the substrate W and the component P as a subject multiple times using the substrate imaging unit 44 and the nozzle imaging unit 45 as the imaging unit. The amount of warpage can be obtained from the omnifocal image of the substrate W, and the pre-adsorption state and mounting state of the component P can be confirmed from the omnifocal image of the component P. In addition, when using the board | substrate imaging part 44 and the nozzle imaging part 45 as an imaging part of an image generation apparatus, the upper surface height of a to-be-photographed object can be measured using the height sensor 43 of the mounting head 40. FIG.

  Moreover, in this Embodiment, although it was set as the structure which makes the irradiation light quantity with respect to the components P constant by adjusting the brightness of the illumination 56, it is not limited to this structure. The amount of irradiation light may be adjusted so as to be constant with respect to the position of the illuminated subject when focused on the different position. For example, the irradiation light quantity may be adjusted to be constant according to the shutter time of the illumination 56, or may be adjusted to be constant according to the shutter speed.

  In the present embodiment, the height of the subject is calculated from the omnifocal image, but a three-dimensional image of the subject may be generated from the omnifocal image.

  In the present embodiment, the configuration in which the image generation device 50 is mounted on the mounting device 1 has been described. However, the configuration is not limited to this configuration. The image generation apparatus 50 may be mounted on an apparatus other than the mounting apparatus 1 or may be a dedicated apparatus for generating an omnifocal image.

  In the present embodiment, the image generation device 50 is configured to generate an omnifocal image of the BGA in which the solder ball 92 protrudes from the package 91. However, the omnifocal image of other components is also generated by the same method. be able to. The subject is not limited to the component P, and may be any substrate W or other imaging target.

  In the present embodiment, the height sensor 52 measures the upper surface height of the component P and adjusts the focal position of the liquid lens 55 based on the upper surface height. However, the present invention is limited to this configuration. Not. The focal position of the liquid lens 55 may be adjusted using data such as the height of the component P preset in the memory of the mounting apparatus 1.

  As described above, the present invention has an effect that an omnifocal image can be generated with a simple and lightweight configuration, and in particular, a mounting apparatus for mounting components on a substrate, and an image generation mounted on the mounting apparatus. It is useful for an image generation method using an apparatus and an image generation apparatus.

DESCRIPTION OF SYMBOLS 1 Mounting apparatus 40 Mounting head 44 Board | substrate imaging part (imaging part)
45 Nozzle imaging unit (imaging unit)
50 Image generator 51 Component imaging unit (imaging unit)
52 Height Sensor 53 Image Correction Unit 54 Image Generation Unit 55 Liquid Lens 56 Illumination P Component (Subject)
W Substrate (Subject)

Claims (8)

An image generation device that generates an omnifocal image of a subject from a plurality of captured images focused on different positions of the subject,
An imaging unit that images the subject a plurality of times while moving a focal position by a liquid lens having a variable refractive index;
An image generation apparatus comprising: an image generation unit configured to generate an omnifocal image of the subject from a plurality of captured images captured by the imaging unit. The distance between the imaging unit and the subject is fixed,
The image generation apparatus according to claim 1, wherein when the imaging unit focuses on a different position of the subject, the amount of light applied to the position is constant.   The image generation apparatus according to claim 2, wherein the imaging unit makes the amount of irradiation light constant by adjusting the brightness of illumination. A height sensor for measuring the height of the upper surface of the subject;
The image generating apparatus according to claim 1, wherein the imaging unit varies a focal position of the liquid lens with reference to a height of an upper surface of the subject. An image correction unit that corrects a subject image in each captured image captured during conveyance of the subject and matches the coordinate position of the subject image between the plurality of captured images;
The image generation apparatus according to claim 1, wherein the image generation unit generates an omnifocal image of the subject from the plurality of captured images after correction.   The image generation apparatus according to claim 1, wherein the image generation unit calculates a height of the subject based on the omnifocal image. The image generation device according to any one of claims 1 to 6,
A mounting head for transporting the component as the subject to a predetermined position on the substrate;
The mounting apparatus, wherein the mounting head mounts the component on the substrate based on the omnifocal image generated by the image generation apparatus. An image generation method for generating an omnifocal image of a subject from a plurality of captured images focused on different positions of the subject,
Imaging the subject multiple times with an imaging unit while moving the focal position with a liquid lens having a variable refractive index;
And a step of generating an omnifocal image of the subject from a plurality of captured images captured by the imaging unit.

Images