US11119395B2 - Image pickup apparatus, optical measurement apparatus, and measurement system - Google Patents
Image pickup apparatus, optical measurement apparatus, and measurement system Download PDFInfo
- Publication number
- US11119395B2 US11119395B2 US16/031,406 US201816031406A US11119395B2 US 11119395 B2 US11119395 B2 US 11119395B2 US 201816031406 A US201816031406 A US 201816031406A US 11119395 B2 US11119395 B2 US 11119395B2
- Authority
- US
- United States
- Prior art keywords
- image pickup
- image
- beam splitter
- optical
- measurement
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
- G01B11/2433—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures for measuring outlines by shadow casting
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/48—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus
- G03B17/54—Details of cameras or camera bodies; Accessories therefor adapted for combination with other photographic or optical apparatus with projector
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/28—Reflectors in projection beam
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/09—Beam shaping, e.g. changing the cross-sectional area, not otherwise provided for
- G02B27/0938—Using specific optical elements
- G02B27/095—Refractive optical elements
- G02B27/0955—Lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/10—Projectors with built-in or built-on screen
Definitions
- the present disclosure relates to an optical measurement apparatus projecting an image of a subject on a screen.
- Patent Document 1 discloses an optical measuring machine including a screen and first and second image-forming units forming an optical image of a target object on the screen.
- the first image-forming unit takes a digital image of the target object and projects an optical image of the target object on the screen on the basis of the image data.
- the second image-forming unit forms an optical image of illuminating light radiated to and reflected off the target object, on the screen.
- the first and second image-forming units are switchable when necessary by switching between the position of an image pickup of the first image-forming unit and the position of a projection lens of the second image-forming unit (see paragraphs [0029] to [0033] and [0062] of the specification, FIG. 2, and the like of Patent Document 1).
- Such an optical measurement apparatus requires a technique to improve measurement accuracy and measurement workability.
- an object is to provide an image pickup apparatus capable of improving measurement accuracy and measurement workability of an optical measurement apparatus, an optical measurement apparatus including the image pickup apparatus, and a measurement system.
- an image pickup apparatus includes a base section, a beam splitter, and an image pickup section.
- the base section is configured to be detachably attached to an optical measurement apparatus including a projection optical system configured to project an image of a subject on a screen.
- the beam splitter is disposed on an optical axis of the projection optical system upon attachment of the base section to the optical measurement apparatus.
- the image pickup section includes an image pickup device configured to receive light generated through splitting at the beam splitter and is configured to take an image of the subject upon attachment of the base section.
- This image pickup apparatus includes the base section detachably attached to the optical measurement apparatus.
- the beam splitter is disposed on the optical axis of the projection optical system, and an image of the subject can be taken on the basis of the light generated through splitting at the beam splitter.
- This configuration enables measurement on the basis of a projected image of the subject displayed on the screen and a picked-up image of the subject. That is, while the optical measurement apparatus has its own function, the function of an image measurement apparatus performing measurement on the basis of the picked-up image of the subject can be added. Thus, the measurement accuracy and measurement workability can be improved.
- the base section may be configured to be attached to a holding mechanism of the optical measurement apparatus, the holding mechanism being configured to detachably hold a lens unit holding a projection lens system of the projection optical system.
- the image pickup apparatus having this configuration can be readily used as an add-on to, for example, an existing optical measurement apparatus.
- the function of the image measurement apparatus can be added to the optical measurement apparatus at relatively low cost.
- the image pickup apparatus may further include a lens section configured to function as the projection lens system of the projection optical system upon attachment of the base section.
- the image pickup apparatus having this configuration can be used instead of, for example, an existing lens unit.
- the function of the image measurement apparatus can be readily added to the optical measurement apparatus.
- the base section may be configured to be detachably attached to a lens unit holding a projection lens system of the projection optical system.
- the image pickup apparatus having this configuration can be readily used as an add-on to, for example, an existing lens unit.
- the function of the image measurement apparatus can be added to the optical measurement apparatus at relatively low cost.
- the image pickup apparatus may further include an illuminator section configured to radiate light to the subject upon attachment of the base section.
- the subject By attaching the image pickup apparatus having this configuration, the subject can be illuminated.
- the beam splitter may be a first beam splitter
- the image pickup section may include an optical system configured to guide light generated through splitting at the first beam splitter to the image pickup device.
- the illuminator section may include a light source section and a second beam splitter disposed on an optical axis of the optical system and configured to split light emitted from the light source section and to emit the light along the optical axis of the optical system to the first beam splitter.
- the illuminator section may include a ring illuminator disposed around the optical axis of the projection optical system upon attachment of the base section.
- This configuration enables efficient radiation of illuminating light to the subject.
- the image pickup section may include an image pickup lens section configured to reduce or magnify light generated through splitting at the beam splitter and to guide the light to the image pickup device.
- This configuration enables an image of the subject to be taken accurately.
- the lens section may be configured to magnify an image of the subject with a predetermined magnification upon attachment of the base section.
- the image pickup lens section may be configured to reduce light generated through splitting at the beam splitter with a magnification corresponding to the predetermined magnification and to guide the light to the image pickup device.
- This configuration enables an image of the subject to be taken accurately.
- An optical measurement apparatus includes a screen, a projection optical system, a beam splitter, and an image pickup section.
- the projection optical system is configured to project an image of a subject on the screen.
- the beam splitter is disposed on an optical axis of the projection optical system.
- the image pickup section includes an image pickup device configured to receive light generated through splitting at the beam splitter and is configured to take an image of the subject.
- This configuration enables measurement on the basis of a projected image of the subject displayed on the screen and a picked-up image of the subject. Thus, the measurement accuracy and measurement workability can be improved.
- a measurement system includes a measurement section and a measurement processing section.
- the measurement section includes the screen, the projection optical system, the beam splitter, and the image pickup section.
- the measurement processing section is configured to perform measurement processing on the subject on a basis of image pickup data acquired by the image pickup section.
- This configuration enables measurement on the basis of a projected image of the subject displayed on the screen and a picked-up image of the subject. Thus, the measurement accuracy and measurement workability can be improved.
- the measurement system may further include a display section configured to display an image of the subject on a basis of the image pickup data acquired by the image pickup section.
- the measurement accuracy and measurement workability of the optical measurement apparatus can be improved. Note that the above-described effects are not limited, and any of the effects described in the present disclosure may be exhibited.
- FIG. 1 is a schematic block diagram of an example configuration of a measurement system according to an embodiment.
- FIG. 2 is a schematic external perspective view of a projection apparatus.
- FIG. 3 is a schematic perspective view of an example configuration of a stage unit.
- FIG. 4 is a schematic view of an example configuration of a projection optical system of the projection apparatus.
- FIG. 5 is a schematic view illustrating the case in which a lens unit with no camera equipped is attached.
- FIG. 6 is a schematic view of an example configuration of a lens unit.
- FIG. 7 is a schematic bottom view of an example configuration of a ring illuminator section.
- FIG. 8 is a front view of a head portion with a screen disposed thereon.
- FIG. 9 is a schematic view of an example measurement GUI displayed on a monitor apparatus.
- FIG. 10 is a graph for comparing accuracy in dimension measurement using a projected image with accuracy in dimension measurement by image measurement software 51 using the measurement GUI.
- FIGS. 11A and 11B are schematic views for describing measurement using a reference chart.
- FIG. 12 is a schematic view of an example configuration of an image pickup apparatus according to another embodiment.
- FIG. 13 is a schematic view of an example configuration of an image pickup apparatus according to still another embodiment.
- FIG. 1 is a schematic block diagram of an example configuration of a measurement system according to an embodiment.
- the measurement system 100 includes a projection apparatus 10 , a data processing apparatus 50 , and a monitor apparatus 60 .
- the projection apparatus 10 and the data processing apparatus 50 are connected in a mutually communicable manner.
- the monitor apparatus 60 is connected with the data processing apparatus 50 .
- a configuration for connection of these apparatuses is not limited, and a desired wired or wireless connection method may be used.
- a desired interface, cable, network module, near field wireless communication module, or the like may be used.
- the projection apparatus 10 can radiate illuminating light to a workpiece (subject) and form and project an image of the workpiece on a screen 12 (see FIG. 2 ). Thus, a projected image of the workpiece is displayed on the screen 12 .
- the projection apparatus 10 includes a camera-equipped lens unit (hereinafter referred to as lens unit) 30 .
- the lens unit 30 can be attached to and detached from the projection apparatus 10 , and includes a camera 31 , a projection lens section 32 , and an image pickup lens section 33 .
- the projection apparatus 10 corresponds to an optical measurement apparatus.
- the lens unit 30 corresponds to an image pickup apparatus. The projection apparatus 10 and the lens unit 30 will be described in detail later.
- the data processing apparatus 50 includes hardware (circuitry), such as a GPU, CPU, ROM, RAM, and HDD, necessary for a configuration of a computer.
- the CPU loads a program preliminarily stored in the ROM or the like into the RAM and executes the program to execute image measurement software 51 .
- the data processing apparatus 50 can be realized by, for example, a desired computer, such as a personal computer (PC).
- the projection apparatus 10 sends a scale value and a camera signal to the data processing apparatus 50 .
- the scale value indicates position information on a stage 13 (see FIG. 2 ) on which the workpiece is placed, and will be described in detail later.
- the camera signal contains image pickup data on the workpiece of which an image is taken by the camera 31 .
- the image measurement software 51 performs various pieces of measurement processing on the basis of the scale value (position information) and the camera signal (image pickup data) sent from the projection apparatus 10 . Desired measurement processing, such as edge detection, dimension measurement, angle measurement, roundness measurement, and shape measurement, can be performed. Note that information other than the position information and the image pickup data may be sent from the projection apparatus 10 to the data processing apparatus 50 and used for measurement processing.
- the image measurement software 51 generates a measurement graphical user interface (GUI) 61 (see FIG. 9 ) containing the scale value, a picked-up image of the workpiece, and the like.
- GUI measurement graphical user interface
- the monitor apparatus 60 is a display device using, for example, a liquid crystal, electro-luminescence (EL), or the like.
- the monitor apparatus 60 displays the measurement GUI 61 on the basis of the image signal sent from the data processing apparatus 50 . It is to be understood that other images can be di splayed.
- FIG. 2 is a schematic external perspective view of the projection apparatus 10 .
- the projection apparatus 10 includes a main body 11 , the screen 12 , the stage 13 , a movement mechanism 14 , and the lens unit 30 . Note that in FIG. 2 , the lens unit 30 is simplified.
- the main body 11 includes a base section 15 , a support portion 16 , and a head portion 17 .
- the base section 15 is placed on a desk, a workbench, or the like, and has a top surface 15 a .
- the support portion 16 is disposed at a rear end of the base section 15 and extends in the height direction.
- the head portion 17 is disposed at an upper portion of the support portion 16 .
- the screen 12 is disposed on a front surface of the head portion 17 and has two reference lines 18 a and 18 b used for visual measurement of the workpiece.
- the two reference lines 18 a and 18 b are orthogonal to each other at the center of the circular screen 12 .
- the stage 13 is disposed on the top surface 15 a of the base section 15 and can move in X, Y, and Z directions orthogonal to each other.
- the movement mechanism 14 is configured on the top surface 15 a of the base section 15 and supports the stage 13 in such a manner that the stage 13 can move in the X, Y, and Z directions.
- such a coordinate system is determined that the X direction, Y direction, and Z direction extend respectively in the lateral direction, front-rear direction, and vertical direction of the projection apparatus 10 .
- the lateral direction along the reference line 18 a of the screen 12 corresponds to the X direction
- the vertical direction along the reference line 18 b corresponds to the Y direction.
- the movement mechanism 14 includes three linear encoders 14 a to 14 c detecting amounts of movement in the X, Y, and Z directions.
- the linear encoders 14 a to 14 c calculate the scale values in the X, Y, and Z directions, and the scale values are sent to the data processing apparatus 50 .
- the movement mechanism 14 also includes an operation section (not illustrated) receiving a movement operation performed by a user and can move the stage 13 in the X, Y, and Z directions in accordance with the amount of the operation input.
- the configuration of the movement mechanism 14 is not limited, and a desired configuration may be used.
- FIG. 3 is a schematic perspective view of an example configuration of a stage unit.
- the stage unit 80 includes a stage 81 on which the workpiece W is placed, an X-axis stage 82 , and a Y-axis stage 83 .
- the X-axis stage 82 supports the stage 81 in such a manner that the stage 81 can move in the X direction.
- the Y-axis stage 83 supports the stage 81 in such a manner that the stage 81 can move in the Y direction.
- the X-axis stage 82 includes an X-axis handle 84 and an X-axis linear encoder (not illustrated).
- the Y-axis stage 83 includes a Y-axis handle 85 and a Y-axis linear encoder (not illustrated). The user turns the X-axis handle 84 and the Y-axis handle 85 to move the stage 81 .
- the X-axis handle 84 and the Y-axis handle 85 function as the above-described operation section.
- the X-axis linear encoder and the Y-axis linear encoder output the scale values corresponding to movement of the stage 81 .
- X and Y coordinate values are output with a predetermined position determined as a reference (origin).
- the user can determine the predetermined position being the reference, and can determine, for example, a desired position as the origin (0,0) (zero setting).
- the stage unit 80 illustrated in FIG. 3 may be disposed on the top surface 15 a of the base section 15 and used as the stage 13 and the movement mechanism 14 .
- a Z-axis handle (not illustrated) may be turned to move the head portion 17 in the vertical direction.
- FIG. 4 is a schematic view of an example configuration of a projection optical system (or optical projection system) of the projection apparatus 10 .
- the projection optical system 20 projects an image of the workpiece on the screen 12 and includes a projection lens system and reflecting mirrors 21 to 23 .
- the projection lens section 32 of the lens unit 30 functions as the projection lens system of the projection optical system 20 .
- the illuminating light reflected off the workpiece is guided along an optical axis O 1 of the projection optical system 20 to the screen 12 .
- the projection lens section 32 (projection lens system) of the lens unit 30 magnifies the image of the workpiece.
- the magnified image of the workpiece is sequentially reflected off the reflecting mirrors 21 to 23 and projected on the screen 12 from the rear side in the Y direction.
- the projection optical system 20 may have any configuration designed in a desired manner.
- another optical member may be disposed in the head portion 17 .
- a ring illuminator section 25 radiating illuminating light to the workpiece is attached to a lower portion of the lens unit 30 .
- the ring illuminator section 25 includes a ring illuminator 26 disposed around the optical axis O 1 of the projection optical system 20 when the lens unit 30 is attached.
- the illumination operation, amount of light, and the like of the ring illuminator 26 can be controlled by the data processing apparatus 50 .
- a unit holding section 24 is disposed on a bottom surface 17 a of the head portion 17 .
- the lens unit 30 is attached to and held by the unit holding section 24 .
- a specific configuration for holding the lens unit 30 is not limited and may be designed in a desired manner.
- FIG. 5 is a schematic view illustrating the case in which a lens unit 90 with no camera equipped is attached to the unit holding section 24 .
- the lens unit 90 holds the projection lens system of the projection optical system 20 and can be attached to and detached from the unit holding section 24 .
- the projection lens section (not illustrated) functioning as the projection lens system of the projection optical system 20 when attached to the unit holding section 24 is disposed in the lens unit 90 .
- the ring illuminator section 25 illustrated in FIG. 4 may be attached to the lens unit 90 .
- a light source 91 disposed on the front surface side of the support portion 16 and a half mirror (not illustrated) disposed in the lens unit 90 may enable coaxial epi-illumination.
- the lens unit 90 with no camera equipped is attached to the unit holding section 24 when necessary depending on the magnification or the like of the projection lens section disposed inside.
- the lens unit 30 of this embodiment is configured to be attached to and detached from the unit holding section 24 .
- the lens unit 30 is configured to be used as an add-on to an existing projection apparatus 10 .
- the unit holding section 24 corresponds to a holding mechanism of the projection apparatus 10 .
- FIG. 6 is a schematic view of an example configuration of the lens unit 30 .
- the lens unit 30 includes a lens holding section 34 and the camera 31 connected with the lens holding section 34 .
- the lens holding section 34 includes a main body portion 35 having a substantially cylindrical shape and extending in one direction and a connection portion 36 formed on a side surface of the main body portion 35 .
- the connection portion 36 also has a substantially cylindrical shape and is coupled to the side surface of the main body portion 35 while extending in a direction substantially orthogonal to the extending direction of the main body portion 35 .
- the lens holding section 34 has a T shape lying on its side as a whole.
- the main body portion 35 has one end portion 35 a on the upper side attached to the unit holding section 24 illustrated in FIGS. 4 and 5 .
- the main body portion 35 has the other end portion 35 b on the lower side to which the ring illuminator section 25 is attached.
- the lens holding section 34 corresponds to a base section.
- the camera 31 is connected with the connection portion 36 of the lens holding section 34 in a direction substantially orthogonal to the extending direction of the main body portion 35 while facing the interior of the main body portion 35 .
- the camera 31 includes an image pickup device 37 .
- Examples of the image pickup device 37 include complementary metal oxide semiconductor (CMOS) and charge coupled device (CCD) sensors.
- CMOS complementary metal oxide semiconductor
- CCD charge coupled device
- the camera 31 corresponds to an image pickup section (image pickup circuitry).
- a first projection lens group 38 , a second projection lens group 39 , a beam splitter 40 , and the image pickup lens section (image pickup lens group) 33 are disposed in the lens holding section 34 .
- the first projection lens group 38 includes a plurality of lenses and is disposed in the lower end portion 35 b of the main body portion 35 .
- the second projection lens group 39 includes a plurality of lenses and is disposed in the upper end portion 35 a of the main body portion 35 .
- the first and second projection lens groups 38 and 39 constitute the projection lens section 32 functioning as the projection lens system of the projection optical system 20 .
- the first and second projection lens groups 38 and 39 have an optical axis O 2 substantially parallel with the extending direction of the main body portion 35 .
- the lens unit 30 is attached to the unit holding section 24 so that the optical axis O 2 of the first and second projection lens groups 38 and 39 (i.e., the projection lens section 32 ) coincides with the optical axis O 1 of the projection optical system 20 .
- the first and second projection lens groups 38 and 39 can magnify light incident along the optical axis O 2 (O 1 ) with a predetermined magnification and form an image on the screen 12 .
- the predetermined magnification is not limited and may be a desired magnification, for example, a magnification of 10, 20, 50, 100, or the like.
- the configuration is not limited to that of the projection lens section 32 , and, for example, a single lens instead of the plural lenses may be disposed in a position of each of the first and second projection lens groups 38 and 39 .
- the beam splitter 40 is disposed between the first and second projection lens groups 38 and 39 and on the optical axis O 2 . In other words, the beam splitter 40 is disposed on the optical axis O 1 of the projection optical system 20 .
- the beam splitter 40 transmits one portion of light passing through the first projection lens group 38 as a first split beam L 1 and emits the first split beam L 1 along the optical axis O 2 toward the second projection lens group 39 .
- the beam splitter 40 reflects another portion of the light passing through the first projection lens group 38 as a second split beam L 2 and emits the second split beam L 2 toward the camera 31 connected with the connection portion 36 .
- the beam splitter 40 is composed of, for example, a half mirror.
- a beam splitting element capable of controlling the amount of each of the first and second split beams L 1 and L 2 may be used.
- a dichroic mirror or the like capable of splitting into the first and second split beams L 1 and L 2 in accordance with the wavelength range may be used. For example, such control can be exercised that the color component of the projected image of the workpiece displayed on the screen 12 differs from the color component of the picked-up image of the workpiece taken by the camera 31 .
- the image pickup lens section 33 is disposed between the camera 31 and the beam splitter 40 in the connection portion 36 of the lens holding section 34 .
- the image pickup lens section 33 guides the second split beam L 2 generated through splitting at the beam splitter 40 to the image pickup device 37 of the camera 31 . That is, the image pickup lens section 33 reduces the second split beam L 2 with a magnification corresponding to the magnifying power of the projection lens section 32 and forms an image of the workpiece on the image pickup device 37 .
- the magnification (reduction ratio) of the image pickup lens section 33 is determined such that an image of the workpiece is appropriately formed on the image pickup device 37 .
- the disclosure is not limited to the case in which the image pickup lens section 33 reduces the second split beam L 2 .
- the second split beam L 2 may be magnified by the image pickup lens section 33 and guided to the image pickup device 37 .
- a projection lens section 32 of high magnification provides a narrower field of view for projection.
- An image of the field of view formed with the second split beam L 2 generated through splitting at the beam splitter 40 may be smaller than the effective area of the image pickup device 37 .
- the image pickup lens section 33 magnifies the second split beam L 2 .
- the projection lens section 32 of high magnification provides a narrower field of view for projection but better resolution of a projected image.
- high resolution is required for measurement in which a projected image of the screen 12 is locally taken, for example, it is effective to magnify the field of view smaller than the area capable of being taken by the image pickup device 37 with a high magnification and project the image.
- the first projection lens group 38 , the beam splitter 40 , and the image pickup lens section 33 constitute an image pickup optical system.
- the second split beam L 2 travels along an optical axis O 3 of the image pickup optical system and is incident on the image pickup device 37 .
- the camera 31 can take an image of the workpiece.
- the image pickup lens section 33 may have any configuration and is provided with at least one lens.
- the image pickup lens section 33 may be designed appropriately to match the design of the first projection lens group 38 .
- the image pickup optical system may also have any configuration, and a desired optical path of the second split beam L 2 may be designed.
- FIG. 7 is a schematic bottom view of an example configuration of the ring illuminator 26 .
- the ring illuminator 26 includes a ring-shaped main body portion 27 and a plurality of light sources 28 disposed on the main body portion 27 .
- the ring illuminator 26 is attached to the lens unit 30 so that the main body portion 27 surrounds the lower end portion 35 b of the lens unit 30 .
- the light sources 28 are composed of, for example, light emitting diodes (LED); however, no such limitation is intended.
- the number of the light sources 28 and the wavelength of emitted light are not limited, and a desired design may be used.
- the lens holding section 34 , the beam splitter 40 , and the camera 31 are integrally configured as the lens unit 30 that can be detachably attached to the projection apparatus 10 .
- This configuration facilitates positioning of the beam splitter 40 and the camera 31 and the like, and allows the beam splitter 40 to be readily disposed on the optical axis O 1 of the projection optical system 20 .
- the integrated configuration eliminates the need of camera adjustment and the like in measuring the workpiece and thus exhibits excellent usability and high measurement workability.
- the lens unit 30 of this embodiment can be used as an add-on, no additional mechanism for equipping the beam splitter 40 , the image pickup lens section 33 , and the camera 31 is required to be prepared, resulting in cost reduction.
- a plurality of lens units 30 can be prepared for projection lens sections 32 of different magnifications, and that by using an appropriate one of the lens units 30 , a projected image magnified with a desired magnification can be projected on the screen 12 . A picked-up image of the workpiece at that time can be acquired simultaneously. That is, the lens unit 30 can be used instead of the existing lens unit 90 .
- the ring illuminator section 25 is also integrated with the lens holding section 34 , so that illuminating light can be efficiently radiated to the workpiece only by attaching the lens unit 30 . This configuration prevents the apparatus from being complex.
- FIG. 8 is a front view of the head portion 17 with the screen 12 disposed thereon.
- FIG. 9 is a schematic view of an example of the measurement GUI 61 displayed on the monitor apparatus 60 .
- a workpiece is placed on the stage 13 , and the ring illuminator section 25 is turned on.
- the ring illuminator section 25 emits illuminating light toward the workpiece, and reflected light thereof is incident on the lens unit 30 .
- the first split beam L 1 passing through the first projection lens group 38 , the beam splitter 40 , and the second projection lens group 39 is magnified with a predetermined magnification and projected on the screen 12 of the head portion 17 .
- a projected image P 1 of the workpiece is displayed on the screen 12 as illustrated in FIG. 8 .
- the user operates the X-axis handle 84 and the Y-axis handle 85 illustrated in FIG. 3 to move the stage 13 .
- This operation can move the projected image P 1 displayed on the screen 12 .
- a scale display section 29 is disposed below the screen 12 .
- the scale display section 29 displays an X scale value (X coordinate value) and a Y scale value (Y coordinate value) corresponding to movement of the projected image P 1 of the workpiece. These scale values are used to perform various types of measurement.
- the stage 13 is moved to position a point J of the projected image P 1 illustrated in FIG. 8 on the reference line 18 b of the screen 12 .
- the X and Y scale values are subjected to zero setting.
- the stage 13 is moved in the X direction to position a point K of the projected image P 1 on the reference line 18 b .
- the inner diameter of the workpiece in the X direction can be measured.
- the second split beam L 2 passing through the first projection lens group 38 , the beam splitter 40 , and the image pickup lens section 33 in the light incident on the lens unit 30 is received by the image pickup device 37 of the camera 31 .
- an image of the workpiece is taken to generate image pickup data of the workpiece.
- the image pickup data is sent to the data processing apparatus 50 , and the measurement GUI 61 is generated.
- the generated measurement GUI 61 is displayed on the monitor apparatus 60 .
- the displayed measurement GUI 61 contains, for example, a measurement window 62 corresponding to the screen 12 of the head portion 17 , the X and Y scale values, and an execution window 63 for executing various types of measurement. Note that a specific configuration of the measurement GUI 61 is not limited and may be designed in a desired manner.
- a picked-up image P 2 of the workpiece in the measurement window 62 is moved, and the X and Y scale values are updated.
- the position of the picked-up image P 2 and the X and Y scale values correspond to the position of the projected image P 1 displayed on the screen 12 and the X and Y scale values displayed on the scale display section 29 , respectively. It is to be understood that no such limitation is intended, and movement of the picked-up image P 2 and update of the X and Y scale values may be performed with reference to a different reference position.
- the user positions the center of the picked-up image P 2 of the workpiece in the vicinity of the center of the measurement window 62 .
- the execution window 63 is appropriately operated to automatically execute various types of measurement by the image measurement software 51 .
- the inner diameter from the point J to the point K in the X direction can be readily measured.
- the image measurement software 51 performs automatic measurement, so that even if the center of the picked-up image P 2 is not positioned exactly at the center of the measurement window 62 , for example, highly accurate measurement can be performed. Additionally, without moving the stage 13 at all, the inner diameter and the like can be measured on the basis of the picked-up image P 2 of the workpiece. Thus, high measurement workability is exhibited.
- FIG. 10 is a graph for comparing accuracy in dimension measurement using the projected image P 1 displayed on the screen 12 with accuracy in dimension measurement by the image measurement software 51 using the measurement GUI 61 .
- Three measurers measured the dimensions of the same measurement subject in the X direction and the Y direction ten times. The mean of repeatability ( 3 ⁇ ) of the three measurers was calculated for each of the X and Y directions, and a graph was prepared. As a result, measurement by the image measurement software 51 significantly reduced person-to-person variation in comparison with visual measurement. This indicates that measurement with the picked-up image P 2 of the workpiece exhibited significantly high measurement accuracy.
- FIGS. 11A and 11B are schematic views for describing measurement using a reference chart.
- a reference chart 5 is attached to the screen 12 of the head portion 17 .
- the dimension, angle, and the like of the workpiece can be measured. Additionally, it can be determined whether or not the dimension or the like of the workpiece is within tolerance.
- a plurality of types of reference charts 5 are prepared for measurement applications, and the user replaces the reference chart 5 with an appropriate one to be used.
- a desired reference chart image 6 can be displayed on the measurement window 62 of the measurement GUI 61 as illustrated in FIG. 11B . That is, the reference chart 5 is not required to be prepared actually.
- the reference chart image 6 can be displayed in a desired position to match the position of the picked-up image P 2 of the workpiece, so that positioning of the stage 13 is not required. Thus, significantly high workability is exhibited.
- the measurement system 100 includes the lens holding section 34 with which the lens unit 30 equipped with the camera 31 is detachably attached to the projection apparatus 10 .
- the beam splitter 40 is positioned on the optical axis O 1 of the projection optical system 20 , and an image of the workpiece is taken on the basis of the second split beam L 2 generated through splitting at the beam splitter 40 .
- This configuration enables observation of the projected image P 1 of the workpiece displayed on the screen 12 and the picked-up image P 2 of the workpiece at the same time. Measurement by the image measurement software 51 can also be performed on the basis of the picked-up image P 2 .
- the projection apparatus 10 has its own function, the function of an image measurement apparatus performing measurement on the basis of the picked-up image P 2 of the workpiece can be added. Thus, the measurement accuracy and measurement workability can be improved.
- the lens unit 30 can be readily used as an add-on to an existing projection apparatus 10 , so that the function of the image measurement apparatus can be added to the projection apparatus 10 at relatively low cost.
- the camera 31 equipped in the lens unit 30 can take an image of the workpiece in projecting an image of the workpiece.
- the picked-up image P 2 of the workpiece can be acquired with high precision independently of the measurement environment. In other words, variation in image quality and the like of the picked-up image P 2 due to variation in the measurement environment can be prevented, and an image can be taken stably.
- the beam splitter 40 is disposed in the vicinity of the projection lens system magnifying an image of the workpiece, light before diffusion of the light beam be emitted as the second split beam L 2 toward the image pickup optical system.
- the image pickup lens section 33 forming an image of the second split beam L 2 on the image pickup device 37 can be reduced in size.
- FIG. 12 is a schematic view of an example configuration of an image pickup apparatus according to another embodiment.
- the lens unit 30 integrally configured with the lens holding section 34 holding the projection lens section 32 is described as one embodiment of the image pickup apparatus.
- the image pickup apparatus 230 illustrated in FIG. 12 can be attached to and detached from a lens unit 290 that holds a projection lens section 232 and that is not equipped with a camera. That is, a beam splitter 240 , an image pickup lens section 233 , and a camera 231 are integrally configured as a unit detachably attached to the lens unit 290 . Note that the lens unit 290 is typically attached to and detached from a projection apparatus; however, no such limitation is intended, and the lens unit 290 may be fixed.
- a base section 275 holding the beam splitter 240 and the image pickup lens section 233 is attached to the lens unit 290 .
- the beam splitter 240 is positioned on the optical axis O 1 of the projection optical system.
- reflected light of a workpiece is split into a first split beam L 1 and a second split beam L 2 .
- the projection lens section 232 magnifies the first split beam L 1 , and an image of the first split beam L 1 is formed on the screen. Thus, a projected image of the workpiece is displayed.
- the second split beam L 2 travels along the optical axis O 3 of the image pickup optical system and is received by an image pickup device 237 of the camera 231 .
- a picked-up image of the workpiece can be generated. Consequently, similar to the above-described embodiment, the projected image P 1 of the workpiece displayed on the screen 12 and the picked-up image P 2 of the workpiece can be observed at the same time. Measurement by the image measurement software can also be performed on the basis of the picked-up image P 2 . That is, the function of the image measurement apparatus can be added to the projection apparatus.
- the image pickup apparatus 230 can be readily attached to an existing projection apparatus.
- the function of the image measurement apparatus can be added to the projection apparatus 10 at relatively low cost.
- the image pickup apparatus 230 can be also readily attached to a desired lens unit 290 regardless of the magnification of the projection lens section 232 , for example.
- FIG. 13 is a schematic view of an example configuration of an image pickup apparatus according to still another embodiment.
- a lens unit 330 integrally configured with a lens holding section 334 holding a projection lens section 332 is used as an image pickup apparatus.
- the lens holding section 334 corresponds to a base section.
- the lens unit 330 includes a light source section 370 disposed at a connection portion 336 connected with a camera 331 and a beam splitter 371 disposed on the optical axis O 3 of the image pickup optical system.
- the light source section 370 is composed of, for example, an LED, and emits illuminating light toward the beam splitter 371 .
- the beam splitter 371 emits light emitted from the light source section 370 along the optical axis O 3 of the image pickup optical system toward a beam splitter 340 disposed on the optical axis O 1 of the projection optical system, as illuminating light L 3 .
- the illuminating light L 3 being part of the light emitted from the light source section 370 thus reversely travels through the image pickup optical system and is radiated along the optical axis O 1 of the projection optical system to a workpiece. This configuration readily enables coaxial epi-illumination.
- the beam splitter 340 disposed on the optical axis O 1 of the projection optical system corresponds to a first beam splitter.
- the beam splitter 371 disposed on the optical axis O 3 of the image pickup optical system corresponds to a second beam splitter.
- the optical axis O 3 of the image pickup optical system corresponds to the optical axis of an optical system guiding a second split beam L 2 generated through splitting at the first beam splitter 340 to an image pickup device 337 . Note that in the example illustrated in FIG. 13 , part of the image pickup optical system corresponds to the aforementioned optical system.
- the light source section 370 and the beam splitter 371 function as an illuminator section radiating light to the workpiece when the lens holding section 334 is attached.
- the light source section and the beam splitter for epi-illumination illustrated in FIG. 13 may be equipped to the image pickup apparatus 230 illustrated in FIG. 12 .
- the image pickup optical system corresponds to an optical system guiding the second split beam L 2 generated through splitting at the beam splitter 240 to the image pickup device 237 .
- the image pickup apparatus according to the present technique can be attached to and detached from the projection apparatus and can be used as an add-on to an existing projection apparatus.
- the image pickup apparatus according to the present technique fixed to the projection apparatus or including an additional holding mechanism as the unit holding section is also included in the image pickup apparatus, the optical measurement apparatus, and the measurement system according to the present technique.
- These configurations also enable measurement on the basis of a projected image of a subject displayed on the screen and a picked-up image of the subject. That is, both the function of the projection apparatus and the function of the image measurement apparatus can be achieved. Thus, the measurement accuracy and measurement workability can be improved.
- the beam splitter may be disposed in any position in the projection optical system.
- the beam splitter disposed in the vicinity of the projection lens section as described above is advantageous in that the apparatus can be reduced in size; however, the beam splitter may be disposed in another position.
- the projection apparatus 10 corresponds to a measurement section (measurement apparatus), and the data processing apparatus 50 corresponds to a measurement processing section (measurement processing apparatus).
- the monitor apparatus 60 corresponds to a display section.
- An apparatus including all these components may be configured as an optical measurement apparatus according to the present technique. Additionally, an apparatus in which the measurement section and the measurement processing section are integrally configured or an apparatus in which the measurement section and the display section are integrally configured may be configured as an optical measurement apparatus according to the present technique.
- the projection apparatus is exemplified as the optical measurement apparatus. No such limitation is intended, and the present technique can be applied to a desired optical measurement apparatus projecting an image of a subject on a screen.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
-
- Patent Document 1: JP 2008-261721 A
- L1 First split beam
- L2 Second split beam
- L3 Illuminating light
- O1 Optical axis of projection optical system
- O2 Optical axis of projection lens section
- O3 Optical axis of image pickup optical system
- P1 Projected image
- P2 Picked-up image
- 5 Reference chart
- 6 Reference chart image
- 10 Projection apparatus
- 12 Screen
- 20 Projection optical system
- 25 Ring illuminator section
- 30, 330 Lens unit
- 31, 231, 331 Camera
- 32, 232, 332 Projection lens section
- 33, 233 Image pickup lens section
- 34, 334 Lens holding section
- 37, 237, 337 Image pickup device
- 40, 240, 340, 371 Beam splitter
- 50 Data processing apparatus
- 51 Image measurement software
- 60 Monitor apparatus
- 61 Measurement GUI
- 100 Measurement system
- 230 Image pickup apparatus
- 275 Base section
- 370 Light source section
Claims (9)
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2017134569A JP6928803B2 (en) | 2017-07-10 | 2017-07-10 | Imaging device |
JP2017-134569 | 2017-07-10 | ||
JPJP2017-134569 | 2017-07-10 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20190011823A1 US20190011823A1 (en) | 2019-01-10 |
US11119395B2 true US11119395B2 (en) | 2021-09-14 |
Family
ID=64665981
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/031,406 Active US11119395B2 (en) | 2017-07-10 | 2018-07-10 | Image pickup apparatus, optical measurement apparatus, and measurement system |
Country Status (4)
Country | Link |
---|---|
US (1) | US11119395B2 (en) |
JP (1) | JP6928803B2 (en) |
CN (1) | CN109238164B (en) |
DE (1) | DE102018004788A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN209543035U (en) * | 2019-03-04 | 2019-10-25 | 深圳光峰科技股份有限公司 | Luminance detection device, light-source system and projection device |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6082865A (en) * | 1997-07-24 | 2000-07-04 | Semiconductor Energy Laboratory Co., Ltd. | Projection type display device with image pickup function and communication system |
US20080062683A1 (en) * | 2006-09-07 | 2008-03-13 | Belliveau Richard S | Theatre light apparatus incorporating LED tracking system |
JP2008261721A (en) | 2007-04-12 | 2008-10-30 | Mitsutoyo Corp | Optical measuring apparatus |
US20100238141A1 (en) * | 2009-03-19 | 2010-09-23 | Sanyo Electric Co., Ltd. | Projection display apparatus, writing/drawing board, and projection system |
US20110122327A1 (en) * | 2009-11-20 | 2011-05-26 | Sanyo Electric Co., Ltd. | Electronic device stand and image display system |
US20120007839A1 (en) * | 2010-06-18 | 2012-01-12 | Vantage Surgical Systems, Inc. | Augmented Reality Methods and Systems Including Optical Merging of a Plurality of Component Optical Images |
US20130286264A1 (en) * | 2012-04-27 | 2013-10-31 | Sony Corporation | Imaging device and projector unit |
US20140240573A1 (en) * | 2008-12-12 | 2014-08-28 | Texas Instruments Incorporated | Shared-field projection and imaging system |
US20150022783A1 (en) * | 2013-07-16 | 2015-01-22 | Lg Electronics Inc. | Display apparatus capable of projecting different images on display areas |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4971445A (en) * | 1987-05-12 | 1990-11-20 | Olympus Optical Co., Ltd. | Fine surface profile measuring apparatus |
JP2811318B2 (en) * | 1989-04-13 | 1998-10-15 | 東京エレクトロン株式会社 | Semiconductor inspection equipment |
US20080006268A1 (en) * | 2006-07-07 | 2008-01-10 | David Hanlon | Helmet Having A Filter |
US8090992B2 (en) * | 2008-07-25 | 2012-01-03 | Lsi Corporation | Handling of clustered media errors in raid environment |
US8669640B2 (en) * | 2009-07-14 | 2014-03-11 | Freescale Semiconductor, Inc. | Bipolar transistor |
JP5679560B2 (en) * | 2011-02-01 | 2015-03-04 | 株式会社キーエンス | Dimension measuring apparatus, dimension measuring method and program for dimension measuring apparatus |
DE102013210078B4 (en) * | 2013-05-29 | 2015-04-30 | Trumpf Werkzeugmaschinen Gmbh + Co. Kg | Apparatus, method and computer program product for determining the focus position of a high energy beam |
US9196135B2 (en) * | 2013-06-28 | 2015-11-24 | Immersion Corporation | Uniform haptic actuator response with a variable supply voltage |
-
2017
- 2017-07-10 JP JP2017134569A patent/JP6928803B2/en active Active
-
2018
- 2018-06-11 CN CN201810595166.0A patent/CN109238164B/en active Active
- 2018-06-14 DE DE102018004788.2A patent/DE102018004788A1/en active Pending
- 2018-07-10 US US16/031,406 patent/US11119395B2/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6082865A (en) * | 1997-07-24 | 2000-07-04 | Semiconductor Energy Laboratory Co., Ltd. | Projection type display device with image pickup function and communication system |
US20080062683A1 (en) * | 2006-09-07 | 2008-03-13 | Belliveau Richard S | Theatre light apparatus incorporating LED tracking system |
JP2008261721A (en) | 2007-04-12 | 2008-10-30 | Mitsutoyo Corp | Optical measuring apparatus |
US20140240573A1 (en) * | 2008-12-12 | 2014-08-28 | Texas Instruments Incorporated | Shared-field projection and imaging system |
US20100238141A1 (en) * | 2009-03-19 | 2010-09-23 | Sanyo Electric Co., Ltd. | Projection display apparatus, writing/drawing board, and projection system |
US20110122327A1 (en) * | 2009-11-20 | 2011-05-26 | Sanyo Electric Co., Ltd. | Electronic device stand and image display system |
US20120007839A1 (en) * | 2010-06-18 | 2012-01-12 | Vantage Surgical Systems, Inc. | Augmented Reality Methods and Systems Including Optical Merging of a Plurality of Component Optical Images |
US20130286264A1 (en) * | 2012-04-27 | 2013-10-31 | Sony Corporation | Imaging device and projector unit |
US20150022783A1 (en) * | 2013-07-16 | 2015-01-22 | Lg Electronics Inc. | Display apparatus capable of projecting different images on display areas |
Non-Patent Citations (1)
Title |
---|
Combined Chinese Office Action and Search Report dated Jan. 29, 2021 in Patent Application No. 201810595166.0 (with English language translation), 19 pages. |
Also Published As
Publication number | Publication date |
---|---|
JP2019015660A (en) | 2019-01-31 |
JP6928803B2 (en) | 2021-09-01 |
DE102018004788A1 (en) | 2019-01-10 |
CN109238164B (en) | 2022-01-04 |
CN109238164A (en) | 2019-01-18 |
US20190011823A1 (en) | 2019-01-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20210026000A1 (en) | Methods and Systems for LIDAR Optics Alignment | |
US9341465B2 (en) | Dimension measuring apparatus, dimension measuring method, and program for dimension measuring apparatus | |
US10088301B2 (en) | Image measurement device | |
US9046498B2 (en) | Board inspection apparatus using multiple cameras | |
US10088302B2 (en) | Image measurement device | |
US20150241683A1 (en) | Image Measurement Device | |
US20230368362A1 (en) | Image measurement apparatus | |
JP2014106094A (en) | Shape measurement device | |
US11119395B2 (en) | Image pickup apparatus, optical measurement apparatus, and measurement system | |
JP7154069B2 (en) | Image inspection device | |
JP2010281626A (en) | Device for inspecting optical characteristic | |
JP7152223B2 (en) | Image measuring device | |
JP6635892B2 (en) | Magnifying observation device | |
JP6654979B2 (en) | Magnifying observation device | |
US20230368363A1 (en) | Image measurement apparatus | |
US12013525B2 (en) | Magnified observation apparatus | |
US12013230B2 (en) | Three-dimensional shape measuring apparatus | |
US10753725B2 (en) | Measuring apparatus and method for controlling the illumination for a measuring apparatus | |
JP6635893B2 (en) | Magnifying observation device | |
JP2020086298A (en) | Magnifying observation device | |
JP6654980B2 (en) | Magnifying observation device | |
CN117053700A (en) | Image measuring apparatus | |
CN117053682A (en) | Image measuring apparatus | |
CN117053680A (en) | Image measuring apparatus and touch detector | |
CN117053678A (en) | Image measuring apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MITUTOYO CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:KATO, RYUSUKE;MORIUCHI, EISUKE;REEL/FRAME:046307/0288 Effective date: 20180709 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction |