WO2021188995A1 - Intelligent method of tracking focus in machine vision applications - Google Patents
Intelligent method of tracking focus in machine vision applications Download PDFInfo
- Publication number
- WO2021188995A1 WO2021188995A1 PCT/US2021/023316 US2021023316W WO2021188995A1 WO 2021188995 A1 WO2021188995 A1 WO 2021188995A1 US 2021023316 W US2021023316 W US 2021023316W WO 2021188995 A1 WO2021188995 A1 WO 2021188995A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- focus position
- compensated
- adjustable variable
- lens assembly
- lens
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 116
- 238000003384 imaging method Methods 0.000 claims abstract description 108
- 230000006399 behavior Effects 0.000 claims description 88
- 230000006870 function Effects 0.000 claims description 34
- 238000012546 transfer Methods 0.000 claims description 28
- 230000008859 change Effects 0.000 claims description 26
- 230000015654 memory Effects 0.000 claims description 23
- 239000007788 liquid Substances 0.000 claims description 22
- 230000032683 aging Effects 0.000 claims description 16
- 238000004458 analytical method Methods 0.000 claims description 7
- 230000004044 response Effects 0.000 claims description 7
- 238000010408 sweeping Methods 0.000 claims description 7
- 230000008569 process Effects 0.000 description 63
- 238000004891 communication Methods 0.000 description 11
- 230000003287 optical effect Effects 0.000 description 10
- 238000010586 diagram Methods 0.000 description 9
- 230000008901 benefit Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000000712 assembly Effects 0.000 description 5
- 238000000429 assembly Methods 0.000 description 5
- 238000007689 inspection Methods 0.000 description 4
- 230000001902 propagating effect Effects 0.000 description 4
- 230000009471 action Effects 0.000 description 3
- 239000004065 semiconductor Substances 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 230000003139 buffering effect Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000000737 periodic effect Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 241000287531 Psittacidae Species 0.000 description 1
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000004075 alteration Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000003542 behavioural effect Effects 0.000 description 1
- 230000015556 catabolic process Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000006731 degradation reaction Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 230000002431 foraging effect Effects 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 238000007373 indentation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000004886 process control Methods 0.000 description 1
- 238000001303 quality assessment method Methods 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B13/32—Means for focusing
- G03B13/34—Power focusing
- G03B13/36—Autofocus systems
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/12—Fluid-filled or evacuated lenses
- G02B3/14—Fluid-filled or evacuated lenses of variable focal length
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/023—Mountings, adjusting means, or light-tight connections, for optical elements for lenses permitting adjustment
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
- G02B7/09—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification adapted for automatic focusing or varying magnification
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/02—Mountings, adjusting means, or light-tight connections, for optical elements for lenses
- G02B7/04—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification
- G02B7/10—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens
- G02B7/102—Mountings, adjusting means, or light-tight connections, for optical elements for lenses with mechanism for focusing or varying magnification by relative axial movement of several lenses, e.g. of varifocal objective lens controlled by a microcomputer
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B3/00—Focusing arrangements of general interest for cameras, projectors or printers
- G03B3/10—Power-operated focusing
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B43/00—Testing correct operation of photographic apparatus or parts thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/67—Focus control based on electronic image sensor signals
Definitions
- Machine vision is use of automated imaging-based inspection and analysis for such applications as part inspection, process control, and robot guidance.
- focusing distance of an imaging system is fixed. If necessary, the focus has to be manually adjusted to a particular distance to focus on an object of interest.
- manual focusing requires an external computer and display for an operator.
- an autofocus system can alleviate some of the limitations of manual focus, autofocus systems tend to be slow and cannot be used effectively in a moving system such as a conveyer belt.
- an autofocus algorithm may select a wrong object to focus on, which may result in a blurry image of an intended object of interest.
- liquid lens assemblies to help speed up autofocusing.
- liquid lens present an entirely new set of problems.
- the focus of a liquid lens focus will drift from its held position.
- longer refocusing delays (30-40ms for a full sweep) and the fact that there is no feedback
- using a Liquid Lens in fixed imaging poses particular challenges.
- the present invention is a computer-implemented method for tracking focus of an adjustable variable focus lens-based imaging system, the method comprises: identifying, in the imaging system, an initial fixed focus position of an adjustable variable focus lens assembly of the imaging system for capturing an image of an object; determining one or more focusing parameters of the adjustable variable focus lens assembly for the initial fixed focus position and comparing the one or more focusing parameters to a lens behavior model for the adjustable variable focus lens assembly; determining a compensated fixed focus position of the imaging system based on the comparison to the lens behavior model; and capturing, via the imaging system, at least one image of the object at the compensated fixed focus position.
- a method for tracking focus of an adjustable variable focus lens-based imaging system includes identifying, in the imaging system, an initial fixed focus position of an adjustable variable focus lens assembly of the imaging system for capturing an image of an object; and determining one or more focusing parameters of the adjustable variable focus lens assembly for the initial fixed focus position and comparing the one or more focusing parameters to a lens behavior model for the adjustable variable focus lens assembly.
- the method further includes determining a compensated fixed focus position of the imaging system based on the comparison to the lens behavior model; and capturing, via the imaging system, at least one image of the object at the compensated fixed focus position.
- the one or more focusing parameters includes at least one of time, current temperature of the adjustable variable focus lens assembly, diopter of the adjustable variable focus lens assembly, voltage associated with the initial fixed focus position, voltage sweep associated with the initial fixed focus position, and modulation transfer function of at least a portion of an image captured by the imaging system at the initial fixed focus position.
- the compensated fixed focus position of the imaging system based on the comparison to the lens behavior model is determined by identifying a focusing sweep range defined by a forward focus position forward of the initial fixed focus position and an aft focus position aft of the initial fixed focus position; determining a compensated forward focus position and a compensated aft focus position based on the comparison to the lens aging model; capturing, via the imaging system, a plurality of images of the object at focus positions at and/or between the compensated forward focus position and the compensated aft focus position; and determining the compensated fixed focus position as one of the focus positions.
- the initial fixed focus position is associated with an initial reference voltage
- determining the compensated fixed focus position of the imaging system includes: based on the comparison to the lens behavior model, determining a forward focus position voltage and an aft focus position voltage; capturing, via the imaging system, a plurality of images of the object at different focus positions by sweeping the imaging system across voltages at and/or between the forward focus position voltage and the aft focus position voltage; and determining the compensated fixed focus position as one of the different focus positions.
- the initial fixed focus position is associated with an initial reference voltage
- determining the compensated fixed focus position of the imaging system includes: identifying a focusing sweep voltage range defined by a forward focus position voltage corresponding to a forward focus position forward of the initial fixed focus position and by an aft focus position voltage corresponding to an aft focus position aft of the initial fixed focus position; determining a compensated forward focus position voltage and a compensated aft focus position voltage based on the comparison to the lens behavior model; capturing, via the imaging system, a plurality of images of the object at different focus positions by sweeping the imaging system across voltages at and/or between the forward focus position voltage and the aft focus position voltage, wherein the different focus positions are between +1 diopter and -1 diopter of a center focus position ; and determining the compensated fixed focus position as one of the different focus positions.
- the lens behavior model includes time based compensation data, temperature based compensation data, diopter based compensation data, voltage based compensation data, voltage sweep based compensation data, and/or modulation transfer function based compensation data.
- the adjustable variable focus lens assembly includes a liquid lens.
- the lens behavior model is an aging model that includes historical data for the one or more focusing parameters of the adjustable variable focus lens assembly.
- the lens behavior model is a thermal model that includes thermal data for the one or more focusing parameters of the adjustable variable focus lens assembly.
- the lens behavior model is a drift model that includes lens drift data for the one or more focusing parameters of the adjustable variable focus lens assembly.
- comparing the one or more focusing parameters to the lens behavior model includes; capturing a plurality of images of the object and identifying a feature of interest in the plurality of images; determining a contrast or modulation transfer function corresponding to the feature of interest for each of the plurality of images; determining a change in the contrast or the modulation transfer function between the plurality of images; and comparing the change in the contrast or the modulation transfer function to the lens behavior model and determining a change in the one or more focusing parameters corresponding to the change in the contrast or the modulation transfer function.
- an imaging system includes: an imaging assembly having an adjustable variable focus lens assembly; one or more processors; and a non-transitory machine-readable memory storing machine-readable instructions that, when executed by the one or more processors, cause the imaging system to: identify an initial fixed focus position of the adjustable variable focus lens assembly for capturing an image of an object; determine one or more focusing parameters of the adjustable variable focus lens assembly for the initial fixed focus position and compare the one or more focusing parameters to a lens behavior model for the adjustable variable focus lens assembly; determine a compensated fixed focus position of the imaging system based on the comparison to the lens behavior model; and capture at least one image of the object at the compensated fixed focus position.
- the imaging assembly is a barcode reader. In some examples, the imaging assembly is a machine vision system.
- a machine vision method includes: identifying, in a machine vision system having an adjustable variable focus lens assembly, one or more current operating conditions of the adjustable variable focus lens assembly, the adjustable variable focus lens assembly having a first operating parameter value set; comparing the one or more current operating conditions to a lens behavior model for the adjustable variable focus lens assembly; in response to the comparison, determining a compensated parameter value set for compensating for age related changes to the adjustable variable focus lens assembly; and capturing, via the machine vision system, at least one image of an object using the compensated parameter value set.
- a machine vision system including: an imaging assembly having an adjustable variable focus lens assembly; one or more processors; and a non- transitory machine-readable memory storing machine-readable instructions that, when executed by the one or more processors, cause the machine vision system to: identify one or more current operating conditions of the adjustable variable focus lens assembly, the adjustable variable focus lens assembly having a first operating parameter value set; compare the one or more current operating conditions to a lens behavior model for the adjustable variable focus lens assembly; and in response to the comparison, determine a compensated parameter value set for compensating for age related changes to the adjustable variable focus lens assembly; and capture, via the machine vision system, at least one image of an object using the compensated parameter value set.
- FIG. 1 illustrates a block diagram of a machine vision system for implementing example methods and/or operations described herein including techniques for tracking and adjusting of an adjustable variable focus lens assembly.
- FIG. 2 illustrates a block diagram of a flowchart representing an example process for tracking and adjusting of an adjustable variable focus lens assembly as may be implemented by the machine vision system of FIG. 1.
- FIG. 3 illustrates is a block diagram of a flowchart representing an example process for determining focusing parameters and comparing those focusing parameters to a lens behavior model as may be executed by the process in FIG. 2, in implementing example methods and/or operations described herein.
- FIG. 4 illustrates a block diagram of a flowchart representing an example process for determining a new focus position from a compensated focusing sweep range as may be executed by the process in FIG. 2, in implementing example methods and/or operations described herein.
- imaging systems such as machine vision systems rely upon fixed focus positions between an object and an image sensor to perform high resolution image analysis.
- Machine vision systems are often deployed to analyze extremely small features that require the use of high magnification of a feature of interest.
- the result is particularly true for variable focus lens assemblies, such as liquid lens.
- variable focus lens assemblies such as liquid lens.
- These lens assemblies allow for fine and relatively fast adjustment to a fixed focus position.
- these lens assemblies are susceptible to performance changes due to age (time), temperature, drift, lens quality.
- the focus position for a given drive voltage may change depending on temperature or the age of the liquid lens, for example.
- the focus position and focus operation of a variable focus lens assembly is tracked and compared to a lens behavior model.
- compensated new focus positions may be determined for the variable lens assemblies.
- focusing parameters for the variable focus lens assembly may be measured and compared against one or more lens behavior models.
- Example focusing parameters are measurable parameters of operation or function of the variable lens assembly, and include parameters such as current time, current temperature, diopter of the adjustable variable focus lens assembly, applied voltage, contrast of at least a feature of an image, a modulation transfer function (MTF) of at least a feature of an image.
- MTF modulation transfer function
- the tracking and compensation is performed using historical data on lens performance that is included in the lens behavior model, where such models may be aging models that indicate performance over time, thermal models that indicate performance at different temperatures, drift models that indicate performance under different positions, other models of lens performance, or any combination thereof.
- the present techniques provide periodic fine tuning of the fixed focus position of a variable lens assembly by adjusting a small window of focusing sweep based on measuring an image characteristic such as an optical merit function, like MTF or contrast.
- this focusing sweep is adjusted to compensate for changes in variable focus lens assembly performance as determined from the lens behavior model.
- the focusing sweep refers to a predefined, limited focusing range that is used in machine vision systems to compensate for errors and lens variation, while finding and maintaining a fixed focus position.
- this limited focusing sweep range may be adjusted to correct for aging effects, thermal effects, drift effects, etc. affecting a lens assembly.
- the forward and aft focus positions of the sweep may be corrected, as well as the midpoint frequency for the sweep range.
- the focusing sweep is +/-1 diopter of optical power.
- any number of optical merit functions or other focusing parameters may be used by the lens behavior model to determine new, compensated focus positions of a lens assembly.
- MTF is a measure of the ability of an optical system to transfer various levels of detail from object to image and demonstrates performance, which may be measured in terms of contrast or optical modulation.
- the present techniques compensate for short term lens performance changes (e.g., due to thermal changes) by adjusting small window focusing sweeps to more accurately determine focus position, while also compensating for long term lens performance changes, such as resulting from aging.
- FIG. 1 illustrates an example environment 100 capable of implementing operations of the example methods described herein, as may be represented by the flowcharts of the drawings that accompany this description.
- the environment 100 includes a machine vision system 102 where objects of interest (two of which are designated at reference numerals 104 and 106) are moved through a FOV 108 of the machine vision system 102 or placed in the FOV 108 for imaging and inspection.
- the objects of interest 104, 106 may be moving on a scanning surface 110 such as on a conveyor belt, along an assembly line, etc.
- the objects of interest 104, 106 may be moved continuously relative to the FOV 108 of the machine vision system 102, or moved in a discretized manner where at least part of the time an object of interest 104, 106 is held still for a period of time sufficient to allow one or more images to be captured of the object of interest 104, 106.
- the system 102 may be implemented in as a barcode reader, such as a handheld barcode reader or bi-optic barcode reading having a horizontal tower and a vertical platter each configured to perform barcode imaging.
- a barcode reader such as a handheld barcode reader or bi-optic barcode reading having a horizontal tower and a vertical platter each configured to perform barcode imaging.
- the example machine vision system 102 includes an imaging assembly 112 having any number and/or type(s) of imaging sensor 114 (e.g., a complementary metal-oxide semiconductor (CMOS) imaging array).
- imaging sensor 114 under control of, for example, a processor 116 captures one or more images of an object of interest 104, 106.
- CMOS complementary metal-oxide semiconductor
- the example imaging assembly 112 includes any number and/or type(s) of variable focus elements 118 positioned between the imaging sensor 114 and a window (not shown) of the machine vision system 102, and any number and/or type(s) of actuators 120 to activate, operate, etc. the variable focus elements 118 under the control of a focus controller 122.
- Example variable focus elements 118 include, but are not limited to, a liquid lens, a voice coil motor, etc.
- An example liquid lens is the Arctic 25 FH0-Z available form Parrot Drones SAS Confidential of France.
- Example actuators 120 include a focusing lens drive, a shift lens drive, a zoom lens drive, an aperture drive, angular velocity drive, voice coil motor drive, etc.
- the processor 116 sets one or more focusing parameters, two of which are designated at reference numbers 124 and 126, that the focus controller 122 uses to control the actuators 120. In this manner, the processor 116 can control the focus distance to an imaging plane of the imaging assembly 112 to an intended or needed focus distance.
- the imaging assembly 112 is configured such that if the imaging assembly 112 has an autofocus module or autofocus operation that the autofocus operation is disabled for at least one image capture operation and focus distance is controlled by the processor 116 via the focusing parameters 124, 126 for that image capture operation.
- objects of interest 104, 106 have one or more respective indicia, two of which are designated at reference numerals 104A and 106A.
- more than one indicia 104A, 106A is associated with an object of interest 104, 106.
- an indicia 104A, 106A may represent more than one focus distance for more than one object of interest 104, 106.
- the focus distances may be associated with different portions, parts, members, aspects, etc.
- An indicia 104A, 106A need not be positioned at the focus distance(s) represented by the indicia 104A, 106A.
- an indicia 104A, 106A may be sized and placed to be recognized without the use of auto-focus, the indicia 104A, 106A may be placed at a default focus distance the machine vision system 102 uses to image and identify indicia 104A, 106A, etc.
- Indicia 104A, 106A may be placed on an object of interest 104, 106, alongside an object of interest 104, 106, etc.
- Example indicia 104A, 106A include, but are not limited to, a barcode (one-dimensional (ID), two-dimensional (2D) or three-dimensional (3D)), a fiducial mark, direct part marking (DPM), or any other special designated pattern that may be used to convey information.
- ID one-dimensional
- 2D two-dimensional
- 3D three-dimensional
- DPM direct part marking
- the imaging assembly 112 is fixedly mounted at a known location and is selectively focusable on objects of interest 104, 106 that are different distances away from the known location based on focus distances encoded in indicia 104A, 106A.
- the imaging assembly 112 is moveably mounted and positionable (e.g., in one, two or three dimensions) at different known positions, and is focused on objects of interest 104, 106 that are different distances away relative to a current known position based on focus distances encoded in indicia 104A, 106A.
- an indicia 104A, 106A encodes imaging assembly position and focus distance(s).
- the indicia 104A, 106A may further encode other imaging properties such as zoom, aperture, etc.
- an indicia processing module 128 recognizes an indicia 104A, 106A in an image as a focus adjustment trigger, the indicia processing module 128 decodes the indicia 104A, 106A to obtain predetermined payload data or information encoded in the indicia 104A, 106A.
- Example payload data or information includes focus distances to imaging planes, size or dimensions of an object of interest 104, 106.
- the payload data or information may be encoded in the indicia 104A, 106A according to any past, present or future industry standard such as Code 39 barcodes, GS1 barcodes, Interleaved 2 of 5 (ITF) barcodes, etc.
- the processor 116 configures the imaging assembly 112 to each of the identified focus distances.
- the processor 116 queries a focusing parameter database 130 to obtain the focusing parameters 124, 126 corresponding to the focus distance identified by a captured indicia 104A, 106A.
- the known dimension(s) of an indicia 104A, 106A, the current known FOV, and the size of the indicia 104A, 106A in an image can be used to determine (e.g., calculate, estimate, etc.) the distance to the indicia 104A, 106A.
- the FOV is considered constant or fixed regardless of focus distance.
- the focus distance can be calibrated using a fixed focus and calibrated FOV, for example, the focus position is set to a particular distance and maintained in place during operation of the system 102. In some examples, as the system 102 is cycled off and back on, the system maintains (or returns to) to this same fixed focus distance.
- the processor 116 For each identified focus distance to an imaging plane (i.e., the focus position), the processor 116 writes, stores, etc. the corresponding focusing parameters 124, 126 to the imaging assembly 112, and controls the focus controller 122 to set the focus distance of the imaging assembly 112 according to the focusing parameters 124, 126, and fix (e.g., maintain, hold, lock, etc.) the focus position at a distance.
- the process 116 further tracks the focus of the variable focus elements 118 and compensates focus position, in accordance with the example methods described herein, as may be represented by the flowcharts of the drawings that accompany this description, including those of FIGS. 2-4.
- a lens behavior model 129 is provided and includes historical data and/or performance data, and in some examples algorithms, for comparing focusing parameters 126 and 124 to determine when adjustments to focus position are warranted to compensate for changes in performance of the elements 118.
- the lens behavior model 129 may compare any number of focusing parameters from the imaging system 112, including those controlling operating of the actuators 120, data from the focus controller 122, and feedback data from the variable focus elements 118.
- the processor 116 controls the imaging sensor 114 to capture one or more images of an object of interest 104, 106. Because the focus distance is known a priori to correspond to the object of interest 104, 106, a captured image will be properly focused for one or more desired aspects of the object of interest 104, 106, and non-desired aspects or other objects cannot result in improper focus.
- the number of images to capture is encoded in the indicia 104A, 106A. When a number of images is to be captured, the indicia 104A, 106A may further encode times between image captures to accommodate, for example, movement of a conveyor belt, assembly line, etc.
- the time duration that focusing parameters 124, 126 are held may be until another or subsequent indicia focus adjustment trigger is identified.
- the focus distance encoded in an indicia 104A, 106A can be used to set a starting focus distance for auto-focus to, for example, accommodate variations in object of interest to imaging sensor separation.
- the machine vision system 102 includes a computing assembly 132 that includes one or more processors (one of which is designated at reference numeral 116), program memory 134, random-access memory (RAM) 136, input/output (I/O) interfaces 138, and network interfaces 140, all of which are interconnected via an address/data bus 142.
- the program memory 134 may store software and/or instructions 144, which may be executed by the processor 116.
- Different portions of the example machine vision system 102 for example, the imaging assembly 112 and the computing assembly 132, may be implemented separately by different computing systems.
- the processor 116 and the focus controller 122 may be implemented as two different processors and/or controllers. However, in other examples, the processor 116 and the focus controller 122 are implemented by the same processor and/or controller.
- the processor 116 and the focus controller 122 of the illustrated example may be hardware, and may be semiconductor based (e.g., silicon based) devices.
- Example processors 116 and focus controller 122 include a programmable processor, a programmable controller, a graphics processing unit (GPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a programmable logic device (PLD), a field programmable gate array (FPGA), a field programmable logic device (FPLD), etc.
- the processor 116 implements the indicia processing module 128.
- the processor 116 implements instructions that inspect objects of interest 104, 106 using images taken based on focus distances determined from indicia 104A, 106A.
- the program memory 134 may include any number and/or type(s) of volatile and/or non volatile storage media or disks storing the software, machine- or computer-readable instructions, or computer- or machine-executable instructions 144, and the focusing parameter database 130.
- the software and instructions 144 may be executed by the processor 116 to implement the indicia processing module 128, and inspect objects of interest 104, 106 using images taken based on focus distances determined from indicia.
- the software and instructions 144 may be stored on separate non-transitory computer- or machine-readable storage mediums or disks, or at different physical locations.
- the memories 134, 136 include any number or type(s) of volatile or non-volatile non- transitory computer- or machine-readable storage media or disks, such as a semiconductor memory, a magnetically readable memory, an optically readable memory, a hard disk drive (HDD), an optical storage drive, a solid-state storage device, a solid-state drive (SSD), a read-only memory (ROM), a RAM, a compact disc (CD), a compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a Blu-ray disk, a redundant array of independent disks (RAID) system, a cache, a flash memory, or any other storage device or storage disk in which information may be stored for any duration (e.g., permanently, for an extended time period, for a brief instance, for temporarily buffering, for caching of the information, etc.).
- volatile or non-volatile non- transitory computer- or machine-readable storage media or disks such as a semiconductor memory, a magnetically
- non-transitory computer-readable medium is expressly defined to include any type of computer-readable storage device and/or storage disk and to exclude propagating signals and to exclude transmission media.
- non-transitory machine-readable medium is expressly defined to include any type of machine-readable storage device and/or storage disk and to exclude propagating signals and to exclude transmission media.
- the I/O interfaces 138 may include any number and/or type(s) of different types of I/O circuits or components that enable the processor 116 to communicate with peripheral I/O devices.
- Example I/O interfaces 138 include a universal serial bus (USB), a Bluetooth ® interface, a near field communication (NFC) interface, an infrared transceiver, and/or a PCI express interface.
- the peripheral I/O devices may be any desired type of I/O device such as a keyboard, a display 146 (a liquid crystal display (LCD), a cathode ray tube (CRT) display, a light emitting diode (LED) display, an organic light emitting diode (OLED) display, an in-place switching (IPS) display, a touch screen, etc.), a navigation device (a mouse, a trackball, a capacitive touch pad, a joystick, etc.), a speaker, a microphone, a printer, a button, a communication interface, an antenna, etc.
- a keyboard a keyboard
- a display 146 a liquid crystal display (LCD), a cathode ray tube (CRT) display, a light emitting diode (LED) display, an organic light emitting diode (OLED) display, an in-place switching (IPS) display, a touch screen, etc.
- a navigation device a mouse, a trackball, a capacitive
- the machine vision system 102 includes one or more network interfaces 140 for connecting the machine vision system 102 to a server 148. These devices may be connected via any suitable communication means, including wired and/or wireless connectivity components that implement one or more past, present or future industry communication protocol standards like, for example, a TCP/IP interface, a Wi-FiTM transceiver (according to the 802.11 family of standards), an Ethernet transceiver, a cellular network radio, a satellite network radio, a cable modem, a digital subscriber line (DSL) modem, a dialup modem, or any other suitable communication protocols or standards.
- a TCP/IP interface a Wi-FiTM transceiver (according to the 802.11 family of standards)
- an Ethernet transceiver a cellular network radio, a satellite network radio, a cable modem, a digital subscriber line (DSL) modem, a dialup modem, or any other suitable communication protocols or standards.
- DSL digital subscriber line
- the imaging assembly 112 is implemented separately from other parts of the machine vision system 102 (e.g., separately from the computing assembly 132) and is coupled to the other parts of the machine vision system 102 via the I/O interfaces 138 and/or the network interfaces 140.
- the other parts of the machine vision system 102 are implemented on a cloud-based platform at a remote location.
- FIG. 1 While an example machine vision system 102 is illustrated in FIG. 1, one or more of the elements, processes and/or devices illustrated in FIG. 1 may be combined, divided, re-arranged, omitted, eliminated and/or implemented in any other way.
- the processor 116 and the focus controller 122 may be implemented by the same programmable processor, programmable controller, GPU, DSP, an ASIC, a PLD, an FPGA, an FPLD, etc.
- the machine vision system 102 may include one or more elements, processes and/or devices in addition to, or instead of, those illustrated in FIG. 1, and/or may include more than one of any or all of the illustrated elements, processes and devices.
- the phrase "in communication,” including variations thereof, encompasses direct communication and/or indirect communication through one or more intermediary components, and does not require direct physical (e.g., wired) communication and/or constant communication, but rather additionally includes selective communication at periodic intervals, scheduled intervals, aperiodic intervals, and/or one-time events.
- the server 148 includes, among other things, program memory storing software or instructions that, when executed by a processor of the server 148 cause the server 148 to inspect objects of interest 104, 106 based on images taken by the machine vision system 102 using focus distances determined from indicia 104A, 106A.
- the server 148 may be located in the same location as the machine vision system 102. In other embodiments, server 148 (and/or other connected devices) may be located at a remote location, such as on a cloud-platform or other remote location. In still other embodiments, server 148 (and/or other connected devices) may be formed of a combination of local and cloud-based computers.
- a process 200 may be implemented by the machine vision system 102.
- the process 202 identifies an initial focus position of a variable focus lens assembly, such as for example, the variable focus elements 118 elements.
- the initial focus position may correspond to the focus position of the variable focus lens assembly upon startup of the system 100 or upon activation of an object imaging process for the machine vision system 102.
- a process 204 determines one or more focusing parameters for the adjustable variable focus lens assembly, where these focusing parameters may include settings for that variable focus lens assembly that result in the initial focus position.
- the process 204 may determine these focusing parameters from control signals sent by the focus controller 122 to the actuators 120 controlling the operation of the variable focus elements 118.
- the process 204 may determine the focusing parameters from feedback loop data of the actuators 120 indicating the position of a focusing lens drive, a shift lens drive, a zoom lens drive, an aperture drive, angular velocity drive, voice coil motor drive, or other drives controlling the position and operation of the variable focus elements 118.
- the process 202 may determine the focusing parameters from position sensors in the variable focus elements 118.
- Example focusing parameters include one or more of the current time, current temperature of the adjustable variable focus lens assembly, diopter of the adjustable variable focus lens assembly, applied voltage that sets the initial fixed focus position, and a voltage sweep associated with the initial fixed focus position (e.g., a range of voltages and the sweep up or sweep down in voltage that led to the current voltage).
- the focusing parameters may be optical parameters such as the optical contrast or modulation transfer function (MTF) of at least a portion of an image captured by the machine vision system 102.
- the contrast or MTF may correspond to a feature of interest in an image, such as the indicia 104A and 106A on objects 104 and 106, respectively.
- Example indicia include barcodes, DPMs, or fiducial markers on an object.
- Yet other features of interest may be edges on an object, protrusions on an object, and/or indentations on an object.
- the process 204 compares the focusing parameter(s) to a lens behavior model, which contains one or more models of the behavior of focusing parameters under different conditions.
- the lens behavior models may be data files that store different focusing parameters and different settings for those focusing parameters under different operating conditions of a machine vision system, such as different operating conditions of the adjustable variable focus lens assembly (collectively this data form various types of compensation data).
- a lens behavior model includes time compensation data, temperature compensation data, diopter compensation data, voltage compensation data, voltage sweep compensation data, and/or modulation transfer function compensation data.
- the lens behavior model includes executable algorithms for receiving focusing parameter values and performing a prediction to determine expected values for the focusing parameters.
- the algorithm may use historical focusing parameter value data and a regression model to determine expected values, for example.
- the lens behavior model is a lens aging model that contains historical data and/or predicted future values for focusing parameters, as a function of operating time for a lens assembly.
- Operating time may be measured in reference to a universal time system, such as days, weeks, months, years.
- Operating time may be an accumulated time representing the time in which an imaging system was turned on and operating.
- Operating time may be a number of cycles of operation, such as the number of times a variable focus lens assembly has its focus position adjusted.
- An example lens aging model compared at process 204 may include values for applied voltage versus fixed focus position as a function of operating time, thereby indicating changes in the applied voltage necessary to maintain a particular focus position as the variable focus lens assembly ages.
- the aging model may include time based modeling for any number of other focusing parameters as well.
- the lens behavior model compared at process 204 is a thermal model that contains thermal data for the one or more focusing parameters.
- a model may model changes in focusing parameter values as a function of temperature.
- the lens behavior model is a drift model that includes lens drift data for the one or more focusing parameters, indicating changes in the focusing parameters depending on the lens position, in particular depending on drift changes in lens position.
- the lens behavior model is a multidimensional model that contains modeling for multiple different variables, including, for example, aging dependence, thermal dependence, drift dependence, and/or any other model behaviors.
- a compensated fixed focus position is determined for the adjustable variable focus lens assembly, where the compensated fixed focus position represents the corrected focus position that the adjustable variable focus lens assembly is to be set at.
- This compensated fixed focus position may be determined by the lens behavior model, for example, where the determination includes a determination of the changes in focusing parameters that are to be used to achieve the new focus position.
- the process 202 determines the initial focus position of a liquid lens.
- the process 204 determines the focusing parameters that correspond to the initial focus position, such as the voltage as that has been applied to the liquid lens to achieve that initial focus position.
- the lens behavior model is then used by the process 204 to determine what the actual, desired focus position should be given changes in behavioral conditions of the lens. These changes can be a change in temperature, a change in age/time, and/or a change in drift position.
- the changes may result from a comparison of a current state of the machine vision system, such as its current temperature or current age/time, in comparison to the a baseline state, such as an initial startup of the machine vision system, a first time use of the machine vision system, a factory released state of the machine vision system, or some other baseline state.
- the baseline state could be the operating state at any previous point in time, including allowing for continuous monitoring of the operating state, and thus the focusing parameters of the liquid lens.
- the actual, desired focus position then becomes the new focus position correcting for changes between the operating state and the baseline state that the liquid lens should be set to achieve the desired focusing for imaging purposes.
- the process 206 determines this compensated fixed focus position and the compensated focusing parameters that will achieve that position.
- the process 208 sets the liquid lens according to those compensated focusing parameters and captures an image of the object at the compensated focus position.
- the process 200 has adjusted the focus position for the variable focus elements, thereby compensating for lens behavior.
- FIG. 3 illustrates is a process 300 that may be implemented by the process 204, in an example implementation.
- a process 302 a plurality of images of an object are received and a feature of interest in the plurality of images is identified.
- the images are preferably images captured under differently operating states of the machine vision system 102, for example, at different points in time or under different lens behavior conditions, such as a different temperatures, different focus positions, etc.
- the process 302 deploys imaging processing, feature identification, feature segmentation, and feature registration techniques to identify the feature of interest, in whole or in part, in each of the plurality of images.
- a process 304 uses an image characteristic (or multiple image characteristics) and then assess the feature of interest in each image using that image characteristic.
- the process 304 may use image contrast determined for all or part of the feature of interest or the MTF determined for all or part of the feature of interest, as the image characteristic. Contrast and MTF are example optical merit functions that can be used as image characteristics. Other image characteristics may be used.
- the contrast of the feature of interest may change under different operating states of the machine vision system, even with the adjustable variable focus lens assembly set to image an object at the same focus position for each of images.
- the images are analyzed to determine if there has been a change in the image characteristic across one or more of the images, that is, across one or more operating states of the machine vision system.
- the contrast or MTF for the feature of interest is compared to identify changes.
- a process 308 compares the change in the image characteristic, e.g., the contrast and/or the modulation transfer function of the feature of interest, to the lens behavior model and uses the lens behavior model to determine a change in the one or more focusing parameters corresponding to the change in the contrast or the modulation transfer function.
- the change in the one or more focusing parameters is then used to determine the compensated fixed focus position at the process 206.
- the machine vision system 102 is used to develop a lens behavior model to be used in determining future compensated focus positions.
- the machine vision system 102 may capture a plurality of images of an object and store values for one or more focusing parameters of the adjustable variable focus lens assembly for each image. With the images captured at different points in time and under different operating states, changes in the focusing parameter values provides portion of a behavior model for a lens.
- the machine vision system 102 may determine an image quality for all or some portion of the image. The machine vision system 102 may determine changes in that image quality across the plurality images, thereby providing another portion of a behavior model for a lens.
- the changes in focusing parameter values and the changes in image quality across multiple images are then used to generate the lens behavior model, where the type of lens behavior model (e.g., aging, thermal, drift, etc.) depends on which focusing parameter or parameters have values that changed corresponding to a change in image quality.
- image quality assessment may be made based on contrast or MTF, in some examples.
- the present techniques provide a valuable framework for performing small focus compensation in machine vision systems and other imaging systems that require high precision and that are susceptible to performance changes in operation of imaging focusing elements.
- the present techniques are capable of measuring focusing parameters comparing those to a lens behavior model and adjusting a variable focus lens assembly in small focusing adjustments on the orders of a few diopters or less.
- the compensation focusing may be determined from behavior models on aging, thermal conditions, drift, system boot status, system on/off status, or other factors. It is common in the camera industry to capture multiple images and automatically select the one with best quality.
- the present techniques avoid such brute force, guess work, and can intelligently track focusing and adjusting a focusing sweep based on a variety of lens behavior models, looking for features of interest in an image or image characteristics for an image, including features defined by a user, and tracking changes in those to adjust performance of a variable focus lens assembly, on the fly.
- the process 200 may be used to determine a compensated focusing sweep range, i.e., a new range of focuses that the machine vision system 102 will sweep through to image an object, such as the objects 104 and 106.
- a focusing sweep range is defined by a first focus position and a second, different focus position.
- One focus position may be considered the forward focus position and the other the aft focus position, and, in operation, the machine vision system 102 may sweep across the range of focuses defined by these forward and aft positions in capturing an image of the object. Unlike a conventional autofocus system, this focusing sweep range is very small, typically less than +/-1 diopter of optical power.
- the forward focus position and the aft focus position are defined relative to a fixed focus position and these forward and aft focus positions can change with changes in performance of the variable focus lens assembly.
- the present techniques may use lens behavior models to not only compensate for drift, temperature, time, etc. in determining compensated focus parameters and compensated focus positions, but to determine focus sweep ranges that will be used in finding the compensated focus position .
- the lens behavior model may be used to determine where a desired focus position is for a machine vision system, by determining, using a lens behavior model, a limited range of focusing positions to sweep across and assessing the resulting performance to identify a desired focus position, where that desired focus position may be a compensated position of a previously attempted focus position or an entirely new desired focus position, for example, as may result during startup of a machine vision system.
- a process 400 in FIG. 4 may be used.
- the process 400 may be implemented by the process 206 in FIG. 2.
- the process 400 may be implemented as a standalone process.
- a focusing sweep range is defined by selecting a forward focus position forward of the initial fixed focus position from process 202.
- an aft focus position aft of that initial fixed focus position may be defined.
- the process 402 may define this position by using a predetermined +/- focus position change, e.g., measured in millimeters forward and aft of the initial focus position.
- the process 402 may instead define a forward focus position voltage and an aft focus position voltage, where these two voltages are voltage applied to an adjustable variable focus lens assembly to achieve the forward and aft focus positions.
- the process 400 determines compensated forward and after focus positions to generate a new focusing sweep range, whereby this new focusing sweep range can be used to determine the ultimately compensated fixed focus position.
- a machine vision system may have such performance degradation over time such that a focus position initially used by the system to capture images mounted on a conveyor for inspection is no longer the correct focus position. Aging or changes in thermal conditions have altered the performance of a liquid lens or other variable focus element. Under normal operation, the machine vision system, in initially trying to find its fixed focus position for imaging may sweep through a small range from a forward focus position to an aft focus position.
- compensated forward and aft focus positions are determined.
- compensated forward and aft focus position voltages are determined from the comparison to the lens behavior model.
- the lens behavior model as a thermal model, may indicate the forward and aft focus positions should be both be compensated by +1 diopter and - 1 diopter, respectively, under a current temperature parameter value.
- the process 404 is optional, such that compensated forward and aft focus positions may not be determined, but instead, predetermined forward and aft focus positions may be used.
- a plurality of images of an object are then captured at different focus positions by sweeping the variable focus elements 118, e.g., a liquid lens, from the compensated forward focus position (or voltage) to the compensated aft focus position (or voltage).
- the images may be captured at the forward and aft focus positions and any number of other focus positions in between, depending the granularity of adjustments than can be one the variable focus elements 118 and the speed with which the system is to determine a fixed focus position.
- the capture of images may correspond to a focusing sweep voltage range, such that a compensated voltage is applied to the variable focus element 118 to sweep the focus thereof from the forward to the after focus positions.
- these images may be analyzed to identify an optimum image and the corresponding focus position for that optimum image. That focus position is then set by the process 408 as the compensated fixed focus potion (or voltage) that is to be used for future image capture.
- initial positions may be determined upon startup of a machine vision system.
- one or more focus parameters may be determined upon startup and compared to one or more lens behavior models, using a modified version of process 402.
- An initial forward focus position and an initial aft focus position then may be determined, e.g., at process 404, after which images of an object are captured at different focus position over the resulting focus sweep range, at process 406, and process 408 determines the initial fixed focus position corresponding to the desired one of those images.
- a machine vision method is therefore provided for a machine vision system having an adjustable variable focus lens assembly.
- One or more current operating conditions of the adjustable variable focus lens assembly are identified.
- the lens assembly has a first operating parameter value set.
- a compensated parameter value set is determined, for example, to compensate for age related changes to the lens assembly.
- the operating parameter value set may include fixed focus position, focusing sweep distance range, or voltage values or other values associated with controlling operation of an actuator and/or lens assembly.
- logic circuit is expressly defined as a physical device including at least one hardware component configured (e.g., via operation in accordance with a predetermined configuration and/or via execution of stored machine-readable instructions) to control one or more machines and/or perform operations of one or more machines.
- Examples of a logic circuit include one or more processors, one or more coprocessors, one or more microprocessors, one or more controllers, one or more digital signal processors (DSPs), one or more application specific integrated circuits (ASICs), one or more field programmable gate arrays (FPGAs), one or more microcontroller units (MCUs), one or more hardware accelerators, one or more special-purpose computer chips, and one or more system-on-a- chip (SoC) devices.
- Some example logic circuits, such as ASICs or FPGAs are specifically configured hardware for performing operations (e.g., one or more of the operations described herein and represented by the flowcharts of this disclosure, if such are present).
- Some example logic circuits are hardware that executes machine-readable instructions to perform operations (e.g., one or more of the operations described herein and represented by the flowcharts of this disclosure, if such are present). Some example logic circuits include a combination of specifically configured hardware and hardware that executes machine-readable instructions.
- the above description refers to various operations described herein and flowcharts that may be appended hereto to illustrate the flow of those operations. Any such flowcharts are representative of example methods disclosed herein. In some examples, the methods represented by the flowcharts implement the apparatus represented by the block diagrams. Alternative implementations of example methods disclosed herein may include additional or alternative operations. Further, operations of alternative implementations of the methods disclosed herein may combined, divided, re-arranged or omitted.
- the operations described herein are implemented by machine-readable instructions (e.g., software and/or firmware) stored on a medium (e.g., a tangible machine-readable medium) for execution by one or more logic circuits (e.g., processor(s)).
- the operations described herein are implemented by one or more configurations of one or more specifically designed logic circuits (e.g., ASIC(s)).
- the operations described herein are implemented by a combination of specifically designed logic circuit(s) and machine-readable instructions stored on a medium (e.g., a tangible machine-readable medium) for execution by logic circuit(s).
- each of the terms "tangible machine-readable medium,” “non-transitory machine-readable medium” and “machine-readable storage device” is expressly defined as a storage medium (e.g., a platter of a hard disk drive, a digital versatile disc, a compact disc, flash memory, read-only memory, random-access memory, etc.) on which machine-readable instructions (e.g., program code in the form of, for example, software and/or firmware) are stored for any suitable duration of time (e.g., permanently, for an extended period of time (e.g., while a program associated with the machine-readable instructions is executing), and/or a short period of time (e.g., while the machine-readable instructions are cached and/or during a buffering process)).
- machine-readable instructions e.g., program code in the form of, for example, software and/or firmware
- each of the terms “tangible machine-readable medium,” “non-transitory machine-readable medium” and “machine-readable storage device” is expressly defined to exclude propagating signals. That is, as used in any claim of this patent, none of the terms “tangible machine-readable medium,” “non-transitory machine-readable medium,” and “machine-readable storage device” can be read to be implemented by a propagating signal.
- any feature disclosed in any of the aforementioned embodiments/examples/implementations may be included in any of the other aforementioned embodiments/examples/implementations.
- the benefits, advantages, solutions to problems, and any element(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential features or elements of any or all the claims.
- the claimed invention is defined solely by the appended claims including any amendments made during the pendency of this application and all equivalents of those claims as issued.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Automatic Focus Adjustment (AREA)
- Studio Devices (AREA)
- Focusing (AREA)
- Lens Barrels (AREA)
Abstract
Description
Claims
Priority Applications (9)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020227035911A KR20220154794A (en) | 2020-03-19 | 2021-03-19 | Intelligent way to track focus in machine vision applications |
CN202180034813.0A CN115552331A (en) | 2020-03-19 | 2021-03-19 | Intelligent method for tracking focus in machine vision applications |
DE112021001751.9T DE112021001751T5 (en) | 2020-03-19 | 2021-03-19 | INTELLIGENT METHOD OF TRACKING A FOCUS IN MACHINE VISION APPLICATIONS |
JP2022555979A JP7478834B2 (en) | 2020-03-19 | 2021-03-19 | An intelligent method for focus tracking in machine vision applications. |
DE212021000344.3U DE212021000344U1 (en) | 2020-03-19 | 2021-03-19 | imaging system |
EP21772516.7A EP4121818A4 (en) | 2020-03-19 | 2021-03-19 | Intelligent method of tracking focus in machine vision applications |
GB2215073.4A GB2608763B (en) | 2020-03-19 | 2021-03-19 | Intelligent method of tracking focus in machine vision applications |
EP22202426.7A EP4170424A1 (en) | 2020-03-19 | 2021-03-19 | Intelligent method of tracking focus in machine vision applications |
MX2022011468A MX2022011468A (en) | 2020-03-19 | 2021-03-19 | Intelligent method of tracking focus in machine vision applications. |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/824,368 US11221461B2 (en) | 2020-03-19 | 2020-03-19 | Intelligent method of tracking focus in machine vision applications |
US16/824,368 | 2020-03-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021188995A1 true WO2021188995A1 (en) | 2021-09-23 |
Family
ID=77747936
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2021/023316 WO2021188995A1 (en) | 2020-03-19 | 2021-03-19 | Intelligent method of tracking focus in machine vision applications |
Country Status (9)
Country | Link |
---|---|
US (1) | US11221461B2 (en) |
EP (2) | EP4170424A1 (en) |
JP (1) | JP7478834B2 (en) |
KR (1) | KR20220154794A (en) |
CN (1) | CN115552331A (en) |
DE (2) | DE112021001751T5 (en) |
GB (1) | GB2608763B (en) |
MX (1) | MX2022011468A (en) |
WO (1) | WO2021188995A1 (en) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11367220B1 (en) * | 2020-08-27 | 2022-06-21 | Edge 3 Technologies | Localization of lens focus parameter estimation and subsequent camera calibration |
WO2024096460A1 (en) * | 2022-10-31 | 2024-05-10 | 삼성전자주식회사 | Electronic device for acquiring distance information, and operation method thereof |
US20240248283A1 (en) * | 2023-01-20 | 2024-07-25 | Cognex Corporation | Lens Assembly and Thermal Correction for Machine Vision System |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100243862A1 (en) * | 2009-03-31 | 2010-09-30 | Laurens Nunnink | System for adjusting focus of a liquid lens in a machine vision system |
US20170078549A1 (en) * | 2013-11-27 | 2017-03-16 | Mitutoyo Corporation | Machine vision inspection system and method for obtaining an image with an extended depth of field |
US20180046062A1 (en) * | 2014-10-03 | 2018-02-15 | Andra Motion Technologies Inc. | System and techniques for image capture |
US20190104302A1 (en) * | 2017-09-29 | 2019-04-04 | Mitutoyo Corporation | Variable focal length lens system with optical power monitoring |
Family Cites Families (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR19990015918A (en) * | 1997-08-12 | 1999-03-05 | 이해규 | Camera electronic shutter driving method and device |
JP2002228903A (en) | 2001-01-30 | 2002-08-14 | Olympus Optical Co Ltd | Optical unit |
ATE523854T1 (en) * | 2004-01-23 | 2011-09-15 | Intermec Ip Corp | AUTOFOCUS BARCODE SCANNERS AND THE LIKE WITH MICROFLUIDIC LENSES |
CN102436018A (en) * | 2006-12-15 | 2012-05-02 | 手持产品公司 | Apparatus and method comprising deformable lens element |
US8366001B2 (en) * | 2008-08-14 | 2013-02-05 | Varioptic S.A. | Calibration methods for imaging systems and imaging systems using such |
WO2011052770A1 (en) * | 2009-10-30 | 2011-05-05 | 株式会社オプトエレクトロニクス | Optical information reader |
JP6101074B2 (en) * | 2012-12-27 | 2017-03-22 | キヤノン株式会社 | Optical apparatus, image blur correction apparatus, imaging apparatus, control method therefor, program, and storage medium |
US10712529B2 (en) * | 2013-03-13 | 2020-07-14 | Cognex Corporation | Lens assembly with integrated feedback loop for focus adjustment |
DE102014104029B3 (en) * | 2014-03-24 | 2015-04-23 | Sick Ag | Optoelectronic device and method for taking sharp images |
US9977216B2 (en) * | 2016-07-14 | 2018-05-22 | Microsoft Technology Licensing, Llc | Passive lens athermalization using liquid lens |
US10679024B2 (en) | 2018-07-24 | 2020-06-09 | Cognex Corporation | System and method for auto-focusing a vision system camera on barcodes |
CN109521547B (en) * | 2018-12-21 | 2021-03-26 | 广州医软智能科技有限公司 | Variable-step-length automatic focusing method and system |
WO2020190602A1 (en) * | 2019-03-18 | 2020-09-24 | Corning Incorporated | Enhanced imaging device using liquid lens, embedded digital signal processor, and software |
-
2020
- 2020-03-19 US US16/824,368 patent/US11221461B2/en active Active
-
2021
- 2021-03-19 GB GB2215073.4A patent/GB2608763B/en active Active
- 2021-03-19 WO PCT/US2021/023316 patent/WO2021188995A1/en unknown
- 2021-03-19 EP EP22202426.7A patent/EP4170424A1/en active Pending
- 2021-03-19 CN CN202180034813.0A patent/CN115552331A/en active Pending
- 2021-03-19 DE DE112021001751.9T patent/DE112021001751T5/en active Pending
- 2021-03-19 DE DE212021000344.3U patent/DE212021000344U1/en active Active
- 2021-03-19 EP EP21772516.7A patent/EP4121818A4/en active Pending
- 2021-03-19 MX MX2022011468A patent/MX2022011468A/en unknown
- 2021-03-19 KR KR1020227035911A patent/KR20220154794A/en unknown
- 2021-03-19 JP JP2022555979A patent/JP7478834B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100243862A1 (en) * | 2009-03-31 | 2010-09-30 | Laurens Nunnink | System for adjusting focus of a liquid lens in a machine vision system |
US20170078549A1 (en) * | 2013-11-27 | 2017-03-16 | Mitutoyo Corporation | Machine vision inspection system and method for obtaining an image with an extended depth of field |
US20180046062A1 (en) * | 2014-10-03 | 2018-02-15 | Andra Motion Technologies Inc. | System and techniques for image capture |
US20190104302A1 (en) * | 2017-09-29 | 2019-04-04 | Mitutoyo Corporation | Variable focal length lens system with optical power monitoring |
Non-Patent Citations (1)
Title |
---|
See also references of EP4121818A4 * |
Also Published As
Publication number | Publication date |
---|---|
GB202215073D0 (en) | 2022-11-30 |
JP7478834B2 (en) | 2024-05-07 |
JP2023518256A (en) | 2023-04-28 |
KR20220154794A (en) | 2022-11-22 |
GB2608763A (en) | 2023-01-11 |
US20210294071A1 (en) | 2021-09-23 |
EP4121818A1 (en) | 2023-01-25 |
EP4170424A1 (en) | 2023-04-26 |
MX2022011468A (en) | 2023-02-14 |
CN115552331A (en) | 2022-12-30 |
EP4121818A4 (en) | 2024-05-01 |
US11221461B2 (en) | 2022-01-11 |
DE112021001751T5 (en) | 2022-12-29 |
GB2608763B (en) | 2024-08-28 |
DE212021000344U1 (en) | 2022-12-14 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP4170424A1 (en) | Intelligent method of tracking focus in machine vision applications | |
KR101975433B1 (en) | A method for calibrating an image capture device | |
JP5637995B2 (en) | Optical information reader | |
US8711275B2 (en) | Estimating optical characteristics of a camera component using sharpness sweep data | |
US11763412B2 (en) | Methods and systems to focus an imager for machine vision applications | |
US20080277480A1 (en) | Temperature compensated auto focus control for a microfluidic lens, such as auto focus control for a microfluidic lens of a bar code scanner | |
US10120163B2 (en) | Auto-focus method for a coordinate-measuring apparatus | |
US20140043701A1 (en) | Optical device, method of moving lens of optical device, and program for moving lens of optical device | |
US12026916B2 (en) | Method and apparatus for in-field stereo calibration | |
US11624606B2 (en) | Methods and apparatus for using range data to predict object features | |
KR20230004309A (en) | Method of detecting and correcting focus drift of variable focus lens for fixed focus applications | |
EP3434004B1 (en) | System and method for optimizing focus of an optical system passively | |
Pertuz et al. | Efficient focus sampling through depth-of-field calibration | |
JP6623419B2 (en) | Display control device, imaging device, smartphone, display control method, and program | |
WO2020110711A1 (en) | Inspection system, inspection method, and program | |
CN111344631A (en) | Specifying device, imaging device, specifying method, and program | |
CN111226433A (en) | Specifying device, control device, imaging device, specifying method, and program | |
KR101558981B1 (en) | Apparatus for auto focusing of camera | |
KR20140144973A (en) | Auto focus offset calibration method | |
JP2019203967A (en) | Display controller, imaging apparatus, method for controlling display, and program | |
Zhao et al. | Research on autofocusing method with automatic calibration for aerial camera based on imaging resolution |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21772516 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022555979 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 202215073 Country of ref document: GB Kind code of ref document: A Free format text: PCT FILING DATE = 20210319 |
|
ENP | Entry into the national phase |
Ref document number: 20227035911 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2021772516 Country of ref document: EP Effective date: 20221019 |