US10677681B2 - Inspection method and apparatus for testing cap sealing of container that involves calculating surface temperature of temperature sensor and comparing difference between measured temperature and the calculated temperature with threshold for correcting thermal image data - Google Patents

Inspection method and apparatus for testing cap sealing of container that involves calculating surface temperature of temperature sensor and comparing difference between measured temperature and the calculated temperature with threshold for correcting thermal image data Download PDF

Info

Publication number
US10677681B2
US10677681B2 US15/306,337 US201615306337A US10677681B2 US 10677681 B2 US10677681 B2 US 10677681B2 US 201615306337 A US201615306337 A US 201615306337A US 10677681 B2 US10677681 B2 US 10677681B2
Authority
US
United States
Prior art keywords
camera
temperature
value
temperature sensor
image data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active, expires
Application number
US15/306,337
Other versions
US20190195724A1 (en
Inventor
Seoung Je JO
Jae Hun PARK
Boo Han LEE
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Coglix Co Ltd
Original Assignee
Coglix Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Coglix Co Ltd filed Critical Coglix Co Ltd
Assigned to COGLIX CO.LTD. reassignment COGLIX CO.LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: JO, SEOUNG JE, LEE, BOO HAN, PARK, JAE HUN
Publication of US20190195724A1 publication Critical patent/US20190195724A1/en
Application granted granted Critical
Publication of US10677681B2 publication Critical patent/US10677681B2/en
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01MTESTING STATIC OR DYNAMIC BALANCE OF MACHINES OR STRUCTURES; TESTING OF STRUCTURES OR APPARATUS, NOT OTHERWISE PROVIDED FOR
    • G01M3/00Investigating fluid-tightness of structures
    • G01M3/38Investigating fluid-tightness of structures by using light
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/0022Radiation pyrometry, e.g. infrared or optical thermometry for sensing the radiation of moving bodies
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02Constructional details
    • G01J5/026Control of working procedures of a pyrometer, other than calibration; Bandwidth calculation; Gain control
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/02Constructional details
    • G01J5/07Arrangements for adjusting the solid angle of collected radiation, e.g. adjusting or orienting field of view, tracking position or encoding angular position
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/10Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/10Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors
    • G01J5/20Radiation pyrometry, e.g. infrared or optical thermometry using electric radiation detectors using resistors, thermistors or semiconductors sensitive to radiation, e.g. photoconductive devices
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J5/48Thermography; Techniques using wholly visual means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N17/00Diagnosis, testing or measuring for television systems or their details
    • H04N17/002Diagnosis, testing or measuring for television systems or their details for television cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/20Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only
    • H04N23/23Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from infrared radiation only from thermal infrared radiation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J5/00Radiation pyrometry, e.g. infrared or optical thermometry
    • G01J2005/0077Imaging

Definitions

  • the present invention relates to an inspection method and apparatus, and more particularly, to a method and apparatus for inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera.
  • IR infrared
  • Induction sealing which is known as cap sealing, is a non-contact method of heating a metallic disk to hermetically seal the top of plastic and glass containers. This sealing process takes place after the container has been filled, for example, tablets, and capped.
  • a closure is supplied to a bottler with an aluminum foil liner already inserted.
  • a typical induction liner is multilayered.
  • the top layer spaced apart from an opening of the container is generally a paper pulp that is generally spot-glued to the cap.
  • the next layer is wax that is used to bond a layer of aluminum foil to the pulp.
  • the bottom layer is a polymer film laminated to the foil.
  • the container passes under an induction coil that emits an oscillating electromagnetic field.
  • the conductive aluminum foil liner begins to heat.
  • the heat melts the wax, which is absorbed into the pulp backing and releases the foil from the cap.
  • the polymer film also heats and flows onto the lip of the container.
  • the polymer creates a bond with the container resulting in a hermetically sealed product. While neither the container nor its contents are negatively affected, this process is performed within a few seconds or faster. It is possible to overheat the foil causing damage to the seal layer or any protective barriers. This could result in faulty seals, even weeks after the initial sealing process,
  • thermography based systems In order to detect a defect in sealing, various thermography based systems have been suggested and the systems are most based on processing of thermal image data of cap sealing photographed by an infrared (IR) camera or IR imaging camera.
  • IR infrared
  • the IR camera or IR imaging camera detects energy of an IR wavelength range and converts the energy to an image. All objects emit an IR ray and an object having a higher temperature emits a larger amount of IR. Accordingly, an IR image may be understood to be a thermal image.
  • the IR camera may include a cooled type and an uncooled type.
  • the cooled type IR camera is sensitive to a wavelength range of about 1 ⁇ m to about 5 ⁇ m and the uncooled IR camera is sensitive to a wavelength range of about 7 ⁇ m to about 13 ⁇ m.
  • Factory calibration of an IR camera is performed by a manufacturer. In this process, the IR camera has a calibration table or a calibration file suitable for a particular temperature range.
  • the present invention provides an inspection method and apparatus, which may improve confidence of thermal image data when an infrared (IR) image is obtained by using an IR camera and the thermal image data corresponding to the obtained IR image is stored or inspected.
  • IR infrared
  • the present invention provides an inspection method and apparatus, which may notify a user of an abnormal operation of an IR camera, a case of exceeding a calibration temperature range of an IR camera, or a case in which the current situation is inappropriate for an inspection in an inspection system using an IR camera.
  • a method of inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera including measuring a temperature by using a temperature sensor located within a field of view (FOV) of the IR camera, calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value.
  • IR infrared
  • the method may further include outputting a notification corresponding to a rapid temperature change through a display portion of an apparatus when the difference value between the first value and the second value is greater than the certain threshold value.
  • the method may further include outputting a notification indicating that a state of the IR camera is abnormal through a display portion of an apparatus when the difference value between the first value and the second value is greater than the certain threshold value.
  • the method may further include outputting a notification indicating that a correction range of the IR camera is exceeded through a display portion of an apparatus when the difference value between the first value and the second value is greater than the certain threshold value.
  • the certain threshold value may be differently set according to whether the IR camera is a cooled type or an uncooled type.
  • the certain threshold value may be differently set according to accuracy and range of correction of the IR camera.
  • the certain threshold value may be differently set according to noise equivalent temperature difference of the IR camera.
  • the certain threshold value may be a value between about 0.01 and about 5.0 in terms of Celsius temperature.
  • a non-transitory computer readable storage medium having stored thereon a program, which when executed by a computer, performs the method of inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera, the method including measuring a temperature by using a temperature sensor located within a field of view (FOV) of the IR camera, calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value.
  • IR infrared
  • an apparatus for inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera including the IR camera photographing the cap sealing of the container, a temperature sensor located within a field of view (FOV) of the IR camera and measuring a temperature, and a controller calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value.
  • IR infrared
  • the temperature sensor may be located within the FOV by being connected to a support member that extends downwardly from a position adjacent to the IR camera.
  • the apparatus may further include a display portion that displays the thermal image data obtained by photographing the cap sealing of the container and the thermal image data of the temperature sensor, in which, when the difference value between the first value and the second value is greater than the certain threshold value, the controller outputs through the display portion a notification corresponding to a rapid temperature change, a notification indicating that a state of the IR camera is abnormal, or a notification indicating that a correction range of the IR camera is exceeded.
  • the certain threshold value may be differently set according to whether the IR camera is a cooled type or an uncooled type, accuracy and range of correction of the IR camera, or noise equivalent temperature difference of the IR camera.
  • the certain threshold value may be a value between about 0.01 and about 5.0 in terms of Celsius temperature.
  • the inspection method and apparatus may improve confidence of thermal image data when an infrared (IR) image is obtained by using an IR camera and the thermal image data corresponding to the obtained IR image is stored or inspected.
  • IR infrared
  • the present invention provides an inspection method and apparatus, which may notify a user of an abnormal operation of an IR camera, a case of exceeding a calibration temperature range of an IR camera, or a case in which the current situation is inappropriate for an inspection in an inspection system using an IR camera.
  • FIG. 1 is a schematic view of an overall system according to an embodiment.
  • FIGS. 2 and 3 are schematic views of an inspection apparatus of FIG. 1 .
  • FIG. 4 is an exemplary view of thermal image data indicating a temperature sensor photographed by an infrared (IR) camera.
  • IR infrared
  • FIG. 5 is an exemplary view of thermal image data of cap sealing photographed by the IR camera.
  • FIG. 6 is a schematic view of an inspection apparatus according to another embodiment.
  • FIG. 7 is a flowchart of an inspection method according to another embodiment.
  • FIG. 8 is a flowchart of an inspection method according to another embodiment.
  • the expressions such as “A or B,” “at least one of A and/or B,” or “at least one or more of A and/or B” may include all available combinations of items listed together.
  • the expressions such as “A or B,” “at least one of A and B,” or “at least one of A or B” may signify all cases of (1) including at least one A, (2) including at least one B, or (3) including both of at least one A and at least one B.
  • first and second are used herein merely to describe a variety of constituent elements regardless of an order and/or importance and to distinguish one constituent element from another constituent element, but the constituent elements are not limited by the terms.
  • a first user device and a second user devise may denote different user devices regardless of an order and/or importance.
  • a first constituent element may be referred to as a second constituent element, and vice versa.
  • constituent element e.g., a first constituent element
  • another constituent element e.g., a second constituent element
  • the constituent element contacts or is connected to the other constituent element directly or through at least one of other constituent elements, e.g., a third constituent element.
  • a constituent element e.g., a first constituent element
  • the constituent element should be construed to be directly connected to another constituent element without any other constituent element, e.g., a third constituent element, interposed therebetween.
  • Other expressions, such as, “between” and “directly between”, describing the relationship between the constituent elements may be construed in the same manner.
  • the expression “configured to” may be interchangeable with an expression such as “suitable for”, “having the capacity to”, “designed to”, “adapted to”, “made to”, or “capable of”.
  • the expression “configured to” does not necessarily signify one that is “specifically designed to” in hardware. Instead, in some situations, the expression “configured to” may signify one that is “capable of” performing a function with other device or parts.
  • an expression “a processor configured to perform functions A, B, and C” may signify an exclusive processor, for example, an embedded processor, for performing the functions or a generic-purpose processor, for example, a central processing unit (CPU) or an application processor (AP), capable of performing the functions by executing one or more software programs stored in a memory device.
  • an exclusive processor for example, an embedded processor, for performing the functions or a generic-purpose processor, for example, a central processing unit (CPU) or an application processor (AP), capable of performing the functions by executing one or more software programs stored in a memory device.
  • CPU central processing unit
  • AP application processor
  • FIG. 1 is a schematic view of an overall system 100 according to an embodiment.
  • the overall system 100 may include a capping machine 105 for attaching a cap on a container 1 that is transferred along a process line, a sealing machine 110 for hermetically sealing the cap that is attached or placed on the container 1 , and an inspection apparatus 120 for inspecting cap sealing of the transferred container.
  • the inspection apparatus 120 may include a display or display portion 121 and an infrared (IR) camera 122 .
  • the inspection apparatus 120 may further include a multi-rejection structure that allows the container 1 determined to be a good product to continuously proceed along the process line, separately collects the container 1 determined to be a not good product in a collection box corresponding to Not Good (NG), and separately collects the container 1 determined to be a user check product in a collection box corresponding to User Check (UC).
  • NG Not Good
  • UC User Check
  • the good product, the not good product, and the user check product are determined by previously learning cap sealing of the container 1 according to the types of a good product and a not good product and, during an actual inspection, comparing thermal image data of the container 1 photographed by the IR camera 122 with the previously learned data, thereby classifying the products into the good product and the not good product. Furthermore, when the above operation is performed based on data learned by using machine learning, the operation may be expressed by confidence points and the good product, the not good product, and the user check product are determined based on a predefined confidence value range.
  • the current inspection product when the confidence value thereof is greater than the maximum confidence value, the current inspection product is determined to be a good product, when the confidence value thereof is less than the minimum confidence value, the current inspection product is determined to be a not good product, and when the confidence value thereof is between the maximum confidence value and the minimum confidence value, the current inspection product is determined to be a user check product.
  • the confidence value when the confidence value is ambiguous, the current inspection product is separately classified to be processed by user check, rather than forcedly determined to be a good product or a not good product with a low confidence.
  • the inspection apparatus 120 may predict inspection accuracy of cap sealing of a particular container through a setting process, before performing an actual inspection. For example, the predicted inspection accuracy may be notified to a user by predicting the inspection accuracy according to a result of the previous learning based on the types of a good product and a not good production.
  • the capping machine 105 places a cap on the container 1 transferred along the process line.
  • the sealing machine 110 may be a high frequency heat inducing (HFHI) unit.
  • the container 1 passing through the sealing machine 110 is transferred to the inspection apparatus 120 and is located within a field of view (FOV) of the IR camera 122 .
  • FOV field of view
  • the cap sealing of the container 1 is photographed by the IR camera 122
  • the photographed cap sealing is image-processed to generate thermal image data
  • the thermal image data is displayed on the display portion 121 .
  • the inspection apparatus 120 compares the thermal image data with the previously learned data and determines whether the cap sealing corresponding to the thermal image data is a good product, a not good product, or a user check product.
  • the inspection apparatus 120 may display on the display portion 121 a type of defect, for example, Overheat, Loosen, Damaged seal, or Underheat. Accordingly, it is possible to check in which process line of the entire process of the cap sealing of a container, for example, the capping machine 105 or the sealing machine 110 , an error occurred.
  • a type of defect for example, Overheat, Loosen, Damaged seal, or Underheat.
  • the inspection apparatus 120 may locate a temperature sensor within the FOV of the IR camera 122 , perform a comparison operation between a value of the temperature sensor and a temperature value calculated from thermal image data obtained by photographing the temperature sensor, and notify a user of temperature calibration and inspection environment of the IR camera 122 .
  • the above configuration is described below with reference to FIGS. 2 and 3 .
  • FIGS. 2 and 3 are schematic views of the inspection apparatus 120 of FIG. 1 .
  • a temperature sensor 210 is located within an FOV 200 of the IR camera 122 .
  • the temperature sensor 210 is supported by a support member 220 extending downwardly to be adjacent to the IR camera 122 .
  • the temperature sensor 210 may include a thermocouple, a resistance temperature detector (RTD) sensor, and a thermister.
  • the IR camera 122 may be a cooled type or an uncooled type, but not limited thereto.
  • a cooled type IR camera may include thermoelectric cooling (TE Type), Stirling cooling (closed cycle cooling), argon gas cooling, liquid nitrogen cooling (LN2) according to a cooling method, but not limited thereto.
  • the cooled type IR camera is generally sensitive to a wavelength range of about 1 ⁇ m to about 5 ⁇ m.
  • An uncooled type IR camera may be a microbolometric sensor, which is a sensor requiring no cooling at all, and may have merits of the same performance, low power consumption, and no maintenance and repair required.
  • the uncooled type IR camera is generally sensitive to a wavelength range of about 7 ⁇ m to about 13 ⁇ m.
  • FIG. 4 is an exemplary view of thermal image data indicating the temperature sensor 210 photographed by the IR camera 122 .
  • FIG. 5 is an exemplary view of thermal image data of cap sealing photographed by the IR camera 122 .
  • an image 400 indicating thermal image data obtained by photographing the temperature sensor 210 located within the FOV of the IR camera 122 is illustrated.
  • a thermal image data 500 obtained by photographing cap sealing of the container 1 and a thermal image data 510 obtained by photographing the temperature sensor 210 are displayed on the display portion 121 of the inspection apparatus 120 .
  • the inspection apparatus 120 compares a temperature value measured by the temperature sensor 210 with a temperature value based on the thermal image data 510 of the temperature sensor 210 photographed by the IR camera 122 , and corrects the thermal image data 500 obtained by photographing the cap sealing of the container 1 based on a result of the comparison. Furthermore, when a difference between the measured temperature value and the calculated temperature value is greater than a certain threshold value, the inspection apparatus 120 may display on the display portion 121 a notification of generation of a rapid temperature change, a notification of the IR camera 122 being in an abnormal state, or a notification of excess of a calibration range or a correction range of the IR camera 122 .
  • a user or an operator of the inspection apparatus 120 may not only recognize that accuracy of inspection is possibly lowered due to a current operation environment of the inspection apparatus 120 , but also improve confidence of the inspection apparatus 120 by operating the inspection apparatus 120 by waiting until the temperature difference is within a certain range or the temperature values match each other to a degree.
  • FIG. 6 is a schematic view of the inspection apparatus 120 according to another embodiment.
  • the inspection apparatus 120 may include a controller 600 , a temperature measurer 610 , a photographing controller 620 , a thermal image data corrector 630 , and an abnormality notifier 640 . Furthermore, the inspection apparatus 120 may further include the display portion 121 , the IR camera 122 , the temperature sensor 210 , and the support member 220 , which are illustrated in FIGS. 1 to 3 . Furthermore, although FIG. 6 illustrates that internal elements of the inspection apparatus 120 are separate from one another, the present disclosure is not limited thereto and functions of the internal elements may be integrally processed by the controller 600 , a processor, or CPU.
  • the controller 600 controls the overall operation of the inspection apparatus 120 .
  • the temperature measurer 610 converts data sensed by the temperature sensor 210 located within the FOV of the IR camera 122 to a temperature value.
  • the temperature measurer 610 may include an analog-to-digital (AD) converter for converting an actual temperature value sensed by the temperature sensor 210 to digital data.
  • AD analog-to-digital
  • the photographing controller 620 photographs the cap sealing of the container 1 located within the FOV and the temperature sensor 210 by controlling the IR camera 122 .
  • the controller 600 calculates a surface temperature of the temperature sensor 210 from the temperature value measured by the temperature measurer 610 and the thermal image data of the temperature sensor 210 obtained by photographing the temperature sensor 210 .
  • the controller 600 compares a difference value between the measured temperature value and the calculated temperature value with a certain threshold value.
  • the threshold value may be determined freely or according to the properties of the inspection apparatus 120 .
  • the threshold value may be a value between 0.01 and 5.0 in terms of Celsius temperature.
  • the threshold value may be differently determined according to whether the IR camera 122 is of a cooled type or an uncooled type, the accuracy and state of calibration, and noise equivalent temperature difference (NETD).
  • NETD noise equivalent temperature difference
  • the threshold value may be set to be about 0.5 for a cooled type and about 1.0 for an uncooled type, about 1.0 for a cooled type and about 2.0 for an uncooled type, or about 0.1 for a cooled type and about 2.0 for an uncooled type.
  • the thermal image data corrector 630 corrects the photographed thermal image data by referring to the calibration table of the IR camera 122 . Furthermore, the thermal image data corrector 630 corrects the thermal image data corresponding to the photographed cap sealing of the container 1 according to a result of the comparison by the controller 600 .
  • the abnormality notifier 640 may issue a notification when a difference value between the temperature value measured by the temperature sensor 210 and the temperature value based on the thermal image data of the temperature sensor 210 photographed by the IR camera 122 is relatively large, an ambient temperature is rapidly changes, a current situation is inappropriate for inspection, the IR camera 122 does not work properly, or the thermal image data of the photographed cap sealing exceeds a temperature range for calibration.
  • FIG. 7 is a flowchart of an inspection method according to another embodiment.
  • a temperature is measured by using a temperature sensor located within the FOV of an IR camera.
  • a surface temperature of the temperature sensor is calculated based on thermal image data of the temperature sensor photographed by the IR camera.
  • a difference value between a first value measured by the temperature sensor and a calculated second value is compared with a certain threshold value.
  • the threshold value may be a value between 0.01 and 5.0 in terms of Celsius temperature.
  • the threshold value may be differently determined according to whether the IR camera is of a cooled type or an uncooled type, the accuracy and state of calibration, and NETD.
  • the threshold value may be about 0.5 for a cooled type and about 1.0 for an uncooled type, about 1.0 for a cooled type and about 2.0 for an uncooled type, or about 0.1 for a cooled type and about 2.0 for an uncooled type.
  • the generation of inaccurate thermal image data according to a change in an ambient temperature of the IR camera, and an error of inspection according thereto, may be prevented, and also, the thermal image data may be corrected according to a calibration range of the IR camera. Accordingly, confidence of data in the inspection apparatus using the IR camera may be improved.
  • FIG. 8 is a flowchart of an inspection method according to another embodiment.
  • a temperature in the FOV of an IR camera is measured by using a temperature sensor.
  • the temperature sensor is photographed by using the IR camera.
  • a surface temperature of the temperature sensor is calculated.
  • an operation 806 it is determined whether a difference value between the two values is greater than a threshold value T. In other words, it is determined whether a difference value between the temperature value measured in the operation 800 and the temperature value calculated in the operation 804 is greater than the threshold value T.
  • the threshold value T may be freely determined.
  • the process returns to the operation 800 .
  • the difference value between the two values is greater than the threshold value T as a result of the determination of the operation 806 , it is notified that there is a temperature change.
  • a user or operator may be notified that checking a camera state is necessary, through a notification of IR camera's abnormal operation or a notification of excess of a calibration temperature range.
  • the apparatus described herein may comprise a processor, a memory for storing program data to be executed by the processor, a permanent storage such as a disk drive, a communications port for handling communications with external devices, and user interface devices, including a display, keys, etc.
  • these software modules may be stored as program instructions or computer readable code executable by the processor on a non-transitory computer-readable media such as read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices.
  • ROM read-only memory
  • RAM random-access memory
  • CD-ROMs compact discs
  • magnetic tapes magnetic tapes
  • floppy disks floppy disks
  • optical data storage devices optical data storage devices.
  • the computer readable recording media may also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. This media can be read by the computer, stored in the memory, and executed by the processor.
  • the present inventive concept may be described in terms of functional block components and various processing steps. Such functional blocks may be realized by any number of hardware and/or software components configured to perform the specified functions.
  • the present inventive concept may employ various integrated circuit (IC) components, e.g., memory elements, processing elements, logic elements, look-up tables, and the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices.
  • IC integrated circuit
  • the inventive concept may be implemented with any programming or scripting language such as C, C++, Java, assembler language, or the like, with the various algorithms being implemented with any combination of data structures, objects, processes, routines or other programming elements.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Toxicology (AREA)
  • Biomedical Technology (AREA)
  • General Health & Medical Sciences (AREA)
  • Radiation Pyrometers (AREA)

Abstract

In an inspection method and apparatus, when an infrared (IR) image is obtained by using an IR camera and thermal image data corresponding to the obtained IR image is stored or inspected, confidence of the thermal image data is improved.

Description

RELATED APPLICATIONS
This application is the national stage under 35 U.S.C. § 371 of International Application No. PCT/KR2016/011737, filed Oct. 19, 2016, the content of which is incorporated by reference herein in its entirety.
TECHNICAL FIELD
The present invention relates to an inspection method and apparatus, and more particularly, to a method and apparatus for inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera.
BACKGROUND ART
Induction sealing, which is known as cap sealing, is a non-contact method of heating a metallic disk to hermetically seal the top of plastic and glass containers. This sealing process takes place after the container has been filled, for example, tablets, and capped. A closure is supplied to a bottler with an aluminum foil liner already inserted. A typical induction liner is multilayered. The top layer spaced apart from an opening of the container is generally a paper pulp that is generally spot-glued to the cap. The next layer is wax that is used to bond a layer of aluminum foil to the pulp. The bottom layer is a polymer film laminated to the foil. In existing capping technologies, after the cap or closure is applied to the opening of container, the container passes under an induction coil that emits an oscillating electromagnetic field. As the container passes under the induction coil, the conductive aluminum foil liner begins to heat. The heat melts the wax, which is absorbed into the pulp backing and releases the foil from the cap. The polymer film also heats and flows onto the lip of the container. When cooled, the polymer creates a bond with the container resulting in a hermetically sealed product. While neither the container nor its contents are negatively affected, this process is performed within a few seconds or faster. It is possible to overheat the foil causing damage to the seal layer or any protective barriers. This could result in faulty seals, even weeks after the initial sealing process,
In order to detect a defect in sealing, various thermography based systems have been suggested and the systems are most based on processing of thermal image data of cap sealing photographed by an infrared (IR) camera or IR imaging camera.
The IR camera or IR imaging camera detects energy of an IR wavelength range and converts the energy to an image. All objects emit an IR ray and an object having a higher temperature emits a larger amount of IR. Accordingly, an IR image may be understood to be a thermal image.
The IR camera may include a cooled type and an uncooled type. Generally, the cooled type IR camera is sensitive to a wavelength range of about 1 μm to about 5 μm and the uncooled IR camera is sensitive to a wavelength range of about 7 μm to about 13 μm. Factory calibration of an IR camera is performed by a manufacturer. In this process, the IR camera has a calibration table or a calibration file suitable for a particular temperature range.
When an appropriate calibration value is not loaded, incorrect temperature data is read. When a sudden temperature change of an external environment occurs, the temperature of an object to be photographed is changed. The physical quantity of temperature has the following properties. Even when a temperature value changes as a temperature environment is rapidly changed, the temperatures of objects in the environment are relatively slowly affected, compared to the temperature of the atmosphere, and the temperatures of the objects are changed. When the IR camera is in error, data is read and presented in an image, showing a different value from an actual temperature. These properties are important problems in the IR camera based image photographing performed through observation of thermal energy.
DETAILED DESCRIPTION OF THE INVENTION Technical Problem
The present invention provides an inspection method and apparatus, which may improve confidence of thermal image data when an infrared (IR) image is obtained by using an IR camera and the thermal image data corresponding to the obtained IR image is stored or inspected.
Furthermore, the present invention provides an inspection method and apparatus, which may notify a user of an abnormal operation of an IR camera, a case of exceeding a calibration temperature range of an IR camera, or a case in which the current situation is inappropriate for an inspection in an inspection system using an IR camera.
Technical Solution
According to an aspect of the present invention, there is provided a method of inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera, the method including measuring a temperature by using a temperature sensor located within a field of view (FOV) of the IR camera, calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value.
The method may further include outputting a notification corresponding to a rapid temperature change through a display portion of an apparatus when the difference value between the first value and the second value is greater than the certain threshold value.
The method may further include outputting a notification indicating that a state of the IR camera is abnormal through a display portion of an apparatus when the difference value between the first value and the second value is greater than the certain threshold value.
The method may further include outputting a notification indicating that a correction range of the IR camera is exceeded through a display portion of an apparatus when the difference value between the first value and the second value is greater than the certain threshold value.
The certain threshold value may be differently set according to whether the IR camera is a cooled type or an uncooled type.
The certain threshold value may be differently set according to accuracy and range of correction of the IR camera.
The certain threshold value may be differently set according to noise equivalent temperature difference of the IR camera.
The certain threshold value may be a value between about 0.01 and about 5.0 in terms of Celsius temperature.
According to an aspect of the present invention, there is provided a non-transitory computer readable storage medium having stored thereon a program, which when executed by a computer, performs the method of inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera, the method including measuring a temperature by using a temperature sensor located within a field of view (FOV) of the IR camera, calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value.
According to an aspect of the present invention, there is provided an apparatus for inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera, the apparatus including the IR camera photographing the cap sealing of the container, a temperature sensor located within a field of view (FOV) of the IR camera and measuring a temperature, and a controller calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value.
The temperature sensor may be located within the FOV by being connected to a support member that extends downwardly from a position adjacent to the IR camera.
The apparatus may further include a display portion that displays the thermal image data obtained by photographing the cap sealing of the container and the thermal image data of the temperature sensor, in which, when the difference value between the first value and the second value is greater than the certain threshold value, the controller outputs through the display portion a notification corresponding to a rapid temperature change, a notification indicating that a state of the IR camera is abnormal, or a notification indicating that a correction range of the IR camera is exceeded.
The certain threshold value may be differently set according to whether the IR camera is a cooled type or an uncooled type, accuracy and range of correction of the IR camera, or noise equivalent temperature difference of the IR camera.
The certain threshold value may be a value between about 0.01 and about 5.0 in terms of Celsius temperature.
Advantageous Effects
The inspection method and apparatus according to an embodiment may improve confidence of thermal image data when an infrared (IR) image is obtained by using an IR camera and the thermal image data corresponding to the obtained IR image is stored or inspected.
Furthermore, the present invention provides an inspection method and apparatus, which may notify a user of an abnormal operation of an IR camera, a case of exceeding a calibration temperature range of an IR camera, or a case in which the current situation is inappropriate for an inspection in an inspection system using an IR camera.
DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic view of an overall system according to an embodiment.
FIGS. 2 and 3 are schematic views of an inspection apparatus of FIG. 1.
FIG. 4 is an exemplary view of thermal image data indicating a temperature sensor photographed by an infrared (IR) camera.
FIG. 5 is an exemplary view of thermal image data of cap sealing photographed by the IR camera.
FIG. 6 is a schematic view of an inspection apparatus according to another embodiment.
FIG. 7 is a flowchart of an inspection method according to another embodiment.
FIG. 8 is a flowchart of an inspection method according to another embodiment.
BEST MODE
As the inventive concept allows for various changes and numerous embodiments, embodiments will be illustrated in the drawings and described in detail in the written description. However, this is not intended to limit the present inventive concept to particular modes of practice, and it is to be appreciated that various modifications, equivalents, and/or alternatives that do not depart from the spirit and technical scope of the present inventive concept are encompassed in the present inventive concept. Like reference numerals refer to like elements throughout the specification regarding the description of the drawings.
In the present specification, it is to be understood that the terms such as “including,” “having,” and “comprising” are intended to indicate the existence of the features, numbers, steps, actions, components, parts, or combinations thereof disclosed in the specification, and are not intended to preclude the possibility that one or more other features, numbers, steps, actions, components, parts, or combinations thereof may exist or may be added.
In the present specification, the expressions such as “A or B,” “at least one of A and/or B,” or “at least one or more of A and/or B” may include all available combinations of items listed together. For example, the expressions such as “A or B,” “at least one of A and B,” or “at least one of A or B” may signify all cases of (1) including at least one A, (2) including at least one B, or (3) including both of at least one A and at least one B.
Terms such as “first” and “second” are used herein merely to describe a variety of constituent elements regardless of an order and/or importance and to distinguish one constituent element from another constituent element, but the constituent elements are not limited by the terms. For example, a first user device and a second user devise may denote different user devices regardless of an order and/or importance. For example, without departing from the right scope of the present inventive concept, a first constituent element may be referred to as a second constituent element, and vice versa.
In the present specification, when a constituent element, e.g., a first constituent element, is “(operatively or communicatively) coupled with/to” or is “connected to” another constituent element, e.g., a second constituent element, the constituent element contacts or is connected to the other constituent element directly or through at least one of other constituent elements, e.g., a third constituent element. Conversely, when a constituent element, e.g., a first constituent element, is described to “directly connect” or to be “directly connected” to another constituent element, e.g., a second constituent element, the constituent element should be construed to be directly connected to another constituent element without any other constituent element, e.g., a third constituent element, interposed therebetween. Other expressions, such as, “between” and “directly between”, describing the relationship between the constituent elements, may be construed in the same manner.
In the present specification, the expression “configured to” may be interchangeable with an expression such as “suitable for”, “having the capacity to”, “designed to”, “adapted to”, “made to”, or “capable of”. The expression “configured to” does not necessarily signify one that is “specifically designed to” in hardware. Instead, in some situations, the expression “configured to” may signify one that is “capable of” performing a function with other device or parts. For example, an expression “a processor configured to perform functions A, B, and C” may signify an exclusive processor, for example, an embedded processor, for performing the functions or a generic-purpose processor, for example, a central processing unit (CPU) or an application processor (AP), capable of performing the functions by executing one or more software programs stored in a memory device.
The terms used in the present inventive concept have been selected from currently widely used general terms in consideration of the functions in the present inventive concept. However, the terms may vary according to the intention of one of ordinary skill in the art, case precedents, and the advent of new technologies. Also, for special cases, meanings of the terms selected by the applicant are described in detail in the description section. Accordingly, the terms used in the present inventive concept are defined based on their meanings in relation to the contents discussed throughout the specification, not by their simple meanings.
FIG. 1 is a schematic view of an overall system 100 according to an embodiment.
Referring to FIG. 1, the overall system 100 may include a capping machine 105 for attaching a cap on a container 1 that is transferred along a process line, a sealing machine 110 for hermetically sealing the cap that is attached or placed on the container 1, and an inspection apparatus 120 for inspecting cap sealing of the transferred container. The inspection apparatus 120 according to the present embodiment may include a display or display portion 121 and an infrared (IR) camera 122. The inspection apparatus 120 may further include a multi-rejection structure that allows the container 1 determined to be a good product to continuously proceed along the process line, separately collects the container 1 determined to be a not good product in a collection box corresponding to Not Good (NG), and separately collects the container 1 determined to be a user check product in a collection box corresponding to User Check (UC).
The good product, the not good product, and the user check product are determined by previously learning cap sealing of the container 1 according to the types of a good product and a not good product and, during an actual inspection, comparing thermal image data of the container 1 photographed by the IR camera 122 with the previously learned data, thereby classifying the products into the good product and the not good product. Furthermore, when the above operation is performed based on data learned by using machine learning, the operation may be expressed by confidence points and the good product, the not good product, and the user check product are determined based on a predefined confidence value range. In other words, as a result of analysis of thermal image data of a current inspection product, when the confidence value thereof is greater than the maximum confidence value, the current inspection product is determined to be a good product, when the confidence value thereof is less than the minimum confidence value, the current inspection product is determined to be a not good product, and when the confidence value thereof is between the maximum confidence value and the minimum confidence value, the current inspection product is determined to be a user check product. In other words, when the confidence value is ambiguous, the current inspection product is separately classified to be processed by user check, rather than forcedly determined to be a good product or a not good product with a low confidence.
Furthermore, the inspection apparatus 120 according to the present embodiment may predict inspection accuracy of cap sealing of a particular container through a setting process, before performing an actual inspection. For example, the predicted inspection accuracy may be notified to a user by predicting the inspection accuracy according to a result of the previous learning based on the types of a good product and a not good production.
The capping machine 105 places a cap on the container 1 transferred along the process line. The sealing machine 110 may be a high frequency heat inducing (HFHI) unit.
The container 1 passing through the sealing machine 110 is transferred to the inspection apparatus 120 and is located within a field of view (FOV) of the IR camera 122. Under the control of the inspection apparatus 120, the cap sealing of the container 1 is photographed by the IR camera 122, the photographed cap sealing is image-processed to generate thermal image data, and the thermal image data is displayed on the display portion 121. Furthermore, the inspection apparatus 120 compares the thermal image data with the previously learned data and determines whether the cap sealing corresponding to the thermal image data is a good product, a not good product, or a user check product. Furthermore, even when the cap sealing is determined to be a not good product, the inspection apparatus 120 may display on the display portion 121 a type of defect, for example, Overheat, Loosen, Damaged seal, or Underheat. Accordingly, it is possible to check in which process line of the entire process of the cap sealing of a container, for example, the capping machine 105 or the sealing machine 110, an error occurred.
To increase confidence of the IR camera 122 according to a temperature change, the inspection apparatus 120 according to the present embodiment may locate a temperature sensor within the FOV of the IR camera 122, perform a comparison operation between a value of the temperature sensor and a temperature value calculated from thermal image data obtained by photographing the temperature sensor, and notify a user of temperature calibration and inspection environment of the IR camera 122. The above configuration is described below with reference to FIGS. 2 and 3.
FIGS. 2 and 3 are schematic views of the inspection apparatus 120 of FIG. 1.
Referring to FIGS. 2 and 3, a temperature sensor 210 is located within an FOV 200 of the IR camera 122. The temperature sensor 210 is supported by a support member 220 extending downwardly to be adjacent to the IR camera 122. The temperature sensor 210 may include a thermocouple, a resistance temperature detector (RTD) sensor, and a thermister.
The IR camera 122 may be a cooled type or an uncooled type, but not limited thereto. A cooled type IR camera may include thermoelectric cooling (TE Type), Stirling cooling (closed cycle cooling), argon gas cooling, liquid nitrogen cooling (LN2) according to a cooling method, but not limited thereto. The cooled type IR camera is generally sensitive to a wavelength range of about 1 μm to about 5 μm.
An uncooled type IR camera may be a microbolometric sensor, which is a sensor requiring no cooling at all, and may have merits of the same performance, low power consumption, and no maintenance and repair required. The uncooled type IR camera is generally sensitive to a wavelength range of about 7 μm to about 13 μm.
FIG. 4 is an exemplary view of thermal image data indicating the temperature sensor 210 photographed by the IR camera 122. FIG. 5 is an exemplary view of thermal image data of cap sealing photographed by the IR camera 122.
Referring to FIG. 4, an image 400 indicating thermal image data obtained by photographing the temperature sensor 210 located within the FOV of the IR camera 122 is illustrated.
Referring to FIG. 5, a thermal image data 500 obtained by photographing cap sealing of the container 1 and a thermal image data 510 obtained by photographing the temperature sensor 210 are displayed on the display portion 121 of the inspection apparatus 120.
The inspection apparatus 120 according to the present embodiment compares a temperature value measured by the temperature sensor 210 with a temperature value based on the thermal image data 510 of the temperature sensor 210 photographed by the IR camera 122, and corrects the thermal image data 500 obtained by photographing the cap sealing of the container 1 based on a result of the comparison. Furthermore, when a difference between the measured temperature value and the calculated temperature value is greater than a certain threshold value, the inspection apparatus 120 may display on the display portion 121 a notification of generation of a rapid temperature change, a notification of the IR camera 122 being in an abnormal state, or a notification of excess of a calibration range or a correction range of the IR camera 122.
Accordingly, a user or an operator of the inspection apparatus 120 may not only recognize that accuracy of inspection is possibly lowered due to a current operation environment of the inspection apparatus 120, but also improve confidence of the inspection apparatus 120 by operating the inspection apparatus 120 by waiting until the temperature difference is within a certain range or the temperature values match each other to a degree.
FIG. 6 is a schematic view of the inspection apparatus 120 according to another embodiment.
Referring to FIG. 6, the inspection apparatus 120 may include a controller 600, a temperature measurer 610, a photographing controller 620, a thermal image data corrector 630, and an abnormality notifier 640. Furthermore, the inspection apparatus 120 may further include the display portion 121, the IR camera 122, the temperature sensor 210, and the support member 220, which are illustrated in FIGS. 1 to 3. Furthermore, although FIG. 6 illustrates that internal elements of the inspection apparatus 120 are separate from one another, the present disclosure is not limited thereto and functions of the internal elements may be integrally processed by the controller 600, a processor, or CPU.
The controller 600 controls the overall operation of the inspection apparatus 120.
The temperature measurer 610 converts data sensed by the temperature sensor 210 located within the FOV of the IR camera 122 to a temperature value. For example, the temperature measurer 610 may include an analog-to-digital (AD) converter for converting an actual temperature value sensed by the temperature sensor 210 to digital data.
The photographing controller 620 photographs the cap sealing of the container 1 located within the FOV and the temperature sensor 210 by controlling the IR camera 122.
The controller 600 calculates a surface temperature of the temperature sensor 210 from the temperature value measured by the temperature measurer 610 and the thermal image data of the temperature sensor 210 obtained by photographing the temperature sensor 210. The controller 600 compares a difference value between the measured temperature value and the calculated temperature value with a certain threshold value. The threshold value may be determined freely or according to the properties of the inspection apparatus 120. Furthermore, the threshold value may be a value between 0.01 and 5.0 in terms of Celsius temperature. Furthermore, the threshold value may be differently determined according to whether the IR camera 122 is of a cooled type or an uncooled type, the accuracy and state of calibration, and noise equivalent temperature difference (NETD).
For example, the threshold value may be set to be about 0.5 for a cooled type and about 1.0 for an uncooled type, about 1.0 for a cooled type and about 2.0 for an uncooled type, or about 0.1 for a cooled type and about 2.0 for an uncooled type.
The thermal image data corrector 630 corrects the photographed thermal image data by referring to the calibration table of the IR camera 122. Furthermore, the thermal image data corrector 630 corrects the thermal image data corresponding to the photographed cap sealing of the container 1 according to a result of the comparison by the controller 600.
The abnormality notifier 640 may issue a notification when a difference value between the temperature value measured by the temperature sensor 210 and the temperature value based on the thermal image data of the temperature sensor 210 photographed by the IR camera 122 is relatively large, an ambient temperature is rapidly changes, a current situation is inappropriate for inspection, the IR camera 122 does not work properly, or the thermal image data of the photographed cap sealing exceeds a temperature range for calibration.
FIG. 7 is a flowchart of an inspection method according to another embodiment.
Referring to FIG. 7, in an operation 700, a temperature is measured by using a temperature sensor located within the FOV of an IR camera.
In an operation 702, a surface temperature of the temperature sensor is calculated based on thermal image data of the temperature sensor photographed by the IR camera.
In an operation 704, a difference value between a first value measured by the temperature sensor and a calculated second value is compared with a certain threshold value. The threshold value may be a value between 0.01 and 5.0 in terms of Celsius temperature. Furthermore, the threshold value may be differently determined according to whether the IR camera is of a cooled type or an uncooled type, the accuracy and state of calibration, and NETD. For example, For example, the threshold value may be about 0.5 for a cooled type and about 1.0 for an uncooled type, about 1.0 for a cooled type and about 2.0 for an uncooled type, or about 0.1 for a cooled type and about 2.0 for an uncooled type.
In an operation 706, the thermal image data corresponding to the cap sealing of a container obtained by the IR camera based on the measured first value.
In the inspection method according to an embodiment, the generation of inaccurate thermal image data according to a change in an ambient temperature of the IR camera, and an error of inspection according thereto, may be prevented, and also, the thermal image data may be corrected according to a calibration range of the IR camera. Accordingly, confidence of data in the inspection apparatus using the IR camera may be improved.
FIG. 8 is a flowchart of an inspection method according to another embodiment.
Referring to FIG. 8, in an operation 800, a temperature in the FOV of an IR camera is measured by using a temperature sensor.
In an operation 802, the temperature sensor is photographed by using the IR camera.
In an operation 804, a surface temperature of the temperature sensor is calculated.
In an operation 806, it is determined whether a difference value between the two values is greater than a threshold value T. In other words, it is determined whether a difference value between the temperature value measured in the operation 800 and the temperature value calculated in the operation 804 is greater than the threshold value T. The threshold value T may be freely determined.
When the difference value between the two values is not greater than the threshold value T as a result of the determination of the operation 806, the process returns to the operation 800.
When the difference value between the two values is greater than the threshold value T as a result of the determination of the operation 806, it is notified that there is a temperature change. For example, a user or operator may be notified that checking a camera state is necessary, through a notification of IR camera's abnormal operation or a notification of excess of a calibration temperature range.
The apparatus described herein may comprise a processor, a memory for storing program data to be executed by the processor, a permanent storage such as a disk drive, a communications port for handling communications with external devices, and user interface devices, including a display, keys, etc. When software modules are involved, these software modules may be stored as program instructions or computer readable code executable by the processor on a non-transitory computer-readable media such as read-only memory (ROM), random-access memory (RAM), CD-ROMs, magnetic tapes, floppy disks, and optical data storage devices. The computer readable recording media may also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion. This media can be read by the computer, stored in the memory, and executed by the processor.
All references, including publications, patent applications, and patents, cited herein are hereby incorporated by reference to the same extent as if each reference were individually and specifically indicated to be incorporated by reference and were set forth in its entirety herein.
The present inventive concept may be described in terms of functional block components and various processing steps. Such functional blocks may be realized by any number of hardware and/or software components configured to perform the specified functions. For example, the present inventive concept may employ various integrated circuit (IC) components, e.g., memory elements, processing elements, logic elements, look-up tables, and the like, which may carry out a variety of functions under the control of one or more microprocessors or other control devices. Similarly, where the elements of the present inventive concept are implemented using software programming or software elements, the inventive concept may be implemented with any programming or scripting language such as C, C++, Java, assembler language, or the like, with the various algorithms being implemented with any combination of data structures, objects, processes, routines or other programming elements. Functional aspects may be implemented in algorithms that are executed on one or more processors. Furthermore, the present inventive concept could employ any number of conventional techniques for electronics configuration, signal processing and/or control, data processing and the like. The words “mechanism,” “element,” “means,” and “configuration” are used broadly and are not limited to mechanical or physical embodiments, but can include software routines in conjunction with processors, etc.
The particular implementations shown and described herein are illustrative examples of the inventive concept and are not intended to otherwise limit the scope of the inventive concept in any way. For the sake of brevity, conventional electronics, control systems, software development and other functional aspects of the systems (and components of the individual operating components of the systems) may not be described in detail. Furthermore, the connecting lines, or connectors shown in the various figures presented are intended to represent functional relationships and/or physical or logical couplings between the various elements. It should be noted that many alternative or additional functional relationships, physical connections or logical connections may be present in a practical device. Moreover, no item or component is essential to the practice of the inventive concept unless the element is specifically described as “essential” or “critical”. It will be recognized that terms “comprising,” “including,” and “having,” as used herein, are specifically intended to be read as open-ended terms of art.
The use of terms “a” and “an” and “the” and similar referents in the context of describing the inventive concept (especially in the context of the following claims) are to be construed to cover both the singular and the plural. Furthermore, recitation of ranges of values herein are merely intended to serve as a shorthand method of referring individually to each separate value falling within the range, unless otherwise indicated herein, and each separate value is incorporated into the specification as if it were individually recited herein. Finally, the steps of all methods described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The use of any and all examples, or language (e.g., “such as”) provided herein, is intended merely to better illuminate the inventive concept and does not pose a limitation on the scope of the inventive concept unless otherwise claimed. Numerous modifications and adaptations will be readily apparent to those of ordinary skill in this art without departing from the spirit and scope of the inventive concept.

Claims (9)

The invention claimed is:
1. A method of inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera, the method comprising:
measuring a temperature by using a temperature sensor located within a field of view (FOV) of the IR camera;
calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera;
comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value;
correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value; and
displaying the thermal image data obtained by photographing the cap sealing of the container and the thermal image data of the temperature sensor,
wherein, when the difference value between the first value and the second value is greater than the certain threshold value, outputs (i) a notification corresponding to a temperature change, (ii) a notification indicating that a state of the IR camera is abnormal, or (iii) a notification indicating that a correction range of the IR camera is exceeded,
wherein the certain threshold value is differently set according to accuracy and range of correction of the IR camera.
2. The method of claim 1, wherein the certain threshold value is differently set according to whether the IR camera is a cooled type or an uncooled type.
3. The method of claim 1, wherein the certain threshold value is differently set according to noise equivalent temperature difference of the IR camera.
4. The method of claim 1, wherein the certain threshold value is a value between 0.01 and 5.0 in terms of Celsius temperature.
5. A non-transitory computer readable storage medium having stored thereon a program, which when executed by a computer, performs the method defined in claim 1.
6. An apparatus for inspecting cap sealing of a container transferred along a process line by using an infrared (IR) camera, the apparatus comprising:
the IR camera photographing the cap sealing of the container;
a temperature sensor located within a field of view (FOV) of the IR camera and measuring a temperature;
a display portion that displays the thermal image data obtained by photographing the cap sealing of the container and the thermal image data of the temperature sensor; and
a controller calculating a surface temperature of the temperature sensor based on thermal image data of the temperature sensor photographed by the IR camera, comparing a difference value between a first value measured by the temperature sensor and a second value that is calculated, with a certain threshold value, and correcting the thermal image data corresponding to the cap sealing of the container obtained by the IR camera based on the measured first value,
wherein, when the difference value between the first value and the second value is greater than the certain threshold value, the controller outputs through the display portion (i) a notification corresponding to a temperature change, (ii) a notification indicating that a state of the IR camera is abnormal, or (iii) a notification indicating that a correction range of the IR camera is exceeded,
wherein the certain threshold value is differently set according to accuracy and range of correction of the IR camera.
7. The apparatus of claim 6, wherein the temperature sensor is located within the FOV by being connected to a support member that extends downwardly from a position adjacent to the IR camera.
8. The apparatus of claim 6, wherein the certain threshold value is differently set according to whether the IR camera is a cooled type or an uncooled type, or noise equivalent temperature difference of the IR camera.
9. The apparatus of claim 6, wherein the certain threshold value is a value between 0.01 and 5.0 in terms of Celsius temperature.
US15/306,337 2016-10-19 2016-10-19 Inspection method and apparatus for testing cap sealing of container that involves calculating surface temperature of temperature sensor and comparing difference between measured temperature and the calculated temperature with threshold for correcting thermal image data Active 2037-01-16 US10677681B2 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/KR2016/011737 WO2018074621A1 (en) 2016-10-19 2016-10-19 Inspection method and apparatus

Publications (2)

Publication Number Publication Date
US20190195724A1 US20190195724A1 (en) 2019-06-27
US10677681B2 true US10677681B2 (en) 2020-06-09

Family

ID=62019541

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/306,337 Active 2037-01-16 US10677681B2 (en) 2016-10-19 2016-10-19 Inspection method and apparatus for testing cap sealing of container that involves calculating surface temperature of temperature sensor and comparing difference between measured temperature and the calculated temperature with threshold for correcting thermal image data

Country Status (4)

Country Link
US (1) US10677681B2 (en)
KR (1) KR102223770B1 (en)
AU (1) AU2016426890B2 (en)
WO (1) WO2018074621A1 (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110944951B (en) 2017-03-24 2022-09-27 康宁股份有限公司 System and method for measuring glass temperature during tube conversion
US10714364B2 (en) * 2017-08-31 2020-07-14 Taiwan Semiconductor Manufacturing Co., Ltd. Apparatus and method for inspecting wafer carriers
SG11202111848PA (en) * 2019-06-07 2021-12-30 Alcon Inc Method for determining whether a sealing area of a primary packaging container for an ophthalmic lens is unacceptable for properly sealing a foil thereto
KR102656079B1 (en) * 2020-11-23 2024-04-09 주식회사 엠테이크 Unit for error correction and object temperature measuring device with the same
US12060295B2 (en) 2021-05-24 2024-08-13 Corning Incorporated Converter systems and methods for controlling operation of glass tube converting processes
US12459852B2 (en) 2021-05-24 2025-11-04 Corning Incorporated Feedback control systems and methods for glass tube converting processes
DE112021007873T5 (en) * 2021-06-23 2024-04-25 Mitsubishi Electric Corporation TEMPERATURE MEASURING DEVICE, TEMPERATURE MEASURING METHOD AND ELECTRICAL DEVICE
JP7650002B2 (en) * 2022-03-30 2025-03-24 パナソニックIpマネジメント株式会社 Determination system, determination method, and program
WO2023223314A1 (en) * 2022-05-19 2023-11-23 Yoran Imaging Ltd. Methods and systems for sealing evaluation of induction-sealed containers

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000031313A (en) 1998-11-05 2000-06-05 윤종용 Device for examining bottle and method thereof
KR20020015517A (en) 2000-08-22 2002-02-28 박원재 Capping testing system of vessel
US20030062671A1 (en) * 2001-09-28 2003-04-03 Toshiba Tec Kabushiki Kaisha Image forming apparatus and method for controlling the same
JP2003307505A (en) * 2002-04-15 2003-10-31 Nec San-Ei Instruments Ltd Noncontact inspection device and noncontact inspection method by thermography
KR20050009060A (en) * 2003-07-15 2005-01-24 삼성탈레스 주식회사 Infrared imaging apparatus able to measuring the absolute temperature of a target
KR100661794B1 (en) 2006-05-24 2006-12-28 주훈 Infrared Thermal Microscope with Infrared Blackbody
US20100236743A1 (en) * 2007-10-24 2010-09-23 Zhi Xie Apparatus and method for measuring the surface temperature of continuous casting billet/slab
JP2012225728A (en) 2011-04-19 2012-11-15 Shohoku Laminate Co Ltd Method and device for inspecting application state of adhesive
US20130141590A1 (en) 2011-12-05 2013-06-06 Tamron Co., Ltd. Infrared Camera
US20140270563A1 (en) * 2013-03-15 2014-09-18 Drs Rsta, Inc. Method of shutterless non-uniformity correction for infrared imagers
US20140311256A1 (en) 2013-04-22 2014-10-23 Pressco Technology Inc. Cap analysis technique
KR20150022249A (en) 2013-08-22 2015-03-04 김용민 Appartus and method for detecting defect
KR101643713B1 (en) 2015-08-06 2016-08-11 주식회사 이오비스 Method for inspecting of product using learning type smart camera
US20160295206A1 (en) * 2015-04-01 2016-10-06 Fujifilm Corporation Imaging device and imaging method
US20190014990A1 (en) * 2015-07-17 2019-01-17 Drägerwerk AG & Co. KGaA Measuring apparatus for the determination of a temperature of an object, the use thereof and method for the operation thereof, as well as thermotherapy device with such a measuring apparatus

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20000031313A (en) 1998-11-05 2000-06-05 윤종용 Device for examining bottle and method thereof
KR20020015517A (en) 2000-08-22 2002-02-28 박원재 Capping testing system of vessel
US20030062671A1 (en) * 2001-09-28 2003-04-03 Toshiba Tec Kabushiki Kaisha Image forming apparatus and method for controlling the same
JP2003307505A (en) * 2002-04-15 2003-10-31 Nec San-Ei Instruments Ltd Noncontact inspection device and noncontact inspection method by thermography
KR20050009060A (en) * 2003-07-15 2005-01-24 삼성탈레스 주식회사 Infrared imaging apparatus able to measuring the absolute temperature of a target
KR100661794B1 (en) 2006-05-24 2006-12-28 주훈 Infrared Thermal Microscope with Infrared Blackbody
US20100236743A1 (en) * 2007-10-24 2010-09-23 Zhi Xie Apparatus and method for measuring the surface temperature of continuous casting billet/slab
JP2012225728A (en) 2011-04-19 2012-11-15 Shohoku Laminate Co Ltd Method and device for inspecting application state of adhesive
US20130141590A1 (en) 2011-12-05 2013-06-06 Tamron Co., Ltd. Infrared Camera
JP2013118547A (en) 2011-12-05 2013-06-13 Tamron Co Ltd Infrared camera
US20140270563A1 (en) * 2013-03-15 2014-09-18 Drs Rsta, Inc. Method of shutterless non-uniformity correction for infrared imagers
US20140311256A1 (en) 2013-04-22 2014-10-23 Pressco Technology Inc. Cap analysis technique
KR20150022249A (en) 2013-08-22 2015-03-04 김용민 Appartus and method for detecting defect
US20160295206A1 (en) * 2015-04-01 2016-10-06 Fujifilm Corporation Imaging device and imaging method
US20190014990A1 (en) * 2015-07-17 2019-01-17 Drägerwerk AG & Co. KGaA Measuring apparatus for the determination of a temperature of an object, the use thereof and method for the operation thereof, as well as thermotherapy device with such a measuring apparatus
KR101643713B1 (en) 2015-08-06 2016-08-11 주식회사 이오비스 Method for inspecting of product using learning type smart camera

Also Published As

Publication number Publication date
KR102223770B1 (en) 2021-03-05
US20190195724A1 (en) 2019-06-27
KR20190038924A (en) 2019-04-09
WO2018074621A1 (en) 2018-04-26
AU2016426890B2 (en) 2020-10-29
AU2016426890A1 (en) 2019-05-23

Similar Documents

Publication Publication Date Title
US10677681B2 (en) Inspection method and apparatus for testing cap sealing of container that involves calculating surface temperature of temperature sensor and comparing difference between measured temperature and the calculated temperature with threshold for correcting thermal image data
US11599989B2 (en) Inspection method and apparatus
CN101027548B (en) Method and apparatus for monitoring and detecting defects in plastic package sealing
US9791395B2 (en) Thermography-based method for detecting defects in seals with conductive inner-seals
CN113678165B (en) Device for hot spot sensing
US20180348741A1 (en) Manufacturing line monitoring device, manufacturing line monitoring program, and manufacturing line monitoring method
US12034281B2 (en) Fault detection system
JP6180392B2 (en) Cooling abnormality detection system
US20220390313A1 (en) Container leakage detection using thermal imaging
KR102260477B1 (en) Fault prediction system of circuit board using thermal imaging
WO2020208726A1 (en) Power conversion device
CN107606493B (en) A pipeline leak detection system
US20170305071A1 (en) Electric heating device
US20230014691A1 (en) System for Monitoring a Device
KR100777041B1 (en) Apparatus and Method for Thermal Testing
JP6207294B2 (en) Inspection method, inspection system, and image processing apparatus
TWI639823B (en) Method, apparatus, and system for detecting thermal sealing defects
CN113902722B (en) A blackbody detection method, device and equipment
US20110158282A1 (en) Method for detecting changes in a vacuum state in a detector of a thermal camera
JP5808682B2 (en) Appropriateness determination method of inner lid heating temperature by high frequency induction heating
JP6964305B2 (en) Package content inspection method and inspection equipment
TWM552474U (en) Apparatus and system for detecting thermal sealing defects

Legal Events

Date Code Title Description
AS Assignment

Owner name: COGLIX CO.LTD., KOREA, DEMOCRATIC PEOPLE'S REPUBLI

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JO, SEOUNG JE;PARK, JAE HUN;LEE, BOO HAN;REEL/FRAME:040104/0355

Effective date: 20161019

Owner name: COGLIX CO.LTD., KOREA, DEMOCRATIC PEOPLE'S REPUBLIC OF

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JO, SEOUNG JE;PARK, JAE HUN;LEE, BOO HAN;REEL/FRAME:040104/0355

Effective date: 20161019

FEPP Fee payment procedure

Free format text: ENTITY STATUS SET TO SMALL (ORIGINAL EVENT CODE: SMAL); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4