CN111855700A - Product spot inspection trademark defect detection system and method based on smart phone - Google Patents

Product spot inspection trademark defect detection system and method based on smart phone Download PDF

Info

Publication number
CN111855700A
CN111855700A CN202010690217.5A CN202010690217A CN111855700A CN 111855700 A CN111855700 A CN 111855700A CN 202010690217 A CN202010690217 A CN 202010690217A CN 111855700 A CN111855700 A CN 111855700A
Authority
CN
China
Prior art keywords
image
trademark
smart phone
image processing
template
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010690217.5A
Other languages
Chinese (zh)
Inventor
彭黎辉
朱海丰
曹丽
李群庆
刘淼
林锋
张宿义
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Luzhou Laojiao Co Ltd
Original Assignee
Tsinghua University
Luzhou Laojiao Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University, Luzhou Laojiao Co Ltd filed Critical Tsinghua University
Priority to CN202010690217.5A priority Critical patent/CN111855700A/en
Publication of CN111855700A publication Critical patent/CN111855700A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956Inspecting patterns on the surface of objects
    • G01N21/95607Inspecting patterns on the surface of objects using a comparative method
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/956Inspecting patterns on the surface of objects
    • G01N21/95607Inspecting patterns on the surface of objects using a comparative method
    • G01N2021/95615Inspecting patterns on the surface of objects using a comparative method with stored comparision signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/52Details of telephonic subscriber devices including functional features of a camera

Abstract

A product spot check trademark defect detection system based on smart phone, it includes: the intelligent mobile phone comprises a camera and an APP program, and the APP program is used for sending and receiving the trademark image; the computer is used for running an image processing script, and the image processing script is used for receiving the communication request and carrying out image processing. The invention further provides a product spot inspection trademark defect detection method based on the smart phone.

Description

Product spot inspection trademark defect detection system and method based on smart phone
Technical Field
The invention relates to the field of trademark defect detection, in particular to a system and a method for detecting trademark defects in a product sampling inspection process by using a smart phone.
Background
Trademarks are often displayed on the packaging or surfaces of various products in the form of printed images, and have the functions of identifying product brands, representing brand images, prompting product information and the like. In the industrial printing process, a brand image may have printing defects such as damage, scratch, stain, etc. due to environmental impurities or machine problems, and the brand image having the defects may affect the recognition of product information and leave a bad impression to consumers, so it is necessary to control the number of products having the brand printing defects to prevent excessive defective products from flowing to the market. At present, for defect detection in the trademark printing process, the technology of detecting trademark defects by acquiring trademark images and combining the trademark images with image processing by machine vision is relatively mature and widely applied. However, the trademark inspected by the printing quality still has a possibility of being damaged and generating defects in the subsequent packaging and the like production process. Therefore, before the product is delivered from the factory, whether the trademark has defects or not is detected in a sampling inspection mode.
The selective inspection of the brand printing quality before the product leaves the factory is an important link for controlling the product quality, and a defect detection system on a brand printing production line is not suitable for the selective inspection process due to the limited number of samples for single selective inspection. The spot inspection of the product trademark before delivery is mainly finished manually at present. Meanwhile, under the condition of large-scale industrial production, a large number of samples to be detected are generated after small-proportion sampling, the labor intensity of detection workers is high, and the working state of the workers also influences the judgment standard of detection.
Disclosure of Invention
In view of the above, the invention provides a product spot check trademark defect detection system and method based on a smart phone, which can change the current situation that the trademark defect detection depends on manual work in the current product spot check process, and improve the accuracy of the trademark defect detection.
A product spot check trademark defect detection system based on smart phone, it includes: the intelligent mobile phone comprises a camera and an APP program, and the APP program is used for sending and receiving the trademark image; the computer is used for running an image processing script, and the image processing script is used for receiving the communication request and carrying out image processing.
Further, the trademark image includes a non-defective trademark image, a defective trademark image, and a marked trademark image.
Further, the APP program is further used for sending a text description of the trademark defect detection.
Further, the APP program has three functions of adding a template, selecting the template and detecting an object, wherein the function of adding the template is to shoot a non-defective trademark image as a template image, store the template image into the smart phone and send the template image to a server to be stored into the computer; the template selecting function is to select one template image from the smart phone as a detection reference so that the template image is adopted as a standard comparison image when the computer runs the image processing script; the object detection function is to shoot a trademark image to be detected and send the trademark image to be detected to the computer, and the computer runs the image processing script, detects the trademark image to be detected and feeds a detection result back to the smart phone.
Further, the image processing script comprises an image processing algorithm, and the image processing algorithm comprises a brightness equalization image processing algorithm and a perspective transformation link image processing algorithm.
A product spot check trademark defect detection method based on a smart phone comprises the following steps:
s1, providing a product spot check trademark defect detection system based on a smart phone, which comprises the smart phone and a computer, wherein the smart phone comprises a camera and an APP program, and the APP program is used for sending and receiving trademark images; the computer is used for running an image processing script, and the image processing script is used for receiving the communication request and carrying out image processing;
s2, starting the APP, and shooting a non-defective trademark image by using the camera to serve as a template image;
s3, shooting trademark images to be detected one by using the camera; and
and S4, displaying the marked trademark image and the trademark defect detection text description thereof by the APP program.
Further, the algorithm flow chart for processing the image in the product spot inspection trademark defect detection method based on the smart phone comprises the following steps:
s11, reading the trademark image to be detected;
s12, dividing the target and the background of the trademark image to be detected based on the edge;
s13, adjusting the proportion to make the brightness uniform;
s14, perspective transformation is carried out to make the shapes consistent;
s15, registering the trademark image to be detected based on the characteristic information;
S16, detecting the aberration shadow of the trademark image to extract defects;
s17, marking the trademark image defect to be detected to obtain a detection result;
and S18, feeding back the result to the smart phone.
Compared with the existing manual spot inspection method, the method provided by the invention takes the portable and easily-obtained smart phone as a carrier, provides automatic trademark image defect detection technical support for trademark defect detection workers, and the image processing algorithm is carried out remotely through network communication, so that the method has the advantages of reducing workload, unifying detection standards, improving the accuracy of trademark defect detection and the like.
Drawings
Fig. 1 is a schematic diagram of a product spot inspection trademark defect detection system based on a smart phone and a processing flow thereof provided by the invention.
FIG. 2 is a functional flow diagram of an APP program provided by the present invention.
Fig. 3 is a flowchart of a product spot check trademark defect detection method based on a smart phone provided by the invention.
Fig. 4 is a flowchart of an algorithm for processing an image in the method for detecting the brand defect in the product spot check based on the smart phone.
Fig. 5 is a schematic diagram of a trademark defect detection result displayed by the smart phone provided by the present invention.
Description of the main elements
Trademark defect detection system 10
Smart phone 12
Computer 14
The following detailed description will further illustrate the invention in conjunction with the above-described figures.
Detailed Description
The system and method for detecting trademark defects of products by sampling inspection based on smart phones according to the present invention will be described in detail with reference to the accompanying drawings and specific embodiments.
Referring to fig. 1 and 2, the present invention provides a product spot check trademark defect detection system 10 based on a smart phone 12, which includes a smart phone 12 and a computer 14.
The computer 14 has an image processing script running on the server that accepts communication requests by creating a server object. The image processing script includes an image processing algorithm. That is, the computer 14 runs an image processing script for receiving a communication request and performing image processing.
The smartphone 12 has a camera and an APP program thereon. When the APP program on the smartphone 12 is started (opened), the APP program connects as a client object to the server object for sending and receiving related images or related data. The related images include a flawless trademark image, a flawed trademark image, and a marked trademark image taken by a camera. The associated data includes a trademark defect detection caption.
The APP program has three functions of adding a template, selecting the template and detecting an object. The "add template" function is to take a defect-free trademark image as a reference, store the template image in the smartphone 12, and send the template image to the server and store it in the computer 14.
The "template selection" function is to select an added template image from the smartphone 12 as a reference for subsequent detection, and inform the server of this information, so that the template image is used as a standard comparison image when a defect detection algorithm is run, that is, the template image is used as a standard comparison image when the computer 14 runs the image processing script.
The object detection function is to turn on a camera in the smartphone 12, capture a trademark image to be detected, and send the captured trademark image to a server object. The server calls an image defect detection algorithm script to detect the trademark image to be detected shot by the camera, after the detection is finished, the defects in the trademark image to be detected shot by the camera are marked, a marked trademark image is formed, and a trademark defect detection text description is formed; and then feeding back the marked trademark image and the trademark defect detection text description to the smart phone 12. After receiving the marked trademark image and the trademark defect detection text description, the smart phone 12 displays the marked trademark image and the trademark defect detection text description, and then completes a detection process. That is, the object detection function is to capture an image of a trademark to be detected and send the image of the trademark to be detected to the computer 14, and the computer 14 runs the image processing script, detects the image of the trademark to be detected, and feeds back a detection result to the smart phone 12.
Because the trademark image is acquired by the smart phone 12, a corresponding brightness equalization image processing algorithm, a perspective transformation link image processing algorithm and the like can be designed for the trademark image acquired by the smart phone 12. The brightness balancing function is to make the brightness consistent by adjusting the proportion of the trademark images with different brightness due to the change of light and different shooting distances. The role of the perspective transformation is to transform trademark images having different shapes due to different shooting angles and distances into the same shape by the principle of perspective transformation. The trademark image processed by the links of brightness balance and perspective transformation has good consistency, and can meet the requirement of a trademark defect detection algorithm on image quality. Therefore, the image processing algorithm comprises a brightness equalization algorithm and a perspective transformation link algorithm.
Referring to fig. 3, the present invention further provides a product spot check trademark defect detection method based on the smart phone 12, which includes the following steps:
s1, starting the APP program on the smart phone 12, and taking a non-defective trademark image as a template image by using a camera in the smart phone 12;
s2, shooting trademark images to be detected one by using the camera in the smart phone 12; and
And S3, displaying the marked trademark image and the trademark defect detection text description thereof by the APP program.
In step S3, the marked trademark image indicates that the trademark is defective.
Referring to fig. 4, the present invention provides an algorithm flowchart of processing images in the product spot check trademark defect detection method based on the smart phone 12, which includes the following steps:
s10, start;
s11, reading the trademark image to be detected;
s12, dividing the target and the background of the trademark image to be detected based on the edge;
s13, adjusting the proportion to make the brightness uniform;
s14, perspective transformation is carried out to make the shapes consistent;
s15, registering the trademark image to be detected based on the characteristic information;
s16, detecting the aberration shadow of the trademark image to extract defects;
s17, marking the trademark image defect to be detected to obtain a detection result;
s18, feeding back the result to the smartphone 12;
and S19, ending.
Fig. 5 is a schematic diagram of the trademark defect detection result displayed by the smart phone 12.
The product spot inspection trademark defect detection system 10 and method based on the smart phone 12 have the following advantages: firstly, the method uses the smart phone 12 to photograph the printed trademark image of the product to be detected, and then sends the image to the cloud computer 14 for defect detection, and feeds back the detection result to the smart phone 12 for display after the defect detection is completed. The detection workers can finish the detection of the samples only by photographing the samples to be detected one by one, so that the workload of the workers is reduced, and the unified defect detection standard and the data of the stored defect image are facilitated; secondly, compared with the detection system which is widely used on the trademark printing production line at present, the invention mainly utilizes the photographing function of the smart phone 12, namely, the smart phone 12 is used as the main detection equipment, so that the hardware threshold of the detection system is lower, and the detection system does not need special requirements on the working environment and the working conditions, for example, the requirements on uniform and consistent illumination of images during detection, the condition that the printing surface faces to a camera at the same angle and the like are not needed; thirdly, conditions and hardware equipment required for detecting the defects of the simplified trademark images can participate in the links of factory digitization and automatic modification.
In addition, other modifications within the spirit of the invention will occur to those skilled in the art, and it is understood that such modifications are included within the scope of the invention as claimed.

Claims (10)

1. The utility model provides a product selective examination trade mark defect detecting system based on smart mobile phone which characterized in that, it includes:
the intelligent mobile phone comprises a camera and an APP program, wherein the APP program is used for sending and receiving the trademark image; and
and the computer is used for running an image processing script, and the image processing script is used for receiving the communication request and carrying out image processing.
2. The smartphone-based product spot check brand defect detection system of claim 1, wherein the brand image includes a non-defective brand image, a defective brand image, and a marked brand image.
3. The smartphone-based product spot check brand defect detection system of claim 1, wherein the APP program is further configured to send a written description of brand defect detection.
4. The product spot check trademark defect detection system based on the smart phone as claimed in claim 1, wherein the APP program has three functions of 'add template', 'select template' and 'object detection', the 'add template' function is to take a non-defective trademark image as a template image, store the template image in the smart phone, and send the template image to a server to be stored in the computer; the template selecting function is to select one template image from the smart phone as a detection reference so that the template image is adopted as a standard comparison image when the computer runs the image processing script; the object detection function is to shoot a trademark image to be detected and send the trademark image to be detected to the computer, and the computer runs the image processing script, detects the trademark image to be detected and feeds a detection result back to the smart phone.
5. The smartphone-based product spot check trademark defect detection system of claim 1, wherein the image processing script includes an image processing algorithm including a brightness equalization image processing algorithm and a perspective transformation link image processing algorithm.
6. A product spot check trademark defect detection method based on a smart phone comprises the following steps:
s1, providing a product spot check trademark defect detection system based on a smart phone, which comprises the smart phone and a computer, wherein the smart phone comprises a camera and an APP program, and the APP program is used for sending and receiving trademark images; the computer is used for running an image processing script, and the image processing script is used for receiving the communication request and carrying out image processing;
s2, starting the APP, and shooting a non-defective trademark image by using the camera to serve as a template image;
s3, shooting trademark images to be detected one by using the camera; and
and S4, displaying the marked trademark image and the trademark defect detection text description thereof by the APP program.
7. The product spot-check trademark defect detection method based on the smart phone as claimed in claim 6, wherein the APP program has three functions of 'add template', 'select template' and 'object detection', the 'add template' function is to take a non-defective trademark image as a template image, store the template image in the smart phone, and send the template image to a server to be stored in the computer; the template selecting function is to select one template image from the smart phone as a detection reference so that the template image is adopted as a standard comparison image when the computer runs the image processing script; the object detection function is to shoot a trademark image to be detected and send the trademark image to be detected to the computer, and the computer runs the image processing script, detects the trademark image to be detected and feeds a detection result back to the smart phone.
8. The method for detecting the brand defects of the products based on the smart phone, as claimed in claim 6, wherein the image processing script comprises an image processing algorithm, the image processing algorithm comprises a brightness equalization image processing algorithm and a perspective transformation link image processing algorithm.
9. The smart phone based product spot check trademark defect detection method as claimed in claim 6, wherein the APP program is further used for sending a text description of trademark defect detection.
10. The method for detecting the brand defects of the products based on the smart phone in a spot inspection manner as claimed in claim 6, wherein the algorithm flow chart for processing the images in the method for detecting the brand defects of the products based on the smart phone comprises the following steps:
s11, reading the trademark image to be detected;
s12, dividing the target and the background of the trademark image to be detected based on the edge;
s13, adjusting the proportion to make the brightness uniform;
s14, perspective transformation is carried out to make the shapes consistent;
s15, registering the trademark image to be detected based on the characteristic information;
s16, detecting the aberration shadow of the trademark image to extract defects;
s17, marking the trademark image defect to be detected to obtain a detection result;
and S18, feeding back the result to the smart phone.
CN202010690217.5A 2020-07-17 2020-07-17 Product spot inspection trademark defect detection system and method based on smart phone Pending CN111855700A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010690217.5A CN111855700A (en) 2020-07-17 2020-07-17 Product spot inspection trademark defect detection system and method based on smart phone

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010690217.5A CN111855700A (en) 2020-07-17 2020-07-17 Product spot inspection trademark defect detection system and method based on smart phone

Publications (1)

Publication Number Publication Date
CN111855700A true CN111855700A (en) 2020-10-30

Family

ID=72983699

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010690217.5A Pending CN111855700A (en) 2020-07-17 2020-07-17 Product spot inspection trademark defect detection system and method based on smart phone

Country Status (1)

Country Link
CN (1) CN111855700A (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN206057203U (en) * 2016-09-18 2017-03-29 东莞智源彩印有限公司 A kind of print product inspects machine by random samples
JP6218094B1 (en) * 2016-04-15 2017-10-25 Jeインターナショナル株式会社 Inspection method, inspection apparatus, inspection program, and recording medium
CN107907546A (en) * 2017-12-06 2018-04-13 华南理工大学 A kind of defects of vision detection method and system based on intelligent mobile terminal
CN109685761A (en) * 2018-11-08 2019-04-26 宁波送变电建设有限公司甬城配电网建设分公司 A kind of power cable defect inspection method and its detection system based on cloud platform
CN110006923A (en) * 2019-04-23 2019-07-12 Oppo广东移动通信有限公司 A kind of label quality detecting method, device and computer readable storage medium
CN111413277A (en) * 2020-04-17 2020-07-14 宁波积微速成智能科技有限公司 Tire surface defect detection system and method

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6218094B1 (en) * 2016-04-15 2017-10-25 Jeインターナショナル株式会社 Inspection method, inspection apparatus, inspection program, and recording medium
CN206057203U (en) * 2016-09-18 2017-03-29 东莞智源彩印有限公司 A kind of print product inspects machine by random samples
CN107907546A (en) * 2017-12-06 2018-04-13 华南理工大学 A kind of defects of vision detection method and system based on intelligent mobile terminal
CN109685761A (en) * 2018-11-08 2019-04-26 宁波送变电建设有限公司甬城配电网建设分公司 A kind of power cable defect inspection method and its detection system based on cloud platform
CN110006923A (en) * 2019-04-23 2019-07-12 Oppo广东移动通信有限公司 A kind of label quality detecting method, device and computer readable storage medium
CN111413277A (en) * 2020-04-17 2020-07-14 宁波积微速成智能科技有限公司 Tire surface defect detection system and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
赵丹等: "基于计算机图像处理的印刷品缺陷检测", 《包装工程》 *

Similar Documents

Publication Publication Date Title
CN102253048B (en) Machine vision detection method and system for detection of various products
WO2021109627A1 (en) Defect classification method and device for small sample, and computing apparatus
CN107272234A (en) A kind of detection method and system based on lcd panel test picture
CN111289538A (en) PCB element detection system and detection method based on machine vision
CN112801937A (en) Method, device and system for detecting warping defect of glass substrate
CN109685789A (en) The battery core surface gummed paper detection method and device of view-based access control model detection
CN208366871U (en) Detection system
CN113269769A (en) Defect detection method, system and equipment based on image registration
CN114029237A (en) Real-time sorting system and method for surface defects of aluminum profiles
CN111426693A (en) Quality defect detection system and detection method thereof
CN111899231A (en) Display panel defect detection method, device, equipment and storage medium
WO2022222467A1 (en) Open circular ring workpiece appearance defect detection method and system, and computer storage medium
CN113706501B (en) Intelligent monitoring method for aircraft assembly
CN110602299B (en) Appearance defect detection method based on different inclination angles
CN111855700A (en) Product spot inspection trademark defect detection system and method based on smart phone
CN112763496A (en) Mobile phone battery surface defect detection device and detection method thereof
CN115908768B (en) Combined lighting shooting battery flaw identification method, system and platform
CN108663376B (en) Seamless steel tube quality detection device and detection method
CN116681677A (en) Lithium battery defect detection method, device and system
CN111275756A (en) Spool positioning method and apparatus
CN113469991B (en) Visual online detection method for laser welding spot of lithium battery tab
CN210090325U (en) Screwdriver bit detection device
CN109060831B (en) Automatic dirt detection method based on bottom plate fitting
CN112964737A (en) Double-sided appearance detection method of circuit board
CN207610993U (en) A kind of defects of vision detecting system based on intelligent mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20201030

RJ01 Rejection of invention patent application after publication