CN114549519B - Visual detection method and system for automobile spraying production line and readable storage medium - Google Patents
Visual detection method and system for automobile spraying production line and readable storage medium Download PDFInfo
- Publication number
- CN114549519B CN114549519B CN202210364967.2A CN202210364967A CN114549519B CN 114549519 B CN114549519 B CN 114549519B CN 202210364967 A CN202210364967 A CN 202210364967A CN 114549519 B CN114549519 B CN 114549519B
- Authority
- CN
- China
- Prior art keywords
- information
- production line
- carrier
- spraying
- preset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 102
- 238000005507 spraying Methods 0.000 title claims abstract description 89
- 238000001514 detection method Methods 0.000 title claims abstract description 45
- 238000003860 storage Methods 0.000 title claims abstract description 20
- 230000000007 visual effect Effects 0.000 title claims abstract description 14
- 238000007781 pre-processing Methods 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 claims description 61
- 238000010422 painting Methods 0.000 claims description 24
- 238000011179 visual inspection Methods 0.000 claims description 21
- 238000012545 processing Methods 0.000 claims description 20
- 239000000969 carrier Substances 0.000 claims description 12
- 238000012937 correction Methods 0.000 claims description 10
- 238000001914 filtration Methods 0.000 claims description 6
- 238000007689 inspection Methods 0.000 claims description 6
- 230000011218 segmentation Effects 0.000 claims description 6
- 230000009466 transformation Effects 0.000 claims description 6
- 239000007921 spray Substances 0.000 claims description 3
- 239000000203 mixture Substances 0.000 claims description 2
- 239000011248 coating agent Substances 0.000 description 14
- 238000000576 coating method Methods 0.000 description 14
- 230000008569 process Effects 0.000 description 14
- 238000000605 extraction Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 238000006073 displacement reaction Methods 0.000 description 4
- 238000004088 simulation Methods 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000010586 diagram Methods 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000005315 distribution function Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000003672 processing method Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000001035 drying Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000003973 paint Substances 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30156—Vehicle coating
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30248—Vehicle exterior or interior
- G06T2207/30252—Vehicle exterior; Vicinity of vehicle
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Application Of Or Painting With Fluid Materials (AREA)
Abstract
The invention discloses a visual detection method, a system and a readable storage medium for an automobile spraying production line, which are used for collecting production line images and preprocessing the production line images; establishing a coordinate system of a conveying platform, and carrying out sectional treatment on the conveying platform to form a plurality of conveying areas; acquiring carrier position information of a target product, and comparing the carrier position information with preset position information to obtain a deviation rate; judging whether the deviation rate is greater than a preset deviation rate threshold value or not, if so, generating compensation information, and adjusting the position of the carrier to be in a preset position according to the compensation information; the system can accurately shoot the positioning information of the vehicle body, realize the on-line detection of the bumper, select the corresponding spraying program according to the type of the bumper and carry out intelligent spraying through the spraying robot.
Description
Technical Field
The invention relates to the field of intelligent diagnosis and detection, in particular to a visual detection method and system for an automobile spraying production line and a readable storage medium.
Background
Machine vision is a branch of rapid development of artificial intelligence. Machine vision is a key technology in the production process, taking an automobile coating production line as an example, on a machine or a production line, the machine vision can realize vehicle body positioning and vehicle type identification so as to conveniently identify the vehicle body which does not accord with a plan, ensure the normal operation of the production line and be closely related to the whole production.
In the prior art, in the whole coating production line, a bumper needs to be subjected to multiple process flows of workpiece feeding, pretreatment, robot painting, drying, workpiece discharging, spot repairing and the like, and the conditions that the bumper is separated from a hanger, deviates or falls off in any link can influence the operation of the production line and even scrap products. Therefore, how to improve the stability of the coating production line is a technical problem which exists in the field for a long time but is not solved all the time.
Disclosure of Invention
In order to solve at least one technical problem, the invention provides a visual detection method, a system and a readable storage medium for an automobile spraying production line.
The invention provides a visual inspection method for an automobile spraying production line in a first aspect, which comprises the following steps:
collecting production line images, preprocessing the production line images to obtain processed images,
acquiring production line parameter information according to the processed image, establishing a conveying platform coordinate system, and performing segmentation processing on the conveying platform to form a plurality of conveying areas;
acquiring carrier position information of a target product, and comparing the carrier position information with preset position information to obtain a deviation rate;
judging whether the deviation rate is larger than a preset deviation rate threshold value or not,
if the deviation rate is greater than a preset deviation rate threshold value, generating compensation information, and adjusting the position of the carrier to a preset position according to the compensation information;
establishing a corresponding detection mode according to the conveying area and obtaining a detection result,
and displaying the detection result according to a preset mode.
Furthermore, the target product comprises automobile parts of different automobile types, such as one of an automobile door panel, an automobile bumper or an automobile engine top cover, and the detection mode can be that the target product is photographed through an industrial camera to obtain image information.
The calculation method is that the result obtained by subtracting the preset position information from the carrier position information is divided by the length of the target product, and then the result is multiplied by 100% to obtain a percentage, namely the deviation rate, the preset deviation rate threshold is 20%, and when the deviation rate is greater than 20%, the carrier position is adjusted to a correct preset position through compensation information to be corrected, so that the carrier position is always in a correct position.
In a preferred embodiment of the invention, production line images are collected and preprocessed; the method specifically comprises the following steps:
extracting image characteristics of the production line, filtering and denoising the image characteristics through wavelet transformation,
signal reconstruction is carried out on the denoised image signal to obtain a processed image,
and performing color texture enhancement on the processed image to obtain an enhanced image.
In a preferred embodiment of the present invention, the method further comprises: carrier parameter information is collected, positioning points are established according to the carrier parameter information, and coordinate information of the positioning points is obtained;
positioning a target product according to the positioning points to obtain positioning state information;
comparing the positioning state information with preset state information to obtain a positioning state deviation rate;
if the deviation rate of the positioning state is larger than the first threshold and smaller than the second threshold, generating first alarm information, generating adjustment information according to the first alarm information, and adjusting the spraying state parameters according to the adjustment information;
if the deviation rate of the positioning state is larger than a second threshold value, generating second alarm information, marking the target product according to the second alarm information, and generating a corresponding processing mode;
the first threshold is less than the second threshold.
In a preferred embodiment of the present invention, the image information of the workpiece is collected, the type of the workpiece is identified, N identification points are obtained at different positions of the workpiece, and coordinates of the N identification points are formed,
the coordinates of the N identification points are compared with preset coordinates,
if M coordinates in the N identification points deviate from a preset threshold value, judging that the position of the workpiece deviates,
wherein M is greater than N/3.
In a preferred embodiment of the invention, image information of the target product is collected, the type of the target product is identified, the information of the vehicle type of the target product is matched,
selecting a corresponding spraying program according to the information of the target product vehicle type,
the target product delivery time is set according to the spray program,
and when the target product is identified to reach the preset position through the radio frequency chip, the spraying robot sprays the target product according to the spraying program.
In a preferred embodiment of the present invention, a coordinate system of the conveying platform is established, and the conveying platform is processed in segments to form a plurality of conveying areas, specifically: acquiring spraying parameter information, and establishing carrier movement parameter information according to the spraying parameter information;
segmenting the conveying platform according to the carrier movement parameter information, and establishing carrier movement speed models in different conveying areas;
automatically generating a carrier preset moving speed under a corresponding time node through a carrier moving speed model;
acquiring the real-time moving speed of the carrier;
comparing the real-time moving speed of the carrier with the preset moving speed of the carrier to obtain a speed deviation rate;
judging whether the speed deviation rate is larger than a preset speed deviation rate or not,
and if so, generating correction information, and correcting the current moving speed through the correction information.
In a preferred embodiment of the present invention, the production line parameters include the length of the production line or the identification of different types of workpieces on the production line or the composition of the spraying equipment on the production line and the position of the spraying equipment, the conveying areas are arranged along the length of the production line, the number of the conveying areas is 3-10, preferably 5, each conveying area is provided with a spraying robot, the spraying robots in different conveying areas can perform different spraying operations including the spraying mode, the spraying speed or the spraying color, etc., the lengths of the adjacent conveying areas are the same or different, the moving speeds of the carriers in different conveying areas are different, the moving speed of the carriers is increased in a gradient manner, and when the moving speed is increased to the preset speed, the carriers are kept to move at a constant speed.
In a preferred embodiment of the present invention, a corresponding detection mode is established according to the conveying area, and a detection result is obtained, specifically:
obtaining an automobile type, and generating bumper parameter information according to the automobile type;
generating a corresponding spraying mode according to the bumper parameter information,
different parts of the bumper are sprayed in different conveying areas,
collecting the spraying state information of the bumper, judging the spraying error according to the spraying state,
and if the spraying error is larger than the preset error, carrying out secondary spraying on the bumper.
Further, the bumper parameter information comprises the shape or size of the bumper, and different spraying methods are adopted for bumpers of different vehicle types.
The second aspect of the present invention further provides a vision inspection system for an automobile painting production line, the system comprising: the visual detection method program for the automobile spraying production line is executed by the processor to realize the following steps:
collecting production line images, preprocessing the production line images to obtain processed images,
acquiring production line parameter information according to the processed image, establishing a conveying platform coordinate system, and carrying out segmentation processing on the conveying platform to form a plurality of conveying areas;
acquiring carrier position information of a target product, and comparing the carrier position information with preset position information to obtain a deviation rate;
judging whether the deviation rate is larger than a preset deviation rate threshold value or not,
if the deviation rate is greater than a preset deviation rate threshold value, generating compensation information, and adjusting the position of the carrier to a preset position according to the compensation information;
establishing a corresponding detection mode according to the conveying area and obtaining a detection result,
and displaying the detection result according to a preset mode.
The calculating method comprises the following steps that a result obtained by subtracting the preset position information from the carrier position information is divided by the length of a target product, and then the result is multiplied by 100% to obtain a percentage which is the deviation rate, the preset deviation rate threshold is 20%, and when the deviation rate is larger than 20%, the carrier position is adjusted to a correct preset position through compensation information to be corrected, so that the carrier position is always in the correct position.
The third aspect of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a program for a visual inspection method of an automobile painting production line, and when the program for the visual inspection method of the automobile painting production line is executed by a processor, the method implements the steps of the visual inspection method of the automobile painting production line as described in any one of the above.
Compared with the prior art, the invention has the following beneficial technical effects:
(1) the invention develops a visual detection method, a system and a readable storage medium for an automobile spraying production line, which can accurately shoot automobile body positioning information, hanger information, automobile type information and the like, realize the on-line detection of accurate points of a bumper and a hanger, completely avoid the conditions of detachment, deviation or falling of the bumper from the hanger, improve the stability of the coating production line and solve the technical problems existing in the field for a long time but not solved all the time.
(2) The invention can alarm the abnormal positioning condition in time, improves the safety of coating production, ensures the production efficiency of a coating production line, effectively saves the production cost and improves the productivity of the automobile production industry.
Drawings
FIG. 1 is a flow chart illustrating a visual inspection method for an automotive painting production line according to the present invention;
FIG. 2 illustrates a flow chart of an image pre-processing method of the present invention;
FIG. 3 illustrates a positioning deviation alarm flow diagram of the present invention;
FIG. 4 is a flow chart illustrating a workpiece position shifting method of the present invention;
FIG. 5 shows a flow chart of the spray coating method of the present invention;
FIG. 6 is a schematic view of the sectional processing method of the conveying platform of the present invention;
FIG. 7 is a block diagram of a vision inspection system for a vehicle painting line according to the present invention.
Detailed Description
In order that the above objects, features and advantages of the present invention can be more clearly understood, a more particular description of the invention, taken in conjunction with the accompanying drawings and detailed description, is set forth below. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention, however, the present invention may be practiced otherwise than as specifically described herein and, therefore, the scope of the present invention is not limited by the specific embodiments disclosed below.
FIG. 1 is a flow chart of a visual inspection method for an automobile painting production line according to the present invention.
As shown in fig. 1, a first aspect of the present invention provides a visual inspection method for an automobile painting production line, including:
s102, collecting production line images, and preprocessing the production line images;
s104, establishing a conveying platform coordinate system, and carrying out segmentation treatment on the conveying platform to form a plurality of conveying areas;
s106, carrier position information of the target product is collected, and the carrier position information is compared with preset position information to obtain a deviation rate;
s108, judging whether the deviation ratio is larger than a preset deviation ratio threshold value or not,
s110, if the position of the carrier is larger than the preset position, generating compensation information, and adjusting the position of the carrier to the preset position according to the compensation information;
s112, establishing a corresponding detection mode according to the conveying area and obtaining a detection result,
and S114, displaying the detection result according to a preset mode.
It should be noted that the display part can display through the display screen, the detection part is mainly an ethernet industrial camera, image acquisition is performed through the industrial camera, and the central control system connects the camera with the control cabinet in the system through the network switch, so that the control cabinet can quickly and accurately receive the relevant information of the bumper carrier through the tracking system installed on the bumper carrier. On the automobile coating production line, once the operation panel discovers that the skid carrier occupies the space, the signal is directly sent out, the visual detection system receives the signal and starts working, images are shot, information is processed, the positioning condition of the automobile body is calculated, the signal is sent out, the signal is transmitted to the control cabinet PLC through the DI/O module signal, after the central control system receives the signal, data comparison is carried out with plan information, if the signal is inconsistent, the alarm is carried out through the central control system, the configuration of the visual detection system is positioned, the automation of automobile coating production is improved, and remote monitoring is realized.
Furthermore, the tracking system comprises an infrared sensor, the infrared sensor collects position information of the bumper carrier in real time and transmits the position information to the central control system in real time, and the central control system analyzes and processes the position information, judges the position of a workpiece according to the position of the bumper carrier and performs corresponding paint spraying processing.
Furthermore, the tracking system can also be provided with an encoder, the position information of the bumper carrier is detected through the encoder, the encoder is equipment for compiling and converting signals or data into signal forms which can be used for communication, transmission and storage, angular displacement or linear displacement is converted into electric signals through the encoder, the encoder can be divided into a contact type and a non-contact type, the encoder comprises an incremental type and an absolute type, the incremental encoder converts the displacement into periodic electric signals, then the electric signals are converted into counting pulses, the magnitude of the displacement is represented by the number of the pulses, each position of the absolute encoder corresponds to a determined digital code, and the position is determined according to the digital code.
Further, after the target product reaches a preset position, the target product is sprayed by spraying robots arranged on two sides of the production line.
As shown in FIG. 2, the present invention discloses a flow chart of an image preprocessing method.
According to the embodiment of the invention, production line images are collected and preprocessed; the method specifically comprises the following steps:
s202, extracting the image characteristics of the production line, carrying out filtering and denoising on the image characteristics through wavelet transformation,
s204, signal reconstruction is carried out on the denoised image signal to obtain a processed image,
and S206, performing color texture enhancement on the processed image to obtain an enhanced image.
It should be noted that image enhancement is a method commonly used in the digital image processing process, and is divided into two categories, namely a spatial domain method for processing in the pixel space where an image is located and a frequency domain method for indirectly processing in the frequency domain after fourier transform according to different processing spaces, image denoising based on wavelet transform is performed by a nonlinear method, wavelet transform is a function approximation problem in the mathematical field, and the best approximation to the original image information in the function space after the expansion and translation of the wavelet function is found according to the actual requirements. Meanwhile, the image denoising based on the wavelet transformation is also a signal filtering problem, the wavelet denoising is an important stage for ensuring the quality of the later classification discrimination in the image recognition process while keeping the characteristic detail information such as the edge of the image, the characteristic extraction is an important stage for ensuring the quality of the later classification discrimination in the image recognition process, the extracted image characteristic needs to be capable of expressing the typical characteristic of a recognized object, and the characteristic extraction has characteristics of uniqueness, completeness, geometric invariance and abstraction, and the elements of the characteristic extraction have characteristics of color, texture, edge, shape and the like. The color is a basic component of image information, each identified object has a characteristic of color, the texture feature is statistics of local properties of the image through an image gray scale distribution function, and is a description of gray scale spatial distribution of each pixel in the image, and the local part may not have a rule, but a certain rule is presented on the overall characteristic of the image.
As shown in fig. 3, the present invention discloses a positioning deviation alarm flow chart.
According to the embodiment of the invention, the method further comprises the following steps: s302, carrier parameter information is collected, positioning points are established according to the carrier parameter information, and coordinate information of the positioning points is obtained;
s304, positioning the target product according to the positioning point to obtain positioning state information;
s306, comparing the positioning state information with preset state information to obtain a positioning state deviation rate;
s308, if the deviation ratio of the positioning state is larger than a first threshold value and smaller than a second threshold value, generating first alarm information, generating adjustment information according to the first alarm information, and adjusting the spraying state parameters according to the adjustment information;
s310, if the deviation rate of the positioning state is larger than a second threshold value, generating second alarm information, marking the target product according to the second alarm information, and generating a corresponding processing mode;
the first threshold is less than the second threshold.
It should be noted that, the carrier is also provided with a tracking recognition system, which can be used for precise positioning, the system is matched with a positioning vision detection system, and the vision detection system is used for identifying whether the bumper positioning on the hanger is consistent with a set value or not and whether the vehicle model simulation is consistent or not, and can transmit the data information to the spraying robot, reduce the process of the simulation identification of the robot, and prevent the risk of robot collision caused by inconsistent bumper model information or position problems, effectively reduce production faults, reduce the rework probability of coating production, improve the progress and quality of vehicle production, when the deviation rate of the positioning state is larger than a second threshold value, the target product is far deviated from the preset position, and at the moment, the position of a target product can be adjusted through the stop operation, and the target product can be bumpers of different models or other automobile parts.
As shown in FIG. 4, the present invention discloses a flow chart of a workpiece position shifting method.
According to the embodiment of the invention, the method further comprises the following steps: s402, collecting workpiece image information, identifying the workpiece type, acquiring N identification points at different positions of the workpiece, forming coordinates of the N identification points,
s404, comparing the coordinates of the N identification points with preset coordinates,
s406, if M coordinates in the N identification points deviate from a preset threshold value, determining that the position of the workpiece deviates,
wherein M is greater than N/3.
It should be noted that the type of the workpiece is determined according to the type of the workpiece, and the spraying program of the type information is automatically selected according to the type information, the spraying programs of different workpieces of the same type are stored in the same data packet, and the spraying programs of different types are stored in different data packets for classification.
In an embodiment of the present invention, the workpiece includes a bumper, N identification points are obtained at different positions of the bumper, N may be 10 identification points or 20, 40, 50, 60, 80, 100, 500 or 1000 identification points according to the size of the bumper, when the size of the bumper is larger, 5000 or 10000 identification points may also be selected, the number of the identification points may be adjusted according to the size of the bumper, and when 1/3 identification points are deviated from or greater than 1/3 identification points in the identification points, it is indicated that the workpiece is further deviated, and at this time, the workpiece needs to be subjected to position adjustment.
As shown in FIG. 5, the present invention discloses a flow chart of the spraying method.
According to the embodiment of the invention, the method further comprises the following steps: s502, collecting image information of the target product, identifying the type of the target product, matching the type information of the target product,
s504, selecting a corresponding spraying program according to the information of the vehicle type of the target product,
s506, setting the conveying time of the target product according to the spraying program,
and S508, when the target product is identified to reach the preset position through the radio frequency chip, the spraying robot sprays the target product according to the spraying program.
As shown in fig. 6, the invention discloses a schematic view of a sectional processing method of a conveying platform.
According to the embodiment of the invention, a conveying platform coordinate system is established, and the conveying platform is subjected to segmented processing to form a plurality of conveying areas, which specifically comprise:
s602, acquiring spraying parameter information, and establishing carrier movement parameter information according to the spraying parameter information;
s604, segmenting the conveying platform according to the carrier movement parameter information, and establishing carrier movement speed models in different conveying areas;
s606, automatically generating a carrier preset moving speed under a corresponding time node through a carrier moving speed model;
s608, acquiring the real-time moving speed of the carrier;
s610, comparing the real-time moving speed of the carrier with the preset moving speed of the carrier to obtain a speed deviation rate;
s612, judging whether the speed deviation rate is larger than a preset speed deviation rate or not,
and S614, if the current moving speed is larger than the preset moving speed, generating correction information, and correcting the current moving speed through the correction information.
According to the embodiment of the invention, the lengths of the adjacent conveying areas are the same or different, the moving speeds of the carriers in the different conveying areas are different, the moving speeds of the carriers are increased in a gradient manner, and when the moving speeds are increased to the preset speed, the carriers are kept to move at a constant speed.
It should be noted that, during the process of sliding the carrier on the slide, initially, the moving speed of the carrier is slowly increased, and when the carrier is increased to a predetermined speed, the carrier keeps running at a constant speed.
According to the embodiment of the invention, a corresponding detection mode is established according to the conveying area, and a detection result is obtained, specifically:
obtaining an automobile type, and generating bumper parameter information according to the automobile type;
generating a corresponding spraying mode according to the bumper parameter information,
different parts of the bumper are sprayed by different conveying areas,
collecting the spraying state information of the bumper, judging the spraying error according to the spraying state,
and if the spraying error is larger than the preset error, carrying out secondary spraying on the bumper.
It should be noted that, the shape and size of the bumper of different vehicle types are different, so the bumper parameters need to be determined according to the vehicle types, then different spraying modes and spraying time are selected according to different bumper parameters, after the spraying is finished, the uniformity of the sprayed layer on the bumper is detected, the uniformity is greatly deviated, or when the spraying error is large, the secondary spraying or the multiple spraying is carried out on the uneven position on the bumper, and if the required index is still not reached, the outer side of the bumper can be scraped and re-sprayed.
As shown in FIG. 7, the invention discloses a block diagram of a vision inspection system for an automobile painting production line.
The second aspect of the present invention also provides a vision inspection system for an automobile painting production line, comprising: the visual detection method program of the automobile spraying production line is executed by the processor to realize the following steps:
collecting production line images, and preprocessing the production line images;
establishing a conveying platform coordinate system, and carrying out sectional treatment on the conveying platform to form a plurality of conveying areas;
acquiring carrier position information of a target product, and comparing the carrier position information with preset position information to obtain a deviation rate;
judging whether the deviation rate is larger than a preset deviation rate threshold value or not,
if the position of the carrier is larger than the preset position, generating compensation information, and adjusting the position of the carrier to the preset position according to the compensation information;
establishing a corresponding detection mode according to the conveying area and obtaining a detection result,
and displaying the detection result according to a preset mode.
It should be noted that the detection part mainly uses an ethernet industrial camera, image acquisition is performed through the industrial camera, and the central control system connects the camera with a control cabinet in the system through a network switch, so that the control cabinet can quickly and accurately receive the relevant information of the bumper carrier through a tracking system installed on the bumper carrier. On the automobile coating production line, once the operation panel discovers that the skid carrier occupies the space, the signal is directly sent out, the visual detection system receives the signal and starts working, images are shot, information is processed, the positioning condition of the automobile body is calculated, the signal is sent out, the signal is transmitted to the control cabinet PLC through the DI/O module signal, after the central control system receives the signal, data comparison is carried out with plan information, if the signal is inconsistent, the alarm is carried out through the central control system, the configuration of the visual detection system is positioned, the automation of automobile coating production is improved, and remote monitoring is realized.
According to the embodiment of the invention, the method further comprises the following steps: carrier parameter information is collected, positioning points are established according to the carrier parameter information, and coordinate information of the positioning points is obtained;
positioning a target product according to the positioning points to obtain positioning state information;
comparing the positioning state information with preset state information to obtain a positioning state deviation rate;
if the deviation rate of the positioning state is larger than the first threshold and smaller than the second threshold, generating first alarm information, generating adjustment information according to the first alarm information, and adjusting the spraying state parameters according to the adjustment information;
if the deviation rate of the positioning state is larger than a second threshold value, generating second alarm information, marking the target product according to the second alarm information, and generating a corresponding processing mode;
the first threshold is less than the second threshold.
It should be noted that, a tracking recognition system is also arranged on the carrier, accurate positioning can be carried out through the tracking recognition system, data matching is carried out with the positioning vision detection system, whether bumper positioning on the hanger is consistent with a set value or not is recognized through the vision system, whether vehicle type simulation is consistent or not is recognized, data information can be transmitted to the spraying robot, the process of simulation recognition of the robot is reduced, the risk of collision of the robot due to inconsistent vehicle type information of the bumper or due to position problems is prevented, production faults are effectively reduced, the reworking probability of coating production is reduced, and the progress and the quality of vehicle production are improved.
In addition, the target product comprises a bumper, and the positioning state information further comprises the fixing direction and height of the bumper on the vehicle, whether the bumper slides to deviate from the original position in the mobile spraying process, whether the bumper is separated from a hanger, deviates or falls, and the like. The target product is marked according to the feedback of the second alarm information, when the target product is larger or deviates from the original position, the fact that the spraying effect of the target product is sharply reduced in the spraying process is shown, even the target product is possibly not sprayed, when the target product is serious, the operation of a production line can be influenced, whether the machine needs to be stopped or not is judged according to the second alarm information, the shortest stopping time is judged and established, and the loss is reduced to the minimum.
According to the embodiment of the invention, a conveying platform coordinate system is established, and the conveying platform is subjected to segmented processing to form a plurality of conveying areas, which specifically comprise: acquiring spraying parameter information, and establishing carrier movement parameter information according to the spraying parameter information;
segmenting the conveying platform according to the carrier movement parameter information, and establishing carrier movement speed models in different conveying areas;
automatically generating a carrier preset moving speed under a corresponding time node through a carrier moving speed model;
acquiring the real-time moving speed of the carrier;
comparing the real-time moving speed of the carrier with the preset moving speed of the carrier to obtain a speed deviation rate;
judging whether the speed deviation rate is larger than a preset speed deviation rate or not,
and if the current moving speed is larger than the preset moving speed, generating correction information, and correcting the current moving speed through the correction information.
According to the embodiment of the invention, the lengths of the adjacent conveying areas are the same or different, the moving speeds of the carriers in the different conveying areas are different, the moving speed of the carriers is increased in a gradient manner, and when the moving speed is increased to the preset speed, the carriers are kept to move at a constant speed.
It should be noted that, in the process of sliding the carrier on the slide, initially, the moving speed of the carrier is slowly increased, and when the carrier is increased to a predetermined speed, the carrier keeps running at a constant speed.
According to the embodiment of the invention, a corresponding detection mode is established according to the conveying area, and a detection result is obtained, specifically:
obtaining an automobile type, and generating bumper parameter information according to the automobile type;
generating a corresponding spraying mode according to the bumper parameter information,
different parts of the bumper are sprayed in different conveying areas,
collecting the spraying state information of the bumper, judging the spraying error according to the spraying state,
and if the spraying error is larger than the preset error, carrying out secondary spraying on the bumper.
It should be noted that, the shape and size of the bumper of different automobile models are different, so the bumper parameters need to be determined according to the automobile models, different spraying modes and spraying time are selected according to different bumper parameters, after the spraying is completed, the uniformity of the sprayed layer on the bumper is detected, the uniformity is larger, or when the spraying error is larger, the secondary spraying or the multiple spraying is carried out on the uneven position on the bumper, and if the required index is still not met, the outer side of the bumper can be scraped and sprayed again.
According to the embodiment of the invention, production line images are collected, and the production line images are preprocessed; the method specifically comprises the following steps:
extracting image characteristics of the production line, filtering and denoising the image characteristics through wavelet transformation,
signal reconstruction is carried out on the denoised image signal to obtain a processed image,
and performing color texture enhancement on the processed image to obtain an enhanced image.
It should be noted that image enhancement is a method commonly used in the digital image processing process, and is divided into two categories, namely a spatial domain method for processing in the pixel space where an image is located and a frequency domain method for indirectly processing in the frequency domain after fourier transform according to different processing spaces, image denoising based on wavelet transform is performed by a nonlinear method, wavelet transform is a function approximation problem in the mathematical field, and the best approximation to the original image information in the function space after the expansion and translation of the wavelet function is found according to the actual requirements. Meanwhile, the image denoising based on the wavelet transformation is also a signal filtering problem, the wavelet denoising is an important stage for ensuring the quality of the later classification discrimination in the image recognition process while keeping the characteristic detail information such as the edge of the image, the characteristic extraction is an important stage for ensuring the quality of the later classification discrimination in the image recognition process, the extracted image characteristic needs to be capable of expressing the typical characteristic of a recognized object, and the characteristic extraction has characteristics of uniqueness, completeness, geometric invariance and abstraction, and the elements of the characteristic extraction have characteristics of color, texture, edge, shape and the like. The color is the basic component of the image information, each identified object has the characteristic of color, the texture characteristic is the statistics of the local properties of the image through the image gray level distribution function, and is a description of the gray level spatial distribution of each pixel in the image, and the local part may not have a rule, but a certain rule is presented on the characteristic of the whole image.
The third aspect of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium includes a program of a visual inspection method for an automobile painting production line, and when the program of the visual inspection method for the automobile painting production line is executed by a processor, the steps of the visual inspection method for the automobile painting production line are implemented as in any one of the above.
The visual detection method, the system and the readable storage medium for the automobile spraying production line disclosed by the invention can accurately shoot the automobile body positioning information, the automobile type information and the like, and realize the on-line detection of the bumper. In addition, the application of the system can timely alarm the abnormal positioning condition, thereby improving the safety of coating production, ensuring the production efficiency of a coating production line, effectively saving the production cost and improving the productivity of the automobile production industry.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: a removable memory device, a Read-only memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention or portions thereof contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily think of the changes or substitutions within the technical scope of the present invention, and shall cover the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (9)
1. A visual inspection method for an automobile spraying production line is characterized by comprising the following steps:
collecting production line images, preprocessing the production line images to obtain processed images,
acquiring production line parameter information according to the processed image, establishing a conveying platform coordinate system, and carrying out segmentation processing on the conveying platform to form a plurality of conveying areas;
acquiring carrier position information of a target product, and comparing the carrier position information with preset position information to obtain a deviation rate;
judging whether the deviation rate is greater than a preset deviation rate threshold value or not, if the deviation rate is greater than the preset deviation rate threshold value, generating compensation information, and adjusting the position of the carrier to a preset position according to the compensation information;
establishing a corresponding detection mode according to the conveying area, obtaining a detection result, and displaying the detection result according to a preset mode;
establishing a conveying platform coordinate system, and carrying out sectional treatment on the conveying platform to form a plurality of conveying areas, which specifically comprises the following steps: acquiring spraying parameter information, and establishing carrier movement parameter information according to the spraying parameter information;
segmenting the conveying platform according to the carrier movement parameter information, and establishing carrier movement speed models in different conveying areas;
automatically generating a carrier preset moving speed under a corresponding time node through a carrier moving speed model;
acquiring the real-time moving speed of the carrier;
comparing the real-time moving speed of the carrier with the preset moving speed of the carrier to obtain a speed deviation rate;
judging whether the speed deviation rate is larger than a preset speed deviation rate or not,
and if so, generating correction information, and correcting the current moving speed through the correction information.
2. The visual inspection method of the automobile spraying production line according to claim 1, characterized in that the production line image is collected and preprocessed; the method specifically comprises the following steps:
extracting image characteristics of the production line, filtering and denoising the image characteristics through wavelet transformation,
signal reconstruction is carried out on the denoised image signal to obtain a processed image,
and carrying out color texture enhancement on the processed image to obtain an enhanced image.
3. The visual inspection method for the automobile painting production line according to claim 1, further comprising:
carrier parameter information is collected, positioning points are established according to the carrier parameter information, and coordinate information of the positioning points is obtained;
positioning a target product according to the positioning points to obtain positioning state information;
comparing the positioning state information with preset state information to obtain a positioning state deviation rate;
if the deviation ratio of the positioning state is larger than a first threshold value and smaller than a second threshold value, generating first alarm information, generating adjustment information according to the first alarm information, and adjusting the spraying state parameters according to the adjustment information;
if the deviation rate of the positioning state is larger than a second threshold value, generating second alarm information, marking the target product according to the second alarm information, and generating a corresponding processing mode;
the first threshold is less than the second threshold.
4. The visual inspection method of the automobile painting production line according to claim 1, wherein the image information of the workpiece is collected, the type of the workpiece is identified, N identification points are obtained at different positions of the workpiece, and coordinates of the N identification points are formed,
the coordinates of the N identification points are compared with preset coordinates,
if M coordinates in the N identification points deviate from a preset threshold value, judging that the position of the workpiece deviates,
wherein M is greater than N/3.
5. The visual inspection method for automobile painting production line according to claim 1,
collecting image information of a target product, identifying the type of the target product, matching the type information of the target product,
selecting a corresponding spraying program according to the information of the target product vehicle type,
the target product delivery time is set according to the spray program,
and when the target product is identified to reach the preset position through the radio frequency chip, the spraying robot sprays the target product according to the spraying program.
6. The visual inspection method of the automobile painting production line according to claim 1, wherein the production line parameters include the length of the production line, the identification of different types of workpieces in the production line, the composition of the painting equipment in the production line, and the position of the painting equipment, the conveying areas are arranged along the length of the production line, 3-10 conveying areas are arranged, the lengths of the adjacent conveying areas are the same or different, the moving speeds of the carriers in the different conveying areas are different, the moving speeds of the carriers are gradually increased in a gradient manner, and when the moving speeds are increased to a preset speed, the carriers are kept to move at a constant speed.
7. The visual inspection method for the automobile spraying production line as claimed in claim 1, wherein a corresponding inspection mode is established according to a conveying area, and an inspection result is obtained, specifically:
obtaining an automobile type, and generating bumper parameter information according to the automobile type;
generating a corresponding spraying mode according to the bumper parameter information,
different parts of the bumper are sprayed in different conveying areas,
collecting the spraying state information of the bumper, judging the spraying error according to the spraying state,
and if the spraying error is larger than the preset error, performing secondary spraying on the bumper.
8. A visual inspection system for an automotive painting production line, the system comprising: the visual detection method program for the automobile spraying production line is executed by the processor to realize the following steps:
collecting production line images, preprocessing the production line images to obtain processed images,
acquiring production line parameter information according to the processed image, establishing a conveying platform coordinate system, and carrying out segmentation processing on the conveying platform to form a plurality of conveying areas;
acquiring carrier position information of a target product, and comparing the carrier position information with preset position information to obtain a deviation rate;
judging whether the deviation rate is greater than a preset deviation rate threshold value or not, if the deviation rate is greater than the preset deviation rate threshold value, generating compensation information, and adjusting the position of the carrier to a preset position according to the compensation information;
establishing a corresponding detection mode according to the conveying area, obtaining a detection result, and displaying the detection result according to a preset mode;
establishing a coordinate system of a conveying platform, and carrying out segmentation treatment on the conveying platform to form a plurality of conveying areas, which specifically comprises the following steps: acquiring spraying parameter information, and establishing carrier movement parameter information according to the spraying parameter information;
segmenting the conveying platform according to the carrier movement parameter information, and establishing carrier movement speed models in different conveying areas;
automatically generating a carrier preset moving speed under a corresponding time node through a carrier moving speed model;
acquiring the real-time moving speed of the carrier;
comparing the real-time moving speed of the carrier with the preset moving speed of the carrier to obtain a speed deviation rate;
judging whether the speed deviation rate is larger than a preset speed deviation rate or not,
and if the current moving speed is larger than the preset moving speed, generating correction information, and correcting the current moving speed through the correction information.
9. A computer-readable storage medium, characterized in that the computer-readable storage medium includes a program of a visual inspection method for an automobile painting production line, and when the program of the visual inspection method for an automobile painting production line is executed by a processor, the steps of the visual inspection method for an automobile painting production line according to any one of claims 1 to 7 are implemented.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210364967.2A CN114549519B (en) | 2022-04-08 | 2022-04-08 | Visual detection method and system for automobile spraying production line and readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210364967.2A CN114549519B (en) | 2022-04-08 | 2022-04-08 | Visual detection method and system for automobile spraying production line and readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114549519A CN114549519A (en) | 2022-05-27 |
| CN114549519B true CN114549519B (en) | 2022-07-22 |
Family
ID=81665925
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210364967.2A Active CN114549519B (en) | 2022-04-08 | 2022-04-08 | Visual detection method and system for automobile spraying production line and readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114549519B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115343289A (en) * | 2022-07-18 | 2022-11-15 | 中国第一汽车股份有限公司 | Automatic scratch detection system and method for whole automobile assembly pit package |
| CN114998328A (en) * | 2022-07-27 | 2022-09-02 | 苏州天成涂装系统股份有限公司 | Workpiece spraying defect detection method and system based on machine vision and readable storage medium |
| CN115561249B (en) * | 2022-11-09 | 2023-04-25 | 松乐智能装备(广东)有限公司 | Intelligent monitoring method and system for spraying equipment |
| CN115646788A (en) * | 2022-12-26 | 2023-01-31 | 中铭谷智能机器人(广东)有限公司 | Method and system for automatically spraying automobile metal plate |
| CN116182953B (en) * | 2023-03-06 | 2024-01-05 | 中稀材(广东)技术有限公司 | Intelligent online detection system for flat plate spraying process and application method of intelligent online detection system |
| CN116923988B (en) * | 2023-09-19 | 2023-12-15 | 杭州集英智慧农业装备有限公司 | Intelligent remote control monorail conveyor, control method and medium |
| CN117148803B (en) * | 2023-10-27 | 2024-01-26 | 深圳市磐锋精密技术有限公司 | Adjusting control method for automatic centering width adjusting assembly line |
| CN117270481B (en) * | 2023-11-22 | 2024-02-23 | 北京东大金智科技股份有限公司 | Data processing method and system for industrial personal computer |
| CN117635120B (en) * | 2023-12-05 | 2024-08-02 | 苏州天成涂装系统股份有限公司 | Remote monitoring management system for coating equipment |
| CN117452222A (en) * | 2023-12-21 | 2024-01-26 | 深圳市安仕新能源科技有限公司 | BMS production line quality control method, system and medium |
| CN117706966B (en) * | 2024-02-05 | 2024-05-14 | 钛玛科（北京）工业科技有限公司 | Intelligent automatic centering control system |
| CN118150578A (en) * | 2024-03-14 | 2024-06-07 | 苏州诺克智能装备股份有限公司 | Visual detection method, system and medium for automobile welding production line |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113409617B (en) * | 2021-06-15 | 2023-02-17 | 中国水产科学研究院南海水产研究所 | Fishery ship yaw early warning system and method |
| CN113856938B (en) * | 2021-11-29 | 2022-03-04 | 单县多米石墨烯科技有限公司 | Spraying uniformity detection method and system for graphene anticorrosive paint |
-
2022
- 2022-04-08 CN CN202210364967.2A patent/CN114549519B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN114549519A (en) | 2022-05-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN114549519B (en) | Visual detection method and system for automobile spraying production line and readable storage medium | |
| CN104992449B (en) | Information identification and surface defect online test method based on machine vision | |
| CN111127402A (en) | Visual detection method for welding quality of robot | |
| CN109840900B (en) | Fault online detection system and detection method applied to intelligent manufacturing workshop | |
| CN112419298B (en) | Bolt node plate rust detection method, device, equipment and storage medium | |
| CN111123853A (en) | Control method of robot for detecting and remedying spraying on inner surface of automobile | |
| CN104299246B (en) | Production line article part motion detection and tracking based on video | |
| CN113870217B (en) | Edge deviation vision measurement method based on machine vision and image detector | |
| CN111539927A (en) | Detection process and algorithm of automobile plastic assembly fastening buckle lack-assembly detection device | |
| CN112381783B (en) | Weld track extraction method based on red line laser | |
| CN114235837A (en) | LED packaging surface defect detection method, device, medium and equipment based on machine vision | |
| CN115358965A (en) | Welding deformation adaptive linear weld grinding track generation method and device | |
| US20220044382A1 (en) | Electronic device and method for marking defects of products | |
| CN114913346A (en) | Intelligent sorting system and method based on product color and shape recognition | |
| CN111062910B (en) | Local threshold segmentation method and defect detection method | |
| CN111539951B (en) | Visual detection method for outline size of ceramic grinding wheel head | |
| CN111805533B (en) | Device for workpiece blanking and workpiece blanking method based on visual positioning | |
| CN112109374A (en) | Method for positioning and controlling assembling and disassembling of bending die based on computer vision system | |
| US20230025165A1 (en) | Method to locate defects in e-coat | |
| CN114932292B (en) | Narrow-gap passive vision weld joint tracking method and system | |
| CN112927197B (en) | Method, device, equipment and storage medium for detecting rust of air conditioner outdoor unit bracket | |
| Qian et al. | The autonomous detection of sheet metal parts using imageprocessing | |
| Shishira et al. | Proximity contours: Vision based detection and tracking of objects in manufacturing plants using industrial control systems | |
| CN114581447A (en) | Conveying belt deviation identification method and device based on machine vision | |
| CN115272984B (en) | Method, system, computer and readable storage medium for detecting lane occupation operation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |