Disclosure of Invention
The invention aims to provide an automatic detection system for production of liquid crystal display clock products, which has high automation degree and detection accuracy. The detection and inspection of a plurality of items can be completed at one time. The problem of low efficiency caused by missed detection due to subjective factors such as fatigue and negligence in the conventional manual detection can be solved. The number of full-time inspectors can be reduced, and labor cost is saved.
In order to achieve the purpose, the technical scheme of the invention is as follows: the automatic detection system for the production of the liquid crystal display clock products comprises a fixed detection device, a first multi-shaft mechanical arm and a second multi-shaft mechanical arm, wherein the first multi-shaft mechanical arm places the finished liquid crystal display clock products into the fixed detection device, the fixed detection device collects the image, sound and light source information of the finished liquid crystal display clock products in real time, analyzes whether the finished liquid crystal display clock products are abnormal or not, and then places the finished liquid crystal display clock products into a normal product area or an abnormal product area through the second multi-shaft mechanical arm.
In an embodiment of the invention, after the fixed detection device collects the image, sound and light source information of the finished products of the liquid crystal display clocks and watches, whether the finished products of the liquid crystal display clocks and watches are abnormal or not is judged through the image, sound and light source information of the standard liquid crystal display clocks and watches, and after the detection is finished, the fixed detection device displays the detection information on a local display and transmits the detection information to a production background management system.
In an embodiment of the present invention, the fixed detection device collects information of an image, a sound, and a light source of a finished product of a liquid crystal display clock in real time, and analyzes whether the finished product of the liquid crystal display clock is abnormal, and the specific implementation steps are as follows:
(1) image abnormity judgment of finished products of liquid crystal display clocks and watches:
after a fixing detection device powers on a finished product of a liquid crystal display clock product through a three-axis manipulator arranged on the fixing detection device, acquiring image information displayed by an LCD or LED screen under the working state of the finished product of the liquid crystal display clock product through a camera arranged on the fixing detection device, then performing point-by-point pixel gray level analysis on the image information displayed by the LCD or LED screen through a 32-order gray level histogram algorithm and a gray level matrix symbiotic algorithm by the fixing detection device, and finally comparing the image information with the image information displayed by the LCD or LED screen of a standard liquid crystal display clock product to judge whether difference exists;
(2) sound abnormity judgment of finished products of liquid crystal display clocks and watches:
after the fixed detection device powers on the finished products of the liquid crystal display clock products through a three-axis manipulator arranged on the fixed detection device, sound information of the finished products of the liquid crystal display clock products is collected through a microphone arranged on the fixed detection device, then the fixed detection device analyzes the frequency and decibel level of the sound information through an audio processing algorithm, and finally the sound information is compared with the sound information of the standard liquid crystal display clock products to judge whether difference exists;
(3) judging the light source abnormity of finished products of liquid crystal display clocks and watches:
after a fixing detection device powers on a finished product of a liquid crystal display clock product through a three-axis manipulator arranged on the fixing detection device, backlight color and backlight brightness information of an LCD or LED screen of the finished product of the liquid crystal display clock product in a working state are acquired through a photoelectric color detection sensor circuit and a photoelectric brightness detection sensor circuit arranged on the fixing detection device, then the fixing detection device analyzes the brightness and chromaticity of the backlight color and the backlight brightness of the LCD or LED screen through a color difference algorithm, and finally, the fixing detection device is compared with the backlight color and the backlight brightness of the LCD or LED screen of a standard liquid crystal display clock product to judge whether the difference exists.
In an embodiment of the present invention, the specific implementation manner of performing point-by-point pixel gray scale analysis on the image information displayed by the LCD or LED screen through the 32-level gray histogram algorithm and the gray matrix symbiotic algorithm, and finally comparing the analyzed result with the image information displayed by the LCD or LED screen of the standard LCD clock product to determine whether there is a difference is as follows:
respectively calculating the image similarity S1 and S2 of the LCD or LED screen display image of the liquid crystal display clock type product to be detected and the LCD or LED screen display image of the standard liquid crystal display clock type product through a 32-order gray histogram algorithm and a gray matrix co-occurrence algorithm to obtain a final similarity formula:
S=K1*S1+K2*S2
K1+K2=1
k1 and K2 are respectively the weight of the 32-order gray level histogram algorithm and the gray level matrix symbiotic algorithm;
if the final similarity S is greater than or equal to the preset similarity threshold
If so, the finished product of the liquid crystal display clock product to be detected is normal; otherwise, the finished products of the liquid crystal display clock products to be detected are abnormal.
In an embodiment of the present invention, the specific implementation manner of analyzing the frequency and decibel level of the sound information by the audio processing algorithm, and comparing and determining whether there is a difference with the sound information of the standard lcd clock products is as follows:
the microphone collects sound information of finished products of liquid crystal display clocks and watches, namely, buzzer or loudspeaker sound after the finished products of the liquid crystal display clocks and watches are electrified, sound frequency digital values corresponding to the buzzer or the loudspeaker sound are obtained through amplification and analog-to-digital conversion processing, then the sound frequency digital values are compared with preset frequency numerical values, frequency deviation can be judged, meanwhile, logarithmic calculation is carried out on the sound frequency digital values and preset 0 decibel calibration voltage digital values, and the calculation formula is as follows:
and comparing the detected sound decibel series with a preset sound decibel series to judge the sound decibel series deviation, and further judging whether the finished product of the liquid crystal display clock type product to be detected is abnormal or not according to the frequency deviation and the sound decibel series deviation.
In an embodiment of the present invention, the specific implementation manner of analyzing the backlight color and the backlight brightness of the LCD or LED screen by using the color difference algorithm and finally comparing the analyzed result with the backlight color and the backlight brightness of the LCD or LED screen of the standard LCD clock type product to determine whether there is a difference is as follows:
the photoelectric color detection sensor circuit comprises three silicon photosensors which are isolated from each other, the backlight color of an LCD or LED screen under the working state of a finished product of a liquid crystal display clock product needs to be filtered by a red-green-blue three-primary-color filter before being collected, three primary-color components of backlight are respectively obtained, then the three primary colors are irradiated on the three silicon photosensors which are isolated from each other, each sensor generates different voltages according to different incident light intensities, after signal processing, a microprocessor arranged in a fixed detection device converts three paths of voltage values into 32-bit binary data, and then the 32-bit binary data are compared one by one with the preset 32-bit binary data;
meanwhile, for the backlight brightness value of the LCD or LED screen, the backlight brightness value of the LCD or LED screen of the finished product of the liquid crystal display clock to be detected can be calculated by adopting a formula Y =0.30R +0.59G +0.11B, and then is compared with the preset backlight brightness value;
and through the comparison of the 32-bit binary data and the backlight brightness value, whether the finished products of the liquid crystal display clocks and watches to be detected are abnormal can be judged.
In an embodiment of the invention, the fixed detection device, the first multi-axis manipulator and the second multi-axis manipulator are all disposed beside an automatic production line of finished products such as liquid crystal display clock products.
In an embodiment of the invention, the automatic assembly line conveyor belt is provided with mark frames for placing finished products of liquid crystal display clocks and watches at preset intervals, the first multi-shaft manipulator identifies the mark frames at the preset intervals on the automatic assembly line conveyor belt through an attached camera, and if the finished products of the liquid crystal display clocks and watches to be detected in the mark frames are identified, the finished products of the liquid crystal display clocks and watches to be detected are picked up through a starting clamp or a vacuum chuck attached to the first multi-shaft manipulator.
Compared with the prior art, the invention has the following beneficial effects:
1. the system has high automation degree and detection accuracy. The detection and inspection of a plurality of items can be completed at one time. The problem of low efficiency caused by missed detection due to subjective factors such as fatigue and negligence in the conventional manual detection can be solved. The number of full-time inspectors can be reduced, and the labor cost is saved;
2. the invention improves the patterns, backlight brightness, color, sound size and frequency of the previous similar products into machine quantitative analysis judgment from manual judgment, so that the consistency of product performance and quality stability are further improved;
3. the invention can realize automatic sorting and stacking of good products and defective products, and intensively store and display the defective product information on the random display, so that follow-up fault inquiry and positioning maintenance are more rapid and convenient;
4. the invention can transmit all the checked product information to the production management system background, thereby facilitating the production management personnel to carry out summary analysis of big data, searching the probability of production problems of various products and carrying out targeted quality improvement.
Detailed Description
The technical scheme of the invention is specifically explained below with reference to the accompanying drawings.
The invention provides an automatic detection system for the production of liquid crystal display clock products, which comprises a fixed detection device, a first multi-shaft mechanical arm and a second multi-shaft mechanical arm, wherein the first multi-shaft mechanical arm places the finished liquid crystal display clock products into the fixed detection device, the fixed detection device collects the image, sound and light source information of the finished liquid crystal display clock products in real time, analyzes whether the finished liquid crystal display clock products are abnormal or not, and then places the finished liquid crystal display clock products into a normal product area or an abnormal product area through the second multi-shaft mechanical arm. After the fixed detection device collects the image, sound and light source information of the finished products of the liquid crystal display clocks and watches, whether the finished products of the liquid crystal display clocks and watches are abnormal or not is judged through the image, sound and light source information of the standard liquid crystal display clocks and watches, and after the detection is finished, the fixed detection device displays the detection information on a local display and transmits the detection information to a production background management system.
The fixed detection device collects the image, sound and light source information of the finished products of the liquid crystal display clocks and watches in real time, and analyzes whether the finished products of the liquid crystal display clocks and watches are abnormal or not, and the specific implementation steps are as follows:
(1) image abnormity judgment of finished products of liquid crystal display clocks and watches:
after a fixing detection device powers on a finished product of a liquid crystal display clock product through a three-axis manipulator arranged on the fixing detection device, acquiring image information displayed by an LCD or LED screen under the working state of the finished product of the liquid crystal display clock product through a camera arranged on the fixing detection device, then performing point-by-point pixel gray level analysis on the image information displayed by the LCD or LED screen through a 32-order gray level histogram algorithm and a gray level matrix symbiotic algorithm by the fixing detection device, and finally comparing the image information with the image information displayed by the LCD or LED screen of a standard liquid crystal display clock product to judge whether difference exists;
(2) sound abnormity judgment of finished products of liquid crystal display clocks and watches:
after the fixed detection device powers on the finished products of the liquid crystal display clock products through a three-axis manipulator arranged on the fixed detection device, sound information of the finished products of the liquid crystal display clock products is collected through a microphone arranged on the fixed detection device, then the fixed detection device analyzes the frequency and decibel level of the sound information through an audio processing algorithm, and finally the sound information is compared with the sound information of the standard liquid crystal display clock products to judge whether difference exists;
(3) judging the light source abnormity of finished products of liquid crystal display clocks and watches:
after a fixing detection device powers on a finished product of a liquid crystal display clock product through a three-axis manipulator arranged on the fixing detection device, backlight color and backlight brightness information of an LCD or LED screen of the finished product of the liquid crystal display clock product in a working state are acquired through a photoelectric color detection sensor circuit and a photoelectric brightness detection sensor circuit arranged on the fixing detection device, then the fixing detection device analyzes the brightness and chromaticity of the backlight color and the backlight brightness of the LCD or LED screen through a color difference algorithm, and finally, the fixing detection device is compared with the backlight color and the backlight brightness of the LCD or LED screen of a standard liquid crystal display clock product to judge whether the difference exists.
The specific implementation mode for analyzing the pixel gray scale of the image information displayed by the LCD or LED screen point by point through the 32-order gray histogram algorithm and the gray matrix symbiotic algorithm and finally comparing the analyzed pixel gray scale with the image information displayed by the LCD or LED screen of a standard LCD display clock product to judge whether the difference exists is as follows:
respectively calculating the image similarity S1 and S2 of the LCD or LED screen display image of the liquid crystal display clock type product to be detected and the LCD or LED screen display image of the standard liquid crystal display clock type product through a 32-order gray histogram algorithm and a gray matrix co-occurrence algorithm to obtain a final similarity formula:
S=K1*S1+K2*S2
K1+K2=1
k1 and K2 are respectively the weight of the 32-order gray level histogram algorithm and the gray level matrix symbiotic algorithm;
if the final similarity S is greater than or equal to the preset similarity threshold
If so, the finished product of the liquid crystal display clock product to be detected is normal; otherwise, the finished products of the liquid crystal display clock products to be detected are abnormal.
The specific implementation mode of analyzing the frequency and decibel series of the sound information through the audio processing algorithm and finally comparing the sound information with the sound information of standard liquid crystal display clock products to judge whether the difference exists is as follows:
the microphone collects sound information of finished products of liquid crystal display clocks and watches, namely, buzzer or loudspeaker sound after the finished products of the liquid crystal display clocks and watches are electrified, sound frequency digital values corresponding to the buzzer or the loudspeaker sound are obtained through amplification and analog-to-digital conversion processing, then the sound frequency digital values are compared with preset frequency numerical values, frequency deviation can be judged, meanwhile, logarithmic calculation is carried out on the sound frequency digital values and preset 0 decibel calibration voltage digital values, and the calculation formula is as follows:
and comparing the detected sound decibel series with a preset sound decibel series to judge the sound decibel series deviation, and further judging whether the finished product of the liquid crystal display clock type product to be detected is abnormal or not according to the frequency deviation and the sound decibel series deviation.
The specific implementation mode of analyzing the brightness and the chromaticity of the backlight color and the backlight brightness of the LCD or the LED screen by adopting the color difference algorithm and finally comparing the analyzed brightness and the chromaticity with the backlight color and the backlight brightness of the LCD or the LED screen of the standard LCD clock type product to judge whether the difference exists is as follows:
the photoelectric color detection sensor circuit comprises three silicon photosensors which are isolated from each other, the backlight color of an LCD or LED screen under the working state of a finished product of a liquid crystal display clock product needs to be filtered by a red-green-blue three-primary-color filter before being collected, three primary-color components of backlight are respectively obtained, then the three primary colors are irradiated on the three silicon photosensors which are isolated from each other, each sensor generates different voltages according to different incident light intensities, after signal processing, a microprocessor arranged in a fixed detection device converts three paths of voltage values into 32-bit binary data, and then the 32-bit binary data are compared one by one with the preset 32-bit binary data;
meanwhile, for the backlight brightness value of the LCD or LED screen, the backlight brightness value of the LCD or LED screen of the finished product of the liquid crystal display clock to be detected can be calculated by adopting a formula Y =0.30R +0.59G +0.11B, and then is compared with the preset backlight brightness value;
and through the comparison of the 32-bit binary data and the backlight brightness value, whether the finished products of the liquid crystal display clocks and watches to be detected are abnormal can be judged.
The fixed detection device, the first multi-axis manipulator and the second multi-axis manipulator are all arranged beside an automatic production line of finished products of liquid crystal display clock type products. The automatic assembly line conveying belt is provided with mark frames for placing finished products of liquid crystal display clocks and watches according to a preset distance, the first multi-shaft manipulator identifies the mark frames with the preset distance on the automatic assembly line conveying belt through an attached camera, and if the liquid crystal display clocks and watches finished products to be detected are identified in the mark frames, the liquid crystal display clocks and watches finished products to be detected are picked up through a starting clamp or a vacuum chuck attached to the first multi-shaft manipulator.
The following is a specific embodiment of the present invention.
As shown in fig. 1, two multi-axis robots and a fixed inspection device are deployed alongside an automated pipeline. A multi-shaft automatic manipulator identifies mark frames with fixed intervals and shapes on an automatic assembly line conveying belt through an attached camera, and picks up products to be detected by using a pneumatic clamp or a vacuum chuck after identifying the products to be detected in the mark frames. And after the product to be detected is placed downwards in the fixed frame of the detection device, the product is automatically moved back to the upper part of the assembly line conveyor belt to be ready for picking up the next product to be detected.
After the fixed detection device powers on a product through the three-axis manipulator, a camera is used for shooting a product LCD screen or LED lamp display pattern, a 32-order gray level histogram algorithm and a gray level matrix symbiotic algorithm which are operated by a built-in microprocessor are used for carrying out pixel gray level analysis on the shot image, and whether difference exists between the pixel gray level analysis and the gray level matrix symbiotic algorithm and a pre-stored standard pattern is judged.
The three-primary-color filter, the silicon optical sensor and the auxiliary signal processing circuit are used for analyzing the brightness and the chromaticity of the background color of the shot image through a color difference algorithm operated by a built-in microprocessor.
The piezoelectric microphone, the audio shaping and amplifying circuit and the A/D conversion detection circuit are used for carrying out frequency and decibel level analysis on the sampled alarm prompt tone through an audio processing algorithm operated by a built-in microprocessor.
A multi-axis robot picks up inspected products using a pneumatic jig or a vacuum chuck, and places qualified products and unqualified products in a predetermined area or container according to the inspection results. And automatically moves back to the home position ready to pick up the next product for which inspection is complete.
The test results and data for each tested product are displayed on a random self-contained display and also stored in a rewritable non-volatile memory. And the WIFI network is used for transmitting the data to a database of the production management background system.
As shown in fig. 3, in an embodiment of the present invention, the multi-axis manipulator includes a pneumatic control mechanical fixture or a pneumatic control chuck, a longitudinal axis screw assembly, a primary swing arm, a secondary swing arm, a rotary base, a flexible pneumatic-electric pipeline, a video processing and signal control circuit, a DC driving power module, and a coaxial camera.
The motion control mode is as follows: (1) a servo motor drives a pneumatic control mechanical arm which can rotate by 360 degrees; (2) the stepping motor drives the screw rod assembly to enable the manipulator to move downwards along a longitudinal axis (a longitudinal axis limit switch is arranged); (3) the swing arm which can rotate 360 degrees can drive the manipulator and the screw rod group to rotate freely (the electric dragging part of the manipulator and the screw rod group consists of a direct current motor, a photoelectric encoder, a proximity switch and the like); (4) the rotating base mainly supports the upper part 3; (5) the opening and closing of the pneumatic control manipulator is controlled by air pressure (the manipulator is tightly clamped when the air is inflated, and the manipulator is loosened when the air is deflated). The suction and release of the pneumatic control sucker are controlled by air pressure (the sucker and the surface of the object form partial vacuum when air is pumped, the sucker and the object are pressed by external atmospheric pressure, the air pressure between the sucker and the surface of the object is greater than the external atmospheric pressure when air is inflated, and the sucker is separated from the object)
The working process is as follows: when a product arrives, the area mark on the photographing identification conveying belt of the manipulator for picking the product to be detected, which is attached with the coaxial camera, is positioned in the center of the image, and the manipulator system starts to act; the stepping motor controls and drives the lead screw assembly to enable the manipulator to move downwards along the longitudinal axis, and meanwhile, one path of servo motor controls the primary swing arm to move left and right; the other path of servo motor drives the secondary swing arm to rotate to reach the position where the product is just grabbed, then the air is inflated or exhausted, and the mechanical arm clamps or the sucker sucks the product. After a product is gripped or adsorbed, the stepping motor drives the screw rod assembly to ascend along the longitudinal axis, and one path of servo motor controls the primary swing arm to move left and right; the other path of servo motor drives the secondary swing arm to rotate to reach the product inspection fixed frame; the stepping motor drives the lead screw assembly to descend again, after the lead screw assembly reaches a designated position, the air valve deflates or inhales air, and the manipulator or the sucker loosens a product; and returning the manipulator to prepare for the next action.
After the product function is inspected, one path of servo motor of the inspected product manipulator is picked up to control the primary swing arm to start to move left and right; the other path of servo motor drives the secondary swing arm to rotate to reach a product fixing position, the stepping motor drives the lead screw assembly to descend along the longitudinal axis, then air inflation or air suction is carried out, and the product is clamped by the mechanical arm or sucked by the sucker. After the product is gripped or adsorbed, the stepping motor drives the screw rod assembly to ascend along the longitudinal axis. According to whether the product is qualified or not, one path of servo motor controls the primary swing arm to start to move left and right; the other path of servo motor drives the secondary swing arm to rotate and respectively transfers the secondary swing arm to a qualified product stacking area or an unqualified product stacking area; the stepping motor drives the lead screw assembly to descend along the longitudinal axis again, after the lead screw assembly reaches a designated position, the air valve deflates or inhales air, and the manipulator or the sucker loosens a product; and returning the manipulator to prepare for the next action.
As shown in fig. 4, in an embodiment of the present invention, the fixed detection device includes a 7-inch touch display screen, a color CCD imaging camera, a three-primary-color spectrophotometric detection module, an audio frequency and level detection module, a photoelectric detection module, a three-axis manipulator, an industrial control motherboard (ARM 11 processor), a double-rate synchronous dynamic random access memory, a rewritable non-volatile memory, a WIFI signal transmission module, an AC-DC power supply module, and an external multi-axis manipulator pneumoelectric supply pipeline.
Pick up and wait to examine the multiaxis mechanical handle of examining the product and wait to examine the product and place on detection device's fixed position, the photoelectric detection module detects the product and has laid and will target in place signal transmission to control mainboard. The main board drives the three-axis manipulator to move above the product, the manipulator inserts a power pole piece or a plug with the preset distance and voltage into a battery pole piece or a DC power seat at the back of the product, and simultaneously starts a color CCD imaging camera, a three-primary-color spectrophotometry detection function, a sound frequency detection function and a sound level detection function.
In the product power-on initialization process, a color CCD imaging camera is used for shooting pictures of display patterns, and point-by-point pixel gray level analysis is performed by combining a 32-order gray level histogram algorithm and a gray level matrix symbiosis algorithm. The two algorithms in combination can calculate two similarities between the photo pattern and the pre-stored pattern. And then carrying out weighted average on the two similarity degrees to further obtain the image similarity after the average. The final similarity is defined as:
S=K1*S1+K2*S2
K1+K2=1
s1 and S2 are image similarity calculated by a gray level histogram algorithm and a gray level co-occurrence matrix respectively, and K1 and K2 are weights of two similarity calculation methods, and are both 0.5.
And filtering the color of the backlight source by using a red, green and blue tricolor filter to respectively obtain tricolor components of the backlight. The three primary colors irradiate three silicon light sensors which are isolated from each other, each sensor generates different voltages for different intensities of incident light, and each path of voltage signal is transmitted to an A/D detection interface of a microprocessor through a signal amplification processing circuit with different amplification factors. The microprocessor internal color difference algorithm converts the three sampled voltage values into 32-bit binary data, and compares the binary data with preset binary data one by one. Since the color signal includes the luminance signal, the sampled luminance value can be calculated by the formula Y =0.30R +0.59G + 0.11B.
The piezoelectric microphone is used for carrying out audio sampling on the sound of the buzzer or the loudspeaker after being electrified, the input analog voltage is converted into a time (pulse width) signal through the audio shaping amplifying circuit and the sigma-delta type A/D conversion circuit, and a corresponding sound frequency digital value is obtained after the time (pulse width) signal is processed through the digital filter. And comparing the frequency deviation with a preset standard frequency value to obtain the frequency deviation. And simultaneously carrying out logarithmic calculation with a preset 0 dB calibration voltage digital value. The calculation formula is as follows:
and obtaining the detected sound decibel level.
The contrast coincidence rate of the product pattern must be above 95%, the contrast coincidence rate of the backlight brightness and the chromatic aberration must be above 85%, and the contrast coincidence rate of the sound frequency and the decibel level must be above 80%. And if the product is qualified according with the judgment standard, otherwise, the product is unqualified, and the built-in unprocessed processor stores the analysis data in the rewritable non-volatile memory and transmits the analysis data to the production management background database through the WIFI signal transmission module. And simultaneously displayed on an attached 7-inch touch display screen in a graphic and text mode. The production personnel can use the touch keys on the display screen to select and view each detection result of each detected product.
The mainboard drives the three-axis manipulator to pull out the power pole piece or the plug and return to prepare for the next action. And transmitting the product detection judgment result to a manipulator for picking up the detected product through a signal line. And the manipulator respectively places the current inspected products in different preset areas according to the judgment result.
The above are preferred embodiments of the present invention, and all changes made according to the technical scheme of the present invention that produce functional effects do not exceed the scope of the technical scheme of the present invention belong to the protection scope of the present invention.