TWI778704B - Smart needle preparation review system - Google Patents

Abstract

A smart needle preparation review system is disclosed. The system includes a drilling machine, an image capture device, a needle preparation review device, and a data output device. The drilling machine includes a needle plate for placing a plurality of drill needles. The image capture device faces the needle plate and takes a needle plate image of the plurality of drill needles. The needle preparation review device is connected to the image capture device. The needle preparation review device includes a processor and a memory. A drill needle preparation table and the needle plate image are stored in the memory. The processor accesses the memory to conduct a needle preparation review program, so as to identify the needle plate image and obtain a review result by comparing with the drill needle preparation table. The data output device is connected to the needle preparation review device and the review result is output by the data output device.

Description

Smart Needle Preparation Review System

The invention relates to an intelligent needle preparation and verification system, in particular to an intelligent needle preparation and verification system for verifying whether the drill needle preparation is correct according to the dial image.

When using a drilling machine to process a workpiece, the drill bit used is the main factor that directly affects the processing results. In the set processing program, if the wrong drill bit is used, in addition to causing the processing size error, it may also cause machine damage. Affecting the production line capacity also increases the production cost of the process. In order to avoid the above problems, the drills used must be confirmed again before they can be operated online to ensure that the drilling process can meet customer requirements.

However, most of these review procedures are performed manually, and it is not easy to identify the differences between different models when the size difference of the drill bits is difficult to identify with the naked eye. Even if the collars of different colors are added, due to the relationship between the number of inspections and the intensity, it is still unavoidable. Due to human negligence, labor fatigue and the large number of inspections, it is difficult for these inspection manpower to complete the review work, which in turn affects the quality of actual processing.

In view of this, the current manual review method has its limitations. In order to effectively review the needle preparation of the drilling machine, the inventor of the present invention has considered and designed an intelligent needle preparation review system, aiming at the existing technology. To improve the deficiencies, and then promote the implementation and utilization of the industry.

In view of the above-mentioned problems of the prior art, the purpose of the present invention is to provide an intelligent needle preparation review system to solve the problem that the conventional manual review operation is costly and cannot ensure its correctness.

According to an objective of the present invention, an intelligent needle preparation and verification system is provided, which includes a drilling machine, an image capture device, a needle preparation and verification device, and a data output device. The drilling machine includes a needle preparation disc for placing a plurality of drilling needles. The image capture device is arranged to face the dial for preparing the dial, and captures the dial images of the plurality of drill needles. The needle preparation and checking device is connected to the image capture device and receives the dial image. The needle preparation and checking device includes a processor and a memory. The memory stores the drill needle preparation table and the dial image, and the processor accesses the memory to execute the preparation. Needle review program, identify multiple pinhole positions and corresponding multiple drill needle models in the dial image, and compare with the drill needle preparation table to obtain the review result. The data output device is connected to the needle preparation checking device, and outputs the checking result.

Preferably, the needle preparation review program may include a plurality of operation modules executed by the processor: a needle dial positioning module, a needle dial coordinate module, a needle ring color picking module, a needle handle color picking module and a drill. Needle determination module. Wherein, the dial positioning module confirms the parameters of the image capture device when the dial preparation reaches the positioning, and shoots the dial preparation to obtain the image to be analyzed. The dial coordinate module processes the image to be analyzed and then performs Hough ring detection to obtain the drill coordinate image. The needle ring color picking module extracts the needle ring image from the drill needle coordinate image with the first focal length, divides the plurality of needle ring coordinates in the needle ring image into a plurality of acquisition points, and calculates the difference of the plurality of acquisition points. The grayscale value is used to judge the needle ring color of each plurality of needle ring coordinates. The needle shank color picking module extracts the needle shank image with the second focal length from the drill needle coordinate image, and repeats the process of dividing and capturing the needle ring color picking module to determine the needle shank color of each plurality of needle ring coordinates. The drill needle judgment module uses the needle ring color and the needle handle color to establish the needle ring needle handle model of the needle preparation disc, and identify the multiple needle hole positions and the corresponding multiple drill needle models in the needle preparation disc through the needle ring needle handle model.

Preferably, the image capturing device may include a camera and a light source, which are directed toward the dial to capture an image of the dial.

Preferably, the image capture device can transmit the needle plate image to the needle preparation and review device in real time by means of wireless network transmission.

Preferably, the image feature processing may include converting the image to be analyzed into grayscale, and performing blurring and smoothing processing on the grayscale image.

Preferably, the needle ring color picking module may include dividing the circle in the coordinate images of the plurality of drill needles into 31 equal parts, and taking the points at a distance of 80% of the radius distance from the center point of each equal part and the center point of the circle as the plurality of extractions. point.

Preferably, the verification result may include confirming the drill needle and the abnormal drill needle, and the position of the abnormal drill needle is marked on the drill needle preparation table with a warning color to notify the operator for interpretation.

Preferably, the data output device may include a display, and the drill needle preparation table and the verification result are displayed on the display.

Preferably, the data output device may include a mobile device, the mobile device installs an application program, and reads the drill needle preparation table and the verification result through the application program interface.

Preferably, the needle preparation and review device can count the positions of abnormal drill needles, and mark the positions where the frequency of abnormality is higher than the preset value to remind the operator.

Based on the above, the intelligent needle preparation review system according to the present invention can have one or more of the following advantages:

(1) This intelligent needle preparation review system can analyze whether the needles of the needle preparation disc are correct after the drill needle is inserted, so as to avoid the problem of machining errors or machine damage after the needle preparation disc is online, and improve the product yield and process processing. quality.

(2) This intelligent needle preparation review system can identify the position and type of drill needles through image analysis, reduce the waste of manual inspection, reduce labor costs and increase the review efficiency.

(3) This intelligent needle preparation review system can identify whether the drill insert is abnormal through the color of the needle ring and needle handle, and by correcting the needle ring needle handle model and abnormal position prompts to ensure the correctness of identification and improve the review results 's accuracy.

10,30:Intelligent needle preparation review system

11,31: Drilling machine

12: Image capture device

13, 23, 33: Needle preparation review device

14: Data output device

32: Camera

91: Dial image

92: Drill needle preparation table

93: Image to be analyzed

94: Drill coordinate image

95: needle ring color

96: Needle handle color

97: Review results

111, 211, 311: Needle spare plate

131: Processor

132: Memory

231: Dial positioning module

232: Dial coordinate module

233: Needle ring color picking module

234: Needle handle color picking module

235: Drill needle determination module

341: Display screen

342: Mobile Devices

In order to make the technical features, content and advantages of the present invention and the effects that can be achieved more obvious, the present invention is hereby described in detail as follows in the form of embodiments in conjunction with the accompanying drawings:

FIG. 1 is a block diagram of an intelligent needle preparation review system according to an embodiment of the present invention.

FIG. 2 is a schematic diagram of a needle preparation and verification device according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of an intelligent needle preparation review system according to an embodiment of the present invention.

In order to help the examiners to understand the technical features, content and advantages of the present invention and the effects that can be achieved, the present invention is hereby described in detail with the accompanying drawings and in the form of embodiments as follows. The subject matter is only for illustration and auxiliary description, and is not necessarily the real scale and precise configuration after the implementation of the present invention. Therefore, the ratio and configuration relationship of the attached drawings should not be interpreted or limited to the scope of rights of the present invention in actual implementation. Together first to describe.

All terms (including technical and scientific terms) used herein have the meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. It will be further understood that terms such as those defined in commonly used dictionaries should be construed as having meanings consistent with their meanings in the context of the related art and the present invention, and are not to be construed as idealized or excessive Formal meaning unless expressly so defined herein.

Please refer to FIG. 1 , which is a block diagram of an intelligent needle preparation checking system according to an embodiment of the present invention. As shown in the figure, the intelligent needle preparation and review system 10 includes a drilling machine 11 , an image capture device 12 , a needle preparation and review device 13 , and a data output device 14 . The drilling machine 11 includes a processing table for drilling various workpieces, and includes a carrier table for the workpieces. Plate consumables (such as backing plates or metal plates) can be placed on the carrier table, and the workpieces are placed on the carrier table through a conveying device. on the backing plate of the platform. The drill bit for drilling the workpiece is placed in the needle preparation disc 111 of the drill needle. After the drilling machine 11 sets the machining program according to the production model, the drilling machine 11 will select the corresponding drill bit from the needle preparation disc 111 to correct the drill bit. The workpiece is drilled. During drilling, different products or different processing positions of the same product require drills of different sizes. The needle preparation disc 111 will be equipped with drills of various sizes, or the needle preparation disc 111 will be equipped with drills of various sizes due to the wear and tear of the drill bit during the drilling operation. Multiple drill bits of the same size are available for replacement.

In the pre-drilling operation, the preparation of the needle preparation plate 111 is an important procedure. After receiving the work order, the operator will obtain the corresponding drill bits from the warehouse according to the type and quantity of drill bits required in the work order. And according to the drill needle preparation table, the collar drill is inserted into the needle hole of the needle preparation disc 111 . The needle preparation disc 111 can include 6 needle preparation areas, each area includes 50 holes in 5 rows and 10 columns, and the large number of holes may easily cause the operator to have the problem of wrong position or wrong drill when inserting the needle. In order to increase the identification of the drill bit, the drill bit will be added with collars of different colors to distinguish different models. However, after the manual insertion of the needle preparation plate 111 is completed, it is still necessary to conduct a review to avoid damage to the machine or the workpiece caused by the wrong drill bit. The traditional review process is manual The drill needle preparation table and the needle preparation disc 111 are re-checked by means of the method, but the cost of manual operation and the error of human operation cannot ensure the correctness of the checking. Therefore, in this embodiment, the checking is performed by means of image analysis.

After the needle preparation plate 111 is inserted into the needle, the needle preparation plate is placed in the detection area or the loading area of the drilling machine 11 , and the image capture device 12 facing the needle preparation plate 111 captures the needle plate image 91 of the needle preparation plate 111 . The image capturing device 12 can be a fixed camera, and is used with a light source to take a top-view photo of all the holes in the needle preparation tray, and then send it to the needle preparation and review device 13 . The image capture device 12 can transmit the photo file to the needle preparation and review device 13 by means of wireless network transmission, or both the image capture device 12 and the needle preparation and review device 13 are installed on the drilling machine 11 , and pass the transmission line of the drilling machine 11 . The road calling camera takes pictures of the needle preparation disk, and then transmits the photo file to the needle preparation review device 13 .

The needle preparation and checking device 13 includes a processor 131 and a memory 132 , which can be an independent computer, a workstation, a server, etc., or a software program to operate the processing device and the storage device in the drilling machine 11 . When the dial image 91 is received, the image data can be stored in the memory 132. The memory 132 can include a read-only memory, a flash memory, a disk or a cloud database, etc. The memory 132 not only stores the dial The image 91 can also store the corresponding drill needle preparation table 92 according to the model of the processed product. The processor 131 may include a central processing unit, an image processor, a microprocessor, etc. in a computer or a server, and may include a multi-core processing unit or a combination of multiple processing units. The processor 131 accesses the memory 132 through various execution instructions, executes the needle preparation checking procedure, and after a series of image processing and analysis procedures, determines the positions of the plurality of pinholes and the corresponding plurality of drill needle models in the dial image 91 , and compare these data with the drill needle preparation table 92 stored in the memory 132 to determine the review result. The finally obtained review result is then sent to the data output device 14 for output by the data output device 14 . The data output device 14 may include a display, such as an operation display screen of the drilling machine 11 itself, or a separate display screen, to present the review results to the operator. In another embodiment, the operator can also connect via the mobile device application The needle preparation checking device 13 is connected, and the checking result is obtained from the interface of the application program and displayed on the display screen of the mobile device.

The review results mainly indicate the part of the abnormal hole position, that is, the correct confirmation drill is displayed, and then the abnormal drill with a problem is marked with a warning color, so that the operator can interpret it. The abnormal drill bit here may be the wrong drill bit inserted, or the drill bit model cannot be confirmed during interpretation. These abnormalities need to be further confirmed by the reviewer, check the position of the pinhole marked with the warning color, replace the wrong drill bit, or Check whether the unidentifiable hole positions are abnormal. The checked needle preparation tray 111 can be directly confirmed to be loaded, or the checking procedure can be performed again by means of image interpretation. The needle preparation review device 13 will record the abnormal drill needle position, count the abnormal position, and also record and archive the results of actual plug-in errors and identification errors. When the number of abnormal occurrences or the frequency of occurrence exceeds the set standard, an abnormal message will be sent to notify the operator. , and mark the hole positions that need attention on the drill needle preparation table 92 or the needle preparation plate 111. The needle preparation review procedure performed in the needle preparation review device 13 will be further described in the following embodiments.

Please refer to FIG. 2 , which is a schematic diagram of an image processing apparatus according to an embodiment of the present invention. As shown in the figure, the image capture device faces the dial preparation plate 211 to capture the dial image. As described in the foregoing embodiment, the processor accesses a plurality of control commands in the memory, executes the dial positioning module 231, the dial dial The coordinate module 232, the needle ring color picking module 233, the needle shank color picking module 234 and the drill needle judgment module 235 perform the needle preparation review procedure to analyze whether the position and type of the drill bit inserted in the needle preparation plate 211 are correct. .

First, when the needle preparation plate 211 reaches the shooting position, the dial positioning module 231 turns on the shooting light source, confirms the shooting parameters of the camera, such as aperture, exposure, shutter, etc., and transmits the control signal to the camera to shoot the needle preparation plate 211. Image to be analyzed 93 . Since the size of the needle preparation disc 211 may vary according to different drilling machines, in another embodiment, the camera can also be moved to shoot at multiple preset shooting positions, or multiple cameras can be used to shoot at the same time, and then Combine multiple shot images and combine them into a Step 93 with analysis images. The to-be-analyzed image 93 can present an image of all the pin hole positions of the needle preparation tray 211 from a top view, or according to the usage amount of the needle preparation tray 211 , it can present an image of the hole positions of some partitions.

The image to be analyzed 93 can be input to the drill coordinate module 232, and the image features of the image to be analyzed are enhanced through image processing, for example, the original color image is converted into a grayscale image, and the image is blurred and smoothed. noise for subsequent analysis. After image feature processing, the Hough Circle detection method is used to detect the position of the circle in the image, and obtain its center point and radius information, that is, the coordinate position corresponding to each pinhole. Using each circular coordinate position as the drill position, a drill coordinate image 94 is output.

Then, the drill needle coordinate image 94 enters the needle ring color picking module 233, and the drill needle coordinate image 94 is extracted with the first focal length of the needle ring image, and each circle in the needle ring image, that is, the coordinates of each needle ring, is divided into For a plurality of capture points, the grayscale values of the plurality of capture points are calculated. In this embodiment, the circle can be divided into 31 equal parts, and the points at a distance of 80% of the radius from the center point of the circle are used as a plurality of extraction points, that is, the grayscale values of the 31 extraction points are used. To judge the needle ring color of each needle ring coordinate. The judgment method is to find the group with the most gray-scale values in the histogram distribution method, and select a point in the group to correspond to the RGB value of the point extracted from the coordinates in the original image to be analyzed, and then convert it into luminance (HSV). The needle ring color 95 of each needle ring coordinate is output in the form of RGBHSV.

On the other hand, due to the difference between the color ring covered by each drill needle and the needle handle, in addition to identifying the color 95 of the needle ring, the needle handle is also identified. The procedure is similar to that of the needle ring color picking module 233 , the bur coordinate image 94 is input into the needle handle color picking module 234 , and the needle handle image is extracted by using a second focal length different from the first focal length. Repeat the steps of taking an image of the needle ring, divide each circle in the image, capture a plurality of capture points and the color corresponding to the most capture points according to the grayscale value, and determine and output the needle of each needle handle coordinate. Handle color 96.

Input the obtained needle ring color 95 and needle shank color 96 into the drill needle determination module 235 to establish the needle ring needle handle model of the needle preparation plate 111, that is, the needle ring including each hole position of the needle preparation plate 111 and the corresponding hole position Needle handle color. This needle ring needle handle model can be fine-tuned and corrected according to the color values obtained each time, and the accuracy of the model can be improved through multiple learning and training procedures. Since the correct drill needle preparation table will be stored in the memory, compare the above hole position and color with the drill needle preparation table to confirm whether the color of each hole position matches, if so, confirm that the pinhole position is inserted The position of the correct drill needle type, if the colors do not match, it is judged as an abnormal drill needle, and a warning color is marked on the corresponding position of the drill needle preparation table, and the review result 97 is output to remind the reviewers to confirm.

After the needle preparation checking procedure is performed by the needle preparation checking device 23, it can be confirmed whether the pins on the original needle preparation tray 11 are correct, and the abnormal color position can be quickly found out and the abnormality has been eliminated. Compared with manually checking each hole position, the present embodiment can effectively improve the checking efficiency and the checking accuracy. On the other hand, for locations where anomalies often occur, the locations where errors are likely to occur can also be marked according to the frequency of anomalies, so as to remind the plug-in operator to pay attention to the plug-in process and improve the process quality.

Please refer to FIG. 3 , which is a schematic diagram of a needle preparation review system according to an embodiment of the present invention. As shown in the figure, the needle preparation checking system 30 includes a drilling machine 31 , a camera 32 , a needle preparation checking device 33 and an output device. In this embodiment, the output device can be the display screen 341 of the drilling machine 31 or is the display screen of the mobile device 342 . The needle preparation disc 311 of the drilling machine 31 can be used by the drilling machine 31 after the drill bit is inserted into each needle hole by the needle inserter. The correctness of the needle preparation disc 311 will affect the drilling operation of the drilling machine 31. Therefore, After the insertion of the needle preparation tray 311 is completed, the camera 32 captures the needle tray image of the needle preparation tray 311 and transmits it to the needle preparation verification device 33 for verification.

The needle preparation checking device 33 can be an independent computer device, or a checking program can be installed on the drilling machine 31 to execute the checking program through the processing unit and the storage unit of the drilling machine 31 . Dial image in preparation After performing image analysis and identification, the needle checking device 33 judges the color of the needle ring shank of each hole position, compares the colors in the drill needle preparation table, and judges whether the drill needle at each hole position is the correct model, and if there is a discrepancy, then After marking the position, the reviewer will confirm whether to replace the drill bit. The confirmed needle preparation plate 311 can go online for drilling operations, and the review results obtained by the review process can be transmitted to the drilling machine 31 or the operator's mobile device 342 . In addition to outputting the review results through the output device, the abnormal hole positions in the needle preparation plate 311 can also be marked in the work order or drill needle preparation table to remind the needle insertion personnel to pay attention to the specific hole positions.

The above description is exemplary only, not limiting. Any equivalent modifications or changes that do not depart from the spirit and scope of the present invention shall be included in the appended patent application scope.

10:Intelligent needle preparation review system

11: Drilling machine

12: Image capture device

13: Needle preparation review device

14: Data output device

91: Dial image

92: Drill needle preparation table

111: Needle preparation disc

131: Processor

132: Memory

Claims (9)

An intelligent needle preparation review system, which includes: a drilling machine including a needle preparation tray for placing a plurality of drilling needles; an image capture device, which is arranged to face the needle preparation tray, and shoots the plurality of drilling needles a dial image of the dial; a needle preparation and review device, connected to the image capture device, receives the dial image, the needle preparation and review device comprises a processor and a memory, the memory stores a drill bit preparation The needle watch and the dial image, the processor accesses the memory to execute a needle preparation review program, identifies a plurality of pinhole positions and a plurality of corresponding drill needle models in the dial image, and prepares it with the drill bit. needle table comparison to obtain a check result; and a data output device, connected to the needle preparation check device, and outputting the check result, wherein the check result includes a confirmation drill and an abnormal drill, The position of the abnormal drill needle is marked on the drill needle preparation table with a warning color to notify the operator to interpret it. The intelligent needle preparation checking system as claimed in claim 1, wherein the needle preparation checking program comprises a plurality of operation modules executed by the processor: a needle plate positioning module, when the needle preparation plate reaches the positioning , confirm the parameters of the image capture device, photograph the dial to obtain an image to be analyzed; a dial coordinate module, perform Hough ring detection on the image to be analyzed after image feature processing to obtain a drill Coordinate image; a needle ring color picking module, extracting a needle ring image from the drill needle coordinate image with a first focal length, and dividing the plurality of needle ring coordinates in the needle ring image into complex numbers capture points, calculate the grayscale values of the plurality of capture points, and determine the color of a needle ring of each of the plurality of needle ring coordinates; a needle shank color picking module uses a second focal length of the drill needle coordinate image Extracting a needle shank image, repeating the segmentation and capturing process of the needle ring color picking module to determine the color of a needle shank of each of the plurality of needle ring coordinates; and a drill needle determining module, using the needle ring color and The needle handle color establishes a needle ring needle handle model of the needle preparation plate, and the needle ring needle handle model is used to identify the plurality of needle hole positions in the needle preparation plate and the corresponding plurality of drill needle models. The intelligent needle preparation checking system according to claim 2, wherein the image feature processing includes converting the image to be analyzed into grayscale, and performing blurring and smoothing processing on the grayscale image. The intelligent needle preparation and review system according to claim 2, wherein the needle ring color picking module includes dividing the circle in the plurality of drill needle coordinate images into 31 equal parts, and each equal part is connected with the center of the circle. Points with a distance of 80% of the radius are used as the multiple extraction points. The intelligent needle preparation review system according to claim 1, wherein the image capturing device comprises a camera and a light source, which are directed toward the needle preparation plate to capture an image of the needle plate. The intelligent needle preparation review system according to claim 5, wherein the image capture device transmits the needle plate image to the needle preparation review device in real time through wireless network transmission. The intelligent needle preparation review system as claimed in claim 1, wherein the data output device comprises a display, and the drill needle preparation table and the verification result are displayed on the display. The intelligent needle preparation review system as claimed in claim 1, wherein the data output device comprises a mobile device, an application program is installed on the mobile device, and the drill needle preparation table and the verification result are read through the application program interface . The intelligent needle preparation checking system according to claim 1, wherein the needle preparation checking device counts the position of the abnormal drill needle, and marks the position where the frequency of abnormality is higher than a preset value to remind the operator.

Images