CN115963117A

CN115963117A - Chip appearance detection device and method based on machine vision

Info

Publication number: CN115963117A
Application number: CN202211357005.0A
Authority: CN
Inventors: 杨宝龙; 刘伟
Original assignee: Hefei Kaiying Information Technology Co ltd
Current assignee: Hongjing Microelectronics Technology Co ltd
Priority date: 2022-11-01
Filing date: 2022-11-01
Publication date: 2023-04-14

Abstract

The application belongs to the field of chip detection, and particularly relates to a chip appearance detection device and method based on machine vision, which are used for solving the problems of low speed, high cost and many unstable factors of manual visual inspection of disk chips and automatic detection of single chips. The method comprises the following steps: the data instruction module sends a first program instruction to the motion control module for the motion control module to control the motion of the visual unit in the image acquisition module; responding to the motion information of the visual unit sent by the motion control module, and sending a second program instruction to the image acquisition module for acquiring the image information of the to-be-detected disc-mounted chip; and receiving the image information of the to-be-detected disc-mounted chip sent by the image acquisition module, sending the image information to the image detection module, sending a third program instruction to the image detection module, detecting the image information of the to-be-detected disc-mounted chip and recording a detection result. The method controls the movement of the visual unit, images each chip for multiple times, identifies for one time, and improves the detection efficiency and accuracy.

Description

Chip appearance detection device and method based on machine vision

Technical Field

The application belongs to the field of chip detection, and particularly relates to a chip appearance detection device and method based on machine vision.

Background

At present, the whole-tray detection of chip finished products is mostly in a manual visual inspection mode, the manual visual inspection detection speed is low, the number of unstable factors is large, the cost is high, and the requirement for batch production increasing is difficult to meet. Most of the existing chip visual automatic detection technologies are single chip image acquisition processing, and then the chip visual automatic detection technologies are integrated in semiconductor mechanical equipment with different functions and purposes to exist as a functional item, so that the scene requirements of centralized and batch detection before the chip test leaves a factory cannot be completely met.

Disclosure of Invention

The application provides a chip appearance detection device and method based on machine vision, which are used for solving the problems that the existing automatic detection technology is mostly single detection, and the speed of manually checking and checking the disc-loaded chips is low, the cost is high and the number of unstable factors is large.

In a first aspect, the present application provides a chip appearance inspection device based on machine vision, where the chip is a disk-mounted chip, and the device includes:

the device comprises a motion control module, an image acquisition module, an image detection module and a data instruction module; the image acquisition module comprises a light source controller and a visual unit;

the motion control module is used for responding to a first program instruction sent by the data instruction module, controlling the motion of the visual unit and sending the motion information of the visual unit to the data instruction module;

the image acquisition module is used for responding to a second program instruction sent by the data instruction module, acquiring the image information of the to-be-detected disc-mounted chip and sending the image information of the to-be-detected disc-mounted chip to the data instruction module;

the image detection module is used for receiving the image information of the to-be-detected disc-mounted chip sent by the data instruction module, responding to a third program instruction sent by the data instruction module, detecting the image information of the to-be-detected disc-mounted chip and recording a detection result;

the data instruction module is used for responding to the first interactive operation instruction and sending a first program instruction to the motion control module; responding to the motion information of the visual unit sent by the motion control module, and sending a second program instruction to the image acquisition module; and receiving the image information of the to-be-detected disc-mounted chip sent by the image acquisition module, sending the image information of the to-be-detected disc-mounted chip to the image detection module, and sending a third program instruction to the image detection module.

In a second aspect, the present application provides a chip appearance detection method based on machine vision, which is applied to a data instruction module, where the chip is a disk-mounted chip, and the method includes:

responding to the first interactive operation instruction, and sending a first program instruction to the motion control module so that the motion control module can control the motion of the visual unit in the image acquisition module; responding to the motion information of the visual unit sent by the motion control module, and sending a second program instruction to the image acquisition module so that the image acquisition module acquires the image information of the to-be-detected disc-mounted chip; the method comprises the steps of receiving image information of a to-be-detected disc-mounted chip sent by an image acquisition module, sending the image information of the to-be-detected disc-mounted chip to an image detection module, sending a third program instruction to the image detection module so that the image detection module can detect the image information of the to-be-detected disc-mounted chip, and recording a detection result.

In a third aspect, the present application provides an electronic device, comprising: at least one processor; and a memory communicatively coupled to the at least one processor;

wherein the memory stores one or more computer programs executable by the at least one processor, the one or more computer programs being executable by the at least one processor to enable the at least one processor to perform the machine vision based chip appearance inspection method as described above.

In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, which, when executed by a processor, implements the machine vision-based chip appearance detection method as described above.

According to the chip appearance detection device based on machine vision, an image acquisition module photographs and acquires a disc-mounted chip through a light source controller and a vision unit; the motion control module controls the motion of the vision unit to realize multi-segment imaging; after the image acquisition of the whole chip is finished, the acquired image is detected by an image detection module to realize primary identification; in the whole detection process, corresponding program instructions are respectively sent to the image acquisition module, the motion control module and the image detection module through the data instruction module so as to control the three modules to carry out corresponding operations. Therefore, the device replaces manual moving of the disc-mounted chips through controlling the movement of the visual units, images every disc of chips for multiple times, detects all collected images once again, improves the detection efficiency, stabilizes the detection accuracy, and relieves manpower to reduce the working strength.

It should be understood that the statements in this section are not intended to identify key or critical features of the embodiments of the present application, nor are they intended to limit the scope of the present application. Other features of the present application will become apparent from the following description.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

fig. 1 shows a block diagram of a chip appearance detection apparatus based on machine vision according to an embodiment of the present application;

fig. 2 shows a block diagram of a chip appearance detection apparatus based on machine vision according to a second embodiment of the present application;

fig. 3 is a plan view of a machine vision-based Tray-mounted IC appearance defect detection apparatus provided in a specific example of the second embodiment of the present application;

fig. 4 is a block diagram illustrating a structure of a machine vision-based Tray-mounted IC appearance defect detection apparatus provided in a specific example of the second embodiment of the present application;

fig. 5 is a block diagram illustrating a motion control module of a Tray-mounted IC appearance defect detecting apparatus based on machine vision according to a specific example of the second embodiment of the present application;

FIG. 6 is a logic flow diagram of detection control of a method for detecting appearance defects of a Tray-mounted IC based on machine vision according to a specific example of the second embodiment of the present application;

fig. 7 shows a flowchart of a chip appearance detection method based on machine vision according to a third embodiment of the present application;

fig. 8 shows a schematic structural diagram of an electronic device according to a fourth embodiment of the present application.

Detailed Description

To facilitate a better understanding of the technical solutions of the present application, exemplary embodiments of the present application will be described below with reference to the accompanying drawings, in which various details of the embodiments of the present application are included to facilitate understanding, and which should be considered as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In case of conflict, the embodiments and features of the embodiments of the present application can be combined with each other.

As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms "comprises" and/or "comprising," 8230; \8230 "; when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. The terms "connected" or "coupled" and the like are not restricted to physical or mechanical connections, but may include electrical connections, whether direct or indirect.

Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and the present application and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.

Example one

Fig. 1 shows a block diagram of a chip appearance inspection apparatus based on machine vision according to an embodiment of the present application, where the chip is a disk-mounted chip. Referring to fig. 1, the apparatus includes:

a motion control module 11, an image acquisition module 12, an image detection module 13, and a data instruction module 14.

The image acquisition module 12 includes a light source controller and a visual unit, the light source controller is used for controlling the visual unit, and the visual unit is used for acquiring image information of the to-be-tested disc-mounted chip and sending the image information to the data instruction module 14.

And the motion control module 11 is used for responding to the first program instruction sent by the data instruction module 14, performing motion control on the visual unit, and sending the motion information of the visual unit to the data instruction module 14.

The first program instruction is used for controlling the movement of the visual unit, and the visual unit is controlled to move to different positions so as to acquire images of different areas of the to-be-detected disc-mounted chip until the acquisition of image information of all the areas of the to-be-detected disc-mounted chip is finished; the first program instruction is further configured to send motion information of the visual unit to the data instruction module 14, where the motion information includes current position information of the visual unit, and the data instruction module 14 sends an instruction to the motion control module 11 again according to the received current position information of the visual unit to control the visual unit to move to a next position.

And the image acquisition module 12 is configured to acquire image information of the to-be-tested disc-mounted chip in response to the second program instruction sent by the data instruction module 14, and send the image information of the to-be-tested disc-mounted chip to the data instruction module 14.

The second program instruction is used for controlling the visual unit to collect image information of the designated area of the disc-mounted chip to be detected, then sending the collected image information to the data instruction module 14, and displaying the image information in a visual interface of the data instruction module 14; the image information of the to-be-detected disc-mounted chip is acquired by photographing, and the appearance characteristics of the to-be-detected chip can be observed through the acquired image information, so that whether the to-be-detected chip has appearance defects or not is detected.

And the image detection module 13 is configured to receive the image information of the to-be-detected disk-mounted chip sent by the data instruction module 14, detect the image information of the to-be-detected disk-mounted chip in response to a third program instruction sent by the data instruction module 14, and record a detection result.

The image information of the to-be-tested disc-mounted chip sent by the data instruction module 14 is the image information of the to-be-tested disc-mounted chip, which is acquired by the image acquisition module 12 and sent to the data instruction module 14; the third program instruction is used for detecting the acquired image information of the disc-mounted chip to be detected and recording a detection result, so that whether the disc-mounted chip to be detected has the appearance defect is judged by judging whether the detection result is abnormal or not.

And the data instruction module 14 is configured to perform overall control on the apparatus in this embodiment, that is, in response to the received operation instruction and information, send corresponding information and control instruction to the motion control module 11, the image acquisition module 12, and the image detection module 13.

Specifically, the data instruction module 14 functions as follows, corresponding to the three modules:

for sending a first program instruction to the motion control module 11 in response to the first interoperation instruction; sending a second program instruction to the image acquisition module 12 in response to the motion information of the visual unit sent by the motion control module 11; receiving the image information of the to-be-detected disc-mounted chip sent by the image acquisition module 12, sending the image information of the to-be-detected disc-mounted chip to the image detection module 13, and sending a third program instruction to the image detection module 13.

Therefore, for the chip appearance detection device based on machine vision provided in the embodiment, the image acquisition module performs photographing acquisition on the disc-mounted chip through the light source controller and the vision unit; the motion control module controls the motion of the vision unit to realize multi-segment imaging; after the image acquisition of the whole chip is finished, the acquired image is detected by an image detection module to realize primary identification; in the whole detection process, the data instruction module sends corresponding program instructions to the image acquisition module, the motion control module and the image detection module respectively so as to control the three modules to carry out corresponding operations. Therefore, the device replaces manual moving of the disc-mounted chips through controlling the movement of the visual units, images every disc of chips for multiple times, detects all collected images once again, improves the detection efficiency, stabilizes the detection accuracy, and relieves manpower to reduce the working strength.

Example two

Fig. 2 shows a block diagram of a chip appearance inspection apparatus based on machine vision according to a second embodiment of the present application, where the chip is a disk-mounted chip. Referring to fig. 2, the apparatus includes:

a motion control module 21, an image acquisition module 22, an image detection module 23 and a data instruction module 24; wherein, the motion control module 21 includes a sensor 211, a motion controller 212, a driver 213, a stepping motor 214, and a linear sliding table module 215; the image acquisition module 22 includes a light source controller 221 and a vision unit 222.

In one particular implementation, the two components in image acquisition module 22 function as follows:

the light source controller 221 is configured to control a light source switch of the vision unit 222;

the vision unit 222 is composed of an area-array camera, an optical lens and a strip light source, and is configured to collect image information of a disc-mounted chip to be detected, and send the image information of the disc-mounted chip to be detected to the data instruction module 24.

The motion control module 21 is configured to perform motion control on the visual unit 222 in response to the first program instruction sent by the data instruction module 24, and send motion information of the visual unit 222 to the data instruction module 24.

The first program instruction is used for performing motion control on the vision unit 222, and the vision unit 222 is moved to different positions through the motion control on the vision unit 222, so that image acquisition is performed on different areas of the to-be-detected disc-mounted chip until image information acquisition of all the areas of the to-be-detected disc-mounted chip is completed; the first program instruction is further configured to send motion information of the visual unit 222 to the data instruction module 24, where the motion information includes current position information of the visual unit 222, and the data instruction module 24 sends an instruction to the motion control module 21 again according to the received current position information of the visual unit 222 to control the visual unit 222 to move to a next position.

In one particular implementation, the five components in the motion control module 21 function as follows:

the sensor 211 is configured to acquire position information of a to-be-tested disc-mounted chip, and send the position information of the to-be-tested disc-mounted chip to the motion controller 212;

the motion controller 212 is configured to output a driving pulse signal to the driver 213 in response to the position information of the to-be-tested disc-mounted chip; wherein, the driving pulse signal is used for controlling the driver 213 to drive the stepping motor 214 for motion control;

the driver 213 is configured to output a rotation pulse signal to the stepping motor 214 in response to the driving pulse signal; wherein, the rotation pulse signal is used to control the stepping motor 214 to rotate, so as to control the movement of the linear sliding table module 215;

the stepping motor 214 is configured to rotate in response to the rotation pulse signal, and perform motion control on the linear sliding table module 215; specifically, the stepping motor 214 drives the moving slider of the linear sliding table module 215 to move to a specified position at a preset specified speed; wherein, the designated speed and the designated position are set by those skilled in the art according to specific conditions during implementation, and are not limited herein;

the linear sliding module 215 is used for controlling the movement of the vision unit 222; the vision unit 222 is fixedly connected to the linear sliding table module 215, and the linear sliding table module 215 drives the vision unit 222 to move.

And the image acquisition module 22 is configured to acquire image information of the disc-mounted chip to be tested in response to the second program instruction sent by the data instruction module 24, and send the image information of the disc-mounted chip to be tested to the data instruction module 24.

The second program instruction is used for controlling the vision unit 222 to collect image information of the designated area of the disc-mounted chip to be tested, then sending the collected image information to the data instruction module 24, and displaying the image information in a visual interface of the data instruction module 24; specifically, uniform polishing of the to-be-detected disc-mounted chip is achieved through the strip-shaped light source in the visual unit 222, image information of the to-be-detected disc-mounted chip is acquired through the area-array camera and the optical lens, and appearance characteristics of the to-be-detected chip can be observed through the acquired image information, so that whether appearance defects exist in the to-be-detected chip or not is detected.

And the image detection module 23 is configured to receive the image information of the to-be-detected disk-mounted chip sent by the data instruction module 24, detect the image information of the to-be-detected disk-mounted chip in response to the third program instruction sent by the data instruction module 24, and record a detection result.

The image information of the to-be-tested disc-mounted chip sent by the data instruction module 24 is the image information of the to-be-tested disc-mounted chip, which is acquired by the image acquisition module 22 and sent to the data instruction module 24; the third program instruction is used for detecting the acquired image information of the disc-mounted chip to be detected and recording a detection result, so that whether the disc-mounted chip to be detected has an appearance defect is judged by judging whether the detection result is abnormal.

In a specific implementation, the detected content includes: the existence of chips in the chip grids of the disk-mounted chips, the placement direction of the chips in the chip grids, the size of the chips and the characters on the surfaces of the chips; for example, possible abnormalities in the image information include: the chip in a certain chip grid is not available, the chip in a certain chip grid is placed in a wrong direction, the size of the chip or the expression characters are different from the preset standard, and the like.

Wherein, the positioning of each chip grid in the disk-mounted chip is realized by a grid positioning mode; the detection of the chip surface characters is realized by an image character segmentation mode, a defect character fitting mode and/or an OCR character library matching mode.

And the data instruction module 24 is configured to perform overall control on the apparatus in this embodiment, that is, in response to the received operation instruction and information, send corresponding information and control instruction to the motion control module 21, the image acquisition module 22 and the image detection module 23.

Specifically, the data command module 24 functions as follows, corresponding to the above three modules:

for sending a first program instruction to the motion control module 21 in response to the first interoperation instruction; sending second program instructions to the image acquisition module 22 in response to the motion information of the visual unit 222 sent by the motion control module 21; receiving the image information of the to-be-tested disc-mounted chip sent by the image acquisition module 22, sending the image information of the to-be-tested disc-mounted chip to the image detection module 23, and sending a third program instruction to the image detection module 23.

In a particular implementation, the first program instructions are for: performing motion control on the vision unit 222 to enable the vision unit 222 to sequentially move to at least three preset position areas above the disc-mounted chip; the second program instructions are for: sequentially photographing and collecting at least three image information of the to-be-detected disc-mounted chip, which correspond to the preset position area, and displaying the image information in a visual interface included in the data instruction module 24; the third program instructions are for: detecting at least three image information of the to-be-detected disk-mounted chip at the same time; and if the detection result is abnormal, positioning, alarming and recording the chips with the appearance defects in the disc-mounted chip area corresponding to the image information with the abnormality. Therefore, other three modules are controlled through program instructions sent by the data instruction module 24, three times of imaging of the to-be-detected disc-mounted chip is achieved, the three collected images are detected again, and a detection result is obtained.

In an alternative implementation, in order to obtain correct chip information as the detection criterion, before sending the first program instruction to the motion control module 21 in response to the first interoperation instruction, the data instruction module 24 is further configured to: responding to the information acquisition instruction, and acquiring and recording chip information of the disc-mounted chip to be detected; the information acquisition instruction is triggered when scanning operation is carried out on the disc-mounted chip to be detected. Specifically, the disk-mounted chip is scanned by a scanning gun in the data instruction module 24, chip information of the disk-mounted chip to be detected is obtained by scanning, and the chip information is sent and recorded in the computer of the data instruction module 24 for subsequent operation.

In an optional implementation manner, the first interoperation instruction is triggered when a to-be-tested disk chip is detected to be present in the positioning mark region; after the disk chip to be tested is placed in the positioning mark area, the data instruction module 24 receives a first interactive operation instruction. The positioning mark area is set by a person skilled in the art as appropriate in implementation, and is not limited herein.

Therefore, for the chip appearance detection device based on machine vision provided in the embodiment, the image acquisition module uniformly lights the disc-mounted chip through the light source controller and the visual unit, and takes a picture to acquire image information; the motion control module controls the internal components layer by layer and finally controls the motion of the visual unit to realize three-section imaging of the to-be-tested disc-mounted chip; after the image acquisition of the whole chip is finished, the three acquired images are detected by the image detection module to realize one-time identification; in the whole detection process, the data instruction module sends corresponding program instructions to the image acquisition module, the motion control module and the image detection module respectively so as to control the three modules to carry out corresponding operations. Therefore, the device replaces manual moving of the disc-mounted chips through controlling the movement of the vision unit, images are formed on each disc of chips three times, the images collected three times are detected again, the detection efficiency is improved, the detection accuracy is stabilized, and the labor is liberated to reduce the working intensity.

For the convenience of understanding, the following takes a specific example as an example, and details of implementation in the above embodiment are described in detail.

Fig. 3 is a plan view of a machine vision-based Tray IC appearance defect detection apparatus provided in this specific example. Referring to fig. 3, the apparatus includes: the system comprises an operating platform 1, a rack 2, a vision unit 3, a linear module 4, a motor 5, a control unit 6, a computer 7, a code scanning gun 8, a sensor 9, a light shield 10, a tank chain 11 and a Tray disc 12; wherein, the visual unit 3 specifically includes: 3-1 camera, 3-2 lens, 3-3 light source, 3-4 clamp hanger, 3-5 camera support and 3-6 light source support.

Fig. 4 shows a block diagram of a machine vision-based Tray IC appearance defect detection apparatus provided in this specific example, where the chip is a Tray chip. Referring to fig. 4, the apparatus includes: the device comprises a data instruction module, an image acquisition module, a motion control module and an image detection module.

The data instruction module comprises a computer, the computer is composed of a host, a display screen (namely a visual interface in the second embodiment), a keyboard, a mouse, a code scanning gun (namely a scanning gun in the second embodiment) and the like, and the computer is used for acquiring, processing, recording and managing image information acquired by the image acquisition module, data information of the motion control module and operator operation information and outputting acquisition and control instructions.

The image acquisition module consists of a light source controller and a visual unit; the light source controller is used for executing logic control information and controlling the light source switch of the visual unit; the visual unit consists of an area-array camera, an optical lens and a strip light source, and acquires image information of the Tray disc-mounted chip to be detected to a computer according to a program instruction.

The motion control module comprises a sensor, a motion controller, a driver, a stepping motor and a linear sliding table module. The sensor is a position sensor and is used for limiting the movement limit, detecting the motor origin and detecting the position of a Tray; the motion controller is used for carrying out logic control and outputting pulses to the driver to drive the stepping motor to carry out motion control according to the computer program instruction and the sensor position signal; the driver is used for receiving the motion control pulse signal output by the motion controller, converting the motion control pulse signal into a multi-phase pulse signal, amplifying power and driving the stepping motor to rotate; the stepping motor is used for controlling pulse instruction rotation according to the motion of the driver and driving the linear sliding table module to move to a specified position at a given speed; the linear sliding table module is used for controlling the movement of the vision unit.

Fig. 5 shows a structural diagram of a motion control module of a Tray disk IC appearance defect detecting apparatus based on machine vision provided in this specific example. Referring to fig. 5, the motion control module includes:

the rack 2 is used for installing the linear module 4 and the visual unit 3; the whole frame is placed on an operation platform 1, the platform is required to be flat, and the area is not less than 1 square meter; the assembly structure includes:

2-1 horizontal column: 2 rack horizontal support columns; is fixedly connected with the upright post 2-2 through a connecting angle piece 2-4;

2-2 upright posts: 2 vertical support columns of the rack; is fixedly connected with the horizontal column 2-1/2-3 through a connecting angle piece 2-4;

2-3 horizontal strut: 2 horizontal fixing columns of the rack are arranged; is fixedly connected with the upright post 2-2 through a connecting angle piece 2-4;

2-4 connecting corner fittings: respectively connecting and fixing the upright 2-2 and the horizontal columns 2-1 and 2-3;

2-5 end cap: are respectively arranged at the 2-2/2-3 end parts of the frame for sealing protection;

2-6 linear module connecting piece: the linear module 4 is fixed on the stand column 2-2 of the frame.

The linear module 4 is used for motion control, the driver drives the motor to rotate forward, backward, at a constant speed and at an accelerated and decelerated speed according to the command of a controller program, and the transmission mechanism and the lead screw drive the slide block to move left and right; the linear module is fixed on the frame by 2 sleeves of connecting pieces 2-6; the control motor 5 is integrated at one end of the linear module 4, and the driver is installed in the control box or an integrated motor is used; two ends of the linear module are respectively provided with a limit switch 9 (2 sets), and the middle of the linear module is provided with a sliding module 4-1. When the slide block reaches the limit switch, the motor stops running.

A vision unit mounting assembly 3; the sliding module is used for installing and fixing visual unit components such as a camera, a lens, a light source and a light shield and integrally and linearly moving along with the movement of the linear module in the forward direction and the reverse direction according to a control program; the method specifically comprises the following steps:

3-1 camera: the camera is fixedly arranged on the camera bracket 3-5;

3-2 lens: is installed and fixed on the camera 3-1;

3-3 light source: the light source bracket 3-6 is fixed;

3-4, hanging the clamp: the camera support 3-5 and the light source support 3-6 are fixedly arranged on the sliding module 4-1;

3-5 camera support: the clamp is fixedly arranged on the clamp hanging piece 3-4 and used for fixing a camera;

3-6 light source support: is arranged and fixed on the clamp hanging pieces 3-4 and is used for fixing the light source (2 sets).

The image detection module is used for detecting the image information acquired by the image acquisition module. Based on the above apparatus, in this specific example, a method for detecting appearance defects of a Tray-mounted IC based on machine vision is provided, where the method mainly includes:

the whole device is arranged on an operation platform, an operator scans chip information when each batch of detection is started, and a computer receives the scanning information and automatically records data; the method comprises the following steps that an operator horizontally pushes and moves Tray disc-mounted chips into a Tray disc positioning mark area on a platform one by one, a sensor detects a Tray disc in-place signal, a controller receives the in-place signal to automatically control a vision unit to move to the upper part of one third, two thirds and one third of the front section of the Tray disc and the upper part of the rear section of the Tray disc in sequence (namely a preset position area in the second embodiment), images are shot, content identification is set according to programs, detection data are displayed, positioned and alarmed automatically on a computer display screen, the operator replaces defective chips according to indication information and automatically detects the chips again until the chips are qualified and move out of a detection area, the chips are moved in place and detected, and the like; when the batch detection is finished, a report is automatically generated. Fig. 6 shows a flow chart of the detection control logic of the method.

Specifically, the chip type and the main detection content include:

MS chip (chip type): MS1836, MS7210, MS7200, MS1836S, MS2109, MS9288A, MS9291, MS9292, MS9334, MS9288A;

chip size range: 6mm to 16mm;

the chip packaging type is as follows: d, disc loading;

chip Tray disk standard: JEDEC (135.9x315.0) mm.

Specifically, accurate positioning is achieved for the disc-mounted chip through a grid positioning mode, and appearance detection for a single chip is achieved through an image character segmentation mode, a defect character fitting mode and an OCR character library matching mode.

In summary, the present embodiment provides a device and a method for detecting appearance defects of Tray-mounted ICs based on machine vision, which can automatically detect integrity and appearance defects of batch Tray-mounted chips, and simultaneously implement automatic detection and data management functions of entire trays of chips of different models and specifications. The whole chip is pushed into a positioning mark area on the platform manually, the device consisting of the image acquisition module, the motion control module, the image detection module, the data instruction module and the like automatically finishes detecting the integrity of the chip and identifies a defective chip, the device alarms, displays and positions the chip on a computer display screen, the defective chip is manually replaced according to indication information, and the chip detection data is automatically recorded and managed. According to the device, in the operation process, only an operator needs to push the Tray disc to be detected into the Tray disc identification position on the platform for positioning (namely the positioning mark area in the second embodiment) and move out the detected Tray disc for processing, the other detection processes realize automatic operation, the effects of stabilizing the detection accuracy and uniformity, improving the efficiency and liberating the manpower and reducing the cost are quickly achieved at low cost, and the basic requirements of concentrated and batch detection of chips before delivery are met.

EXAMPLE III

Fig. 7 shows a flowchart of a chip appearance detection method based on machine vision according to a third embodiment of the present application, where the method is applied to a data instruction module, and the chip is a disk-mounted chip. Referring to fig. 7, the method includes:

step S310: and responding to the first interactive operation instruction, and sending a first program instruction to the motion control module so that the motion control module can control the motion of the visual unit included in the image acquisition module.

In an alternative implementation, the motion control module includes: sensor, motion control ware, driver, step motor and linear slip table module, step S310 specifically includes:

the sensor acquires the position information of the to-be-detected disc-mounted chip and sends the position information of the to-be-detected disc-mounted chip to the motion controller;

the motion controller responds to the position information of the to-be-detected disc-mounted chip and outputs a driving pulse signal to the driver;

the driver responds to the driving pulse signal and outputs a rotating pulse signal to the stepping motor;

the stepping motor rotates in response to the rotation pulse signal to control the motion of the linear sliding table module;

the linear sliding table module controls the movement of the visual unit.

In an alternative implementation, the first program instructions are for: and controlling the motion of the visual unit to enable the visual unit to sequentially move to at least three preset position areas above the disc-mounted chip.

In an optional implementation manner, before step S310, the method further includes:

responding to the information acquisition instruction, and acquiring and recording chip information of the disc-mounted chip to be detected; the information acquisition instruction is triggered when scanning operation is carried out on the disc-mounted chip to be detected.

In an optional implementation manner, the first interoperation instruction is triggered when the presence of the to-be-tested disk-mounted chip in the positioning mark region is detected.

Step S320: and responding to the motion information of the visual unit sent by the motion control module, and sending a second program instruction to the image acquisition module so that the image acquisition module acquires the image information of the to-be-detected disc-mounted chip.

The image acquisition module comprises a light source controller and a visual unit. In an alternative implementation, the light source controller is configured to control a light source switch of the vision unit; the visual unit consists of an area-array camera, an optical lens and a strip light source and is used for acquiring image information of the disc-mounted chip to be detected and sending the image information of the disc-mounted chip to be detected to the data instruction module.

In an alternative implementation, the second program instructions are for: and sequentially photographing and collecting at least three image information corresponding to the preset position area of the disc-mounted chip to be detected, and displaying the image information in a visual interface included in the data instruction module.

Step S330: the method comprises the steps of receiving image information of a to-be-detected disc-mounted chip sent by an image acquisition module, sending the image information of the to-be-detected disc-mounted chip to an image detection module, sending a third program instruction to the image detection module so that the image detection module can detect the image information of the to-be-detected disc-mounted chip, and recording a detection result.

In an alternative implementation, the third program instructions are for: simultaneously detecting at least three image information of the to-be-detected disc-mounted chip; and if the detection result is abnormal, positioning, alarming and recording the chips with the appearance defects in the disc-mounted chip area corresponding to the image information with the abnormality.

In an alternative implementation, the detected content includes: the existence of chips in the chip grids of the disk-mounted chips, the placement direction of the chips in the chip grids, the size of the chips and the characters on the surfaces of the chips;

wherein, the positioning of each chip grid in the disk-mounted chip is realized by a grid positioning mode;

the detection of the chip surface characters is realized by an image character segmentation mode, a defect character fitting mode and/or an OCR character library matching mode.

The specific structure and the working principle of each module may refer to the description of the first embodiment and the second embodiment of the apparatus, and are not described herein again.

Example four

Fig. 8 shows a schematic structural diagram of an electronic device according to a fourth embodiment of the present application, where the specific embodiment of the present application does not limit a specific implementation of the electronic device. Referring to fig. 8, the electronic device includes:

at least one processor 401; a memory 402 communicatively coupled to the at least one processor; a communication interface 403; and a communication bus 404.

Wherein:

the processor 401, memory 402, and communication interface 403 communicate with each other via a communication bus 404.

A communication interface 403 for communicating with network elements of other devices, such as clients or other servers.

The memory 402 stores one or more computer programs 405 executable by the at least one processor 401, and the one or more computer programs 405 are executable by the at least one processor 401 to enable the at least one processor 401 to perform operations corresponding to the embodiments of the chip appearance inspection method based on machine vision as described above.

EXAMPLE five

An embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the chip appearance detection method based on machine vision as described above.

It will be understood by those of ordinary skill in the art that all or some of the steps of the methods, systems, functional modules/units in the devices disclosed above may be implemented as software, firmware, hardware, and suitable combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be performed by several physical components in cooperation. Some or all of the physical components may be implemented as software executed by a processor, such as a central processing unit, digital signal processor, or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable storage media, which may include computer storage media (or non-transitory media) and communication media (or transitory media).

The term computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable program instructions, data structures, program modules or other data, as is well known to those of ordinary skill in the art. Computer storage media includes, but is not limited to, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), static Random Access Memory (SRAM), flash memory or other memory technology, portable compact disc read-only memory (CD-ROM), digital Versatile Discs (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer. In addition, communication media typically embodies computer readable program instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media as is well known to those skilled in the art.

The computer-readable program instructions described herein may be downloaded from a computer-readable storage medium to a respective computing/processing device, or to an external computer or external storage device via a network, such as the internet, a local area network, a wide area network, and/or a wireless network. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. The network adapter card or network interface in each computing/processing device receives computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in a computer-readable storage medium in the respective computing/processing device.

The computer program instructions for carrying out operations of the present application may be assembler instructions, instruction Set Architecture (ISA) instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider). In some embodiments, the electronic circuitry can execute computer-readable program instructions to implement aspects of the present application by utilizing state information of the computer-readable program instructions to personalize the electronic circuitry, such as a programmable logic circuit, a Field Programmable Gate Array (FPGA), or a Programmable Logic Array (PLA).

The computer program product described herein may be embodied in hardware, software, or a combination thereof. In an alternative embodiment, the computer program product is embodied in a computer storage medium, and in another alternative embodiment, the computer program product is embodied in a Software product, such as a Software Development Kit (SDK), or the like.

Various aspects of the present application are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the application. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer-readable program instructions.

These computer-readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer-readable program instructions may also be stored in a computer-readable storage medium that can direct a computer, programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer-readable medium storing the instructions comprises an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.

The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer, other programmable apparatus or other devices implement the functions/acts specified in the flowchart and/or block diagram block or blocks.

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of instructions, which comprises one or more executable instructions for implementing the specified logical function(s). In some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

Example embodiments have been disclosed herein, and although specific terms are employed, they are used and should be interpreted in a generic and descriptive sense only and not for purposes of limitation. In some instances, features, characteristics and/or elements described in connection with a particular embodiment may be used alone or in combination with features, characteristics and/or elements described in connection with other embodiments, unless expressly stated otherwise, as would be apparent to one skilled in the art. Accordingly, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the application as set forth in the appended claims.

Claims

1. A chip appearance inspection device based on machine vision, wherein the chip is a disk-mounted chip, the device comprising: the device comprises a motion control module, an image acquisition module, an image detection module and a data instruction module; the image acquisition module comprises a light source controller and a visual unit;

the motion control module is used for responding to a first program instruction sent by the data instruction module, performing motion control on the visual unit and sending motion information of the visual unit to the data instruction module;

the image acquisition module is used for responding to a second program instruction sent by the data instruction module, acquiring image information of a to-be-detected disc-mounted chip and sending the image information of the to-be-detected disc-mounted chip to the data instruction module;

the data instruction module is used for responding to a first interactive operation instruction and sending the first program instruction to the motion control module; sending the second program instruction to the image acquisition module in response to the motion information of the visual unit sent by the motion control module; and receiving the image information of the to-be-detected disc-mounted chip sent by the image acquisition module, sending the image information of the to-be-detected disc-mounted chip to the image detection module, and sending the third program instruction to the image detection module.

2. The apparatus of claim 1, wherein the light source controller is configured to control a light source switch of the vision unit;

the visual unit consists of an area-array camera, an optical lens and a strip light source and is used for acquiring the image information of the to-be-detected disc-mounted chip and sending the image information of the to-be-detected disc-mounted chip to the data instruction module.

3. The apparatus of claim 1, wherein the motion control module comprises: the device comprises a sensor, a motion controller, a driver, a stepping motor and a linear sliding table module; wherein, the first and the second end of the pipe are connected with each other,

the sensor is used for acquiring the position information of the to-be-detected disc-mounted chip and sending the position information of the to-be-detected disc-mounted chip to the motion controller;

the motion controller is used for responding to the position information of the to-be-detected disc-mounted chip and outputting a driving pulse signal to the driver;

the driver is used for responding to the driving pulse signal and outputting a rotating pulse signal to the stepping motor;

the stepping motor is used for responding to the rotation pulse signal to rotate and controlling the motion of the linear sliding table module;

and the linear sliding table module is used for controlling the movement of the vision unit.

4. The apparatus of claim 1, wherein the first program instructions are to: the visual unit is subjected to motion control, and the visual unit is sequentially moved to at least three preset position areas above the disc-mounted chip;

the second program instructions are to: sequentially photographing and collecting at least three image information of the to-be-tested disc-mounted chip, which correspond to the preset position area, and displaying the image information in a visual interface included in the data instruction module;

the third program instructions are for: detecting at least three image information of the to-be-detected disc-mounted chip at the same time; and if the detection result is abnormal, positioning, alarming and recording the chips with the appearance defects in the disc-mounted chip area corresponding to the image information with the abnormality.

5. The apparatus of claim 1 or 4, wherein the detected content comprises: the method comprises the following steps of (1) judging whether chips exist in chip grids of the disc-mounted chips, the placement direction of the chips in the chip grids, the size of the chips and characters on the surfaces of the chips;

the detection of the chip surface characters is realized in an image character segmentation mode, a defect character fitting mode and/or an OCR character library matching mode.

6. The apparatus of claim 1, wherein prior to said sending the first program instructions to the motion control module in response to the first interoperation instructions, the data instruction module is further to: responding to the information acquisition instruction, and acquiring and recording chip information of the disc-mounted chip to be detected; and the information acquisition instruction is triggered when the to-be-detected disc-mounted chip is scanned.

7. The apparatus of claim 1, wherein the first interoperation command is triggered when a presence of a to-be-tested disk-mounted chip within a locator region is detected.

8. A chip appearance detection method based on machine vision is characterized in that the method is applied to a data instruction module, the chip is a disc-mounted chip, and the method comprises the following steps:

responding to a first interactive operation instruction, and sending a first program instruction to a motion control module so that the motion control module can control the motion of a visual unit included in an image acquisition module; responding to the motion information of the visual unit sent by the motion control module, and sending a second program instruction to the image acquisition module so that the image acquisition module acquires the image information of the to-be-detected disc-mounted chip; receiving the image information of the to-be-detected disc-mounted chip sent by the image acquisition module, sending the image information of the to-be-detected disc-mounted chip to the image detection module, and sending a third program instruction to the image detection module so that the image detection module can detect the image information of the to-be-detected disc-mounted chip and record a detection result.

9. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,

the memory stores one or more computer programs executable by the at least one processor to enable the at least one processor to perform the method as claimed in claim 8.

10. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the method as claimed in claim 8.