CN112816496A - Automatic optical detection method and device for interface assembly quality of automobile domain controller - Google Patents
Automatic optical detection method and device for interface assembly quality of automobile domain controller Download PDFInfo
- Publication number
- CN112816496A CN112816496A CN202110015425.XA CN202110015425A CN112816496A CN 112816496 A CN112816496 A CN 112816496A CN 202110015425 A CN202110015425 A CN 202110015425A CN 112816496 A CN112816496 A CN 112816496A
- Authority
- CN
- China
- Prior art keywords
- interface
- socket
- label
- domain controller
- mask
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
- G01N35/00584—Control arrangements for automatic analysers
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Image Analysis (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
The invention discloses an automatic optical detection method and device for interface assembly quality of an automobile domain controller, wherein the method comprises the following steps: placing a prototype, controlling the strip-shaped light source to be started by the optical sensing subsystem, collecting an image of a detection surface of the automobile domain controller, and identifying various interface connectors, sockets, labels and positioning marks by using a Mask R-CNN detection and segmentation frame; counting the number of various interface connectors, the number of sockets and the number of labels, and judging the number of the interface connectors, the sockets and the label mounting feet of the automobile domain controller; identifying pixel coordinates of the positioning mark as reference pixel coordinates, identifying coordinates of the interface connector, the interface socket and the label, and respectively judging whether the mounting positions of the interface connector and the interface socket are correct or not and whether the label pasting position is correct or not; and when the number of the interface connectors, the sockets and the labels of the automobile domain controller is enough, the mounting positions of the interface connectors, the interface sockets and the labels are correct, and the automobile domain controller is judged to be qualified.
Description
Technical Field
The invention relates to the technical field of automatic optical detection, in particular to an automatic optical detection method and device for interface assembly quality of an automobile domain controller.
Background
The automobile domain controller replaces the existing distributed electronic and electric framework by relatively and intensively controlling each domain in the automobile through the multi-core chip with stronger processing capacity, and realizes the control of a plurality of domains such as a power assembly, an intelligent cabin, intelligent driving and the like. The automobile domain controller carries out wireless transmission on the automobile sensor data through BT, WIFI and the like, and the wireless transmission capability needs to be tested. However, at present, because the automobile domain controller is provided with a plurality of data transmission interfaces, different test boards are required to be used when the automobile domain controller is tested, the testing efficiency is not high, and the development of the automobile domain controller is restricted.
Disclosure of Invention
In order to solve the above technical problems, an object of the present invention is to provide an automatic optical detection method and apparatus for interface assembly quality of an automobile domain controller.
The purpose of the invention is realized by the following technical scheme:
an automatic optical detection method for interface assembly quality of an automobile domain controller comprises the following steps:
a, controlling a strip light source to be started, collecting an image of a detection surface of an automobile domain controller, and identifying various interface connectors, sockets, labels and positioning marks by using a Mask R-CNN detection and segmentation framework;
b statistics of the number N of various interface connectorsplugNumber of sockets NsocketLabel NlabelThe number of the design interface connectors N of the automobile domain controllerplug-dNumber of sockets Nsocket-dNumber of tags Nlabel-dComparing and judging the mounting feet of the interface connector, the socket and the label of the automobile domain controller;
c, using Mask R-CNN to detect and segment the frame identification positioning mark to obtain the pixel coordinate (u) of the positioning mark0,v0) And the pixel coordinates (u) of the location mark0,v0) Identifying interface joint coordinates (u) as reference pixel coordinatesplug,vplug) Obtaining the relative positioning mark coordinate (delta u) of the interface jointplug,Δvplug) Relative positioning mark size (delta u) with design interface jointplug-d,Δvplug-d) Judging whether the mounting position of the interface joint is correct or not;
d uses Mask R-CNN to detect and divide the frame recognition interface socket coordinate (u)socket,vsocket) Coordinate (u) of the pixel of the location mark0,v0) Obtaining the coordinate (delta u) of the relative positioning mark of the interface socket as the reference pixel coordinatesocket,Δvsocket) Coordinate (delta u) of relative positioning mark with design interface socketsocket-d,Δvsocket-d) Judging whether the mounting position of the interface socket is correct or not;
e using Mask R-CNN to detect and segment frame identification label coordinate (u)label,vlabel) Coordinate (u) of the pixel of the location mark0,v0) Obtaining coordinates (delta u) of the label relative to the positioning mark as reference pixel coordinateslabel,Δvlabel) Positioning the landmark coordinates (Δ u) relative to the design labelsocket-d,Δvsocket-d) Judging whether the label pasting position is correct or not;
and F, integrating the evaluation results of the step B, C, D, E, and judging that the automobile domain controller is qualified when the mounting positions of the interface connector, the interface socket and the label are correct when the mounting numbers of the interface connector, the interface socket and the label of the automobile domain controller are sufficient.
An automatic optical detection device for interface assembly quality of an automobile domain controller comprises: the system comprises an optical sensing subsystem, a motion control subsystem and an upper computer;
the optical sensing subsystem is used for controlling the strip-shaped light source to be started, collecting an image of a detection surface of the automobile domain controller, and identifying various interface connectors, sockets, labels and positioning marks by using a Mask R-CNN detection and segmentation frame;
the motion control subsystem consists of a four-axis motion control card, a program control power supply, 4 servo motors, an industrial personal computer, a display, a relay channel board and a CAN bus, and is used for placing a prototype, so that the prototype CAN move in X, Y, Z three directions and horizontally rotate to improve the test efficiency;
the upper computer is used for identifying the interface connector, the socket, the pins and the sticker labels in the uploaded images.
One or more embodiments of the present invention may have the following advantages over the prior art:
the method has the characteristics of high automation degree, high speed and low labor cost, and has practical significance and popularization value.
Drawings
FIG. 1 is a flow chart of an automatic optical inspection method for interface assembly quality of a car domain controller.
Detailed Description
In order to make the objects, technical solutions and advantages of the present invention more apparent, the present invention will be described in further detail with reference to the following embodiments and accompanying drawings.
As shown in fig. 1, the automatic optical detection method for the interface assembling quality of the automobile domain controller comprises the following steps:
and step 60, integrating the evaluation results of the steps 20, 30, 40 and 50, and judging that the automobile domain controller is qualified when the number of the interface connectors, the sockets and the labels of the automobile domain controller is enough, and the mounting positions of the interface connectors, the interface sockets and the labels are correct.
In the step 10, the Mask R-CNN detection and segmentation framework can output the type (Class), the bounding Box (Box) and the Mask (Mask), and in the detection method of the automobile domain controller, the definition is
The upper left end of the image U-V image coordinate system is an image origin O (0,0), the positive direction of the U axis is horizontal to the right, and the positive direction of the V axis is vertical to the down;
type (Class): interface connector type (A-1, A-2 …), interface socket type (B-1, B-2 …), label (C-1, C-2 …) or locator mark (D);
bounding Box (Box): upper left point (u)1,v1) Lower right side point (u)2,v2);
Mask (Mask): the 28 × 28 bitmap, with 1 for presence and 0 for absence.
In order to ensure the detection accuracy, the accuracy rate is up to 100% in the aspect of type (Class) identification; the accuracy of the boundary frame and the mask adopts COCO APIoU=0.5、APIoU=0.75Evaluation, Mask R-CNN detection and AP segmentation of the bounding Box (Box)IoU=0.5Should equal 100%; AP of Mask (Mask)IoU=0.5≥95%。
Mask R-CNN detection and segmentation framework bounding box used in the embodimentAP of (Box)IoU=0.5100%, the bounding box mAP reaches 96.892%; AP of Mask (Mask)IoU=0.5100%, and the mask mAP reaches 96.220%.
In step 20, the conditions of the number of the interface connectors, the sockets and the label installation feet of the automobile domain controller are as follows:
in step 30, setting the tolerance limit delta of the mounting position of the interface joint on the U axis in the image coordinate systemplug-uAllowable deviation limit delta on V axisplug-vIf the interface connector is installed correctly, the conditions are as follows:
in step 40, setting the interface socket in the image coordinate system, and allowing the deviation limit delta on the U axis at the mounting position of the interface socketsocket-uAllowable deviation limit delta on V axissocket-vThen, the correct conditions for the installation of the interface socket are as follows:
the embodiment also provides an automatic optical detection device for the interface assembly quality of the automobile domain controller, which comprises a motion control subsystem and an upper computer; the above-mentioned
The optical sensing subsystem is used for controlling the strip-shaped light source to be started, collecting an image of a detection surface of the automobile domain controller, detecting and segmenting a frame by using Mask R-CNN, and identifying various interface connectors, sockets, labels and positioning marks;
the motion control subsystem consists of a four-axis motion control card, a program control power supply, 4 servo motors, an industrial personal computer, a display, a relay channel board and a CAN bus, and is used for placing a prototype, so that the prototype CAN move in X, Y, Z three directions and horizontally rotate to improve the test efficiency;
the upper computer is used for identifying the interface connector, the socket, the pins and the sticker labels in the uploaded images.
The optical sensing subsystem consists of two industrial cameras, a lens, a light source controller and four strip light sources and is used for collecting front and rear panel images of the automobile domain controller.
Although the embodiments of the present invention have been described above, the above descriptions are only for the convenience of understanding the present invention, and are not intended to limit the present invention. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. An automatic optical detection method for interface assembly quality of an automobile domain controller, which is characterized by comprising the following steps:
a, controlling a strip light source to be started, collecting an image of a detection surface of an automobile domain controller, and identifying various interface connectors, sockets, labels and positioning marks by using a Mask R-CNN detection and segmentation framework;
b statistics of the number N of various interface connectorsplugNumber of sockets NsocketLabel NlabelThe number of the design interface connectors N of the automobile domain controllerplug-dNumber of sockets Nsocket-dNumber of tags Nlabel-dComparing and judging the mounting feet of the interface connector, the socket and the label of the automobile domain controller;
c, using Mask R-CNN to detect and segment the frame identification positioning mark to obtain the pixel coordinate (u) of the positioning mark0,v0) And the pixel coordinates (u) of the location mark0,v0) Identifying interface joint coordinates (u) as reference pixel coordinatesplug,vplug) Obtaining the relative positioning mark coordinate (delta u) of the interface jointplug,Δvplug) Relative positioning mark size (delta u) with design interface jointplug-d,Δvplug-d) Judging whether the mounting position of the interface joint is correct or not;
d uses Mask R-CNN to detect and divide the frame recognition interface socket coordinate (u)socket,vsocket) Coordinate (u) of the pixel of the location mark0,v0) Obtaining the coordinate (delta u) of the relative positioning mark of the interface socket as the reference pixel coordinatesocket,Δvsocket) Coordinate (delta u) of relative positioning mark with design interface socketsocket-d,Δvsocket-d) Judging whether the mounting position of the interface socket is correct or not;
e using Mask R-CNN to detect and segment frame identification label coordinate (u)label,vlabel) Coordinate (u) of the pixel of the location mark0,v0) Obtaining coordinates (delta u) of the label relative to the positioning mark as reference pixel coordinateslabel,Δvlabel) Positioning the landmark coordinates (Δ u) relative to the design labelsocket-d,Δvsocket-d) Judging whether the label pasting position is correct or not;
and F, integrating the evaluation results of the step B, C, D, E, and judging that the automobile domain controller is qualified when the mounting positions of the interface connector, the interface socket and the label are correct when the mounting numbers of the interface connector, the interface socket and the label of the automobile domain controller are sufficient.
2. The method of claim 1, wherein Mask R-CNN detects and partitions frame output type (Class), bounding Box (Box) and Mask (Mask), and in the method, definition is used for detecting the interface assembly quality of the car domain controller
The upper left end of the image U-V image coordinate system is an image origin O (0,0), the positive direction of the U axis is horizontal to the right, and the positive direction of the V axis is vertical to the down;
type (Class): interface connector type (A-1, A-2 …), interface socket type (B-1, B-2 …), label (C-1, C-2 …) or locator mark (D);
bounding Box (Box): upper left point (u)1,v1) Lower right side point (u)2,v2);
Mask (Mask): the 28 × 28 bitmap, with 1 for presence and 0 for absence.
3. The automatic optical inspection method of interface assembling quality of automobile domain controller as claimed in claim 2, wherein the accuracy rate should reach 100% in type (Class) identification; the accuracy of the boundary frame and the mask adopts COCO APIoU=0.5、APIoU =0.75Evaluation, Mask R-CNN detection and AP segmentation of the bounding Box (Box)IoU=0.5Should equal 100%; AP of Mask (Mask)IoU=0.5≥95%。
4. The automatic optical inspection method for interface assembling quality of car domain controller according to claim 1, characterized in that in said step B: the conditions of the number of the interface joints, the sockets and the label installation feet of the automobile domain controller are as follows:
5. the automatic optical inspection method for interface assembling quality of car domain controller according to claim 1, characterized in that in said step C:
arranged in an image coordinate system, and the allowable deviation limit delta of the mounting position of the interface joint on a U axisplug-uAllowable deviation limit delta on V axisplug-vIf the interface connector is installed correctly, the conditions are as follows:
6. the automatic optical inspection method for interface assembling quality of car domain controller according to claim 1, characterized in that in said step D:
set in the image coordinate system, the allowable deviation limit delta of the mounting position of the interface socket on the U axissocket-uAllowable deviation limit delta on V axissocket-vThen, the correct conditions for the installation of the interface socket are as follows:
7. the automatic optical inspection method for interface assembling quality of car domain controller according to claim 1, characterized in that in said step E:
set in the image coordinate system, the allowable deviation limit delta of the label pasting position on the U axislabel-uAllowable deviation limit delta on V axislabel-vThen the label pasting correct condition is as follows:
8. an automatic optical detection device for interface assembly quality of a car domain controller, characterized in that the device comprises: the system comprises an optical sensing subsystem, a motion control subsystem and an upper computer;
the optical sensing subsystem is used for controlling the strip-shaped light source to be started, collecting an image of a detection surface of the automobile domain controller, and identifying various interface connectors, sockets, labels and positioning marks by using a Mask R-CNN detection and segmentation frame;
the motion control subsystem consists of a four-axis motion control card, a program control power supply, 4 servo motors, an industrial personal computer, a display, a relay channel board and a CAN bus, and is used for placing a prototype, so that the prototype CAN move in X, Y, Z three directions and horizontally rotate to improve the test efficiency;
the upper computer is used for identifying the interface connector, the socket, the pins and the sticker labels in the uploaded images.
9. The automatic optical inspection device for interface mounting quality of automobile domain controller of claim 8, wherein said optical sensing subsystem is composed of two industrial cameras and lens, light source controller, four bar light sources.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110015425.XA CN112816496B (en) | 2021-01-05 | 2021-01-05 | Automatic optical detection method and device for interface assembly quality of automobile domain controller |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110015425.XA CN112816496B (en) | 2021-01-05 | 2021-01-05 | Automatic optical detection method and device for interface assembly quality of automobile domain controller |
Publications (2)
Publication Number | Publication Date |
---|---|
CN112816496A true CN112816496A (en) | 2021-05-18 |
CN112816496B CN112816496B (en) | 2022-09-23 |
Family
ID=75857937
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202110015425.XA Active CN112816496B (en) | 2021-01-05 | 2021-01-05 | Automatic optical detection method and device for interface assembly quality of automobile domain controller |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112816496B (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113888494A (en) * | 2021-09-28 | 2022-01-04 | 广州市华颉电子科技有限公司 | Artificial intelligence interface pin quality detection method of automobile domain controller |
CN114324350A (en) * | 2021-12-10 | 2022-04-12 | 巢湖学院 | Intelligent five-hole socket panel defect detection method and system based on machine vision |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108759667A (en) * | 2018-05-29 | 2018-11-06 | 福州大学 | Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera |
CN109738061A (en) * | 2019-01-11 | 2019-05-10 | 华南理工大学 | A kind of illumination photometer position automatic aligning method and system towards illumination photometer calibrating |
CN109974582A (en) * | 2019-04-04 | 2019-07-05 | 江南大学 | A kind of the conductor diameters non-contact vision detection device and method of automotive wire bundle |
CN110765912A (en) * | 2019-10-15 | 2020-02-07 | 武汉大学 | SAR image ship target detection method based on statistical constraint and Mask R-CNN |
CN111044525A (en) * | 2019-12-30 | 2020-04-21 | 歌尔股份有限公司 | Product defect detection method, device and system |
US20200167943A1 (en) * | 2018-11-28 | 2020-05-28 | Nvidia Corporation | 3d plane detection and reconstruction using a monocular image |
CN111402248A (en) * | 2020-03-23 | 2020-07-10 | 华南理工大学 | Transmission line lead defect detection method based on machine vision |
CN111798516A (en) * | 2020-07-01 | 2020-10-20 | 广东省特种设备检测研究院珠海检测院 | Method for detecting running state quantity of bridge crane equipment and analyzing errors |
US20200356899A1 (en) * | 2019-05-06 | 2020-11-12 | Dassault Systemes | Experience learning in virtual world |
US20200380899A1 (en) * | 2018-07-02 | 2020-12-03 | Beijing Baidu Netcom Science Technology Co., Ltd. | Method and apparatus for detecting peripheral circuit of display screen, electronic device, and storage medium |
-
2021
- 2021-01-05 CN CN202110015425.XA patent/CN112816496B/en active Active
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108759667A (en) * | 2018-05-29 | 2018-11-06 | 福州大学 | Front truck distance measuring method based on monocular vision and image segmentation under vehicle-mounted camera |
US20200380899A1 (en) * | 2018-07-02 | 2020-12-03 | Beijing Baidu Netcom Science Technology Co., Ltd. | Method and apparatus for detecting peripheral circuit of display screen, electronic device, and storage medium |
US20200167943A1 (en) * | 2018-11-28 | 2020-05-28 | Nvidia Corporation | 3d plane detection and reconstruction using a monocular image |
CN109738061A (en) * | 2019-01-11 | 2019-05-10 | 华南理工大学 | A kind of illumination photometer position automatic aligning method and system towards illumination photometer calibrating |
CN109974582A (en) * | 2019-04-04 | 2019-07-05 | 江南大学 | A kind of the conductor diameters non-contact vision detection device and method of automotive wire bundle |
US20200356899A1 (en) * | 2019-05-06 | 2020-11-12 | Dassault Systemes | Experience learning in virtual world |
CN110765912A (en) * | 2019-10-15 | 2020-02-07 | 武汉大学 | SAR image ship target detection method based on statistical constraint and Mask R-CNN |
CN111044525A (en) * | 2019-12-30 | 2020-04-21 | 歌尔股份有限公司 | Product defect detection method, device and system |
CN111402248A (en) * | 2020-03-23 | 2020-07-10 | 华南理工大学 | Transmission line lead defect detection method based on machine vision |
CN111798516A (en) * | 2020-07-01 | 2020-10-20 | 广东省特种设备检测研究院珠海检测院 | Method for detecting running state quantity of bridge crane equipment and analyzing errors |
Non-Patent Citations (1)
Title |
---|
华一丁等: ""基于模型的智能汽车电子电气架构发展综述"", 《汽车零部件》 * |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113888494A (en) * | 2021-09-28 | 2022-01-04 | 广州市华颉电子科技有限公司 | Artificial intelligence interface pin quality detection method of automobile domain controller |
CN114324350A (en) * | 2021-12-10 | 2022-04-12 | 巢湖学院 | Intelligent five-hole socket panel defect detection method and system based on machine vision |
Also Published As
Publication number | Publication date |
---|---|
CN112816496B (en) | 2022-09-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN112816496B (en) | Automatic optical detection method and device for interface assembly quality of automobile domain controller | |
CN104913722B (en) | A kind of car body controller connector pin normotopia degree detection method | |
US20230129522A1 (en) | Artificial intelligence vision inspection system for wiring harness | |
CN105184793A (en) | Electric energy meter sample appearance and PCB element detection method | |
US20050259874A1 (en) | Apparatus, method, and program for assisting in selection of pattern element for pattern matching | |
CN203069520U (en) | Multifunctional automatic PCB (Printed Circuit Board) test system | |
CN110751693A (en) | Method, device, equipment and storage medium for camera calibration | |
CN104345260A (en) | Signal completeness automatic testing system and method | |
US20240062381A1 (en) | Cell detection method and apparatus, device, readable storage medium, and program product | |
CN116681965A (en) | Training method of target detection model and target detection method | |
CN204705323U (en) | A kind of car body controller connector pin normotopia degree pick-up unit | |
CN110738170A (en) | image recognition method for electric meter terminal fault recognition | |
CN113744252A (en) | Method, apparatus, storage medium and program product for marking and detecting defects | |
CN115375608A (en) | Detection method and device, detection equipment and storage medium | |
CN113902740A (en) | Construction method of image blurring degree evaluation model | |
CN111784767B (en) | Method and equipment for determining target position | |
CN110817674B (en) | Method, device and equipment for detecting step defect of escalator and storage medium | |
CN102967844A (en) | Automatic detection system with formal detection function of intelligent ammeters | |
CN108268813B (en) | Lane departure early warning method and device and electronic equipment | |
CN115731306A (en) | Camera calibration system and method | |
CN2406256Y (en) | On-line testing machine with picture identifying function | |
CN112784737B (en) | Text detection method, system and device combining pixel segmentation and line segment anchor | |
CN101398462A (en) | Paster bonding wire automatic detection system | |
CN111553210B (en) | Training method of lane line detection model, lane line detection method and device | |
CN118098086B (en) | Module assembly control method and system for display production |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |