EP4677426A1 - A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system - Google Patents

A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system

Info

Publication number
EP4677426A1
EP4677426A1 EP24718063.1A EP24718063A EP4677426A1 EP 4677426 A1 EP4677426 A1 EP 4677426A1 EP 24718063 A EP24718063 A EP 24718063A EP 4677426 A1 EP4677426 A1 EP 4677426A1
Authority
EP
European Patent Office
Prior art keywords
data
electronic component
neural network
data vector
component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP24718063.1A
Other languages
German (de)
French (fr)
Inventor
Denis Krompaß
Roman EICHLER
Ahmed FRIKHA
Adarsh Mallandur
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Siemens Corp
Original Assignee
Siemens AG
Siemens Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG, Siemens Corp filed Critical Siemens AG
Publication of EP4677426A1 publication Critical patent/EP4677426A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Program-control systems
    • G05B19/02Program-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G05B19/41875Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by quality surveillance of production
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/95Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
    • G01N21/9501Semiconductor wafers
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/32Operator till task planning
    • G05B2219/32193Ann, neural base quality management
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/45Nc applications
    • G05B2219/45026Circuit board, pcb

Definitions

  • the invention relates to a method for monitoring a production of an electronic component by a monitoring system according to the independent claim 1 . Furthermore, the invention relates to a computer program product , a computer-readable storage medium, as well as a monitoring system .
  • AOI automated optical inspection
  • PCB printed circuit board
  • LCD liquid crystal display
  • a camera autonomously scans the device under test for both catastrophic failure , for example missing component , and quality defects , for example fillet si ze or shape or component skew .
  • PCB printed circuit board
  • quality defects for example fillet si ze or shape or component skew .
  • SPI solo paste inspection
  • pre-reflow and post-reflow as well as other stages .
  • one option is to use the data produced by the AOI machine to find patterns that discriminate pseudo errors , in particular so-called false- positives , from real errors and in this way reduce the amount of manual post AOI inspections of PCBs .
  • the data produced by the AOI machine to find patterns that discriminate pseudo errors , in particular so-called false- positives , from real errors and in this way reduce the amount of manual post AOI inspections of PCBs .
  • no speciali zed Al-based approach that can interface with the special data structures produced by AOI machines are available .
  • One aspect of the invention relates to a method for monitoring a production of an electronic component by a monitoring system .
  • First data from an automatic optical inspection device are received by an electronic computing device of the monitoring system, wherein the first data describe components of the electronic component .
  • Second data from the automatic optical inspection device (AOI device ) are received by the electronic computing device , wherein the second data describe pins of the components of the electronic component .
  • a neural network is provided by the electronic computing device , wherein the neural network is configured for calculating data with a preset first si ze for the first data and a preset second si ze for the second data . Each si ze of the received data is determined by the electronic computing device .
  • the determined si ze of the first data and the second data are compared with the preset first si ze and second si ze for the neural network by the electronic computing device .
  • the received first data and second data are padded such that a first data vector is generated in the first si ze and a second data vector is generated in a second si ze by the electronic computing device .
  • a mask is generated by the electronic computing device , wherein the mask describes the first data vector concerning the received first data and a first padding and a second data vector concerning the received second data and a second padding .
  • the first data vector, the second data vector and the mask is transmitted to the neural network .
  • the electronic component is analyzed depending on the first data vector and the second data vector by the neural network then the electronic component is monitored depending on the analyzation .
  • a neural network-based modelling approach is proposed that can process the produced data in its natural form and integrates all measured information of an inspected printed circuit board .
  • its natural form it is meant that for each printed circuit board there exist measurements for a variable set of components and for each component there exist measurements of a variable set of pins . Therefore , processing hierarchically organi zed inputs with variating shapes , in particular number of components and corresponding pins is a non-trivial method .
  • a combination of padding and masking is used to make this input compatible with a neural network .
  • the padding is used to organi ze each input example , for example data of a single PCB (printed circuit board) , in the same shapes arrays that can be batched and digested by the neural network-model .
  • Masking is used to provide the model with the information what parts of the input to ignore , in particular the padding, when processing the data .
  • the pin data of each component and the component data are organi zed in separate arrays as depicted .
  • this method is targeting automated f aults-positive reduction which directly decreases the manual ef fort of reinspection of PCBs that were classi fied as erroneous by the automatic optical inspection device .
  • the advantage of this approach over other data-based approaches is that the hierarchical data generated by the automatic optical inspection device is modelled as-is without information loss . Meaning that more information is used to j udge i f the PCB in question is truly erroneous .
  • the data of a whole board can be processed end-to-end by the model which is not possible by of-the-shel f methods since they can not deal with a dynamic input si ze .
  • the neural network may also be regarded as the model .
  • the false-positive reduction use-case data sets are characteri zed by a high class imbalance , which means that there is an imbalance between board inspections where the AOI machine reported a pseudo error (maj ority) and a real error (minority) .
  • a pseudo error major ority
  • a real error minority
  • additional measures are used to tackle this class-imbalance .
  • the batches are balanced of examples via resampling the minority class ( real error ) , during model training such that between 10 percent and 50 percent of the examples in the batch are boards with real errors .
  • the training data consists of di f ferent AOI test-patterns
  • the batches are additionally balanced via resampling such that during training, the model is exposed to all AOI test-patterns at similar frequency .
  • the loss function is employed, which further improves training results when training with imbalanced data sets .
  • the electronic component is analyzed in such that the electronic component is classi fied in an erroneous component or in a non-erroneous component .
  • the electronic component is analyzed in such, that a real error and/or a pseudo error is classi fied . Therefore , minimi zing pseudo-errors in the production of the electronic component is provided .
  • a classi fication of the automatic optical inspection device is taken into consideration by the electronic computing device .
  • j ust an electronic component which is classi fied from the automatic optical inspection device as erroneous , is analyzed by the electronic computing device .
  • i f the automatic optical inspection device provides the electronic component as non-erroneous no inspection/no monitoring of the monitoring system is provided .
  • i f the automatic optical inspection device classi fies the electronic component as erroneous
  • the monitoring system is monitoring these electronic components .
  • the monitoring system then is configured for classi fying the electronic components such, that a pseudo-error or a real error of the AOI is detected by the monitoring system . Therefore , minimi zing pseudo errors is provided .
  • the pin data is organi zed as a four-dimensional array, where the first two dimensions are the same as in the component data case .
  • the third dimension is the pin axis where each entry describes the measurements of an inspected pin of a component . Note that no order of the pins is enforced here . Since the number of pins can be di f ferent for each component on the PCB this dimension has the si ze of the maximum number of pins seen of the components across all PCBs that are part of the current batch . Therefore , an improved monitoring of the electronic component can be reali zed .
  • the mask is provided as a Boolean masking array . Therefore, in addition to the component data and the pin data, also an information about where the padding is located in the component and pin data is organi zed as the Boolean masking array . Note that the padding and masking is in general only required when data of multiple boards should be processed by the model at once . A typical requirement by the optimi zation process applied to train the downstream neural network model . However, also during inference it can make sense to batch data of multiple boards to improve the runtime . Therefore , an improved monitoring of an electronic component is provided .
  • the neural network comprises at least a first encoder for the first data vector and a second encoder for the second data vector .
  • the neural network further comprises at least a third encoder, wherein in the third encoder a first result of the first encoder and a second result of the second encoder are fused . Therefore , a neural network is provided, which improves the monitoring of the electronic component .
  • the first encoder and the second encoder are provided with the same encoder structure . Therefore , an easy way for encoding is provided .
  • the structures of each encoder may be di f ferent .
  • a zero-padding is used for padding the received data .
  • the slots are filled with zeros . Therefore , an easy way for generating the data vector is provided .
  • the neural network ignores paddings during the analyzation of the first data vector and the second data vector .
  • the neural network is configured to ignore zero-paddings . Therefore , the neural network can analyze the data, but ignores data, which is not relevant , in particular the padded data . Therefore , an improved analyzation of the electronic component is provided .
  • the neural network comprises at least a classi bomb module for classi fying the electronic component .
  • the classi fier module is applied whose output is a single confidence value that the ingested board data represents a pseudo-error .
  • the classi fier module is a multi-layer perception (MLP ) that ingests the encoding of all component and pin measurements of the board and produces a single confidence i f the measurement reflects pseudo-error of the AOI device or not .
  • this MLP may consist of two subsequent fully-connected neural network layers , where the first used a real activation function .
  • the proposed method is a computer-implemented method . Therefore , another aspect of the invention relates to a computer program product comprising program code means for performing a method according to the preceding aspect .
  • Another aspect of the invention relates to a computer- readable storage medium comprising at least the computer program product according to the preceding aspect .
  • a still further aspect of the invention relates to a monitoring system for monitoring a production of an electronic component , comprising at least one electronic computing device , wherein the monitoring system is configured for performing a method according to the preceding aspect .
  • the method is performed by the monitoring system .
  • the electronic computing device may comprise electronic means , for example processors , circuits , in particular integrated circuits , and further electronic components , for performing a method according to the preceding aspect .
  • the electronic computing device may also be regarded as a computing unit .
  • a computing unit may in particular be understood as a data processing device , which comprises processing circuitry .
  • the computing unit can therefore in particular process data to perform computing operations . This may also include operations to perform indexed accesses to a data structure , for example a look-up table , LUT .
  • the computing unit includes one or more hardware and/or software interfaces and/or one or more memory units .
  • a memory unit may be implemented as a volatile data memory, for example a dynamic random access memory, DRAM, or a static random access memory, SRAM, or as a non-volatile data memory, for example a read-only memory, ROM, a programmable read-only memory, PROM, an erasable programmable read-only memory, EPROM, an electrically erasable programmable read-only memory, EEPROM, a flash memory or flash EEPROM, a ferroelectric random access memory, FRAM, a magnetoresistive random access memory, MRAM, or a phase-change random access memory, PCRAM .
  • a volatile data memory for example a dynamic random access memory, DRAM, or a static random access memory, SRAM
  • a non-volatile data memory for example a read-only memory, ROM, a programmable read-only memory, PROM, an erasable programmable read-only memory, EPROM, an electrically erasable programmable read-only memory,
  • Advantageous forms of configuration of the method are to be regarded as advantageous forms of configuration of the computer program product , the computer-readable storage medium as well as the monitoring system .
  • the monitoring system therefore comprises means for performing the method .
  • an error message and/or a prompt for user feedback is output and/or a default setting and/or a predetermined initial state is set .
  • a default setting and/or a predetermined initial state is set .
  • FIG 1 shows an abstract representation of data produced by an automatic optical inspection device
  • FIG 2 shows a schematic block diagram according to a structure of PCB data after performing at least a part of the method according to the invention
  • FIG 3 shows a schematic block diagram according to an embodiment of the monitoring system
  • FIG 4 shows a schematic block diagram according to an attention module according to an embodiment of the invention .
  • FIG 1 shows an abstract representation of the data produced by an automatic optical inspection device 10 (AOI device ) from a monitoring system 12 .
  • AOI device automatic optical inspection device
  • three di f ferent printed circuit boards which may be also regarded as an electronic component 14 , 16 , 18 , were inspected, wherein each board consists of a di f ferent set of components 20 .
  • the first electronic component 14 has three components 20 , for example a capacitor, a resistor and another resistor
  • the second electronic component 16 consists of two components 20
  • the third electronic component 18 comprises four components 20 .
  • Each component 20 internally might have a di f ferent number of pins 22 and consequently the amount of measurement data produced per component 20 is varying .
  • FIG 2 shows a structure of an electronic component 14, 16, 18 after applying padding and masking.
  • first data 24 describes the components 20 of the electronic component 14, 16, 18.
  • second data 26 are shown, wherein the second data 26 describes the pins 22 of the components 20 of the electronic components 14, 16, 18.
  • a first mask 28 for the component data 24 is shown as well as a second mask 30 for the second data 26 is shown.
  • the first mask 28 and the second mask 30 may be fused to one mask 28, 30.
  • FIG 1 and 2 shows a hierarchical processing of organized inputs with varying shapes, in particular the number of components 20 and corresponding pins 22.
  • a neural network 32 FOG 3
  • the padding is used to organize each input example, for example data of a single PCB (printed circuit board) , in the same shaped arrays that can be batched and digested by the neural network 32.
  • Masking is used to provide the model with information what parts of the input to ignore, in particular the padding, when processing the data.
  • the data of each component 20 and the pins 22 are separated in arrays.
  • FIG 2 shows, that the first data 24 is organized in a three-dimensional array where the first dimension is a batch axis, meaning each entry along the dimension describes a different electronic component 14, 16, 18.
  • the second dimension is the component axis, where each entry describes the measurements of the component 20 on an electronic component 14, 16, 18. Note that no order of the components 20 is enforced here. Since the number of components 20 can be different for each electronic component 14, 16, 18 this dimension has the size of the maximum number of components 20 seen on the electronic components 14, 16, 18 that are part of the current batch. Finally, the feature-axis is the same for all components 20 since the same kind of measurements are performed on them.
  • the batch dimension would have the si ze 3 , where the component axis would have a si ze of 4 .
  • the data of the first electronic component 14 and the second electronic component 16 will be zero-padded along the component axis , since they do not have four components 20 .
  • the feature-axis is the same for all components 20 since the same kind of measurements are performed on them .
  • the second data 26 is organi zed in a four-dimensional array, where the first two dimensions are the same as in the component data case .
  • the third dimension is the pin axis where each entry describes the measurements of an expected pin 22 of a component 20 . Note that no order of the pins 22 is enforced here . Since the number of pins 22 can be di f ferent for each component 20 on the electronic components 14 , 16 , 18 this dimension has the si ze of the maximum number of pins 22 seen of the components 20 across all electronic components 14 , 16 , 18 that are part of the current batch .
  • the component data is stored by an array C of a shape n x c x f and the pin data by an array of P of the shape n x c x p x h, where n is the batch si ze , c is the maximum number of components 20 observed on the electronic component 14 , 16 , 18 in the batch, f are the di f ferent kind of measurements performed on a component 20 , p is the maximum number of pins 22 observed in the batch and h are the measurements performed on a pin 22 .
  • information about where the padding is located in the component 20 and the pin data array is organi zed in a Boolean masking array .
  • padding and masking is generally only required when data of multiple boards should be processed by the neural network 32 at once .
  • a typical requirement by the optimi zation process applied to train the downstream neural network-model it can make sense to batch data of multiple boards to improve the runtime .
  • FIG 3 shows a schematic block diagram according to an embodiment of the monitoring system 12 , in particular of the neural network 32 .
  • the neural network 32 is proposed that it can properly process it .
  • the neural network 32 consists of four modules 34 , 36 , 38 , 40 .
  • a third encoder 38 is applied that fuses all the previous , in particular varying number of , encodings , considering also the mask 28 , 30 , into one fixed si ze encoding that represents the state of the ingested board with respect to the observed measurements of components 20 and corresponding pin 22 .
  • a fourth encoder in particular a so-called classi bomb module 40 , is applied whose output is a single confidence value that the ingested board data represents a pseudo-error .
  • the four components 34 , 36 , 38 , 40 are described in more detail .
  • the same encoder structure each is provided, where the encoders for pins and components do not share any model parameters . Consequently, there is no differentiation between pins and components and they may be simply called entities in the following. Therefore, the structure of the first encoder 34 and the second encoder 36 is described in more detail.
  • Categorical measurements including binary
  • component type e.g. "component type” or “pin type”
  • Numerical measurements e.g. “component_high”, “electrode_length”
  • cyclical numerical measurements e.g. "component_angle_f rom_board”, “electrode_angle_f rom_board”
  • the masks 28, 30 are passed to the encoder module too, since the encoder is applied on all entities of the batch at once, which can contain zero-paddings.
  • Each of the C categorical measurement is passed through its own embedding layer 46, which transforms each categorical input into a d-dimensional vector in a learned embedding space.
  • the cyclical numerical features are replaced applying a sin and cosine-based transformation 42 on them and concatenated (Concatenation 48) to the other numerical features.
  • the complete set of numerical features of the entity is then passed through a mask batch normalization 44, which normalizes these inputs. Note that the mask 28, 30 is used by the mask batch normalization 44 such that zero padding values are ignored during normalization.
  • the resulting normalized numerical inputs are then concatenated with the categorical embeddings and fed into a fully connected neural network layer (Dense layer 50) that results in the encoding of the entities.
  • Dense layer 50 fully connected neural network layer
  • the task of this module is to fuse all the available information of an entity, meaning if for example data of 10 entities goes in, 10 vectors in a learned latent space (encodings) that represent the fused information are produced.
  • the task of the component and pin encoder is to encode the available information per component 20 and per pin 22.
  • the task of the board encoder, in particular the third encoder 38 is to combine the encodings of all component 20 and pin 22 measurement available of a PCB to result in an encoding for the whole board .
  • the encodings of all pins 22 of a component 20 are fused using a pin aggregator 52 .
  • the resulting encoding of all pins 22 of a component 20 are concatenated ( Concatenation 54 ) to the encoding of the corresponding component 20 .
  • the enriched component encodings are fused by passing them through a component aggregator 56 . The result is an encoding for the whole PCB .
  • the pin aggregator 52 fuses the encodings of the pin measurements for each component 20 but ignores the paddings .
  • multiple reasonable choices for an aggregation function can be made : max function, applying the max across all pin encodings ; mean function, applying the mean across all pin encodings ; an attention module .
  • weights for a weighted mean can be computed using an attention mechanism as depicted in Figure 4 or by applying multi-headed attention as provided in of f-shel f libraries as pytorch .
  • the latter is used to implement so called cross-attention where not the inputs to the module (the pin encodings ) are also used as queries , but a single query is applied which can either be learned as part of the complete architecture or the corresponding component encoding is used .
  • i f the input is a set of pin encodings where each pin encoding is a vector of si ze k then the pin aggregator 52 will output a single encoding of si ze k that represents the fused encodings .
  • FIG 4 shows an embodiment of an attention module 62 where the attention weights are computed by feeding the component encoding together with the pin encodings into a shared attention network (dense layer 64) .
  • the resulting weights are normalized to add up to 1.0 using a softmax function.
  • each pin-encoding is multiplied with its corresponding weight (a scalar) .
  • the reweighted pinencodings are added. Therefore, Fig. 4 shows a plurality of dense layer 64, a plurality of multiplication layer 66, a plurality of addition layers 68, pin encodings 70, component encodings 72, as well as further pin encodings 74.
  • the component aggregator 56 fuses the encodings of the component measurements (enriched by the encoded measurements of the pins) for each board but ignores the paddings.
  • multiple reasonable choices for an aggregation function can be made: max function, applying the max across all component encodings; mean function, applying the mean across all component encodings; an attention module.
  • the attention on the component encodings can be computed by applying multi-headed attention as provided in off-shelf libraries as pytorch. In contrast to the pin aggregator 52 the query must be learned as part of the complete architecture in this case.
  • the component aggregator 56 will output a single encoding of size h that represents the fused encodings.
  • the classifier 40 is a multi-layer perceptron (MLP) that ingests the encoding of all component and pin measurements of the board and produces a single confidence if the measurements reflect pseudo error of the AOI device or not.
  • MLP multi-layer perceptron
  • this MLP consists of two subsequent fully- connected neural network layers (dense layer 58, 60) , where the first dense layer 58 uses a ReLU activation function.
  • Dense layer 58, 60 two subsequent fully- connected neural network layers

Landscapes

  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • Quality & Reliability (AREA)
  • Automation & Control Theory (AREA)
  • Image Processing (AREA)

Abstract

The invention relates to a method for monitoring a production of an electronic component (14, 16, 18), comprising the steps of receiving first data (24) from an automatic optical inspection device (10), wherein the first data (24) describe components (20) of the electronic component (14, 16, 18); receiving second data (26) from the automatic optical inspection device (10), wherein the second data (26) describe pins (22) of the components (20) of the electronic component (14, 16, 18); providing a neural network (32), wherein the neural network (32) is configured for calculating data with a preset size; determining each size of the received data; comparing the determined size of the first data (24) and second data (26) with the preset size; padding the received first data (24) and second data (26) such that a first data vector is generated in the first size and a second data vector is generated in the second size; generating a mask (28, 30), wherein the mask (28, 30) describes the first data vector concerning the received first data (24) and a first padding and the second data vector concerning the received second data (26) and a second padding; transmitting the first data vector, the second data vector and the mask (28, 30) to the neural network (32); analyzing the electronic component (14, 16, 18) depending on the first data vector and the second data vector; and monitoring the electronic component (14, 16, 18) depending on the analyzation. Furthermore, the invention relates to a computer program product, a computer-readable storage medium, as well as a monitoring system (12).

Description

Description
A method or monitoring a production of an electronic component by a monitoring system, computer program product , computer-readable storage medium, as well as monitoring system
Independent of the grammatical term usage , individuals with male , female or other gender identities are included within the term .
The invention relates to a method for monitoring a production of an electronic component by a monitoring system according to the independent claim 1 . Furthermore , the invention relates to a computer program product , a computer-readable storage medium, as well as a monitoring system .
In the state of the art so-called automated optical inspection (AOI ) is known, which is an automated visual inspection of a printed circuit board ( PCB ) or LCD, or transistor manufacturer where a camera autonomously scans the device under test for both catastrophic failure , for example missing component , and quality defects , for example fillet si ze or shape or component skew . It is commonly used in the manufacturing process because it is a non-contact test method . It is implemented at many stages through the manufacturing process including bare board inspection, solo paste inspection ( SPI ) , pre-reflow and post-reflow as well as other stages .
Historically, the primary place for AOI systems has been after solder reflow or post production . Mainly because , postreflow AOI systems can inspect for most types of defects , for example component placement , solder shorts , missing solder or furthermore , at one place in the line with one single system . In this way the faulty boards are reworked and the other boards are sent to the next process stage . For manufacturers that deploy AOI machines in their assembly lines , a maj or concern is the rate of pseudo errors these AOI machines report . Consequently, a manual process must be employed to inspect the rej ected PCBs and finally decide which boards can proceed to the next stage , which may be regarded as a pseudo error, or which are reworked, which may be regarded as a real error . An automation of this manual process is desired, and there exist many Al-based works that target the problem of defect detection on PCBs but they rely on images , as the AOI machine and humans . Unfortunately, many AOI machine vendors prohibit the access to the images recorded by the AOI machines and solely store and allow access to trades extracted from the images by their undisclosed algorithms that contain information about the board, its components and component pins . As an alternative to replacing the AOI machine , one option is to use the data produced by the AOI machine to find patterns that discriminate pseudo errors , in particular so-called false- positives , from real errors and in this way reduce the amount of manual post AOI inspections of PCBs . Currently, no speciali zed Al-based approach that can interface with the special data structures produced by AOI machines are available .
It is an obj ect of the invention to provide a method, a computer program product , a computer-readable storage medium, as well as a monitoring system, by which the amount of falsepositive errors from a production of an electronic component is automatically minimi zed .
This obj ect is solved by a method, a computer program product , a computer-readable storage medium as well , as a monitoring system according to the independent claims . Advantageous forms of embodiments are presented in the dependent claims .
One aspect of the invention relates to a method for monitoring a production of an electronic component by a monitoring system . First data from an automatic optical inspection device are received by an electronic computing device of the monitoring system, wherein the first data describe components of the electronic component . Second data from the automatic optical inspection device (AOI device ) are received by the electronic computing device , wherein the second data describe pins of the components of the electronic component . A neural network is provided by the electronic computing device , wherein the neural network is configured for calculating data with a preset first si ze for the first data and a preset second si ze for the second data . Each si ze of the received data is determined by the electronic computing device . The determined si ze of the first data and the second data are compared with the preset first si ze and second si ze for the neural network by the electronic computing device . The received first data and second data are padded such that a first data vector is generated in the first si ze and a second data vector is generated in a second si ze by the electronic computing device . A mask is generated by the electronic computing device , wherein the mask describes the first data vector concerning the received first data and a first padding and a second data vector concerning the received second data and a second padding . The first data vector, the second data vector and the mask is transmitted to the neural network . The electronic component is analyzed depending on the first data vector and the second data vector by the neural network then the electronic component is monitored depending on the analyzation .
Therefore , a neural network-based modelling approach is proposed that can process the produced data in its natural form and integrates all measured information of an inspected printed circuit board . By its natural form it is meant that for each printed circuit board there exist measurements for a variable set of components and for each component there exist measurements of a variable set of pins . Therefore , processing hierarchically organi zed inputs with variating shapes , in particular number of components and corresponding pins is a non-trivial method . To make this input compatible with a neural network a combination of padding and masking is used . The padding is used to organi ze each input example , for example data of a single PCB (printed circuit board) , in the same shapes arrays that can be batched and digested by the neural network-model . Masking is used to provide the model with the information what parts of the input to ignore , in particular the padding, when processing the data . In particular, the pin data of each component and the component data are organi zed in separate arrays as depicted .
Therefore , this method is targeting automated f aults-positive reduction which directly decreases the manual ef fort of reinspection of PCBs that were classi fied as erroneous by the automatic optical inspection device . The advantage of this approach over other data-based approaches is that the hierarchical data generated by the automatic optical inspection device is modelled as-is without information loss . Meaning that more information is used to j udge i f the PCB in question is truly erroneous . In particular, the data of a whole board can be processed end-to-end by the model which is not possible by of-the-shel f methods since they can not deal with a dynamic input si ze .
The neural network may also be regarded as the model . In general , the false-positive reduction use-case data sets are characteri zed by a high class imbalance , which means that there is an imbalance between board inspections where the AOI machine reported a pseudo error (maj ority) and a real error (minority) . Besides training the pseudo/real error classi fication model , which uses the neural network architecture described, with of f-the-shel f stochastic gradient-based optimi zation methods , additional measures are used to tackle this class-imbalance . For example , the batches are balanced of examples via resampling the minority class ( real error ) , during model training such that between 10 percent and 50 percent of the examples in the batch are boards with real errors . In case the training data consists of di f ferent AOI test-patterns the batches are additionally balanced via resampling such that during training, the model is exposed to all AOI test-patterns at similar frequency . Second, the loss function is employed, which further improves training results when training with imbalanced data sets .
According to an embodiment , the electronic component is analyzed in such that the electronic component is classi fied in an erroneous component or in a non-erroneous component . In particular, the electronic component is analyzed in such, that a real error and/or a pseudo error is classi fied . Therefore , minimi zing pseudo-errors in the production of the electronic component is provided .
In another embodiment a classi fication of the automatic optical inspection device is taken into consideration by the electronic computing device . In particular, j ust an electronic component , which is classi fied from the automatic optical inspection device as erroneous , is analyzed by the electronic computing device . In particular, i f the automatic optical inspection device provides the electronic component as non-erroneous no inspection/no monitoring of the monitoring system is provided . Just , i f the automatic optical inspection device classi fies the electronic component as erroneous , the monitoring system is monitoring these electronic components . The monitoring system then is configured for classi fying the electronic components such, that a pseudo-error or a real error of the AOI is detected by the monitoring system . Therefore , minimi zing pseudo errors is provided .
In another embodiment the first data vector is a three- dimensional data vector and/or the second data vector is a four-dimensional data vector . In particular, the component data is organi zed as a three-dimensional array where the first dimension is the batch axis , meaning each entry along that dimension describes a di f ferent PCB . The second dimension is the component axis , where each entry describes the measurements of components on a PCB . Note that no order of the components is enforced here . Since the number of components can be di f ferent for each PCB this dimension has the si ze of the maximum number of components seen on the PCBs that are part of the current batch . Finally, the feature-axis is the same for all components since the same kind of measurements are performed on them .
The pin data is organi zed as a four-dimensional array, where the first two dimensions are the same as in the component data case . The third dimension is the pin axis where each entry describes the measurements of an inspected pin of a component . Note that no order of the pins is enforced here . Since the number of pins can be di f ferent for each component on the PCB this dimension has the si ze of the maximum number of pins seen of the components across all PCBs that are part of the current batch . Therefore , an improved monitoring of the electronic component can be reali zed .
In another embodiment , the mask is provided as a Boolean masking array . Therefore , in addition to the component data and the pin data, also an information about where the padding is located in the component and pin data is organi zed as the Boolean masking array . Note that the padding and masking is in general only required when data of multiple boards should be processed by the model at once . A typical requirement by the optimi zation process applied to train the downstream neural network model . However, also during inference it can make sense to batch data of multiple boards to improve the runtime . Therefore , an improved monitoring of an electronic component is provided .
In another embodiment , the neural network comprises at least a first encoder for the first data vector and a second encoder for the second data vector . In particular, the neural network further comprises at least a third encoder, wherein in the third encoder a first result of the first encoder and a second result of the second encoder are fused . Therefore , a neural network is provided, which improves the monitoring of the electronic component .
In another embodiment , the first encoder and the second encoder are provided with the same encoder structure . Therefore , an easy way for encoding is provided . Alternatively, the structures of each encoder may be di f ferent .
According to another embodiment , a zero-padding is used for padding the received data . In particular, where there is no information in the data about the features , the slots are filled with zeros . Therefore , an easy way for generating the data vector is provided .
In another embodiment , the neural network ignores paddings during the analyzation of the first data vector and the second data vector . In particular, the neural network is configured to ignore zero-paddings . Therefore , the neural network can analyze the data, but ignores data, which is not relevant , in particular the padded data . Therefore , an improved analyzation of the electronic component is provided .
In another embodiment , the neural network comprises at least a classi fier module for classi fying the electronic component . In particular, the classi fier module is applied whose output is a single confidence value that the ingested board data represents a pseudo-error . For example , the classi fier module is a multi-layer perception (MLP ) that ingests the encoding of all component and pin measurements of the board and produces a single confidence i f the measurement reflects pseudo-error of the AOI device or not . For example , this MLP may consist of two subsequent fully-connected neural network layers , where the first used a real activation function . Of course , other choices might be reasonable too . In particular, the proposed method is a computer-implemented method . Therefore , another aspect of the invention relates to a computer program product comprising program code means for performing a method according to the preceding aspect .
Another aspect of the invention relates to a computer- readable storage medium comprising at least the computer program product according to the preceding aspect .
A still further aspect of the invention relates to a monitoring system for monitoring a production of an electronic component , comprising at least one electronic computing device , wherein the monitoring system is configured for performing a method according to the preceding aspect . In particular, the method is performed by the monitoring system .
The electronic computing device may comprise electronic means , for example processors , circuits , in particular integrated circuits , and further electronic components , for performing a method according to the preceding aspect . The electronic computing device may also be regarded as a computing unit . A computing unit may in particular be understood as a data processing device , which comprises processing circuitry . The computing unit can therefore in particular process data to perform computing operations . This may also include operations to perform indexed accesses to a data structure , for example a look-up table , LUT .
In particular, the computing unit may include one or more computers , one or more microcontrollers , and/or one or more integrated circuits , for example , one or more applicationspeci fic integrated circuits , AS IC, one or more field- programmable gate arrays , FPGA, and/or one or more systems on a chip, SoC . The computing unit may also include one or more processors , for example one or more microprocessors , one or more central processing units , CPU, one or more graphics processing units , GPU, and/or one or more signal processors , in particular one or more digital signal processors , DSP . The computing unit may also include a physical or a virtual cluster of computers or other of said units .
In various embodiments , the computing unit includes one or more hardware and/or software interfaces and/or one or more memory units .
A memory unit may be implemented as a volatile data memory, for example a dynamic random access memory, DRAM, or a static random access memory, SRAM, or as a non-volatile data memory, for example a read-only memory, ROM, a programmable read-only memory, PROM, an erasable programmable read-only memory, EPROM, an electrically erasable programmable read-only memory, EEPROM, a flash memory or flash EEPROM, a ferroelectric random access memory, FRAM, a magnetoresistive random access memory, MRAM, or a phase-change random access memory, PCRAM .
Advantageous forms of configuration of the method are to be regarded as advantageous forms of configuration of the computer program product , the computer-readable storage medium as well as the monitoring system . The monitoring system therefore comprises means for performing the method .
For use cases or use situations which may arise in the method and which are not explicitly described here , it may be provided that , in accordance with the method, an error message and/or a prompt for user feedback is output and/or a default setting and/or a predetermined initial state is set . Independent of the grammatical term usage , individuals with male , female or other gender identities are included within the term .
Further features of the invention result from the claims , the figures and the figure description . The features and combinations of features mentioned above in the description, as well as the features and combinations of features mentioned below in the figure description and/or shown alone in the figures , can be used not only in the combination indicated in each case , but also in other combinations without departing from the scope of the invention .
The invention will now be explained in more detail with reference to preferred examples of embodiments and with reference to the accompanying drawings .
FIG 1 shows an abstract representation of data produced by an automatic optical inspection device ;
FIG 2 shows a schematic block diagram according to a structure of PCB data after performing at least a part of the method according to the invention;
FIG 3 shows a schematic block diagram according to an embodiment of the monitoring system;
FIG 4 shows a schematic block diagram according to an attention module according to an embodiment of the invention .
FIG 1 shows an abstract representation of the data produced by an automatic optical inspection device 10 (AOI device ) from a monitoring system 12 . In particular, according to the shown embodiment , three di f ferent printed circuit boards , which may be also regarded as an electronic component 14 , 16 , 18 , were inspected, wherein each board consists of a di f ferent set of components 20 . The first electronic component 14 has three components 20 , for example a capacitor, a resistor and another resistor, the second electronic component 16 consists of two components 20 and the third electronic component 18 comprises four components 20 . Each component 20 internally might have a di f ferent number of pins 22 and consequently the amount of measurement data produced per component 20 is varying . FIG 2 shows a structure of an electronic component 14, 16, 18 after applying padding and masking. In particular FIG 2 shows first data 24, wherein the first data 24 describes the components 20 of the electronic component 14, 16, 18. Furthermore, second data 26 are shown, wherein the second data 26 describes the pins 22 of the components 20 of the electronic components 14, 16, 18. Furthermore, a first mask 28 for the component data 24 is shown as well as a second mask 30 for the second data 26 is shown. The first mask 28 and the second mask 30 may be fused to one mask 28, 30.
In particular FIG 1 and 2 shows a hierarchical processing of organized inputs with varying shapes, in particular the number of components 20 and corresponding pins 22. To make this input compatible with a neural network 32 (FIG 3) a combination of padding and masking is used. The padding is used to organize each input example, for example data of a single PCB (printed circuit board) , in the same shaped arrays that can be batched and digested by the neural network 32. Masking is used to provide the model with information what parts of the input to ignore, in particular the padding, when processing the data. In the shown case, the data of each component 20 and the pins 22 are separated in arrays.
In particular FIG 2 shows, that the first data 24 is organized in a three-dimensional array where the first dimension is a batch axis, meaning each entry along the dimension describes a different electronic component 14, 16, 18. The second dimension is the component axis, where each entry describes the measurements of the component 20 on an electronic component 14, 16, 18. Note that no order of the components 20 is enforced here. Since the number of components 20 can be different for each electronic component 14, 16, 18 this dimension has the size of the maximum number of components 20 seen on the electronic components 14, 16, 18 that are part of the current batch. Finally, the feature-axis is the same for all components 20 since the same kind of measurements are performed on them. Assuming the electronic components 14 , 16 , 18 a data of FIG 1 being batched, the batch dimension would have the si ze 3 , where the component axis would have a si ze of 4 . The data of the first electronic component 14 and the second electronic component 16 will be zero-padded along the component axis , since they do not have four components 20 . Finally, the feature-axis is the same for all components 20 since the same kind of measurements are performed on them .
The second data 26 is organi zed in a four-dimensional array, where the first two dimensions are the same as in the component data case . The third dimension is the pin axis where each entry describes the measurements of an expected pin 22 of a component 20 . Note that no order of the pins 22 is enforced here . Since the number of pins 22 can be di f ferent for each component 20 on the electronic components 14 , 16 , 18 this dimension has the si ze of the maximum number of pins 22 seen of the components 20 across all electronic components 14 , 16 , 18 that are part of the current batch .
Furthermore is assumed that the component data is stored by an array C of a shape n x c x f and the pin data by an array of P of the shape n x c x p x h, where n is the batch si ze , c is the maximum number of components 20 observed on the electronic component 14 , 16 , 18 in the batch, f are the di f ferent kind of measurements performed on a component 20 , p is the maximum number of pins 22 observed in the batch and h are the measurements performed on a pin 22 . Then Cn=o, c=i are the component measurements of the second component 20 on the first electronic component 14 . Cn=i, c=3 are the component measurements of the fourth component on the second electronic component 16 , where no fourth component 20 exists on the second electronic component 16 and therefore will be all padding values / zeros . Pn=i, c=i,p=o are the measurement values of the first pin 22 of the second component 20 of the second electronic component 16 . In addition to the component data and the pin data, information about where the padding is located in the component 20 and the pin data array is organi zed in a Boolean masking array .
Note that the padding and masking is generally only required when data of multiple boards should be processed by the neural network 32 at once . A typical requirement by the optimi zation process applied to train the downstream neural network-model . However, also during interference it can make sense to batch data of multiple boards to improve the runtime .
FIG 3 shows a schematic block diagram according to an embodiment of the monitoring system 12 , in particular of the neural network 32 . Giving the input representation as described above , the neural network 32 is proposed that it can properly process it . In particular, the neural network 32 consists of four modules 34 , 36 , 38 , 40 . A first encoder 34 for the component measurement which ingest the batch of the component data and the component data mask . A second encoder 36 for the pin measurement which ingest the batch of component data and the component data mask . After each pin 22 and component 20 of the board have been encoded with respect to their measurements , a third encoder 38 is applied that fuses all the previous , in particular varying number of , encodings , considering also the mask 28 , 30 , into one fixed si ze encoding that represents the state of the ingested board with respect to the observed measurements of components 20 and corresponding pin 22 . Finally, a fourth encoder, in particular a so-called classi fier module 40 , is applied whose output is a single confidence value that the ingested board data represents a pseudo-error . In the following, the four components 34 , 36 , 38 , 40 are described in more detail .
For the encoding of the pins or components the same encoder structure each is provided, where the encoders for pins and components do not share any model parameters . Consequently, there is no differentiation between pins and components and they may be simply called entities in the following. Therefore, the structure of the first encoder 34 and the second encoder 36 is described in more detail.
First the input measurements are differentiated into three categories: Categorical measurements (including binary) (e.g. "component type" or "pin type") ; Numerical measurements (e.g. "component_high", "electrode_length" ) ; cyclical numerical measurements (e.g. "component_angle_f rom_board", "electrode_angle_f rom_board" ) .
In addition, the masks 28, 30 are passed to the encoder module too, since the encoder is applied on all entities of the batch at once, which can contain zero-paddings. Each of the C categorical measurement is passed through its own embedding layer 46, which transforms each categorical input into a d-dimensional vector in a learned embedding space. The cyclical numerical features are replaced applying a sin and cosine-based transformation 42 on them and concatenated (Concatenation 48) to the other numerical features. The complete set of numerical features of the entity is then passed through a mask batch normalization 44, which normalizes these inputs. Note that the mask 28, 30 is used by the mask batch normalization 44 such that zero padding values are ignored during normalization. The resulting normalized numerical inputs are then concatenated with the categorical embeddings and fed into a fully connected neural network layer (Dense layer 50) that results in the encoding of the entities. Note that the task of this module is to fuse all the available information of an entity, meaning if for example data of 10 entities goes in, 10 vectors in a learned latent space (encodings) that represent the fused information are produced.
The task of the component and pin encoder, in particular the first encoder 34 and the second encoder 36, is to encode the available information per component 20 and per pin 22. The task of the board encoder, in particular the third encoder 38 , is to combine the encodings of all component 20 and pin 22 measurement available of a PCB to result in an encoding for the whole board .
In the first step the encodings of all pins 22 of a component 20 are fused using a pin aggregator 52 . In the second step, the resulting encoding of all pins 22 of a component 20 are concatenated ( Concatenation 54 ) to the encoding of the corresponding component 20 . Finally, the enriched component encodings are fused by passing them through a component aggregator 56 . The result is an encoding for the whole PCB .
The pin aggregator 52 fuses the encodings of the pin measurements for each component 20 but ignores the paddings . Here , multiple reasonable choices for an aggregation function can be made : max function, applying the max across all pin encodings ; mean function, applying the mean across all pin encodings ; an attention module .
In case of the attention module , weights for a weighted mean can be computed using an attention mechanism as depicted in Figure 4 or by applying multi-headed attention as provided in of f-shel f libraries as pytorch . The latter is used to implement so called cross-attention where not the inputs to the module ( the pin encodings ) are also used as queries , but a single query is applied which can either be learned as part of the complete architecture or the corresponding component encoding is used .
Note again that i f the input is a set of pin encodings where each pin encoding is a vector of si ze k then the pin aggregator 52 will output a single encoding of si ze k that represents the fused encodings .
FIG 4 shows an embodiment of an attention module 62 where the attention weights are computed by feeding the component encoding together with the pin encodings into a shared attention network (dense layer 64) . The resulting weights are normalized to add up to 1.0 using a softmax function. Subsequently, each pin-encoding is multiplied with its corresponding weight (a scalar) . Finally, the reweighted pinencodings are added. Therefore, Fig. 4 shows a plurality of dense layer 64, a plurality of multiplication layer 66, a plurality of addition layers 68, pin encodings 70, component encodings 72, as well as further pin encodings 74.
The component aggregator 56 according to Fig. 3 fuses the encodings of the component measurements (enriched by the encoded measurements of the pins) for each board but ignores the paddings. Here, multiple reasonable choices for an aggregation function can be made: max function, applying the max across all component encodings; mean function, applying the mean across all component encodings; an attention module.
The attention on the component encodings can be computed by applying multi-headed attention as provided in off-shelf libraries as pytorch. In contrast to the pin aggregator 52 the query must be learned as part of the complete architecture in this case.
Note that if the input is a set of component encodings where each component encoding is a vector of size h then the component aggregator 56 will output a single encoding of size h that represents the fused encodings.
The classifier 40 is a multi-layer perceptron (MLP) that ingests the encoding of all component and pin measurements of the board and produces a single confidence if the measurements reflect pseudo error of the AOI device or not. In the shown case this MLP consists of two subsequent fully- connected neural network layers (dense layer 58, 60) , where the first dense layer 58 uses a ReLU activation function. Of course other choices might be reasonable too.

Claims

Claims
1. A method for monitoring a production of an electronic component (14, 16, 18) by a monitoring system (12) , comprising the steps of:
- receiving first data (24) from an automatic optical inspection device (10) by an electronic computing device of the monitoring system (12) , wherein the first data (24) describe components (20) of the electronic component (14, 16, 18) ;
- receiving second data (26) from the automatic optical inspection device (10) by the electronic computing device, wherein the second data (26) describe pins (22) of the components (20) of the electronic component (14, 16, 18) ;
- providing a neural network (32) by the electronic computing device, wherein the neural network (32) is configured for calculating data with a preset first size for the first data (24) and a preset second size for the second data (26) ;
- determining each size of the received data by the electronic computing device;
- comparing the determined size of the first data (24) and second data (26) with the preset first size and second size for the neural network (32) by the electronic computing device ;
- padding the received first data (24) and second data (26) such that a first data vector is generated in the first size and a second data vector is generated in the second size by the electronic computing device;
- generating a mask (28, 30) by the electronic computing device, wherein the mask (28, 30) describes the first data vector concerning the received first data (24) and a first padding and the second data vector concerning the received second data (26) and a second padding;
- transmitting the first data vector, the second data vector and the mask (28, 30) to the neural network (32) ;
- analyzing the electronic component (14, 16, 18) depending on the first data vector and the second data vector by the neural network (32) ; and - monitoring the electronic component (14, 16, 18) depending on the analyzation.
2. A method according to claim 1, wherein the electronic component (14, 16, 18) is analyzed in such that the electronic component (14, 16, 18) is classified in an erroneous component or in a non-erroneous component.
3. A method according to claim 1 or 2, wherein a classification of the automatic optical inspection device (10) is taken into consideration by the electronic computing device .
4. A method according to claim 3, wherein just an electronic component (14, 16, 18) , which is classified from the automatic optical inspection device (10) as erroneous, is analyzed by the electronic computing device.
5. A method according to any of claims 1 to 4, wherein the first data vector is a three-dimensional data vector and/or the second data vector is a four-dimensional data vector.
6. A method according to claim 5 any of claims 1 to 5, wherein the mask (28, 30) is provided as a Boolean masking array .
7. A method according to any of claims 1 to 6, wherein the neural network (32) comprises at least a first encoder (34) for the first data vector and a second encoder (36) for the second data vector.
8. A method according to claim 7, wherein the neural network (32) further comprises at least a third encoder (38) , wherein in the third encoder (38) a first result of the first encoder (34) and a second result of the second encoder (36) are fused .
9. A method according to claim 7 or 8, wherein the first encoder (34) and the second encoder (36) are provided with a same encoder structure.
10. A method according to any of claims 1 to 9, wherein a zero-padding is used for padding the received data.
11. A method according to any of claims 1 to 10, wherein the neural network (32) ignores paddings during the analyzation of the first data vector and the second data vector.
12. A method according to any of claims 1 to 11, wherein the neural network (32) comprises at least a classifier module (40) for classifying the electronic component (14, 16, 18) .
13. A computer program product comprising program code means for performing a method according to any of claims 1 to 12.
14. A computer-readable storage medium comprising at least the computer program product according to claim 13.
15. A monitoring system (12) for monitoring a production of an electronic component (14, 16, 18) , comprising at least one electronic computing device, wherein the monitoring system (12) is configured for performing a method according to any of claims 1 to 12.
EP24718063.1A 2023-04-20 2024-03-28 A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system Pending EP4677426A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP23168946.4A EP4451074A1 (en) 2023-04-20 2023-04-20 A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system
PCT/EP2024/058573 WO2024217849A1 (en) 2023-04-20 2024-03-28 A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system

Publications (1)

Publication Number Publication Date
EP4677426A1 true EP4677426A1 (en) 2026-01-14

Family

ID=86095831

Family Applications (2)

Application Number Title Priority Date Filing Date
EP23168946.4A Withdrawn EP4451074A1 (en) 2023-04-20 2023-04-20 A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system
EP24718063.1A Pending EP4677426A1 (en) 2023-04-20 2024-03-28 A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP23168946.4A Withdrawn EP4451074A1 (en) 2023-04-20 2023-04-20 A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system

Country Status (3)

Country Link
EP (2) EP4451074A1 (en)
CN (1) CN121488198A (en)
WO (1) WO2024217849A1 (en)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4020314A1 (en) * 2020-12-23 2022-06-29 Siemens Aktiengesellschaft Method and device for optical quality control during manufacture of printed circuit boards
EP4138032A1 (en) * 2021-08-17 2023-02-22 Siemens Aktiengesellschaft Predicting a quality of a printed circuit board assembly from production data

Also Published As

Publication number Publication date
CN121488198A (en) 2026-02-06
WO2024217849A1 (en) 2024-10-24
EP4451074A1 (en) 2024-10-23

Similar Documents

Publication Publication Date Title
US20230053878A1 (en) Systems and methods for predicting a quality of a printed circuit board assembly
US10776911B2 (en) Information processing apparatus, identification system, setting method, and program
US10674651B2 (en) Printed circuit board inspecting apparatus, method for determining fault type of screen printer and computer readable recording medium
JP7712946B2 (en) Electrical circuit design inspection system and method
TWI833010B (en) Image recognition apparatus, image recognition method, and computer program product thereof
TW201709118A (en) Methods, systems and computer program products for concluding correlation between manufacturing segment and end-user device performance
US20250225639A1 (en) Inspection of printed circuit board assemblies
Jessurun et al. FPIC: a novel semantic dataset for optical PCB assurance
US20210027099A1 (en) Image-recognition apparatus, image-recognition method, and non-transitory computer-readable storage medium thereof
US10725098B2 (en) System and method for efficient electrostatic discharge testing and analysis
EP4451074A1 (en) A method or monitoring a production of an electronic component by a monitoring system, computer program product, computer-readable storage medium, as well as monitoring system
US20250307516A1 (en) Automated pcb design and analysis system
Varol et al. A predictive analysis of electronic control unit system defects within automotive manufacturing
EP4451075A1 (en) A method for monitoring a production of an electronic component by a monitoring system, a computer program product, a computer-readable storage medium as well as a monitoring system
CN116601663A (en) AI-powered camera for visual inspections trained with onboard neural network
Chang et al. Prediction of solder joint quality using a data mining methodology for surface mounted technology process
Ivanova et al. Machine learning for in-circuit testing of printed circuit board assembly
US12298258B2 (en) Systems and methods for automated x-ray inspection
Barbosa et al. Industrial Visual Defect Inspection of Electronic Components with Siamese Neural Network.
Fathi et al. Trustworthy machine learning operations for predictive maintenance solutions
Reidy et al. Application of machine learning for quality risk factor analysis of electronic assemblies
He et al. Optimisation of burn-in time considering the hidden loss of quality deviations in the manufacturing process
KR102946464B1 (en) Pcb manufacturing management method providing a delivery list extracted based on a quality control (qc) process for semi-finished pcbs produced based on a manufacturing guide for pcb design, which uses design-related data according to client requirements, to a user terminal
EP4435716A1 (en) System for optimizing the automated optical inspection of printed circuit boards and method thereof
US12117811B1 (en) Route based manufacturing system analysis, apparatuses, systems, and methods

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20251008

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR