CN117764908A - Method, device, equipment and storage medium for displaying defect information of NG image - Google Patents
Method, device, equipment and storage medium for displaying defect information of NG image Download PDFInfo
- Publication number
- CN117764908A CN117764908A CN202311042874.9A CN202311042874A CN117764908A CN 117764908 A CN117764908 A CN 117764908A CN 202311042874 A CN202311042874 A CN 202311042874A CN 117764908 A CN117764908 A CN 117764908A
- Authority
- CN
- China
- Prior art keywords
- defect
- collision
- defect information
- image
- target
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000007547 defect Effects 0.000 title claims abstract description 457
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000003860 storage Methods 0.000 title claims abstract description 19
- 238000001514 detection method Methods 0.000 claims abstract description 29
- 230000004044 response Effects 0.000 claims abstract description 23
- 238000002372 labelling Methods 0.000 claims abstract description 11
- 230000015654 memory Effects 0.000 claims description 26
- 230000004927 fusion Effects 0.000 claims description 4
- 238000013102 re-test Methods 0.000 abstract description 4
- 238000007689 inspection Methods 0.000 abstract 1
- 238000012545 processing Methods 0.000 description 15
- 230000002093 peripheral effect Effects 0.000 description 11
- 238000004519 manufacturing process Methods 0.000 description 8
- 239000000463 material Substances 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 5
- WHXSMMKQMYFTQS-UHFFFAOYSA-N Lithium Chemical compound [Li] WHXSMMKQMYFTQS-UHFFFAOYSA-N 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 229910052744 lithium Inorganic materials 0.000 description 3
- 239000002245 particle Substances 0.000 description 3
- XAGFODPZIPBFFR-UHFFFAOYSA-N aluminium Chemical compound [Al] XAGFODPZIPBFFR-UHFFFAOYSA-N 0.000 description 2
- 229910052782 aluminium Inorganic materials 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013528 artificial neural network Methods 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000009826 distribution Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 238000012795 verification Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000002950 deficient Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 230000001788 irregular Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000003550 marker Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004080 punching Methods 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
The application discloses a defect information display method, device and equipment of an NG image and a storage medium, and relates to the field of image display, wherein a defect display interface is displayed; in response to receiving selection operations of all defect points, performing collision detection according to the pre-display positions of the defect information frames corresponding to the defect points, and determining candidate collision defect points generating collision between the defect information frames; obtaining defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between the defect information frames as target collision defect points; and in response to receiving the display labeling operation of the target collision defect points, labeling and displaying the target collision defect points and the corresponding target defect information frames thereof in the NG image. According to the scheme, the defect information frames in the NG image are directly displayed without collision, the generated collision is fused according to the defect type, or the generated collision is manually selected and displayed, so that judgment of a retest person is facilitated, and the inspection efficiency is improved.
Description
Technical Field
The present invention relates to the field of image display, and in particular, to a method, apparatus, device, and storage medium for displaying defect information of NG images.
Background
In the semiconductor chip production process, a strip material board is stamped on a production PCB circuit board, a plurality of pcs particles are distributed on the material board, pcs are minimum composition particles or minimum composition units for forming the PCB, and a plurality of electronic components are included in the region. But is limited by the problems of environment, equipment precision and the like, and defects, blemishes, defects and the like are inevitably generated in the punching production process of the pcs particles. While the material plates need to be automatically scanned and filtered by a machine in the early production stage, the defects identified by the machine need to be rechecked manually in the later production stage so as to screen the PCB meeting the conditions and carry out subsequent production procedures.
In the related art, the operation process of manual rechecking requires personnel to check images recognized by a machine one by one, specifically, the defect images are amplified and then matched with a field material plate for verification, so that the detection precision is ensured. The manual rechecking mode needs to consider the problems of the size of the material plate and the image display precision, and an operator needs to continuously adjust the cameras one by one and observe the actual material plate image and the defect image, so that the operation efficiency is low, and the rechecking precision is not high.
Disclosure of Invention
The embodiment of the application provides a defect information display method, device and equipment of an NG image and a storage medium, which solve the problem of low manual verification efficiency.
In one aspect, the present application provides a defect information display method of an NG image, the method including:
displaying a defect display interface, wherein the defect display interface comprises an NG image display area and a defect information display area; the NG image display area displays the NG image with defects, and the defect information display area displays defect information of each defect point in the NG image;
determining the pre-display position of a defect information frame corresponding to the defect point in response to receiving selection operation of all the defect points in the defect information display area, and determining candidate collision defect points generating collision between the defect information frames according to collision detection with the pre-display position; the defect information frame is used for displaying in the NG image and describing marked defect points;
obtaining the defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between defect information frames as target collision defect points;
and in response to receiving the display labeling operation of the target collision defect points, labeling and displaying the target collision defect points and the corresponding target defect information frames thereof in the NG image.
Specifically, the defect information display area displays a defect information list, wherein the list lists defect information and defect selection controls of all defect points detected in the NG image; the defect information includes at least one of defect type, defect size, coordinate position, and defect number;
and in response to receiving clicking operation of a corresponding selection control of a target defect point in the defect information list, selecting the target defect point and target defect information, and marking and displaying in the NG image.
Specifically, during collision detection, marking a defect point and a defect information frame in the NG image, displaying the defect information frame at the side of the corresponding defect point, and displaying the defect point type in the defect information frame;
and when collision display is carried out, determining a pre-display position in the NG image according to the coordinate position of each defect point in the defect information list, and carrying out collision detection.
Specifically, in response to the target defect information frame not colliding with other defect information frames, determining the pre-display position as a target display position, and labeling and displaying on the side of the target defect point.
Specifically, in response to collision between the target defect information frame and other defect information frames, determining the selected defect point as the candidate collision defect point, and acquiring a corresponding defect type;
and responding to the consistency of the defect types of the target defect information frames generating the collision, selecting one collision information frame from the target defect information frames, adding the rest defect numbers into the collision information frames for fusion display, and marking all the defect points of the same type in the NG image.
Specifically, when the target defect information frame responding to the collision corresponds to different defect types, determining the candidate collision defect point as the target collision defect point, and not performing marked display; and the selection control of the corresponding defect point in the defect information list is in an unselected state.
Specifically, in response to receiving a selection operation of a selection control corresponding to the target collision defect point in the defect information list, determining a display position of the target defect information frame, and marking and displaying in the NG image, wherein the target collision defect point which collides with the target defect information frame and has inconsistent defect types is not marked and displayed.
In another aspect, the present application provides a defect information display apparatus for NG image, the apparatus including:
the interface display module is used for displaying a defect display interface, wherein the defect display interface comprises an NG image display area and a defect information display area; the NG image display area displays the NG image with defects, and the defect information display area displays defect information of each defect point in the NG image;
the first determining module is used for determining the pre-display position of the defect information frame corresponding to the defect point in response to receiving the selection operation of all the defect points in the defect information display area, and determining candidate collision defect points generating collision between the defect information frames according to collision detection with the pre-display position; the defect information frame is used for displaying in the NG image and describing marked defect points;
the second determining module is used for obtaining the defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between the defect information frames as target collision defect points;
and the marking display module is used for marking and displaying the target collision defect point and the corresponding target defect information frame in the NG image in response to receiving the display marking operation of the target collision defect point.
In yet another aspect, the application provides a computer device, where the computer device includes a processor and a memory, where at least one instruction, at least one program, a code set, or an instruction set is stored in the memory, where the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by the processor to implement the defect information display method of the NG image in the above aspect.
In yet another aspect, the present application provides a computer readable storage medium having stored therein at least one instruction, at least one program, a code set, or an instruction set, where the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the defect information display method of an NG image described in the above aspect.
The beneficial effects that technical scheme that this application embodiment provided include at least: when the defect points are displayed, performing global collision detection on all the defect points according to the pre-display positions of the defect information frames, and finding out candidate collision defect points generating collision; and then finding out the candidate collision defect points of the same defect type according to the defect types of the candidate collision defect points, combining and displaying the defect information frames of the same type, reducing the occupation of picture resources of NG images, and determining whether to display or not by manual display marking operation instead of displaying the defect information frames of different types. And providing defect information of the defect points in the defect information display area, so that an observer can manually select defect label display, and the checking efficiency of a rechecker is improved.
Drawings
FIG. 1 is an NG image with defective points provided by an embodiment of the present application;
fig. 2 is a flowchart of a defect information display method of an NG image provided in an embodiment of the present application;
FIG. 3 shows a schematic diagram of a defect display interface;
FIG. 4 is a schematic illustration of a callout displayed after collision detection;
FIG. 5 is a schematic illustration of an alternative annotation displayed after collision detection;
fig. 6 shows a schematic configuration diagram of a defect information display device of an NG image;
fig. 7 shows a block diagram of a computer device according to an exemplary embodiment of the present application.
Detailed Description
For the purpose of making the objects, technical solutions and advantages of the present application more apparent, the embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
References herein to "a plurality" means two or more. "and/or", describes an association relationship of an association object, and indicates that there may be three relationships, for example, a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. The character "/" generally indicates that the context-dependent object is an "or" relationship.
Fig. 1 is an NG image with a defect point provided in an embodiment of the present application, where the NG image is a product surface structure photographed in a defect detection link, and may specifically be a lithium battery structure or a printed circuit board structure. The NG image comprises a plurality of defect points of the same type or different types, and the defect points can be in the conditions of ' aluminum leakage at the side of the battery ', ' structural damage ', ' adhesion of foreign matters ', structural inclination ' and the like by taking the lithium battery structure as an example. In order to facilitate the retest to clearly know the specific defect type and defect detail information of the product in the screening process, the production line can be optimized in a targeted manner so as to ensure the product yield.
Fig. 2 is a flowchart of a defect information display method of an NG image according to an embodiment of the present application, including the following steps:
step 201, displaying a defect display interface, wherein the defect display interface comprises an NG image display area and a defect information display area.
The method is realized based on computer equipment with a display, and optionally, the computer equipment can be a PC (personal computer), a desktop, an industrial personal computer, a workstation, a server and the like, and a defect display interface is displayed on the display, wherein the defect display interface at least comprises a NG image display area and a defect information display area.
Referring to a schematic diagram of a defect display interface shown in fig. 3, an NG image with a defect (illustrated in this application as a lithium battery image) is displayed in the NG image display area 310, that is, a product defect image that is identified and captured by an upstream production line through a defect detection algorithm, and the defect point 311 is labeled and defect detail information is displayed in a targeted manner in a subsequent operation. Defect information of each defect point in the NG image is displayed in the defect information display area 320. The defect information is the attribute characteristics of the defect points identified by the algorithm, such as the defect type, the defect size, the coordinate position of the defect points, the defect number, the defect confidence and the like.
Step 202, in response to receiving the selection operation of all the defect points in the defect information display area, determining the pre-display position of the defect information frame corresponding to the defect points, and determining candidate collision defect points generating collision between the defect information frames according to collision detection with the pre-display position.
The selection operation of all defect points may be performed by manually operating all defect points in the full selection defect information display area or automatically performed at the time of importing the NG image to perform collision detection.
The collision detection is a test performed before marking defect points in the NG image and displaying defect information frames, wherein the defect points are marked by adding frames or other modes in the image, and the defect information frames formally describe the marked defect points. In most application scenarios, the defect information frame is located on the upper, lower, left and right sides of the label frame and is closer to the label frame, so as to indicate that the explanation of the label is provided.
The collision detection is performed because a part of defect points are densely concentrated, and defect information or a defect information frame displayed on the peripheral side of the marker frame is overlapped and blocked, and special display is required for the case where the blocking occurs. In the present application, collision detection is performed with the pre-display positions of all the defect information frames, and the pre-display positions of the defect information frames are determined when defect points are identified. The collision detection is performed on all defect information frames upon receiving a selection operation of all defect points, and the occurrence of collision, that is, candidate collision defect points that need to be screened, is determined for which there is overlap of the frame areas. Fig. 1 can be used as a schematic view of a scene of collision detection, and it can be seen from the figure that No. 3 (the defect type is side aluminum leakage) and No. 4 (the defect type is side breakage) have defect information frame collision phenomena, and No. 1 and No. 7 (the defect types are foreign object adhesion) have defect information frame collision phenomena.
Step 203, obtaining the defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between the defect information frames as target collision defect points.
The selection of the target collision defect point is to select the defect types inconsistent and the defect information frames generate collision, because the defect information frames of the same type can be combined and processed, namely one defect information frame can be shared, and special processing is needed when different types and collision are generated.
Note that, for a defect information frame in which no collision occurs, the display is normally marked in the NG image.
And step 204, in response to receiving the display labeling operation of the target collision defect point, labeling and displaying the target collision defect point and the corresponding target defect information frame in the NG image.
As shown in fig. 3, detailed defect data information of each defect point is listed in the defect information display area 320, and for those hit target defect information frames, the hit target defect point in the selection is considered to be manually controlled and displayed, and the hit target defect point and its corresponding target defect information frame are marked and displayed in the NG image according to the display marking operation. Thus, control can be given to the recheck, and the target defect information frame can be displayed according to the actual operation. And for those defect points which do not generate collision, the defect points with the same defect type can be directly marked and displayed, and the defect information frames are combined and displayed.
In summary, when displaying the defect points, the present application performs global collision detection on all the defect points according to the pre-display positions of the defect information frame, and finds out the candidate collision defect points that generate the collision therein; and then finding out the candidate collision defect points of the same defect type according to the defect types of the candidate collision defect points, combining and displaying the defect information frames of the same type, reducing the occupation of picture resources of NG images, and determining whether to display or not by manual display marking operation instead of displaying the defect information frames of different types. And providing defect information of the defect points in the defect information display area for an observer to manually select defect label display, so that the checking efficiency of a rechecker is improved.
In some embodiments, in order to implement an interface-operable and more humanized processing manner, the defect labeling display needs to be freely selected according to the needs of an operator, so that a defect information list is set in a defect information display area to display, and defect information and defect selection controls of all defect points detected in the NG image are listed in the list. This is also a means for facilitating the special handling display of those defect points that have collided with in step 204.
As shown in fig. 3, defect information data of all defect points are displayed in the defect information list, and each defect information data is provided with a defect selection control 321, and the defect information includes at least one of NG image number, defect type, defect size, coordinate position, and defect number. When a clicking operation of the selection control 321 corresponding to the target defect point in the defect information list is received, the target defect point and the target defect information are selected, and marked and displayed in the NG image.
In step 202, a pre-display position in the NG image is determined specifically according to the coordinate positions of the respective defect points in the defect information list, and collision detection is performed. The defect point and the defect information frame are relatively fixed, namely after the defect point is determined, the pre-display position of the defect information frame can be determined according to the upper right corner distance, and the defect number and the defect type are displayed in the defect information frame.
And if the target defect information frame does not collide with other defect information frames in collision detection, determining the pre-display position as a target display position, and marking and displaying on the side of the target defect point. Defect points and defect information boxes of "number 8 excessively inclined" as noted in fig. 1. This collision-free display can be performed directly without subsequent calculation.
And for collision between the target defect information frame and other defect information frames in collision detection, determining the selected defect point as a candidate collision defect point, acquiring a corresponding defect type, and performing type matching. The defect type is directly extracted from the defect information list.
When the defect types of the target defect information frames generating the collision are consistent, selecting one collision information frame from the target defect information frames, adding the rest defect numbers into the collision information frame for fusion display, marking all the defect points of the same type in the NG image, and selecting the corresponding defect points in the corresponding defect information list as a selected state. As shown in fig. 1 and fig. 4, the numbers 1 and 7 in fig. 1 are the same defect types, and fig. 4 after fusion display shows the numbers 1 and 7 in a merging and labeling way, and the merging uses the information frame of the original number 1.
And when the target defect information frame generating the collision corresponds to different defect types, determining the candidate collision defect points as target collision defect points, and not performing marked display, wherein a selection control corresponding to the defect points in the defect information list is in an unselected state. For example, in fig. 1, reference numerals 3 and 4 indicate collisions and the defect types are not identical, and are hidden directly after collision detection.
Of course, in some other embodiments, if three or more defect information frames collide, the same type of combination is performed first, collision detection is performed again after the combination is completed, if no collision occurs, normal display is performed, if a collision still occurs, the combined reserved defect information frames are hidden; and if the two combined defect information frames collide, reserving and displaying according to the selection of the large number of the attributive defect types, and hiding the small number of the defect information frames.
Of course, in some embodiments, if several types of inconsistent defect information frames are hidden and no defect points are marked, the image appears blank, and at this time, a defect may be displayed by default. As shown in fig. 5, the defect information frames of the two different defect types of the number 3 and the number 4 in fig. 1 collide, at this time, the defect point and the defect information frame of the number 3 can be selectively marked, the defect information frame of the number 4 is hidden, and the defect point is not marked.
In step 204, when a selection operation of the selection control corresponding to the target collision defect point in the defect information list is received, a display position of the target defect information frame is determined, and marked and displayed in the NG image, while the target collision defect point which collides with the target collision defect point and has inconsistent defect types is not marked and displayed.
This step may occur at any stage, because defect information data of all defect points are recorded in the defect information list, and when a retest needs to view the distribution situation of a certain type of defect points in a targeted manner, the distribution situation of the defect points can be displayed through the area selective marking, so that all the remaining tired defects are hidden. Of course, for the case of inconsistent defect types and collision of the number 3 and the number 4 in fig. 1, the retest can also select the two to be marked and displayed at the same time in a targeted manner, and the images of collision of the defect information frames are displayed in the NG image, and the number 1 and the number 7 are the same.
Fig. 6 shows a schematic structural diagram of a defect information display device for NG image according to an embodiment of the present application, where the device includes:
the interface display module is used for displaying a defect display interface, wherein the defect display interface comprises an NG image display area and a defect information display area; the NG image display area displays the NG image with defects, and the defect information display area displays defect information of each defect point in the NG image;
the first determining module is used for determining the pre-display position of the defect information frame corresponding to the defect point in response to receiving the selection operation of all the defect points in the defect information display area, and determining candidate collision defect points generating collision between the defect information frames according to collision detection with the pre-display position; the defect information frame is used for displaying in the NG image and describing marked defect points;
the second determining module is used for obtaining the defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between the defect information frames as target collision defect points;
and the marking display module is used for marking and displaying the target collision defect point and the corresponding target defect information frame in the NG image in response to receiving the display marking operation of the target collision defect point.
In addition, the application further provides a computer device, which comprises a processor and a memory, wherein at least one instruction, at least one section of program, code set or instruction set is stored in the memory, and the at least one instruction, the at least one section of program, the code set or instruction set is loaded and executed by the processor to realize the defect information display method of the NG image in the aspect.
In addition, the application further provides a computer readable storage medium, wherein at least one instruction, at least one section of program, code set or instruction set is stored in the readable storage medium, and the at least one instruction, the at least one section of program, the code set or instruction set is loaded and executed by a processor to realize the defect information display method of the NG image in the aspect.
The defect information display device for NG image provided in the embodiment of the present application may be applied to the defect information display method for NG image provided in the above embodiment, and relevant details refer to the above method embodiment, and its implementation principle and technical effects are similar, and are not repeated here.
It should be noted that, when performing the caliper operation, the defect information display device for an NG image provided in the embodiment of the present application is only exemplified by the above-mentioned division of each functional module/functional unit, and in practical application, the above-mentioned function allocation may be completed by different functional modules/functional units according to needs, that is, the internal structure of the defect information display device for an NG image is divided into different functional modules/functional units, so as to complete all or part of the functions described above. In addition, the implementation manner of the method for displaying defect information of an NG image provided by the foregoing method embodiment and the implementation manner of the device for displaying defect information of an NG image provided by the present embodiment belong to the same concept, and the detailed implementation process of the device for displaying defect information of an NG image provided by the present embodiment is detailed in the foregoing method embodiment, which is not repeated here.
Fig. 7 shows a block diagram of a computer device according to an exemplary embodiment of the present application. Is a computer device such as a desktop computer, a notebook computer, a palm computer, a cloud server, and the like. The computer device may include, but is not limited to, a processor and a memory. Wherein the processor and the memory may be connected by a bus or other means. The processor may be a central processing unit (Central Processing Unit, CPU). The processor may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), field programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, graphics processors (Graphics Processing Unit, GPU), embedded Neural network processors (Neural-network Processing Unit, NPU) or other specialized deep learning coprocessors, discrete gate or transistor logic devices, discrete hardware components, or a combination of the above.
The processor may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor may be implemented in at least one hardware form of DSP (Digital Signal Processing ), FPGA (Field-Programmable Gate Array, field programmable gate array), PLA (Programmable Logic Array ). The processor 1701 may also include a main processor and a coprocessor, the main processor being a processor for processing data in an awake state, also referred to as a CPU (Central Processing Unit ); a coprocessor is a low-power processor for processing data in a standby state. In some embodiments, the processor may be integrated with a GPU (Graphics Processing Unit, image processor) for taking care of rendering and rendering of the content that the display screen is required to display. In some embodiments, the processor may also include an AI (Artificial Intelligence ) processor for processing computing operations related to machine learning.
The memory is used as a non-transitory computer readable storage medium for storing non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the methods in the above embodiments of the present application. The processor executes various functional applications of the processor and data processing, i.e., implements the methods of the method embodiments described above, by running non-transitory software programs, instructions, and modules stored in memory. The memory may include a memory program area and a memory data area, wherein the memory program area may store an operating system, at least one application program required for a function; the storage data area may store data created by the processor, etc. In addition, the memory may include high-speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some implementations, the memory optionally includes memory remotely located relative to the processor, the remote memory being connectable to the processor through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
In some embodiments, the computer device may further optionally include: a peripheral interface and at least one peripheral. The processor, memory, and peripheral interfaces may be connected by buses or signal lines. The individual peripheral devices may be connected to the peripheral device interface via buses, signal lines or circuit boards. Specifically, the peripheral device includes: at least one of a radio frequency circuit, a display screen and a keyboard.
The peripheral interface may be used to connect at least one Input/Output (I/O) related peripheral to the processor and the memory. In some embodiments, the processor, memory, and peripheral interfaces are integrated on the same chip or circuit board; in some other embodiments, either or both of the processor, memory, and peripheral interface may be implemented on separate chips or circuit boards, which is not limiting in this embodiment.
The display screen is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. When the display is a touch display, the display also has the ability to collect touch signals at or above the surface of the display. The touch signal may be input to the processor for processing as a control signal. At this time, the display screen may also be used to provide virtual buttons and/or virtual keyboards, also referred to as soft buttons and/or soft keyboards. In some embodiments, the display screen may be one, disposed on the front panel of the computer device; in other embodiments, the display screen may be at least two, respectively disposed on different surfaces of the computer device or in a folded design; in other embodiments, the display may be a flexible display disposed on a curved surface or a folded surface of the computer device. Even more, the display screen may be arranged in a non-rectangular irregular pattern, i.e. a shaped screen. The display screen may be made of LCD (Liquid Crystal Display ), OLED (Organic Light-Emitting Diode) or other materials.
The power supply is used to power the various components in the computer device. The power source may be alternating current, direct current, disposable or rechargeable. When the power source comprises a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.
Those skilled in the art will appreciate that the architecture shown in fig. 7 is not limiting of the computer device and may include more or fewer components than shown, or may combine certain components, or employ a different arrangement of components.
The embodiment of the application also discloses a computer readable storage medium. In particular, a computer readable storage medium is used for storing a computer program which, when executed by a processor, implements the method of the above-described method embodiments. It will be appreciated by those skilled in the art that implementing all or part of the processes in the methods of the embodiments described above may be accomplished by way of a computer program to instruct the relevant hardware, and the program may be stored in a computer readable storage medium, and the program may include processes in the embodiments of the methods described above when executed. Wherein the storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a Flash Memory (Flash Memory), a Hard Disk (HDD), or a Solid State Drive (SSD); the storage medium may also comprise a combination of memories of the kind described above.
The present embodiment is only for explanation of the present invention and is not to be construed as limiting the present invention, and modifications to the present embodiment, which may not creatively contribute to the present invention as required by those skilled in the art after reading the present specification, are all protected by patent laws within the scope of claims of the present invention.
Claims (10)
1. A defect information display method of NG image, characterized in that the method comprises:
displaying a defect display interface, wherein the defect display interface comprises an NG image display area and a defect information display area; the NG image display area displays the NG image with defects, and the defect information display area displays defect information of each defect point in the NG image;
determining the pre-display position of a defect information frame corresponding to the defect point in response to receiving selection operation of all the defect points in the defect information display area, and determining candidate collision defect points generating collision between the defect information frames according to collision detection with the pre-display position; the defect information frame is used for displaying in the NG image and describing marked defect points;
obtaining the defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between defect information frames as target collision defect points;
and in response to receiving the display labeling operation of the target collision defect points, labeling and displaying the target collision defect points and the corresponding target defect information frames thereof in the NG image.
2. The method according to claim 1, wherein the defect information display area displays a defect information list listing defect information and defect selection controls of all defect points detected in the NG image; the defect information includes at least one of defect type, defect size, coordinate position, and defect number;
and in response to receiving clicking operation of a corresponding selection control of a target defect point in the defect information list, selecting the target defect point and target defect information, and marking and displaying in the NG image.
3. The method according to claim 2, wherein at the time of collision detection, a defect point and a defect information frame are marked in the NG image, and the defect information frame is displayed at the side of the corresponding defect point, and the defect point type is displayed in the defect information frame;
and when collision display is carried out, determining a pre-display position in the NG image according to the coordinate position of each defect point in the defect information list, and carrying out collision detection.
4. A method according to claim 3, wherein the pre-display position is determined as a target display position in response to the target defect information frame not colliding with other defect information frames, and the display is marked on the side of the target defect point.
5. The method of claim 4, wherein in response to collision between the target defect information frame and other defect information frames, determining the selected defect point as the candidate collision defect point and acquiring a corresponding defect type;
and responding to the consistency of the defect types of the target defect information frames generating the collision, selecting one collision information frame from the target defect information frames, adding the rest defect numbers into the collision information frames for fusion display, and marking all the defect points of the same type in the NG image.
6. The method of claim 5, wherein the candidate collision defect point is determined as the target collision defect point and is not displayed with a label in response to the target defect information frame generating a collision corresponding to a different defect type; and the selection control of the corresponding defect point in the defect information list is in an unselected state.
7. The method of claim 6, wherein in response to receiving a selection operation of the target collision defect point correspondence selection control in the defect information list, determining a display position of the target defect information frame, and displaying a label in the NG image, wherein target collision defect points that collide with the target collision defect point correspondence selection control and have inconsistent defect types are not displayed in a label.
8. A defect information display apparatus of NG image, characterized in that the apparatus comprises:
the interface display module is used for displaying a defect display interface, wherein the defect display interface comprises an NG image display area and a defect information display area; the NG image display area displays the NG image with defects, and the defect information display area displays defect information of each defect point in the NG image;
the first determining module is used for determining the pre-display position of the defect information frame corresponding to the defect point in response to receiving the selection operation of all the defect points in the defect information display area, and determining candidate collision defect points generating collision between the defect information frames according to collision detection with the pre-display position; the defect information frame is used for displaying in the NG image and describing marked defect points;
the second determining module is used for obtaining the defect types corresponding to the candidate collision defect points, and determining the candidate collision defect points which are inconsistent in defect types and generate collision between the defect information frames as target collision defect points;
and the marking display module is used for marking and displaying the target collision defect point and the corresponding target defect information frame in the NG image in response to receiving the display marking operation of the target collision defect point.
9. A computer device comprising a processor and a memory having stored therein at least one instruction, at least one program, code set or instruction set, the at least one instruction, the at least one program, code set or instruction set being loaded and executed by the processor to implement the defect information display method of NG images according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that at least one instruction, at least one program, a code set, or an instruction set is stored in the readable storage medium, the at least one instruction, the at least one program, the code set, or the instruction set being loaded and executed by a processor to implement the defect information display method of the NG image according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311042874.9A CN117764908B (en) | 2023-08-17 | 2023-08-17 | Method, device, equipment and storage medium for displaying defect information of NG image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311042874.9A CN117764908B (en) | 2023-08-17 | 2023-08-17 | Method, device, equipment and storage medium for displaying defect information of NG image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117764908A true CN117764908A (en) | 2024-03-26 |
| CN117764908B CN117764908B (en) | 2024-06-07 |
Family
ID=90313250
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311042874.9A Active CN117764908B (en) | 2023-08-17 | 2023-08-17 | Method, device, equipment and storage medium for displaying defect information of NG image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117764908B (en) |
Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010249772A (en) * | 2009-04-20 | 2010-11-04 | Sharp Corp | Defect analyzer, defect analysis program, and defect analysis method |
| CN104252529A (en) * | 2014-09-04 | 2014-12-31 | 百度在线网络技术（北京）有限公司 | Method and device for loading map annotations |
| CN105890614A (en) * | 2016-03-31 | 2016-08-24 | 百度在线网络技术（北京）有限公司 | Road name display method and device |
| CN107437367A (en) * | 2016-05-26 | 2017-12-05 | 高德信息技术有限公司 | One kind mark system of selection and device |
| US20200357109A1 (en) * | 2018-07-02 | 2020-11-12 | Beijing Baidu Netcom Science Technology Co., Ltd. | Method for detecting display screen quality, apparatus, electronic device and storage medium |
| CN112395519A (en) * | 2021-01-20 | 2021-02-23 | 智道网联科技(北京)有限公司 | Method and device for generating interest points in road information |
| CN112711647A (en) * | 2021-01-19 | 2021-04-27 | 腾讯科技（深圳）有限公司 | Map information display method and device, storage medium and electronic equipment |
| JP2021189899A (en) * | 2020-06-02 | 2021-12-13 | 株式会社リクルート | Information processing device, information processing method, and information processing program |
| CN113935979A (en) * | 2021-10-26 | 2022-01-14 | 昆山万洲特种焊接有限公司 | Defect identification method, defect identification device, storage medium and electronic equipment |
| CN115034171A (en) * | 2022-05-07 | 2022-09-09 | 奥蒂玛光学科技（深圳）有限公司 | Defect labeling method, defect labeling equipment and storage medium |
| CN115984158A (en) * | 2021-10-12 | 2023-04-18 | Tcl科技集团股份有限公司 | Defect analysis method and device, electronic equipment and computer readable storage medium |
| CN115984537A (en) * | 2021-10-14 | 2023-04-18 | 腾讯科技（深圳）有限公司 | Image processing method and device and related equipment |
| CN116245876A (en) * | 2022-12-29 | 2023-06-09 | 摩尔线程智能科技(北京)有限责任公司 | Defect detection method, device, electronic apparatus, storage medium, and program product |
-
2023
- 2023-08-17 CN CN202311042874.9A patent/CN117764908B/en active Active
Patent Citations (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2010249772A (en) * | 2009-04-20 | 2010-11-04 | Sharp Corp | Defect analyzer, defect analysis program, and defect analysis method |
| CN104252529A (en) * | 2014-09-04 | 2014-12-31 | 百度在线网络技术（北京）有限公司 | Method and device for loading map annotations |
| CN105890614A (en) * | 2016-03-31 | 2016-08-24 | 百度在线网络技术（北京）有限公司 | Road name display method and device |
| CN107437367A (en) * | 2016-05-26 | 2017-12-05 | 高德信息技术有限公司 | One kind mark system of selection and device |
| US20200357109A1 (en) * | 2018-07-02 | 2020-11-12 | Beijing Baidu Netcom Science Technology Co., Ltd. | Method for detecting display screen quality, apparatus, electronic device and storage medium |
| JP2021189899A (en) * | 2020-06-02 | 2021-12-13 | 株式会社リクルート | Information processing device, information processing method, and information processing program |
| CN112711647A (en) * | 2021-01-19 | 2021-04-27 | 腾讯科技（深圳）有限公司 | Map information display method and device, storage medium and electronic equipment |
| CN112395519A (en) * | 2021-01-20 | 2021-02-23 | 智道网联科技(北京)有限公司 | Method and device for generating interest points in road information |
| CN115984158A (en) * | 2021-10-12 | 2023-04-18 | Tcl科技集团股份有限公司 | Defect analysis method and device, electronic equipment and computer readable storage medium |
| CN115984537A (en) * | 2021-10-14 | 2023-04-18 | 腾讯科技（深圳）有限公司 | Image processing method and device and related equipment |
| CN113935979A (en) * | 2021-10-26 | 2022-01-14 | 昆山万洲特种焊接有限公司 | Defect identification method, defect identification device, storage medium and electronic equipment |
| CN115034171A (en) * | 2022-05-07 | 2022-09-09 | 奥蒂玛光学科技（深圳）有限公司 | Defect labeling method, defect labeling equipment and storage medium |
| CN116245876A (en) * | 2022-12-29 | 2023-06-09 | 摩尔线程智能科技(北京)有限责任公司 | Defect detection method, device, electronic apparatus, storage medium, and program product |
Non-Patent Citations (3)
| Title |
|---|
| ZIYIN LI 等: "System design for PCB defects detection based on AOI technology", 《2011 4TH INTERNATIONAL CONGRESS ON IMAGE AND SIGNAL PROCESSING》, 12 December 2011 (2011-12-12) * |
| 孙琴;肖书浩;刘誉涵;陈齐山;: "基于机器视觉的塑料制品表面缺陷检测研究", 电子制作, no. 15, 1 August 2020 (2020-08-01) * |
| 李远宁;宁柏锋;董召杰;: "电网机巡图像分析框架与深度学习方法", 电信科学, no. 08, 20 August 2020 (2020-08-20) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117764908B (en) | 2024-06-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102677044B1 (en) | Image processing methods, apparatus and devices, and storage media | |
| US10249089B2 (en) | System and method for representing remote participants to a meeting | |
| JP2021108215A (en) | Method for recognizing image, device, electronic device, computer storage medium, and program | |
| CN116967615B (en) | Circuit board reinspection marking method, device, equipment and storage medium | |
| EP3618006B1 (en) | Image processing method and apparatus | |
| US20200027236A1 (en) | System and method for 3d association of detected objects | |
| US10861169B2 (en) | Method, storage medium and electronic device for generating environment model | |
| CN110536006A (en) | A kind of object's position method of adjustment and electronic equipment | |
| WO2018213702A1 (en) | Augmented reality system | |
| CN111523334B (en) | Virtual exclusion zone setting method and device, terminal equipment, tag and storage medium | |
| US20150103080A1 (en) | Computing device and method for simulating point clouds | |
| CN117764908B (en) | Method, device, equipment and storage medium for displaying defect information of NG image | |
| CN112966484B (en) | Chart typesetting method, device, electronic equipment and readable storage medium | |
| CN112712119B (en) | Method and device for determining detection accuracy of target detection model | |
| US8902252B2 (en) | Digital image selection in a surface computing device | |
| CN114329675A (en) | Model generation method, model generation device, electronic device, and readable storage medium | |
| CN117790349B (en) | Pcs electrical measurement bad defect display method, device, equipment and storage medium | |
| CN117011258A (en) | Circuit board defect image verification display method, device, equipment and storage medium | |
| CN116930207B (en) | Display method for synchronously amplifying field of view of display area and real-time area | |
| CN111858987A (en) | Problem checking method of CAD (computer-aided design) image, electronic equipment and related product | |
| CN116627372B (en) | PNL material alignment preview display method, device, equipment and storage medium | |
| US20230119741A1 (en) | Picture annotation method, apparatus, electronic device, and storage medium | |
| CN117358629A (en) | Material defect detection method, device, equipment and storage medium | |
| CN118334031B (en) | Appearance defect detection method and device, storage medium and electronic equipment | |
| CN117094984B (en) | Photoelectric plate multi-material parallel detection method, device, equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant |