CN114040120B - Shooting path determination method, device and equipment for panel element detection - Google Patents

Shooting path determination method, device and equipment for panel element detection Download PDF

Info

Publication number
CN114040120B
CN114040120B CN202210010032.4A CN202210010032A CN114040120B CN 114040120 B CN114040120 B CN 114040120B CN 202210010032 A CN202210010032 A CN 202210010032A CN 114040120 B CN114040120 B CN 114040120B
Authority
CN
China
Prior art keywords
shooting
areas
area
panel
original
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210010032.4A
Other languages
Chinese (zh)
Other versions
CN114040120A (en
Inventor
徐宇梁
周超
沈小勇
吕江波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Simou Intelligent Technology Co ltd
Shenzhen Smartmore Technology Co Ltd
Original Assignee
Beijing Simou Intelligent Technology Co ltd
Shenzhen Smartmore Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Simou Intelligent Technology Co ltd, Shenzhen Smartmore Technology Co Ltd filed Critical Beijing Simou Intelligent Technology Co ltd
Priority to CN202210010032.4A priority Critical patent/CN114040120B/en
Publication of CN114040120A publication Critical patent/CN114040120A/en
Application granted granted Critical
Publication of CN114040120B publication Critical patent/CN114040120B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/695Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
  • Image Analysis (AREA)

Abstract

The application relates to a shooting path determining method for panel element detection, which comprises the following steps: forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas; taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas; moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas; selecting a plurality of target shooting areas from a plurality of candidate shooting areas; the plurality of target shooting areas cover all the elements to be tested on the panel; and forming a shooting path based on the target shooting area according to the shooting path length constraint. By adopting the method, the detection efficiency can be improved.

Description

Shooting path determination method, device and equipment for panel element detection
Technical Field
The present application relates to the field of panel element detection technologies, and in particular, to a method and an apparatus for determining a shooting path for panel element detection, a computer device, a storage medium, and a computer program product.
Background
AOI (Automated Optical Inspection) Inspection equipment, also known as AOI Optical Automated Inspection equipment, has become an important Inspection tool and process quality control tool for ensuring product quality in the electronics manufacturing industry. AOI detection equipment principle: during automatic detection, the AOI detection equipment automatically scans PCBA products through a high-definition CCD camera, acquires images, compares the detected points with qualified parameters in a database, detects defects on target products through image processing, and displays/marks the defects through a display or an automatic mark for maintenance personnel to repair and SMT engineering personnel to improve the process.
Since the components on the panel to be measured are very small components and the area of the panel is very large, in order to retain more details to determine the defects of the component to be measured, the range of the object shot in each imaging process has to be narrowed when the image is collected. As shown in FIG. 1, to ensure the richness of the details of the components, each picture can only capture a range of box sizes. Therefore, the camera needs to be moved many times to complete the inspection of all the dut on the whole panel by photographing different areas of the panel. A common method is to scan the entire panel in a tiled fashion, as shown in fig. 2. To ensure that no element is missed, a certain overlap area is usually left between the pictures. The numbers in the figures represent the figure for this several scan.
However, tiled scanning may occur where one element appears in two captured images, resulting in more picture data and too much redundancy in picture resources. Moreover, each line of scan has a long operation of returning to the initial position of the line, which is physically a long distance, and thus takes a long time to affect the scanning efficiency.
Disclosure of Invention
In view of the above, it is necessary to provide a shooting path determination method, apparatus, computer device, computer readable storage medium, and computer program product for panel element detection in view of the above technical problems.
In a first aspect, the present application provides a shooting path determining method for panel element detection. The method comprises the following steps:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In one embodiment, the selecting a plurality of target shooting areas from the plurality of candidate shooting areas includes:
and traversing each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and element rejection conditions contained in the preset areas to obtain the plurality of target shooting areas.
In one embodiment, the method further comprises the following steps:
if the target shooting areas can not cover all the elements to be tested on the panel, the target shooting areas are selected from the candidate shooting areas in a supplementing mode based on a preset panel residual element covering condition;
the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
In one embodiment, the traversal priority is a row priority.
In one embodiment, the capture path is a serpentine path.
In one embodiment, the forming of the original shooting area corresponding to each device under test by taking the position of each device under test on the panel as the area center includes:
and acquiring a shooting area which takes the position of each element to be tested on the panel as an area center and corresponds to the shooting range of the shooting equipment as an original shooting area corresponding to each element to be tested.
In a second aspect, the present application also provides a shooting path determining apparatus for panel element detection. The device comprises:
the device comprises an original shooting area generating module, a first image acquiring module and a second image acquiring module, wherein the original shooting area generating module is used for forming an original shooting area corresponding to each element to be detected by taking the position of each element to be detected on a panel as an area center to obtain a plurality of original shooting areas;
the initial shooting area generating module is used for taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
a candidate shooting area generating module, configured to move the multiple initial shooting areas, so that area centers of the moved initial shooting areas coincide with position centers, corresponding to all to-be-detected elements included in the initial shooting areas, to obtain multiple candidate shooting areas;
the target shooting area generating module is used for selecting a plurality of target shooting areas from the candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
and the shooting path generating module is used for forming a shooting path based on the plurality of target shooting areas according to the shooting path length constraint.
In a third aspect, the present application also provides a computer device. The computer device comprises a memory storing a computer program and a processor implementing the following steps when executing the computer program:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In a fourth aspect, the present application further provides a computer-readable storage medium. The computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In a fifth aspect, the present application further provides a computer program product. The computer program product comprising a computer program which when executed by a processor performs the steps of:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
According to the shooting path determining method and device for panel element detection, the computer equipment, the storage medium and the computer program product, the number of pictures to be shot is reduced, the shooting path is optimized, the scanning efficiency of the panel element is improved, and the panel detection efficiency is improved by reasonably designing, selecting and planning the positions of the pictures shot when the panel element is detected.
Drawings
FIG. 1 is a schematic diagram of a panel to be tested and a picture taking range;
FIG. 2 is a schematic diagram of a close-packed scan in the prior art;
FIG. 3 is a flow chart illustrating a photographing path determining method for panel component detection according to an embodiment;
FIG. 4 is a diagram illustrating an original photographing region in one embodiment;
FIG. 5 is a diagram illustrating an initial capture area in one embodiment;
fig. 6 is a schematic diagram of candidate photographing regions in one embodiment;
FIG. 7 is a diagram illustrating a target capture area in one embodiment;
FIG. 8 is a schematic diagram of a shooting path in one embodiment;
FIG. 9 is a diagram illustrating a target capture area in one embodiment;
FIG. 10 is a block diagram showing the construction of a photographing path determining apparatus for panel component detection in one embodiment;
FIG. 11 is a diagram illustrating an internal structure of a computer device in one embodiment.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In one embodiment, as shown in fig. 3, a shooting path determining method for panel element detection is provided, and this embodiment is exemplified by applying the method to a terminal, and it is to be understood that the method may also be applied to a server, and may also be applied to a system including a terminal and a server, and is implemented by interaction between the terminal and the server. In this embodiment, the method includes the steps of:
step S301, forming an original photographing region corresponding to each device to be measured by taking the position of each device to be measured on the panel as a region center, and obtaining a plurality of original photographing regions.
The position of each element to be measured on the panel and the physical range which can be shot by the area-array camera are known, and the shooting area refers to the physical position corresponding to the center of the picture when shooting each time. As shown in fig. 4, a plurality of original photographing regions are generated with the position of each device under test as the center of the photographing region. In the embodiment of the application, a shooting area, in which each component to be tested is located on a panel, is set as an area center and corresponds to a shooting range of a shooting device, and is used as an original shooting area corresponding to each component to be tested.
Step S302, taking the position of the to-be-measured element corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located, so as to obtain a plurality of initial shooting areas.
The width and height of a region of interest (ROI) corresponding to each device under test on the panel are known. As shown in fig. 5, on the basis of ensuring that the ROI of each dut on the panel is still in the shot region, the plurality of original shot regions are moved in the preset direction of the plane of the panel, so as to obtain a plurality of initial shot regions. In the embodiment of the present application, the plurality of original shot regions are moved to the upper right of the plane where the panel is located, so that the ROI of the component is located at the lower left corner of the shot region.
Step S303 is to move the plurality of initial imaging regions so that the region center of the moved initial imaging region coincides with the position center corresponding to the entire device under test included in the initial imaging region, thereby obtaining a plurality of candidate imaging regions.
As shown in fig. 6, the device to be measured that can include the complete ROI in each initial imaging region is found, and the initial imaging region is moved so that the region center of the initial imaging region coincides with the position center corresponding to all the devices to be measured included in the initial imaging region, thereby obtaining a plurality of candidate imaging regions.
Step S304, selecting a plurality of target shooting areas from a plurality of candidate shooting areas; the plurality of target shooting areas cover all the elements to be tested on the panel.
As shown in fig. 7, a plurality of target shot regions are selected from the plurality of candidate shot regions on the basis of ensuring coverage of the ROIs of all the devices under test on the panel.
In step S305, a shooting path is formed based on the plurality of target shooting regions according to the shooting path length constraint.
As shown in fig. 8, in order to shorten the total path length of photographing, a proper arrangement order is performed for a plurality of target photographing regions, thereby forming a final photographing path. Where the numbers in the figures represent the figure for this several scan. In the embodiment of the present application, the photographing path may adopt a serpentine path. The serpentine path can shorten the total path length of the shot compared to returning to the beginning of a line each time when shooting.
According to the shooting path determining method for panel element detection, the number of pictures to be shot is reduced, the shooting path is optimized, the scanning efficiency of the panel element is improved, and the panel detection efficiency is improved by reasonably designing, selecting and planning the positions of the pictures shot when the panel element is detected.
In one embodiment, the selecting a plurality of target photographing regions from the plurality of candidate photographing regions includes: and traversing each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and element rejection conditions contained in the preset areas to obtain the plurality of target shooting areas.
In the embodiment of the present application, before traversing a plurality of candidate shooting regions, the candidate shooting regions may be sorted in a row-first order (corresponding to a preset traversal priority order). Then, the obtained plurality of candidate photographing regions are sequentially traversed one by one. Wherein, for the first target shooting area: when traversing to a candidate shooting area covering the most elements to be tested, taking the candidate shooting area as a first target shooting area; for the non-first target shooting area, when the elements to be tested contained in the traversed subsequent shooting areas are not contained in other areas in the selected target shooting area (corresponding to element exclusion conditions contained in the areas), the traversed candidate shooting areas are used as the target shooting areas, and by analogy, after all the candidate shooting areas are traversed in sequence, a plurality of target shooting areas are obtained.
In one embodiment, the photographing path determining method for panel element detection further includes: if the target shooting areas can not cover all the elements to be tested on the panel, the target shooting areas are selected from the candidate shooting areas in a supplementing mode based on a preset panel residual element covering condition; the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
As shown in fig. 9, after traversing the plurality of candidate capturing areas, part of the devices to be tested still cannot be covered by the target capturing area, that is, the plurality of target capturing areas cannot cover all the devices to be tested on the panel. At this time, the target photographing region needs to be selected from the plurality of candidate photographing regions, so that the finally obtained target photographing region can cover all the devices to be tested on the panel. As shown in fig. 7, the target capture area selected in the supplementary manner not only needs to cover the dut already covered in the target capture area after traversal, but also covers as many duts as possible (corresponding to the panel remaining device coverage condition) that are not covered in the target capture area after traversal.
In order to obtain the total number of pictures taken as small as possible and the total length of paths traversing all the photographing positions in sequence as short as possible under the condition that the position of each element to be measured on the panel, the width and the height of the ROI corresponding to each element to be measured and the width and the height of a physical range capable of being photographed by an area-array camera are known, in an application example, the application provides a photographing path determining method for panel element detection, and the specific flow comprises the following steps:
in a first step, a set S of candidate shooting positions with a limited number of elements is generated. Specifically, a shooting area which takes the position of each element to be tested on the panel as an area center and corresponds to the shooting range of the shooting equipment is obtained and is used as an original shooting area corresponding to each element to be tested, and a plurality of original shooting areas are obtained; taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the upper right of the plane where the panel is located to obtain a plurality of initial shooting areas; and moving the plurality of initial shooting areas so that the area center of the moved initial shooting area coincides with the position center corresponding to all the elements to be measured included in the initial shooting areas, thereby obtaining a plurality of candidate shooting areas. The set of the plurality of candidate shooting areas is the candidate shooting position set S.
In the second step, all the shooting position sets P to be used are obtained. That is, a subset P is always selected from the candidate capturing position set S to ensure that the capturing regions corresponding to all the capturing positions in P can cover the ROIs of all the components to be measured. Specifically, the plurality of candidate photographing regions are sorted in the order of line priority; traversing a plurality of candidate shooting areas one by one according to element rejection conditions contained in preset areas to obtain a plurality of target shooting areas; and if the target shooting areas can not cover all the elements to be tested on the panel, complementarily selecting the target shooting areas from the candidate shooting areas based on a preset panel residual element covering condition, wherein the complementarily selected target shooting areas cover the residual elements on the panel and are partially overlapped with the selected target shooting areas.
And thirdly, finding a shooting sequence to make the total path length of all shooting positions in the traversal set P shorter. Specifically, in order to shorten the total path length of photographing, a photographing path is formed based on a plurality of target photographing regions using a snake walk.
In the above example, the redundancy of the shot images can be greatly reduced, the utilization rate of each image is improved, the detection efficiency of the whole panel is improved, the path of the shot images is reasonably planned, and the whole image acquisition time is further optimized on the basis of less image quantity.
It should be understood that, although the steps in the flowcharts related to the embodiments as described above are sequentially displayed as indicated by arrows, the steps are not necessarily performed sequentially as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least a part of the steps in the flowcharts related to the embodiments described above may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the execution order of the steps or stages is not necessarily sequential, but may be rotated or alternated with other steps or at least a part of the steps or stages in other steps.
Based on the same inventive concept, the embodiment of the present application further provides a shooting path determining apparatus for panel component detection, which is used for implementing the shooting path determining method for panel component detection. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme described in the above method, so specific limitations in one or more embodiments of the shooting path determining device for panel component detection provided below can be referred to the limitations on the shooting path determining method for panel component detection in the above, and are not described herein again.
In one embodiment, as shown in fig. 10, there is provided a photographing path determining apparatus for panel element detection, including:
an original shooting area generating module 1001, configured to form an original shooting area corresponding to each component to be tested, with a location of each component to be tested on the panel as an area center, to obtain multiple original shooting areas;
an initial shooting area generating module 1002, configured to use a position of the to-be-detected element corresponding to each original shooting area as a movement constraint of the corresponding original shooting area, move each original shooting area in a preset direction of a plane where the panel is located, and obtain multiple initial shooting areas;
a candidate shooting area generating module 1003, configured to move the multiple initial shooting areas, so that the area centers of the moved initial shooting areas coincide with position centers corresponding to all of the to-be-detected elements included in the initial shooting areas, and multiple candidate shooting areas are obtained;
a target shooting area generating module 1004 for selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
a shooting path generating module 1005, configured to form a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In an embodiment, the target shooting area generating module is further configured to traverse each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and according to an element rejection condition included in a preset area, so as to obtain the plurality of target shooting areas.
In an embodiment, the target shooting area generating module is further configured to, if the plurality of target shooting areas fail to cover all of the components to be tested on the panel, complementarily select a target shooting area from the plurality of candidate shooting areas based on a preset panel remaining component covering condition; the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
In one embodiment, the traversal priority order is a row priority order.
In one embodiment, the capture path is a serpentine path.
In an embodiment, the original shooting area generating module is further configured to acquire a shooting area, which is located at an area center of each component to be tested on the panel and corresponds to a shooting range of the shooting device, as the original shooting area corresponding to each component to be tested.
The respective modules in the above-described photographing path determining apparatus for panel element detection may be wholly or partially implemented by software, hardware, and a combination thereof. The modules can be embedded in a hardware form or independent from a processor in the computer device, and can also be stored in a memory in the computer device in a software form, so that the processor can call and execute operations corresponding to the modules.
In one embodiment, a computer device is provided, and the computer device may be a terminal, a server, and its internal structure diagram may be as shown in fig. 11. The computer device includes a processor, a memory, and a communication interface connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The communication interface of the computer device is used for communicating with an external device through a network connection. The computer program is executed by a processor to implement a photographing path determining method for panel element detection.
Those skilled in the art will appreciate that the architecture shown in fig. 11 is merely a block diagram of some of the structures associated with the disclosed aspects and is not intended to limit the computing devices to which the disclosed aspects apply, as particular computing devices may include more or less components than those shown, or may combine certain components, or have a different arrangement of components.
In one embodiment, a computer device is provided, comprising a memory and a processor, the memory having a computer program stored therein, the processor implementing the following steps when executing the computer program:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
and traversing each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and element rejection conditions contained in the preset areas to obtain the plurality of target shooting areas.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
if the target shooting areas can not cover all the elements to be tested on the panel, the target shooting areas are selected from the candidate shooting areas in a supplementing mode based on a preset panel residual element covering condition; the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
In one embodiment, the processor, when executing the computer program, further performs the steps of:
and acquiring a shooting area which takes the position of each element to be tested on the panel as an area center and corresponds to the shooting range of the shooting equipment as an original shooting area corresponding to each element to be tested.
In one embodiment, a computer-readable storage medium is provided, having a computer program stored thereon, which when executed by a processor, performs the steps of:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and traversing each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and element rejection conditions contained in the preset areas to obtain the plurality of target shooting areas.
In one embodiment, the computer program when executed by the processor further performs the steps of:
if the target shooting areas can not cover all the elements to be tested on the panel, the target shooting areas are selected from the candidate shooting areas in a supplementing mode based on a preset panel residual element covering condition; the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and acquiring a shooting area which takes the position of each element to be tested on the panel as an area center and corresponds to the shooting range of the shooting equipment as an original shooting area corresponding to each element to be tested.
In one embodiment, a computer program product is provided, comprising a computer program which, when executed by a processor, performs the steps of:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and traversing each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and element rejection conditions contained in the preset areas to obtain the plurality of target shooting areas.
In one embodiment, the computer program when executed by the processor further performs the steps of:
if the target shooting areas can not cover all the elements to be tested on the panel, the target shooting areas are selected from the candidate shooting areas in a supplementing mode based on a preset panel residual element covering condition; the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
In one embodiment, the computer program when executed by the processor further performs the steps of:
and acquiring a shooting area which takes the position of each element to be tested on the panel as an area center and corresponds to the shooting range of the shooting equipment as an original shooting area corresponding to each element to be tested.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, database, or other medium used in the embodiments provided herein may include at least one of non-volatile and volatile memory. The nonvolatile Memory may include Read-Only Memory (ROM), magnetic tape, floppy disk, flash Memory, optical Memory, high-density embedded nonvolatile Memory, resistive Random Access Memory (ReRAM), Magnetic Random Access Memory (MRAM), Ferroelectric Random Access Memory (FRAM), Phase Change Memory (PCM), graphene Memory, and the like. Volatile Memory can include Random Access Memory (RAM), external cache Memory, and the like. By way of illustration and not limitation, RAM can take many forms, such as Static Random Access Memory (SRAM) or Dynamic Random Access Memory (DRAM), among others. The databases referred to in various embodiments provided herein may include at least one of relational and non-relational databases. The non-relational database may include, but is not limited to, a block chain based distributed database, and the like. The processors referred to in the embodiments provided herein may be general purpose processors, central processing units, graphics processors, digital signal processors, programmable logic devices, quantum computing based data processing logic devices, etc., without limitation.
The technical features of the above embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the present application. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present application shall be subject to the appended claims.

Claims (9)

1. A shooting path determining method for panel element detection, the method comprising:
forming an original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as an area center to obtain a plurality of original shooting areas;
taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
moving the plurality of initial shooting areas to enable the area center of the moved initial shooting area to coincide with the position center corresponding to all the elements to be tested included in the initial shooting areas to obtain a plurality of candidate shooting areas;
selecting a plurality of target shooting areas from the plurality of candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
forming a shooting path based on the plurality of target shooting areas according to a shooting path length constraint.
2. The method of claim 1, wherein the selecting a plurality of target shot areas from the plurality of candidate shot areas comprises:
and traversing each candidate shooting area of the plurality of candidate shooting areas according to a preset traversal priority order and element rejection conditions contained in the preset areas to obtain the plurality of target shooting areas.
3. The method of claim 2, further comprising:
if the target shooting areas can not cover all the elements to be tested on the panel, the target shooting areas are selected from the candidate shooting areas in a supplementing mode based on a preset panel residual element covering condition;
the complementary selected target shooting area covers the rest elements on the panel and is partially overlapped with the selected target shooting areas.
4. The method of claim 2, wherein the traversal priority order is a row priority order.
5. The method of any one of claims 1 to 4, wherein the capture path is a serpentine path.
6. The method according to any one of claims 1 to 4, wherein the forming of the original shooting area corresponding to each element to be tested by taking the position of each element to be tested on the panel as the area center comprises:
and acquiring a shooting area which takes the position of each element to be tested on the panel as an area center and corresponds to the shooting range of the shooting equipment as an original shooting area corresponding to each element to be tested.
7. A shooting path determining apparatus for panel element detection, characterized by comprising:
the device comprises an original shooting area generating module, a first image acquiring module and a second image acquiring module, wherein the original shooting area generating module is used for forming an original shooting area corresponding to each element to be detected by taking the position of each element to be detected on a panel as an area center to obtain a plurality of original shooting areas;
the initial shooting area generating module is used for taking the position of the element to be detected corresponding to each original shooting area as the movement constraint of the corresponding original shooting area, and moving each original shooting area to the preset direction of the plane where the panel is located to obtain a plurality of initial shooting areas;
a candidate shooting area generating module, configured to move the multiple initial shooting areas, so that area centers of the moved initial shooting areas coincide with position centers, corresponding to all to-be-detected elements included in the initial shooting areas, to obtain multiple candidate shooting areas;
the target shooting area generating module is used for selecting a plurality of target shooting areas from the candidate shooting areas; the plurality of target shooting areas cover all elements to be tested on the panel;
and the shooting path generating module is used for forming a shooting path based on the plurality of target shooting areas according to the shooting path length constraint.
8. A computer device comprising a memory and a processor, the memory storing a computer program, characterized in that the processor, when executing the computer program, implements the steps of the method of any of claims 1 to 6.
9. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 6.
CN202210010032.4A 2022-01-06 2022-01-06 Shooting path determination method, device and equipment for panel element detection Active CN114040120B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210010032.4A CN114040120B (en) 2022-01-06 2022-01-06 Shooting path determination method, device and equipment for panel element detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210010032.4A CN114040120B (en) 2022-01-06 2022-01-06 Shooting path determination method, device and equipment for panel element detection

Publications (2)

Publication Number Publication Date
CN114040120A CN114040120A (en) 2022-02-11
CN114040120B true CN114040120B (en) 2022-04-12

Family

ID=80147333

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210010032.4A Active CN114040120B (en) 2022-01-06 2022-01-06 Shooting path determination method, device and equipment for panel element detection

Country Status (1)

Country Link
CN (1) CN114040120B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114895666B (en) * 2022-04-11 2024-04-19 广州镭晨智能装备科技有限公司 Path planning method and device for camera shooting assembly and computer readable storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10270348A (en) * 1997-03-26 1998-10-09 Canon Inc Exposing device and manufacture of device
CN104052924A (en) * 2013-03-15 2014-09-17 奥林巴斯映像株式会社 Image Pickup Apparatus, Image Pickup System And Image Pickup Method
WO2018096577A1 (en) * 2016-11-22 2018-05-31 株式会社Fuji Image processing system and image processing method
CN110235045A (en) * 2017-01-23 2019-09-13 卡尔蔡司显微镜有限责任公司 For carrying out the microscope and method of micrography to sample
TW201940896A (en) * 2018-02-06 2019-10-16 日商東麗股份有限公司 Method for manufacturing radioactive ray detector and apparatus for manufacturing radioactive ray detector
CN111998797A (en) * 2020-07-20 2020-11-27 成都飞机工业(集团)有限责任公司 Scanning track planning method of photographing type three-dimensional scanner
CN113689458A (en) * 2021-10-27 2021-11-23 广州市玄武无线科技股份有限公司 2D shooting track path calculation method and device

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107677678A (en) * 2017-09-20 2018-02-09 广州视源电子科技股份有限公司 Appearance detecting method and device based on automatic path planning
CN108717697B (en) * 2018-05-18 2021-04-13 广州视源电子科技股份有限公司 Circuit board detection method and device, computer equipment and storage medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10270348A (en) * 1997-03-26 1998-10-09 Canon Inc Exposing device and manufacture of device
CN104052924A (en) * 2013-03-15 2014-09-17 奥林巴斯映像株式会社 Image Pickup Apparatus, Image Pickup System And Image Pickup Method
WO2018096577A1 (en) * 2016-11-22 2018-05-31 株式会社Fuji Image processing system and image processing method
CN110235045A (en) * 2017-01-23 2019-09-13 卡尔蔡司显微镜有限责任公司 For carrying out the microscope and method of micrography to sample
TW201940896A (en) * 2018-02-06 2019-10-16 日商東麗股份有限公司 Method for manufacturing radioactive ray detector and apparatus for manufacturing radioactive ray detector
CN111998797A (en) * 2020-07-20 2020-11-27 成都飞机工业(集团)有限责任公司 Scanning track planning method of photographing type three-dimensional scanner
CN113689458A (en) * 2021-10-27 2021-11-23 广州市玄武无线科技股份有限公司 2D shooting track path calculation method and device

Also Published As

Publication number Publication date
CN114040120A (en) 2022-02-11

Similar Documents

Publication Publication Date Title
KR100744212B1 (en) Method and system for detecting defects on a printed circuit board
CN110245662A (en) Detection model training method, device, computer equipment and storage medium
US20090074286A1 (en) Data management equipment used to defect review equipment and testing system configurations
Wu et al. Object recognition in construction-site images using 3D CAD-based filtering
CN109360203A (en) Method for registering images, image registration device and storage medium
US20180174000A1 (en) Defect image classification device and defect image classification method
CN109697326B (en) Road disease processing method, device, computer equipment and storage medium
US9253449B2 (en) Mosaic picture generation
US20180341829A1 (en) Image classification system and method, classification data creation system and method, and storage medium
CN114040120B (en) Shooting path determination method, device and equipment for panel element detection
KR20140044395A (en) Defect observation method and defect observation device
CN113240673B (en) Defect detection method, defect detection device, electronic equipment and storage medium
KR101261016B1 (en) method and apparatus for automatic optical inspection of flat panel substrate
CN114998097A (en) Image alignment method, device, computer equipment and storage medium
CN115829843A (en) Image splicing method and device, computer equipment and storage medium
CN116012282A (en) Crystal growth defect detection method, crystal growth defect detection device, computer equipment and storage medium
JP2020112483A (en) Exterior appearance inspection system, calculation model construction method and calculation model construction program
JP2012047618A (en) Method for inspecting cylindrical container
CN112789713B (en) Semiconductor wafer defect inspection system and method for aligning semiconductor wafer image
CN114529500A (en) Defect inspection method for display substrate
US20020191831A1 (en) System and process for analyzing surface defects
Wang et al. A fast image-stitching algorithm for characterization of cracks in large-scale structures
CN111145674B (en) Display panel detection method, electronic device and storage medium
CN112150373B (en) Image processing method, image processing apparatus, and readable storage medium
CN115222728A (en) Screen detection method and device based on visual technology and computer equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant