WO2021179565A1 - 用于获取信息的方法及装置 - Google Patents
用于获取信息的方法及装置 Download PDFInfo
- Publication number
- WO2021179565A1 WO2021179565A1 PCT/CN2020/116527 CN2020116527W WO2021179565A1 WO 2021179565 A1 WO2021179565 A1 WO 2021179565A1 CN 2020116527 W CN2020116527 W CN 2020116527W WO 2021179565 A1 WO2021179565 A1 WO 2021179565A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- sample
- detected
- defect
- feature
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
- G06T7/001—Industrial image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30121—CRT, LCD or plasma display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30141—Printed circuit board [PCB]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30148—Semiconductor; IC; Wafer
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Definitions
- the embodiments of the present disclosure relate to the field of computer technology, and in particular to methods and devices for obtaining information.
- the first is to inspect the quality of items by technicians to check possible defects; the second is to inspect the quality of items through equipment, but the equipment is also set up based on the experience of the technicians to detect defects.
- the effect is basically the same as manual. And there is no need to rest, and a large number of items can be tested for a long time.
- the embodiments of the present disclosure propose methods and devices for obtaining information.
- an embodiment of the present disclosure provides a method for acquiring information, the method comprising: acquiring at least one image feature from an image to be detected, wherein the image to be detected includes an image of the object to be detected, and the image feature is Used to characterize the surface feature information of the object to be inspected; import the image to be inspected and the at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the object to be inspected, wherein the defect detection model passes through the sample image , Sample image features and sample defect information are obtained through training, and are used to characterize the corresponding relationship between the above-mentioned image to be detected and at least one image feature.
- acquiring at least one image feature from the image to be detected includes: acquiring a reference feature of the object to be detected, and the reference feature includes at least one of the following: color feature, structural feature, planar feature; based on the reference
- the feature performs image processing on the above-mentioned image to be detected through a setting method to obtain a corresponding image feature, wherein the above-mentioned setting method includes at least one of the following: color contrast enhancement, filtering, and texture acquisition.
- importing the image to be inspected and the at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the object to be inspected includes: importing the image to be inspected and the at least one image feature The corresponding input channel of the defect detection model obtains defect information corresponding to the object to be detected.
- the above-mentioned defect detection model is obtained by training in the following steps: acquiring a plurality of sample information groups and sample defect information corresponding to each of the above-mentioned sample information groups, wherein the above-mentioned sample information group includes A sample image and at least one sample image feature corresponding to the sample image; each sample information group in the multiple sample information groups is used as input, and the sample defect corresponding to each sample information group in the multiple sample information groups The information is used as output, and the defect detection model is trained.
- each sample information group in the multiple sample information groups is used as input, and the sample defect information corresponding to each sample information group in the multiple sample information groups is used as output, and the training obtains
- the defect detection model includes: performing the following training steps: sequentially inputting each sample information group in the multiple sample information groups to the initialization defect detection model to obtain the corresponding sample information group in the multiple sample information groups To predict the defect information, compare the predicted defect information corresponding to each sample information group in the multiple sample information groups with the sample defect information corresponding to the sample information group to obtain the prediction accuracy rate of the initialized defect detection model, It is determined whether the prediction accuracy is greater than the preset accuracy threshold, and if it is greater than the preset accuracy threshold, the initialized defect detection model is used as the trained defect detection model.
- each sample information group in the multiple sample information groups is used as input, and the sample defect information corresponding to each sample information group in the multiple sample information groups is used as output, and the training obtains
- the defect detection model includes: in response to being not greater than the preset accuracy threshold, adjusting the parameters of the initialization defect detection model, and continuing to execute the training step.
- an embodiment of the present disclosure provides a device for acquiring information, the device comprising: a feature acquiring unit configured to acquire at least one image feature from an image to be detected, wherein the image to be detected contains the image to be detected.
- An image of an object to be detected, and the image feature is used to characterize the surface feature information of the object to be detected;
- the defect information acquisition unit is configured to import the image to be detected and the at least one image feature into a pre-trained defect detection model to obtain a corresponding The defect information of an object is detected, wherein the defect detection model is obtained through training of sample images, sample image features, and sample defect information, and is used to characterize the corresponding relationship between the image to be detected and at least one image feature.
- the feature acquisition unit includes: a reference feature acquisition subunit configured to acquire a reference feature of the object to be detected, the reference feature includes at least one of the following: color feature, structural feature, plane feature; image feature
- the acquiring sub-unit is configured to perform image processing on the image to be detected in a setting manner based on the reference feature to obtain corresponding image features, wherein the setting method includes at least one of the following: color contrast enhancement, filtering, and texture acquisition .
- the defect information acquiring unit includes: an information input subunit configured to import the image to be detected and the at least one image feature into the corresponding input channel of the defect detection model to obtain the defect corresponding to the object to be detected information.
- the aforementioned device includes a defect detection model training unit configured to train a defect detection model
- the aforementioned defect detection model training unit includes: a sample acquisition subunit configured to acquire a plurality of sample information groups and the aforementioned plurality of samples The sample defect information corresponding to each sample information group in the information group, wherein the sample information group includes a sample image and at least one sample image feature corresponding to the sample image; the model training subunit is configured to combine the multiple sample information
- Each sample information group in the group is used as an input, and the sample defect information corresponding to each sample information group in the multiple sample information groups is used as an output, and a defect detection model is obtained by training.
- the aforementioned model training subunit includes: a model training module configured to sequentially input each sample information group of the aforementioned multiple sample information groups into the initialization defect detection model to obtain the aforementioned multiple sample information groups The predicted defect information corresponding to each sample information group in the above multiple sample information groups is compared with the predicted defect information corresponding to each sample information group in the plurality of sample information groups and the sample defect information corresponding to the sample information group to obtain the above Initialize the prediction accuracy of the defect detection model to determine whether the prediction accuracy is greater than the preset accuracy threshold, and if it is greater than the preset accuracy threshold, the initialized defect detection model is used as the trained defect detection model.
- the model training subunit includes: a parameter adjustment module configured to adjust the parameters of the initialization defect detection model in response to not greater than the preset accuracy threshold, and return to the model training module.
- an embodiment of the present disclosure provides an electronic device, including: one or more processors; a memory, on which one or more programs are stored, when the above one or more programs are used by one or more of the above When the processor is executed, the one or more processors are caused to execute the method for obtaining information in the first aspect.
- an embodiment of the present disclosure provides a computer-readable medium on which a computer program is stored, characterized in that, when the program is executed by a processor, the method for obtaining information in the first aspect is implemented.
- the method and device for obtaining information provided by the embodiments of the present disclosure first obtain at least one image feature from an image to be detected, and then import the image to be detected and at least one image feature into a pre-trained defect detection model to obtain a corresponding Detect the defect information of the object. In this way, it is beneficial to improve the accuracy of obtaining defect information of the detected object.
- Fig. 1 is an exemplary system architecture diagram to which an embodiment of the present disclosure can be applied;
- Fig. 2 is a flowchart of an embodiment of a method for obtaining information according to the present disclosure
- Fig. 3 is a schematic diagram of an application scenario of the method for obtaining information according to the present disclosure
- Fig. 4 is a flowchart of an embodiment of a defect detection model training method according to the present disclosure
- Fig. 5 is a schematic structural diagram of an embodiment of an apparatus for acquiring information according to the present disclosure
- Fig. 6 is a schematic structural diagram of an electronic device suitable for implementing embodiments of the present disclosure.
- FIG. 1 shows an exemplary system architecture 100 of a method for acquiring information or an apparatus for acquiring information to which an embodiment of the present disclosure can be applied.
- the system architecture 100 may include image acquisition devices 101, 102, and 103, a network 104 and a server 105.
- the network 104 is used to provide a medium for communication links between the image acquisition devices 101, 102, 103 and the server 105.
- the network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, and so on.
- the image acquisition devices 101, 102, and 103 interact with the server 105 through the network 104 to receive or send messages and so on.
- Various image processing applications may be installed on the image capture devices 101, 102, 103, such as image capture applications, image adjustment applications, image compression applications, and image encryption applications.
- the image acquisition devices 101, 102, 103 may be various electronic devices that have a display screen and support image acquisition, including remote cameras, digital cameras, surveillance cameras, and the like. There is no specific limitation here.
- the server 105 may be a server that provides various services, for example, a defect detection server that provides support for the images to be detected from the image acquisition devices 101, 102, and 103.
- the defect detection server can analyze and process the received data such as the image to be detected, and obtain defect information corresponding to the image to be detected.
- the method for obtaining information provided by the embodiments of the present disclosure is generally executed by the server 105, and accordingly, the device for obtaining information is generally set in the server 105.
- the server can be hardware or software.
- the server can be implemented as a distributed server cluster composed of multiple servers, or as a single server.
- the server is software, it can be implemented as multiple software or software modules (for example, to provide distributed services), or as a single software or software module, which is not specifically limited here.
- the method for obtaining information includes the following steps:
- Step 201 Obtain at least one image feature from the image to be detected.
- the execution subject of the method for acquiring information may receive the image to be detected from the image acquisition devices 101, 102, 103 through a wired connection or a wireless connection.
- the image acquisition devices 101, 102, and 103 of the present application can be set in multiple positions of the product production line to obtain the images to be inspected in each link of the product production. That is, the image to be detected in this application includes the image of the object to be detected.
- wireless connection methods can include, but are not limited to, 3G/4G connection, WiFi connection, Bluetooth connection, WiMAX connection, Zigbee connection, UWB (Ultra Wideband) connection, and other wireless connection methods that are currently known or developed in the future .
- this application does not directly inspect the image to be inspected to identify possible defects on the surface of the object to be inspected. Instead, it performs related processing on the image to be inspected.
- the aforementioned image feature can be used to characterize the surface feature information of the aforementioned object to be detected.
- acquiring at least one image feature from the image to be detected may include the following steps:
- the first step is to obtain the reference feature of the object to be detected.
- the execution subject may first identify the object to be detected from the image to be detected, and then obtain the reference feature corresponding to the object to be detected from a data storage device such as a database by way of query.
- the objects to be inspected can be different objects such as notebook computers, motherboards, displays, silicon chips and so on. Therefore, different objects to be detected have their corresponding reference features.
- the aforementioned reference feature may include at least one of the following: color feature, structural feature, planar feature (that is, multiple faces of the object to be detected), material feature, light sensing feature, and the like.
- the reference feature can also be other features, depending on the actual object to be detected.
- the second step is to perform image processing on the above-mentioned image to be detected through a setting method based on the above-mentioned reference feature to obtain the corresponding image feature.
- the image acquisition devices 101, 102, and 103 acquire images to be detected, they can acquire images of reference features related to the object to be detected. That is, the image to be detected contains the image features of the reference feature related to the object to be detected.
- the execution subject can process the image to be detected in different ways to extract corresponding image features from the image to be detected.
- the above setting method may include at least one of the following: color contrast enhancement, filtering, and texture collection.
- image features can be extracted in different ways based on the reference features of the object to be detected, and defects that are not easy to find with the naked eye (for example, the texture feature of the object to be detected) can be collected, which is beneficial to improve the accuracy and accuracy of obtaining defect information. Effectiveness.
- Step 202 Import the image to be detected and the at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the object to be detected.
- the execution subject can import the image to be detected and at least one image feature into the pre-trained defect detection model.
- the defect detection model here is a model that can process the image to be inspected and the corresponding image features.
- the defect detection model detects the defect information of the object to be inspected in the image to be inspected through the image to be inspected and image features. In this way, the accuracy of obtaining defect information is improved.
- the above-mentioned defect detection model may be obtained through training of sample images, sample image features, and sample defect information, and is used to characterize the corresponding relationship between the above-mentioned image to be detected and at least one image feature.
- the above importing the above-mentioned image to be detected and the above-mentioned at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the object to be detected may include: The image and the at least one image feature are imported into the corresponding input channel of the defect detection model to obtain defect information corresponding to the object to be detected.
- the defect detection model of the present application can have multiple input channels, and each input channel can input different input information. After different input information is input to the defect detection model, it can be processed in the network structure or calculation unit corresponding to the defect detection model to achieve the fusion of multiple image features and the image to be detected, which is beneficial to improve the accuracy and accuracy of obtaining defect information. Effectiveness.
- FIG. 3 is a schematic diagram of an application scenario of the method for obtaining information according to this embodiment.
- the image acquisition device 101 sends the acquired image to be detected containing the XXX image of the object to be detected to the server 105 via the network 104.
- the server 105 obtains at least one image feature from the image to be inspected, and then imports the image to be inspected and at least one image feature into the defect detection model, and obtains defect information corresponding to the object to be inspected may be: object to be inspected: XXX; defect information: 1, Surface scratches; 2. Uneven color; 3. Surface impurities.
- the method provided by the foregoing embodiment of the present disclosure first obtains at least one image feature from the image to be detected, and then imports the image to be detected and the at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the object to be detected. In this way, it is beneficial to improve the accuracy of obtaining defect information of the detected object.
- FIG. 4 shows a flow 400 of an embodiment of a method for training a defect detection model.
- the process 400 of the defect detection model training method includes the following steps:
- Step 401 Acquire multiple sample information groups and sample defect information corresponding to each of the multiple sample information groups.
- the execution body of the defect detection model training method (for example, the server 105 shown in FIG. 1) can obtain multiple sample information groups and sample defects corresponding to each of the multiple sample information groups. information.
- the execution body can obtain multiple sample information groups and play them for those skilled in the art.
- the skilled person can mark sample defect information for each sample information group in the multiple sample information groups based on experience.
- the above-mentioned sample information group may include a sample image and at least one sample image feature corresponding to the sample image.
- the above-mentioned sample image features are obtained by the following steps: feature extraction is performed on the sample image through the above-mentioned setting method.
- the execution subject can extract at least one image feature from the sample image through the above setting method. It should be noted that when the sample image has the corresponding image feature, the sample image feature can be extracted by the corresponding setting method; when the sample image does not have the corresponding image feature, the sample image feature cannot be extracted by the corresponding setting method . Therefore, the characteristics of the sample image are less than or equal to the above-mentioned setting method.
- Step 402 Input each sample information group of the plurality of sample information groups into the initialization defect detection model in turn to obtain predicted defect information corresponding to each sample information group of the plurality of sample information groups.
- the execution subject may sequentially input the sample image contained in each sample information group of the multiple sample information groups and at least one sample image feature corresponding to the sample image To initialize different input channels of the defect detection model, thereby obtaining predicted defect information corresponding to each sample information group in the multiple sample information groups.
- the execution body can input each sample information group from the input side of the initialized defect detection model, sequentially process the parameters of each layer in the initialized defect detection model, and output from the output side of the initialized defect detection model, and output from the output side.
- the information is the predicted defect information corresponding to the sample information group.
- the initialization defect detection model may be an untrained deep learning model or an untrained deep learning model, each layer of which is set with initialization parameters, and the initialization parameters can be continuously adjusted during the training process of the initialization defect detection model.
- Each sample image feature participates in data processing in the corresponding network structure or computing unit to realize the organic fusion of multiple sample image features and sample images.
- Step 403 Compare the predicted defect information corresponding to each sample information group in the multiple sample information groups with the sample defect information corresponding to the sample information group to obtain the prediction accuracy rate of the initialized defect detection model.
- the executive body may assign the corresponding prediction defect information to each sample information group in the multiple sample information groups.
- the predicted defect information is compared with the sample defect information corresponding to the sample information group, so as to obtain the prediction accuracy rate of the initialized defect detection model. Specifically, if the predicted defect information corresponding to a sample information group is the same as or similar to the sample defect information corresponding to the sample information group, the initial defect detection model prediction is correct; if the predicted defect information corresponding to a sample information group is the same as the sample defect information If the sample defect information corresponding to the sample information group is different or not similar, the initial defect detection model predicts the error.
- the execution body can calculate the ratio of the number of correct predictions to the total number of samples, and use this ratio as the prediction accuracy rate of the initialized defect detection model.
- Step 404 Determine whether the prediction accuracy is greater than a preset accuracy threshold.
- the execution entity may compare the prediction accuracy of the initialized defect detection model with a preset accuracy threshold. If it is greater than the preset accuracy threshold, step 405 is executed; if it is not greater than the preset accuracy threshold, step 406 is executed.
- Step 405 Use the above-mentioned initialized defect detection model as a defect detection model completed by training.
- the execution body can use the initialized defect detection model as the completed defect detection. Model.
- Step 406 Adjust the parameters of the above-mentioned initialization defect detection model.
- the execution subject can adjust the parameters of the initialized defect detection model and return to step 402 until the training can characterize the above-mentioned waiting It is up to the deep learning model that detects the correspondence between an image and at least one image feature.
- the present disclosure provides an embodiment of a device for obtaining information.
- the device embodiment corresponds to the method embodiment shown in FIG.
- the device can be applied to various electronic devices.
- the apparatus 500 for acquiring information in this embodiment may include: a feature acquiring unit 501 and a defect information acquiring unit 502.
- the feature acquiring unit 501 is configured to acquire at least one image feature from the image to be inspected, wherein the image to be inspected includes an image of the object to be inspected, and the image feature is used to characterize the surface feature information of the object to be inspected; defect information acquisition
- the unit 502 is configured to import the image to be detected and the at least one image feature into a pre-trained defect detection model to obtain defect information corresponding to the object to be detected, wherein the defect detection model is based on the sample image, the sample image feature, and the sample defect.
- the information is obtained through training and is used to characterize the corresponding relationship between the image to be detected and at least one image feature.
- the feature acquisition unit 501 may include: a reference feature acquisition subunit (not shown in the figure) and an image feature acquisition subunit (not shown in the figure).
- the reference feature acquisition subunit is configured to acquire the reference features of the object to be detected, and the reference feature includes at least one of the following: color features, structural features, and planar features;
- the image feature acquisition subunit is configured to pass based on the reference features.
- the setting mode performs image processing on the above-mentioned image to be detected to obtain corresponding image characteristics, wherein the above-mentioned setting mode includes at least one of the following: color contrast enhancement, filtering, and texture acquisition.
- the defect information acquiring unit 502 may include: an information input subunit (not shown in the figure) configured to import the image to be detected and the at least one image feature into the image The corresponding input channel of the defect detection model obtains defect information corresponding to the object to be detected.
- the foregoing apparatus 500 for obtaining information may include a defect detection model training unit (not shown in the figure), configured to train a defect detection model, and the foregoing defect detection model training unit It may include: a sample acquisition subunit (not shown in the figure) and a model training subunit (not shown in the figure).
- the sample acquisition subunit is configured to acquire a plurality of sample information groups and sample defect information corresponding to each sample information group in the plurality of sample information groups, wherein the sample information group includes sample images and corresponding sample information groups. At least one sample image feature;
- the model training subunit is configured to take each sample information group of the multiple sample information groups as input, and take the sample defect corresponding to each sample information group of the multiple sample information groups The information is used as output, and the defect detection model is trained.
- the above-mentioned model training subunit may include: a model training module (not shown in the figure) configured to sequentially arrange each of the above-mentioned multiple sample information groups Input to the initial defect detection model to obtain the predicted defect information corresponding to each sample information group in the multiple sample information groups, and compare the predicted defect information corresponding to each sample information group in the multiple sample information groups with the The sample defect information corresponding to the sample information group is compared to obtain the prediction accuracy of the initialized defect detection model, and it is determined whether the prediction accuracy is greater than the preset accuracy threshold. If it is greater than the preset accuracy threshold, the initialization is performed The defect detection model is used as the defect detection model completed by training.
- a model training module (not shown in the figure) configured to sequentially arrange each of the above-mentioned multiple sample information groups Input to the initial defect detection model to obtain the predicted defect information corresponding to each sample information group in the multiple sample information groups, and compare the predicted defect information corresponding to each sample information group in the multiple sample information groups with the The sample defect information
- the above-mentioned model training subunit may include: a parameter adjustment module (not shown in the figure), configured to adjust the above-mentioned initialization defect in response to being not greater than the above-mentioned preset accuracy threshold Detect the parameters of the model and return to the above model training module.
- a parameter adjustment module (not shown in the figure), configured to adjust the above-mentioned initialization defect in response to being not greater than the above-mentioned preset accuracy threshold Detect the parameters of the model and return to the above model training module.
- This embodiment also provides an electronic device, including: one or more processors; a memory, on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, The above-mentioned one or more processors are caused to execute the above-mentioned method for obtaining information.
- This embodiment also provides a computer-readable medium on which a computer program is stored, and when the program is executed by a processor, the foregoing method for obtaining information is implemented.
- FIG. 6 shows a schematic structural diagram of a computer system 600 of an electronic device (for example, the server 105 in FIG. 1) suitable for implementing an embodiment of the present disclosure.
- the electronic device shown in FIG. 6 is only an example, and should not bring any limitation to the function and scope of use of the embodiments of the present disclosure.
- the electronic device 600 may include a processing device (such as a central processing unit, a graphics processor, etc.) 601, which can be loaded into a random access device according to a program stored in a read-only memory (ROM) 602 or from a storage device 608.
- the program in the memory (RAM) 603 executes various appropriate actions and processing.
- various programs and data required for the operation of the electronic device 600 are also stored.
- the processing device 601, the ROM 602, and the RAM 603 are connected to each other through a bus 604.
- An input/output (I/O) interface 605 is also connected to the bus 604.
- the following devices can be connected to the I/O interface 605: including input devices 606 such as touch screens, touch pads, keyboards, mice, cameras, microphones, accelerometers, gyroscopes, etc.; including, for example, liquid crystal displays (LCD), speakers, vibration An output device 607 such as a device; a storage device 608 such as a magnetic tape, a hard disk, etc.; and a communication device 609.
- the communication device 609 may allow the electronic device 600 to perform wireless or wired communication with other devices to exchange data.
- FIG. 6 shows an electronic device 600 having various devices, it should be understood that it is not required to implement or have all of the illustrated devices. It may be implemented alternatively or provided with more or fewer devices. Each block shown in FIG. 6 can represent one device, or can represent multiple devices as needed.
- an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart.
- the computer program may be downloaded and installed from the network through the communication device 609, or installed from the storage device 608, or installed from the ROM 602.
- the processing device 601 the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
- the above-mentioned computer-readable medium in the embodiment of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two.
- the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or a combination of any of the above.
- Computer-readable storage media may include, but are not limited to: electrical connections with one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable removable Programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.
- the computer-readable storage medium may be any tangible medium that contains or stores a program, and the program may be used by or in combination with an instruction execution system, apparatus, or device.
- a computer-readable signal medium may include a data signal propagated in a baseband or as a part of a carrier wave, and a computer-readable program code is carried therein.
- This propagated data signal can take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
- the computer-readable signal medium may also be any computer-readable medium other than the computer-readable storage medium.
- the computer-readable signal medium may send, propagate, or transmit the program for use by or in combination with the instruction execution system, apparatus, or device .
- the program code contained on the computer-readable medium can be transmitted by any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.
- the above-mentioned computer-readable medium may be included in the above-mentioned electronic device; or it may exist alone without being assembled into the electronic device.
- the above-mentioned computer-readable medium carries one or more programs.
- the electronic device When the above-mentioned one or more programs are executed by the electronic device, the electronic device: An image of the object to be detected, the above image features are used to characterize the surface feature information of the object to be detected; the image to be detected and the at least one image feature are imported into a pre-trained defect detection model to obtain defect information corresponding to the object to be detected, wherein
- the above-mentioned defect detection model is obtained through training of sample images, sample image features, and sample defect information, and is used to characterize the corresponding relationship between the above-mentioned image to be detected and at least one image feature.
- the computer program code for performing the operations of the embodiments of the present disclosure may be written in one or more programming languages or a combination thereof.
- the above-mentioned programming languages include object-oriented programming languages such as Java, Smalltalk, C++, and Including conventional procedural programming languages-such as "C" language or similar programming languages.
- the program code can be executed entirely on the user's computer, partly on the user's computer, executed as an independent software package, partly on the user's computer and partly executed on a remote computer, or entirely executed on the remote computer or server.
- the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (for example, using an Internet service provider to pass Internet connection).
- LAN local area network
- WAN wide area network
- each block in the flowchart or block diagram can represent a module, program segment, or part of code, and the module, program segment, or part of code contains one or more for realizing the specified logic function.
- Executable instructions can also occur in a different order from the order marked in the drawings. For example, two blocks shown one after another can actually be executed substantially in parallel, and they can sometimes be executed in the reverse order, depending on the functions involved.
- each block in the block diagram and/or flowchart, and the combination of the blocks in the block diagram and/or flowchart can be implemented by a dedicated hardware-based system that performs the specified function or operation Or it can be realized by a combination of dedicated hardware and computer instructions.
- the units involved in the embodiments described in the present disclosure can be implemented in software or hardware.
- the described unit may also be provided in the processor, for example, it may be described as: a processor includes a feature acquisition unit and a defect information acquisition unit.
- the names of these units do not constitute a limitation on the unit itself under certain circumstances.
- the feature acquisition unit can also be described as "a unit that acquires multiple image features of the object to be detected from the image to be detected.”
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
Abstract
Description
Claims (14)
- 一种用于获取信息的方法,包括:从待检测图像中获取至少一条图像特征,其中,所述待检测图像包含待检测物体图像,所述图像特征用于表征所述待检测物体的表面特征信息;以及将所述待检测图像和所述至少一条图像特征导入预先训练的缺陷检测模型,得到对应所述待检测物体的缺陷信息,其中,所述缺陷检测模型通过样本图像、样本图像特征和样本缺陷信息训练得到,用于表征所述待检测图像和至少一条图像特征的对应关系。
- 根据权利要求1所述的方法,其中,所述从待检测图像中获取至少一条图像特征,包括:获取所述待检测物体的基准特征,所述基准特征包括以下至少一项:颜色特征、结构特征、平面特征;以及基于所述基准特征通过设定方式对所述待检测图像进行图像处理,得到对应的图像特征,其中,所述设定方式包括以下至少一项:色彩对比增强、滤波、纹理采集。
- 根据权利要求1所述的方法,其中,所述将所述待检测图像和所述至少一条图像特征导入预先训练的缺陷检测模型,得到对应所述待检测物体的缺陷信息,包括:将所述待检测图像和所述至少一条图像特征导入所述缺陷检测模型的对应输入通道,得到对应所述待检测物体的缺陷信息。
- 根据权利要求1所述的方法,其中,所述缺陷检测模型通过以下步骤训练得到:获取多个样本信息组和所述多个样本信息组中的每个样本信息组所对应的样本缺陷信息,其中,所述样本信息组包括样本图像和对应样本图像的至少一条样本图像特征;以及将所述多个样本信息组中的每个样本信息组作为输入,将所述多个样本信息组中的每个样本信息组所对应的所述样本缺陷信息作为输出,训练得到缺陷检测模型。
- 根据权利要求4所述的方法,其中,所述将所述多个样本信息组中的每个样本信息组作为输入,将所述多个样本信息组中的每个样本信息组所对应的所述样本缺陷信息作为输出,训练得到缺陷检测模型,包括:执行以下训练步骤:将所述多个样本信息组中的每个样本信息组依次输入至初始化缺陷检测模型,得到所述多个样本信息组中的每个样本信息组所对应的预测缺陷信息,将所述多个样本信息组中的每个样本信息组所对应的预测缺陷信息与该样本信息组所对应的所述样本缺陷信息进行比较,得到所述初始化缺陷检测模型的预测准确率,确定所述预测准确率是否大于预设准确率阈值,若大于所述预设准确率阈值,则将所述初始化缺陷检测模型作为训练完成的缺陷检测模型。
- 根据权利要求5所述的方法,其中,所述将所述多个样本信息组中的每个样本信息组作为输入,将所述多个样本信息组中的每个样本信息组所对应的所述样本缺陷信息作为输出,训练得到缺陷检测模型,包括:响应于不大于所述预设准确率阈值,调整所述初始化缺陷检测模型的参数,并继续执行所述训练步骤。
- 一种用于获取信息的装置,包括:特征获取单元,被配置成从待检测图像中获取至少一条图像特征,其中,所述待检测图像包含待检测物体图像,所述图像特征用于表征所述待检测物体的表面特征信息;以及缺陷信息获取单元,被配置成将所述待检测图像和所述至少一条图像特征导入预先训练的缺陷检测模型,得到对应所述待检测物体的缺陷信息,其中,所述缺陷检测模型通过样本图像、样本图像特征和 样本缺陷信息训练得到,用于表征所述待检测图像和至少一条图像特征的对应关系。
- 根据权利要求7所述的装置,其中,所述特征获取单元包括:基准特征获取子单元,被配置成获取所述待检测物体的基准特征,所述基准特征包括以下至少一项:颜色特征、结构特征、平面特征;以及图像特征获取子单元,被配置成基于所述基准特征通过设定方式对所述待检测图像进行图像处理,得到对应的图像特征,其中,所述设定方式包括以下至少一项:色彩对比增强、滤波、纹理采集。
- 根据权利要求7所述的装置,其中,所述缺陷信息获取单元包括:信息输入子单元,被配置成将所述待检测图像和所述至少一条图像特征导入所述缺陷检测模型的对应输入通道,得到对应所述待检测物体的缺陷信息。
- 根据权利要求7所述的装置,其中,所述装置包括缺陷检测模型训练单元,被配置成训练缺陷检测模型,所述缺陷检测模型训练单元包括:样本获取子单元,被配置成获取多个样本信息组和所述多个样本信息组中的每个样本信息组所对应的样本缺陷信息,其中,所述样本信息组包括样本图像和对应样本图像的至少一条样本图像特征;以及模型训练子单元,被配置成将所述多个样本信息组中的每个样本信息组作为输入,将所述多个样本信息组中的每个样本信息组所对应的所述样本缺陷信息作为输出,训练得到缺陷检测模型。
- 根据权利要求10所述的装置,其中,所述模型训练子单元包括:模型训练模块,被配置成将所述多个样本信息组中的每个样本信 息组依次输入至初始化缺陷检测模型,得到所述多个样本信息组中的每个样本信息组所对应的预测缺陷信息,将所述多个样本信息组中的每个样本信息组所对应的预测缺陷信息与该样本信息组所对应的所述样本缺陷信息进行比较,得到所述初始化缺陷检测模型的预测准确率,确定所述预测准确率是否大于预设准确率阈值,若大于所述预设准确率阈值,则将所述初始化缺陷检测模型作为训练完成的缺陷检测模型。
- 根据权利要求11所述的装置,其中,所述模型训练子单元包括:参数调整模块,响应于不大于所述预设准确率阈值,被配置成调整所述初始化缺陷检测模型的参数,返回所述模型训练模块。
- 一种电子设备,包括:一个或多个处理器;存储器,其上存储有一个或多个程序,当所述一个或多个程序被所述一个或多个处理器执行时,使得所述一个或多个处理器执行权利要求1至6中任一所述的方法。
- 一种计算机可读介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1至6中任一所述的方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020217024357A KR20210102458A (ko) | 2020-03-11 | 2020-09-21 | 정보를 취득하는 방법 및 장치 |
JP2021541617A JP2022526473A (ja) | 2020-03-11 | 2020-09-21 | 情報を取得するための方法および装置、電子機器、記憶媒体並びにコンピュータプログラム |
EP20913051.7A EP3907697A4 (en) | 2020-03-11 | 2020-09-21 | INFORMATION ACQUISITION METHOD AND APPARATUS |
US17/443,013 US20220270228A1 (en) | 2020-03-11 | 2021-07-19 | Method and apparatus for obtaining information |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010165825.4A CN111402220B (zh) | 2020-03-11 | 2020-03-11 | 用于获取信息的方法及装置 |
CN202010165825.4 | 2020-03-11 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/443,013 Continuation US20220270228A1 (en) | 2020-03-11 | 2021-07-19 | Method and apparatus for obtaining information |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021179565A1 true WO2021179565A1 (zh) | 2021-09-16 |
Family
ID=71428739
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2020/116527 WO2021179565A1 (zh) | 2020-03-11 | 2020-09-21 | 用于获取信息的方法及装置 |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP3907697A4 (zh) |
CN (1) | CN111402220B (zh) |
WO (1) | WO2021179565A1 (zh) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111402220B (zh) * | 2020-03-11 | 2023-06-09 | 北京百度网讯科技有限公司 | 用于获取信息的方法及装置 |
CN113781460A (zh) * | 2021-09-16 | 2021-12-10 | 北京远舢智能科技有限公司 | 烟包外观缺陷在线检测方法、装置、电子设备和存储介质 |
CN115131327B (zh) * | 2022-07-14 | 2024-04-30 | 电子科技大学 | 一种颜色特征融合的显示屏彩色线缺陷检测方法 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018000731A1 (zh) * | 2016-06-28 | 2018-01-04 | 华南理工大学 | 一种曲面表面缺陷自动检测方法及其装置 |
CN110009614A (zh) * | 2019-03-29 | 2019-07-12 | 北京百度网讯科技有限公司 | 用于输出信息的方法和装置 |
CN110148130A (zh) * | 2019-05-27 | 2019-08-20 | 北京百度网讯科技有限公司 | 用于检测零件缺陷的方法和装置 |
CN110517259A (zh) * | 2019-08-30 | 2019-11-29 | 北京百度网讯科技有限公司 | 一种产品表面状态的检测方法、装置、设备及介质 |
CN111402220A (zh) * | 2020-03-11 | 2020-07-10 | 北京百度网讯科技有限公司 | 用于获取信息的方法及装置 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018208791A1 (en) * | 2017-05-08 | 2018-11-15 | Aquifi, Inc. | Systems and methods for inspection and defect detection using 3-d scanning |
CN109829483B (zh) * | 2019-01-07 | 2021-05-18 | 鲁班嫡系机器人(深圳)有限公司 | 缺陷识别模型训练方法、装置、计算机设备和存储介质 |
CN109949286A (zh) * | 2019-03-12 | 2019-06-28 | 北京百度网讯科技有限公司 | 用于输出信息的方法和装置 |
CN109978870A (zh) * | 2019-03-29 | 2019-07-05 | 北京百度网讯科技有限公司 | 用于输出信息的方法和装置 |
CN109961433A (zh) * | 2019-03-29 | 2019-07-02 | 北京百度网讯科技有限公司 | 产品缺陷检测方法、装置及计算机设备 |
CN110276754B (zh) * | 2019-06-21 | 2021-08-20 | 厦门大学 | 一种表面缺陷检测方法、终端设备及存储介质 |
CN110378900B (zh) * | 2019-08-01 | 2020-08-07 | 北京迈格威科技有限公司 | 产品缺陷的检测方法、装置及系统 |
-
2020
- 2020-03-11 CN CN202010165825.4A patent/CN111402220B/zh active Active
- 2020-09-21 WO PCT/CN2020/116527 patent/WO2021179565A1/zh unknown
- 2020-09-21 EP EP20913051.7A patent/EP3907697A4/en not_active Withdrawn
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018000731A1 (zh) * | 2016-06-28 | 2018-01-04 | 华南理工大学 | 一种曲面表面缺陷自动检测方法及其装置 |
CN110009614A (zh) * | 2019-03-29 | 2019-07-12 | 北京百度网讯科技有限公司 | 用于输出信息的方法和装置 |
CN110148130A (zh) * | 2019-05-27 | 2019-08-20 | 北京百度网讯科技有限公司 | 用于检测零件缺陷的方法和装置 |
CN110517259A (zh) * | 2019-08-30 | 2019-11-29 | 北京百度网讯科技有限公司 | 一种产品表面状态的检测方法、装置、设备及介质 |
CN111402220A (zh) * | 2020-03-11 | 2020-07-10 | 北京百度网讯科技有限公司 | 用于获取信息的方法及装置 |
Non-Patent Citations (1)
Title |
---|
See also references of EP3907697A4 |
Also Published As
Publication number | Publication date |
---|---|
CN111402220B (zh) | 2023-06-09 |
CN111402220A (zh) | 2020-07-10 |
EP3907697A4 (en) | 2022-11-30 |
EP3907697A1 (en) | 2021-11-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2021179565A1 (zh) | 用于获取信息的方法及装置 | |
WO2020155907A1 (zh) | 用于生成漫画风格转换模型的方法和装置 | |
US11276158B2 (en) | Method and apparatus for inspecting corrosion defect of ladle | |
WO2020006963A1 (zh) | 生成图像检测模型的方法和装置 | |
WO2020000879A1 (zh) | 图像识别方法和装置 | |
WO2020233200A1 (zh) | 用于训练模型的方法和装置、用于预测信息的方法和装置 | |
WO2019237657A1 (zh) | 用于生成模型的方法和装置 | |
CN109447156B (zh) | 用于生成模型的方法和装置 | |
JP2020030811A (ja) | 応答時間を確定するための方法及び装置 | |
WO2020029608A1 (zh) | 用于检测电极片毛刺的方法和装置 | |
CN108830837A (zh) | 一种用于检测钢包溶蚀缺陷的方法和装置 | |
WO2022252881A1 (zh) | 图像处理方法、装置、可读介质和电子设备 | |
WO2020093724A1 (zh) | 生成信息的方法和装置 | |
US20220270228A1 (en) | Method and apparatus for obtaining information | |
US20220309405A1 (en) | Combined-learning-based internet of things data service method and apparatus, device and medium | |
CN109902446A (zh) | 用于生成信息预测模型的方法和装置 | |
CN107704388A (zh) | 用于确定应用的启动时间的方法和装置 | |
CN110059624A (zh) | 用于检测活体的方法和装置 | |
CN114419400B (zh) | 图像识别模型的训练方法、识别方法、装置、介质和设备 | |
CN111062914B (zh) | 用于采集脸部图像的方法、装置、电子设备和计算机可读介质 | |
CN111862081B (zh) | 图像评分方法、分数预测网络的训练方法、装置 | |
CN116662193A (zh) | 页面测试方法和装置 | |
CN112315463B (zh) | 一种婴幼儿听力测试方法、装置及电子设备 | |
CN110084298B (zh) | 用于检测图像相似度的方法及装置 | |
CN113255819A (zh) | 用于识别信息的方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2021541617 Country of ref document: JP Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 20217024357 Country of ref document: KR Kind code of ref document: A Ref document number: 2020913051 Country of ref document: EP Effective date: 20210719 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20913051 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |