WO2022104867A1 - Feature detection method and device for target object - Google Patents

Feature detection method and device for target object Download PDF

Info

Publication number
WO2022104867A1
WO2022104867A1 PCT/CN2020/131746 CN2020131746W WO2022104867A1 WO 2022104867 A1 WO2022104867 A1 WO 2022104867A1 CN 2020131746 W CN2020131746 W CN 2020131746W WO 2022104867 A1 WO2022104867 A1 WO 2022104867A1
Authority
WO
WIPO (PCT)
Prior art keywords
feature
picture
pictures
target object
target
Prior art date
Application number
PCT/CN2020/131746
Other languages
French (fr)
Chinese (zh)
Inventor
陈洪生
王成达
刘叶青
张剑
Original Assignee
苏州极目机器人科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 苏州极目机器人科技有限公司 filed Critical 苏州极目机器人科技有限公司
Publication of WO2022104867A1 publication Critical patent/WO2022104867A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/94Hardware or software architectures specially adapted for image or video understanding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/40Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/94Hardware or software architectures specially adapted for image or video understanding
    • G06V10/95Hardware or software architectures specially adapted for image or video understanding structured as a network, e.g. client-server architectures

Definitions

  • the present application relates to the technical field of image object detection, for example, to a method and device for feature detection of objects.
  • the image features of the target object may not be fixed.
  • the tassel may be the male parent or the female parent.
  • the image used for identification is not conducive to the accurate identification of image features of the algorithm due to the acquisition environment factors such as light and mutual occlusion of target objects. Based on the foregoing situation, its features cannot be accurately detected.
  • it is generally used manually to detect features directly in the field, which has large workload, low efficiency and high cost.
  • the present application provides a feature detection method and device for a target object.
  • identifying a first feature picture in parallel, and identifying a second feature in the first feature picture through parallel cascading the feature detection of the target object is realized and the detection accuracy is improved. and detection efficiency.
  • an embodiment of the present application provides a method for detecting features of a target, including:
  • an embodiment of the present application also provides a feature detection device for a target, including:
  • the acquisition module obtains the image of the target object collected in the target area
  • an identification module which processes a plurality of the target object pictures in parallel, and identifies the first feature in the target object pictures
  • a saving module saving the first feature identified in the target object picture as a first feature picture
  • a display module displaying a plurality of the first characteristic pictures in the detection interface
  • a screening module which screens the second feature picture with the second feature in the first feature picture in parallel from the detection interface
  • the extraction module extracts the screened second feature picture.
  • FIG. 1 is a flowchart of a method for detecting a feature of a target according to an embodiment of the present application
  • Fig. 2 is the schematic diagram of the parent plant of a kind of Gypsophila planting pattern provided by the embodiment of the application;
  • FIG. 3 is a schematic diagram of a picture of a target object with a first feature identified according to an embodiment of the present application
  • FIG. 4 is a schematic diagram of a first feature picture provided by an embodiment of the present application.
  • FIG. 5 is a schematic diagram of a detection interface provided by an embodiment of the present application.
  • FIG. 6 is a functional block diagram of a feature detection apparatus for a target object provided by an embodiment of the present application.
  • the embodiment of the present application provides a feature of a target object
  • the detection method and device can quickly and effectively detect the indistinguishable features of the target through the method of cascading and parallel identification, and improve the detection accuracy and detection efficiency.
  • FIG. 1 is a flowchart of a method for detecting a feature of a target according to an embodiment of the present application.
  • an embodiment of the present application provides a feature detection method for a target object, including:
  • step S102 a picture of the target object collected in the target area is obtained.
  • Step S104 Process a plurality of the target object pictures in parallel to identify the first feature in the target object pictures.
  • Step S106 saving the first feature identified in the target object picture as a first feature picture.
  • Step S108 displaying a plurality of the first characteristic pictures in the detection interface.
  • Step S110 Screen second feature pictures with second features in the first feature pictures in parallel from the detection interface.
  • Step S112 extracting the filtered second feature picture.
  • the first feature picture is obtained through parallel autonomous identification, and then the second feature picture is obtained by parallel screening based on the first feature picture.
  • High-accuracy detection results to achieve the purpose of fast and efficient detection.
  • the first feature is a corn tassel
  • the second feature is one or more of tassel shape, tassel color, and leaf color
  • the first feature picture is a corn tassel Picture
  • the second characteristic picture is a picture of the female parent tassel.
  • the picture of the target object is a picture of corn
  • the cascading identification method in this embodiment determines the picture of the female parent tassel from the corn picture, which solves the problem that the female parent tassel cannot be quickly and accurately detected.
  • tasseling is often used, that is, during pollination, the tassel of the female parent is removed, leaving only the tassel of the male parent. During pollination, the fruit on the plant of the female parent is the pollen of the male parent. It is combined with the eggs of the female parent to achieve hybrid seed production. If the female parent is not emasculated, the pollen of the female parent will be pollinated on its own ear to form self-inbred seeds, which will greatly affect the purity of the seeds.
  • Maize hybrid seed production generally adopts the row ratio mode, that is, the parent row is cross-planted in a certain proportion. Because the male parent row does not produce seeds in this row ratio mode, resulting in waste of land, people often replace the male parent row with the female parent row in whole or in part, and plant some male parent rows sporadically in the middle of the female parent row to provide pollen, commonly known as "" Gypsophila" planting mode.
  • the Gypsophila model can often increase the yield by more than 30% compared to the row-by-row model due to the higher proportion of female parents.
  • the circle in Figure 2 is the female parent plant, and the star is the male parent plant. All female parent plants need to be removed from the tassel during operation.
  • the purity detection of emasculation is performed by analyzing the pictures of the plots after emasculation taken by the drone by the method of artificial intelligence image recognition, which can greatly save manpower and time, and improve the efficiency of emasculation detection.
  • artificial intelligence image recognition can only effectively identify corn tassel, and there is no effective way to distinguish the parental tassel, that is, it cannot specifically identify whether the current plant with tassel belongs to the male parent or the female parent, and thus cannot achieve accurate female parent tassel. detection.
  • the applicant's research found that, especially in the Gypsophila planting method, because the parents are very close together, and the parents of corn are planted closely and staggered, it is more difficult to distinguish the tassel of the parents by image recognition methods.
  • One solution is to manually go to the field to check whether the emasculation is complete, which is inefficient, has poor operating conditions, and is time-consuming, labor-intensive and expensive.
  • the machine-recognized pictures are manually confirmed, and the screening of female parent tassel by confirming each picture requires a lot of work, large downloads of pictures, and extremely low efficiency.
  • the target detection method in this embodiment the first feature picture (maize tassel) is automatically identified in parallel, and the method for obtaining the target feature (female tassel) corresponding to the second feature picture is further manually filtered in parallel,
  • the rapid detection of the target feature is realized, and it can be applied to the field of emasculation to obtain results quickly, thereby assisting emasculation.
  • the first feature is a corn bud
  • the second feature is one or more of bud shape, bud color, and leaf color
  • the first feature picture is a bud picture
  • the second feature picture is a female parent bud picture
  • the first feature is a foreign object on a power line
  • the second feature is one or more of a split pin, an anti-vibration hammer, and a wire clip
  • the first feature picture is a foreign object picture
  • the The second characteristic picture is a picture of a split pin, a picture of a shock-proof hammer, or a picture of a wire clip.
  • the target object picture includes a corn picture and a power line picture, and the corresponding first feature and second feature change correspondingly with the change of the target object picture, which is not limited here.
  • upload all the target object pictures collected in the sampling area identify the first feature in parallel, save the first feature picture with the first feature, and display it on the detection interface, based on the operation
  • the instruction selects the second feature picture from the detection interface, extracts the second feature picture, obtains the first feature picture through parallel recognition, and confirms the second feature picture in parallel, which further improves the detection efficiency and makes up for the uncertainty of machine vision detection. , so that the detection accuracy can reach more than 99%.
  • step S102 further includes the following steps:
  • the collected pictures of the target objects are uploaded in batches, and the pictures of the target objects are collected in the target area by the same method.
  • the target area is the sampling area, and multiple target areas are randomly sampled in a piece of land, and dozens to hundreds of target object pictures covering the target area are collected to adapt to the large land area and improve the detection efficiency. Or, if the target area is the entire land parcel, at this time, it is necessary to collect the target object pictures covering all the land parcels. The number of pictures is large, which will reduce the detection efficiency.
  • the method for collecting the image of the target object is the same.
  • the image of the target object is collected at a fixed distance directly above the target object, and the consistency of the posture of the collected image can ensure the subsequent recognition of the image. consistency.
  • the UAV receives the acquisition instruction and controls the UAV to hover over each target in the same acquisition attitude, and collect multiple pictures of the target.
  • the collected image of the target object does not require coordinate information, and the subsequent steps can also be implemented.
  • the collected image of the target object has coordinate information, and the detection result in the detected second feature image can be separately processed according to the coordinate information.
  • the drone After collecting the target object pictures, upload the collected target object pictures in batches, or upload the collected target object pictures in real time when collecting the target object pictures.
  • the former reduces the communication requirements and improves the detection efficiency, while the latter requires communication. higher.
  • the drone after the drone collects multiple target areas, it obtains multiple target images, and transmits them to the server through batch uploading (tens, hundreds, or thousands of images can be uploaded together).
  • step S104 identify the first features in the plurality of target object pictures in parallel by using the first feature model, the first feature model is pre-learned by the deep learning history of the first feature picture Got it.
  • the first feature model is preselected through deep learning history to obtain the first feature model, and based on the first feature model, the uploaded target image is processed with high concurrency, and the first feature is quickly identified and marked. out the first feature.
  • the server side can obtain the corn tassel model through deep learning of historical corn tassel pictures in advance, and then process all uploaded corn pictures (target images) in high concurrency based on the corn tassel model, process each uploaded corn picture in parallel, and identify the corn.
  • Tassel (first feature). It should be noted that the corn tassel model at this time is used to identify the corn tassel, and the identified corn tassel picture includes the male parent tassel picture and the female parent tassel picture (second feature picture), which needs to be further screened. OK to get a picture of the female tassel.
  • all the target object pictures can be processed at the same time, the first feature in the target object picture can be quickly determined, and the detection rate can be improved.
  • the acquisition method of the target image is consistent, the accuracy of the recognition feature is greatly improved, and the detection accuracy is improved.
  • step S106 after the first features are identified in parallel, the first features are marked in parallel, and the marked first feature pictures are stored in parallel as the first feature pictures.
  • the marking can be realized by any marking, as long as the first feature can be seen conspicuously and clearly, for example, it can be a circular frame, a rectangular frame, a polygonal frame and so on.
  • a plurality of first feature pictures are obtained through the methods of parallel identification, marking and saving, thereby improving the detection efficiency.
  • the target object picture is a corn picture including corn tassel features, as shown in FIG. 3 , and the white box marks the identified first feature.
  • the first feature picture is a small picture of the first feature identified from the target object picture, as shown in Figure 4, that is, each white box area in Figure 3 is extracted from the large picture (target object picture).
  • Figure (first feature picture) By saving the first feature picture, the download volume of subsequent screening is facilitated, the detection efficiency is improved, and it is convenient to further identify and screen the second feature from the first feature picture, avoiding the step of directly screening the second feature from the target object picture, greatly improving the detection efficiency. Improved detection accuracy.
  • step S108 the plurality of first feature pictures are sorted according to image parameters, and displayed on the detection interface simultaneously in order, wherein the image parameters include RGB parameters, HSV parameters and image texture parameters.
  • the detection interface is shown in FIG. 5 , and the saved first feature pictures are arranged and displayed on the interface, so that a plurality of first feature pictures can be displayed on one page. If the number of the first feature pictures is too large and exceeds the scope of the interface, or the first feature pictures are too small to be accurately screened, or the screening efficiency is low when the first feature pictures are arranged in a small number, you can, according to the operation instructions input by the user,
  • the arrangement of the first feature pictures is adaptively adjusted to improve the screening experience. For example, in some embodiments, in response to the second operation instruction for the first feature picture, select and view the target object picture where the first feature picture is located, that is, click on the thumbnail image, or view the image where the thumbnail image is located.
  • a large picture, so that the first feature picture that is difficult to confirm can still be confirmed by opening its linked large picture.
  • the first feature picture in response to the third operation instruction for the first feature picture, the first feature picture is enlarged or reduced, and each first feature picture is further confirmed, and further, all the first feature pictures can be further confirmed.
  • the picture is enlarged or reduced so that the feature pictures can be arranged adaptively, the first feature picture can be adjusted to an appropriate size according to the different screening environment, and the number of the first feature pictures displayed on the detection interface can be adjusted, which is convenient for subsequent operations and improves the detection efficiency.
  • a drag operation can also be used to display the first feature pictures beyond the interface range, so as to ensure that all the first feature pictures undergo subsequent screening.
  • the first feature pictures are displayed on the detection interface in a side-by-side arrangement, which is convenient for synchronous detection of multiple feature pictures, as shown in FIG. 5 , the content of the first feature picture is only an example, and the first Feature pictures vary. Further, by arranging multiple rows side by side, the regularity of the arrangement of the first feature pictures is improved, which facilitates the subsequent screening according to the rules, improves the user experience, and further improves the detection efficiency. In one embodiment, all the first feature pictures are displayed on the detection interface, and all the first feature pictures can be screened at the same time, which further improves the detection efficiency.
  • step S110 includes: in response to the first operation instruction, determining a second feature picture with the second feature in the first feature picture by means of parallel identification, wherein the The operation instructions include one or more of the following: manual parallel selection of the second feature picture, manual parallel deletion of the second feature picture, manual parallel inverse selection of the second feature picture.
  • the second feature picture is directly screened from the detection interface, which can increase the detection efficiency.
  • the manual screening user knows the second feature corresponding to the second feature picture of the target area, and then passes Quickly identify the second feature and quickly determine the second feature picture.
  • the first feature picture set is displayed on the detection interface, and a plurality of first feature pictures are processed in parallel by manual screening, and a plurality of second feature pictures are screened at the same time, so as to improve the detection efficiency.
  • this embodiment can be generally used for feature detection and confirmation in a combination of high-throughput AI and artificially assisted recognition, and can be applied to any scenario that requires manual confirmation and fine-tuning of AI recognition results.
  • the first feature pictures are regularly arranged on the detection interface, and the second feature pictures are directly selected by manual screening and sorting. Pictures other than the second feature picture are deleted.
  • the color, shape, and color of the tassel are manually screened to determine whether the picture of the corn tassel is the female parent tassel. If it is the female parent tassel, it is determined as the female parent tassel picture, otherwise it can be deleted.
  • the machine learning method cannot identify the unfixed female parent tassel, and the operator can quickly identify the maize tassel based on the known parental tassel and the field environment.
  • the ear picture identifies the female parent tassel in this target area/plot, which enables screening.
  • the second feature includes not only the own features of the first feature, but also the environmental features, growth features, etc. of the first feature.
  • the second feature picture is determined by fusion of the two features, and the determination method is not limited, and the second feature is not limited, as long as the second feature picture can be determined by the second feature.
  • the first feature picture includes at least a second feature picture, and the second feature picture is determined from the first feature picture, thereby determining the target feature corresponding to the second feature picture, so as to achieve the purpose of detecting the target feature from the target object picture.
  • the second feature picture (the female parent tassel picture) is determined from the target object picture (the corn picture), and the target feature of the second feature picture is the female parent tassel, which is determined by the second feature (tassel color , shape, leaf color, etc.)
  • the step of screening the second feature picture can be assisted by any combination of one or more of the functions of sorting, screening, labeling, and deletion, so as to improve the confirmation efficiency of the second feature picture, improve the adaptability of the detection method, and further Improve user experience.
  • the male parent tassel can be deleted in batches according to the operation of the operator, and the female parent tassel can also be extracted in batches.
  • an operation of individual annotation or batch annotation can be performed for the first feature picture. Screening by factors such as color can speed up the screening.
  • the method further includes the following steps:
  • a target feature removal rate corresponding to the second feature picture in the target area is obtained.
  • the second feature picture can be quickly determined through the real-time upload of the target object picture, so as to realize the detection of the second feature picture. Further, based on the number of plants in the collected image of the target object, the target feature removal rate in the target area and the plot to which the target area belongs can be determined.
  • the number of target object pictures in the target area is not limited, and may range from single digits, dozens, hundreds, or thousands.
  • all the corn tassel is detected by the deep learning detection algorithm, then all the corn tassel content is saved in the new first feature picture, and all the first feature pictures are displayed on the detection interface, and the system responds to the job user
  • the first feature image is subjected to a series of corresponding processing operations, wherein the operations include sorting (for example, according to each color channel of RGB/HSV), selection, deletion, annotation, inverse selection, etc. Rapid extraction of non-target features (male parent tassel) and rapid deletion of non-target features (male parent tassel), so as to achieve the purpose of accurate detection of female parent tassel.
  • the confirmation work of all target object pictures can be completed synchronously (a target object picture may have multiple first feature pictures), thereby achieving ten percent improvement in detection efficiency. times or even hundreds of times.
  • the requirement for detection time is relatively high. Since the plant is in the process of continuous growth, if the detection cannot be obtained in time (the time required for general image detection is counted in days) ), will not reflect the real situation on site.
  • the first feature picture set is obtained by collecting the target object pictures in real time, identifying the first feature in parallel, and presenting the first feature picture set in batches to avoid downloading a large amount of data, and at the same time, it is convenient to screen and identify the second feature picture, and the detection result can be obtained in time.
  • the detection time is saved to the minute level, which greatly improves the detection efficiency. This embodiment obtains the detection result of the on-site situation in time, and can be truly applied to application scenarios such as planting and breeding.
  • This embodiment is applied to the occasions where it is difficult to identify and distinguish the fine features of the image by the machine training method, such as the identification of the parental tassel in the field of cross-breeding, the identification of the female and male buds in the identification of corn buds, the identification of the parental buds in the soybean cross-breeding
  • the machine training method such as the identification of the parental tassel in the field of cross-breeding, the identification of the female and male buds in the identification of corn buds, the identification of the parental buds in the soybean cross-breeding
  • characteristic parts such as screws, cotter pins, and wire clips from images.
  • an embodiment of the present application further provides a feature detection device 600 of a target object, including:
  • the acquisition module 601 obtains the target object pictures collected in the target area; the identification module 602 processes a plurality of the target object pictures in parallel to identify the first feature in the target object pictures; the saving module 603 saves the target object
  • the first feature identified in the picture is a first feature picture; the display module 604 displays a plurality of the first feature pictures in the detection interface; the screening module 605 filters the first features from the detection interface in parallel A second feature picture with the second feature in the picture; the extraction module 606 extracts the screened second feature picture.
  • the embodiment of the present application discloses a method and a device for detecting a feature of a target object, uploading a picture of the target object collected in a target area, identifying a first feature in parallel, saving the picture with the first feature, and displaying it on a detection interface. It is shown that the second feature picture is screened and determined from the detection interface based on the operation instruction, and the second feature picture is extracted, and the purpose of accurately detecting the second feature picture of the target object is achieved through cascade recognition, which greatly improves the detection efficiency.
  • the target feature detection device provided by the embodiment of the present application has the same technical features as the target feature detection method provided by the above embodiments, so it can also solve the same technical problem and achieve the same technical effect.
  • the computer program product of the method and device for detecting the feature of a target provided by the embodiments of the present application includes a computer-readable storage medium storing program codes, and the instructions included in the program codes can be used to execute the methods described in the foregoing method embodiments. For the specific implementation, reference may be made to the method embodiments, which will not be repeated here.
  • Embodiments of the present application further provide an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor.
  • the processor executes the computer program, the method for detecting a feature of a target provided by the foregoing embodiments is implemented. A step of.
  • Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the steps of the method for detecting a feature of a target object of the foregoing embodiments are executed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Human Computer Interaction (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Image Analysis (AREA)

Abstract

The present disclosure relates to the technical field of image feature detection. Disclosed are a feature detection method and device for a target object. The method comprises: obtaining target object pictures acquired in a target area; processing the multiple target object pictures in parallel; recognizing first features in the target object pictures; storing the first features, recognized in the target object pictures, as first feature pictures; displaying multiple first feature pictures in a detection interface; screening, in parallel from the detection interface, second feature pictures, which have second features, in the first feature pictures; and extracting the screened second feature pictures.

Description

目标物的特征检测方法和装置Target feature detection method and device
本申请要求在2020年11月23日提交中国专利局、申请号为202011325389.9的中国专利申请的优先权,该申请的全部内容通过引用结合在本申请中。This application claims the priority of the Chinese Patent Application No. 202011325389.9 filed with the China Patent Office on November 23, 2020, the entire contents of which are incorporated herein by reference.
技术领域technical field
本申请涉及图像目标检测的技术领域,例如涉及一种目标物的特征检测方法和装置。The present application relates to the technical field of image object detection, for example, to a method and device for feature detection of objects.
背景技术Background technique
随着科学技术的发展,深度学习算法广泛应用于图像目标检测的领域中,通过训练模型从图像中识别出目标特征,来实现对相应目标对象进行检测的目的。With the development of science and technology, deep learning algorithms are widely used in the field of image target detection. The purpose of detecting corresponding target objects is achieved by training models to identify target features from images.
然而,在一些实际应用场合中,首先,目标对象的图像特征可能并不固定,例如对于雌雄同株的作物来说,存在雄穗的可能作为父本,也可能作为母本,基于深度学习算法仅能识别雄穗的存在,而无法准确识别出当前存在雄穗的是父本植株还是母本植株。另外,该用于识别的图像由于光线、目标对象存在相互遮挡等采集环境因素,也不利于算法的图像特征准确识别。基于前述情况,其特征无法得到准确检测,当前一般采用人工方式直接至田间检测特征,工作量大、效率低下、成本较高。However, in some practical applications, first, the image features of the target object may not be fixed. For example, for monoecious crops, the tassel may be the male parent or the female parent. Based on deep learning algorithms Only the presence of the tassel can be identified, but it cannot be accurately identified whether the male parent plant or the female parent plant currently has a tassel. In addition, the image used for identification is not conducive to the accurate identification of image features of the algorithm due to the acquisition environment factors such as light and mutual occlusion of target objects. Based on the foregoing situation, its features cannot be accurately detected. Currently, it is generally used manually to detect features directly in the field, which has large workload, low efficiency and high cost.
发明内容SUMMARY OF THE INVENTION
本申请提供一种目标物的特征检测方法和装置,通过并行识别第一特征图片,并通过并行级联识别第一特征图片中的第二特征,从而实现目标物特征的检测,提高检测准确率和检测效率。The present application provides a feature detection method and device for a target object. By identifying a first feature picture in parallel, and identifying a second feature in the first feature picture through parallel cascading, the feature detection of the target object is realized and the detection accuracy is improved. and detection efficiency.
第一方面,本申请实施例提供了一种目标物的特征检测方法,包括:In a first aspect, an embodiment of the present application provides a method for detecting features of a target, including:
获得在目标区域中采集的目标物图片;Obtain the image of the object collected in the target area;
并行处理多个所述目标物图片,识别所述目标物图片中的第一特征;processing a plurality of the target object pictures in parallel, and identifying the first feature in the target object pictures;
保存所述目标物图片中识别的所述第一特征为第一特征图片;Save the first feature identified in the target object picture as a first feature picture;
在检测界面中展示多个所述第一特征图片;displaying a plurality of the first feature pictures in the detection interface;
从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片;Screen the second feature pictures with the second feature in the first feature pictures in parallel from the detection interface;
提取筛选的所述第二特征图片。Extracting the filtered second feature picture.
第二方面,本申请实施例还提供一种目标物的特征检测装置,包括:In a second aspect, an embodiment of the present application also provides a feature detection device for a target, including:
获取模块,获得在目标区域中采集的目标物图片;The acquisition module obtains the image of the target object collected in the target area;
识别模块,并行处理多个所述目标物图片,识别所述目标物图片中的第一特征;an identification module, which processes a plurality of the target object pictures in parallel, and identifies the first feature in the target object pictures;
保存模块,保存所述目标物图片中识别的所述第一特征为第一特征图片;a saving module, saving the first feature identified in the target object picture as a first feature picture;
展示模块,在检测界面中展示多个所述第一特征图片;a display module, displaying a plurality of the first characteristic pictures in the detection interface;
筛选模块,从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片;A screening module, which screens the second feature picture with the second feature in the first feature picture in parallel from the detection interface;
提取模块,提取筛选的所述第二特征图片。The extraction module extracts the screened second feature picture.
附图说明Description of drawings
图1为本申请实施例提供的一种目标物的特征检测方法流程图;1 is a flowchart of a method for detecting a feature of a target according to an embodiment of the present application;
图2为本申请实施例提供的一种满天星种植模式的父母本植株示意图;Fig. 2 is the schematic diagram of the parent plant of a kind of Gypsophila planting pattern provided by the embodiment of the application;
图3为本申请实施例提供的一种识别出第一特征的目标物图片示意图;3 is a schematic diagram of a picture of a target object with a first feature identified according to an embodiment of the present application;
图4为本申请实施例提供的一种第一特征图片示意图;FIG. 4 is a schematic diagram of a first feature picture provided by an embodiment of the present application;
图5为本申请实施例提供的一种检测界面示意图;5 is a schematic diagram of a detection interface provided by an embodiment of the present application;
图6为本申请实施例提供的一种目标物的特征检测装置功能模块图。FIG. 6 is a functional block diagram of a feature detection apparatus for a target object provided by an embodiment of the present application.
具体实施方式Detailed ways
下面将结合附图对本申请的技术方案进行清楚、完整地描述,所描述的实施例是本申请一部分实施例,而不是全部的实施例。The technical solutions of the present application will be clearly and completely described below with reference to the accompanying drawings, and the described embodiments are part of the embodiments of the present application, but not all of the embodiments.
在实际生产过程中,通过深度学习方法存在瓶颈,无法对某一特征的精细特征做到自主识别,进而影响识别准确率和识别效率,基于此,本申请实施例提供的一种目标物的特征检测方法和装置,通过级联并行识别的方法,快速有效地检测到目标物的难以区分的特征,提高检测准确率和检测效率。In the actual production process, there is a bottleneck through the deep learning method, and it is impossible to independently identify the fine features of a certain feature, thereby affecting the recognition accuracy and efficiency. Based on this, the embodiment of the present application provides a feature of a target object The detection method and device can quickly and effectively detect the indistinguishable features of the target through the method of cascading and parallel identification, and improve the detection accuracy and detection efficiency.
为便于对本实施例进行理解,首先对本申请实施例所公开的一种目标物的特征检测方法进行详细介绍,可应用于服务器端。In order to facilitate the understanding of this embodiment, a method for detecting a feature of a target object disclosed in the embodiment of this application is first introduced in detail, which can be applied to the server side.
图1为本申请实施例提供的一种目标物的特征检测方法流程图。FIG. 1 is a flowchart of a method for detecting a feature of a target according to an embodiment of the present application.
参照图1,本申请实施例提供了一种目标物的特征检测方法,包括:Referring to FIG. 1 , an embodiment of the present application provides a feature detection method for a target object, including:
步骤S102,获得在目标区域中采集的目标物图片。In step S102, a picture of the target object collected in the target area is obtained.
步骤S104,并行处理多个所述目标物图片,识别所述目标物图片中的第一特征。Step S104: Process a plurality of the target object pictures in parallel to identify the first feature in the target object pictures.
步骤S106,保存所述目标物图片中识别的所述第一特征为第一特征图片。Step S106, saving the first feature identified in the target object picture as a first feature picture.
步骤S108,在检测界面中展示多个所述第一特征图片。Step S108, displaying a plurality of the first characteristic pictures in the detection interface.
步骤S110,从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片。Step S110: Screen second feature pictures with second features in the first feature pictures in parallel from the detection interface.
步骤S112,提取筛选的所述第二特征图片。Step S112, extracting the filtered second feature picture.
通过上述方法,在目标区域中先通过并行自主识别方式获得第一特征图片,后基于第一特征图片并行筛选获得第二特征图片,通过级联方式对目标物图片进行二次快速筛选,从而获得高准确率的检测结果,达到快速高效检测的目的。Through the above method, in the target area, the first feature picture is obtained through parallel autonomous identification, and then the second feature picture is obtained by parallel screening based on the first feature picture. High-accuracy detection results, to achieve the purpose of fast and efficient detection.
一种实施例中,所述第一特征为玉米雄穗,所述第二特征为雄穗形状、雄穗颜色、叶子颜色中的一种或多种,所述第一特征图片为玉米雄穗图片,所述第二特征图片为母本雄穗图片。目标物图片为玉米图片,通过本实施例中级联识别方法,从玉米图片中确定母本雄穗图片,解决了无法快速准确检测母本雄穗的难题。In one embodiment, the first feature is a corn tassel, the second feature is one or more of tassel shape, tassel color, and leaf color, and the first feature picture is a corn tassel Picture, the second characteristic picture is a picture of the female parent tassel. The picture of the target object is a picture of corn, and the cascading identification method in this embodiment determines the picture of the female parent tassel from the corn picture, which solves the problem that the female parent tassel cannot be quickly and accurately detected.
在杂交育种中,多采用去雄处理,即在授粉期间,将母本的雄穗去除,只留下父本的雄穗,授粉时,母本植株株上结的果实都是父本的花粉和母本的卵子结合而成,如此实现杂交制种。如果母本去雄不好,母本花粉授到自身的果穗上,形成自交种子,会极大影响种子纯度。In cross-breeding, tasseling is often used, that is, during pollination, the tassel of the female parent is removed, leaving only the tassel of the male parent. During pollination, the fruit on the plant of the female parent is the pollen of the male parent. It is combined with the eggs of the female parent to achieve hybrid seed production. If the female parent is not emasculated, the pollen of the female parent will be pollinated on its own ear to form self-inbred seeds, which will greatly affect the purity of the seeds.
玉米杂交制种一般采用行比模式,即把父母本行按一定比例交叉种植。由于该行比模式下父本行不产生种子,造成土地浪费,人们常常全部或部分地以母本行取代父本行,同时在母本行中间零星地种植一些父本以提供花粉,俗称“满天星”种植模式。满天星模式由于较行比种植多出来的母本比例,常常能较行比模式增产30%以上。如图2所示,图2中圆形为母本植株,星形为父本植株。作业时需要去除所有母本植株上的雄穗。Maize hybrid seed production generally adopts the row ratio mode, that is, the parent row is cross-planted in a certain proportion. Because the male parent row does not produce seeds in this row ratio mode, resulting in waste of land, people often replace the male parent row with the female parent row in whole or in part, and plant some male parent rows sporadically in the middle of the female parent row to provide pollen, commonly known as "" Gypsophila" planting mode. The Gypsophila model can often increase the yield by more than 30% compared to the row-by-row model due to the higher proportion of female parents. As shown in Figure 2, the circle in Figure 2 is the female parent plant, and the star is the male parent plant. All female parent plants need to be removed from the tassel during operation.
制种公司在培育种子时,对种子纯度的要求达99.7%以上,对去雄检测精确度的要求也随之提高。为了获取高纯度种子,种业公司需要彻底去除玉米母本的雄穗,目前采用机械去雄或人工去雄的方法,并且在去雄的同时,及时检测去雄效果,确保去雄率,并在纯度不满足要求时重新去雄。一种实施例中,通过人工智能图像识别的方法分析无人机拍摄的去雄后地块的图片来做去雄纯度检测可以极大地节省人力和时间,提高去雄检测效率。但是人工智能图像识别只能有效识别玉米雄穗,缺乏有效方式区分父母本雄穗,即无法具体识别出当 前具有雄穗的植株属于父本还是母本,进而无法实现进行准确的母本雄穗检测。When seed production companies are cultivating seeds, the requirements for the purity of seeds are over 99.7%, and the requirements for the accuracy of emasculation detection are also increased. In order to obtain high-purity seeds, seed companies need to completely remove the tassel from the female maize parent. At present, mechanical or artificial emasculation is used, and at the same time of emasculation, the effect of emasculation is detected in time to ensure the emasculation rate, and Re-emasculation when the purity does not meet the requirements. In one embodiment, the purity detection of emasculation is performed by analyzing the pictures of the plots after emasculation taken by the drone by the method of artificial intelligence image recognition, which can greatly save manpower and time, and improve the efficiency of emasculation detection. However, artificial intelligence image recognition can only effectively identify corn tassel, and there is no effective way to distinguish the parental tassel, that is, it cannot specifically identify whether the current plant with tassel belongs to the male parent or the female parent, and thus cannot achieve accurate female parent tassel. detection.
经申请人研究发现,尤其是满天星种植方式,由于父母本相隔很近,玉米父母本紧密交错种植,通过图像识别方法区分父母本雄穗更加困难。一种解决方法为,人工去田间检查是否去雄彻底,效率低,作业条件恶劣,费时费力费钱,在另一种实施例中,无人机拍摄去雄后地块的图片,识别雄穗图片,通过人工对机器识别后的图片进行确认,而通过确认每一张图片来筛选母本雄穗工作量大,图片下载量大,效率极为低下。The applicant's research found that, especially in the Gypsophila planting method, because the parents are very close together, and the parents of corn are planted closely and staggered, it is more difficult to distinguish the tassel of the parents by image recognition methods. One solution is to manually go to the field to check whether the emasculation is complete, which is inefficient, has poor operating conditions, and is time-consuming, labor-intensive and expensive. For pictures, the machine-recognized pictures are manually confirmed, and the screening of female parent tassel by confirming each picture requires a lot of work, large downloads of pictures, and extremely low efficiency.
基于此,通过本实施例中的目标物检测方法,通过并行自动识别第一特征图片(玉米雄穗),进一步人工并行筛选获得第二特征图片对应的目标特征(母本雄穗)的方法,实现了目标特征(母本雄穗)的快速检测,可应用于去雄现场快速获得结果,进而辅助去雄。Based on this, through the target detection method in this embodiment, the first feature picture (maize tassel) is automatically identified in parallel, and the method for obtaining the target feature (female tassel) corresponding to the second feature picture is further manually filtered in parallel, The rapid detection of the target feature (the female parent tassel) is realized, and it can be applied to the field of emasculation to obtain results quickly, thereby assisting emasculation.
在一些实施例中,第一特征为玉米花苞,第二特征为花苞形状、花苞颜色、叶子颜色中的一种或多种,第一特征图片为花苞图片,第二特征图片为母本花苞图片,通过上述方法,可以快速有效地从玉米图片中检测出母本花苞的图片。In some embodiments, the first feature is a corn bud, the second feature is one or more of bud shape, bud color, and leaf color, the first feature picture is a bud picture, and the second feature picture is a female parent bud picture , through the above method, the picture of the female parent flower bud can be quickly and effectively detected from the corn picture.
在另一实施例中,所述第一特征为电力线异物,所述第二特征为开口销、防震锤、线夹中的一种或多种,所述第一特征图片为异物图片,所述第二特征图片为开口销图片、防震锤图片、或线夹图片。本实施例还可应用于电力巡检领域,通过并行异物检测,进一步级联筛选确定开口销图片、防震锤图片、或线夹图片,实现了快速检测具体异物的目的。In another embodiment, the first feature is a foreign object on a power line, the second feature is one or more of a split pin, an anti-vibration hammer, and a wire clip, the first feature picture is a foreign object picture, and the The second characteristic picture is a picture of a split pin, a picture of a shock-proof hammer, or a picture of a wire clip. This embodiment can also be applied to the field of electric power inspection. Through parallel foreign object detection and further cascading screening to determine a picture of a split pin, a picture of an anti-vibration hammer, or a picture of a wire clip, the purpose of quickly detecting specific foreign objects is achieved.
需要说明的是,目标物图片包括玉米图片、电力线图片,而相对应的第一特征和第二特征随着目标物图片的变化而相应变化,此处不作限制。It should be noted that the target object picture includes a corn picture and a power line picture, and the corresponding first feature and second feature change correspondingly with the change of the target object picture, which is not limited here.
在实际应用的实施例中,对抽样区域中采集到的全部目标物图片进行上传,并行识别出第一特征,将具有该第一特征的第一特征图片进行保存,于检测界面展示,基于操作指令从检测界面筛选确定第二特征图片,并提取第二特征图片,通过并行识别获得第一特征图片,以及并行确认第二特征图片的方式,进一步提高检测效率,弥补了机器视觉检测的不确定性,使得检测准确度能达到99%以上。In the practical application embodiment, upload all the target object pictures collected in the sampling area, identify the first feature in parallel, save the first feature picture with the first feature, and display it on the detection interface, based on the operation The instruction selects the second feature picture from the detection interface, extracts the second feature picture, obtains the first feature picture through parallel recognition, and confirms the second feature picture in parallel, which further improves the detection efficiency and makes up for the uncertainty of machine vision detection. , so that the detection accuracy can reach more than 99%.
在一些实施例中,步骤S102,还包括以下步骤:In some embodiments, step S102 further includes the following steps:
批量上传采集到的所述目标物图片,所述目标物图片通过相同的方法在所述目标区域中采集。The collected pictures of the target objects are uploaded in batches, and the pictures of the target objects are collected in the target area by the same method.
其中,在目标区域为抽样区域,在一片地块中随机抽样获得多个目标区域,采集覆盖该目标区域的几十至上百张目标物图片,以适应地块较大的情况,提高检测效率。或者,目标区域为整个地块,此时需要采集覆盖全部地块的目标 物图片,图片数量较多,会降低检测效率。Among them, the target area is the sampling area, and multiple target areas are randomly sampled in a piece of land, and dozens to hundreds of target object pictures covering the target area are collected to adapt to the large land area and improve the detection efficiency. Or, if the target area is the entire land parcel, at this time, it is necessary to collect the target object pictures covering all the land parcels. The number of pictures is large, which will reduce the detection efficiency.
为了提高后续图像识别的准确率,采集目标物图片的方法相同,一种实施例中,目标物图片为在目标物正上方固定距离处采集,采集图片的姿态的一致性可以保证后续识别图像的一致性。具体的,无人机接收采集指令控制无人机以相同的采集姿态,悬停于每个目标物上方,采集多个目标物图片。需要说明的是,采集到的目标物图片无需坐标信息,也可以实现之后的步骤。在一些实施例中,该采集的目标物图片中具有坐标信息,可以依据此坐标信息对检测出的第二特征图片中的检测结果进行单独处理。In order to improve the accuracy of subsequent image recognition, the method for collecting the image of the target object is the same. In one embodiment, the image of the target object is collected at a fixed distance directly above the target object, and the consistency of the posture of the collected image can ensure the subsequent recognition of the image. consistency. Specifically, the UAV receives the acquisition instruction and controls the UAV to hover over each target in the same acquisition attitude, and collect multiple pictures of the target. It should be noted that the collected image of the target object does not require coordinate information, and the subsequent steps can also be implemented. In some embodiments, the collected image of the target object has coordinate information, and the detection result in the detected second feature image can be separately processed according to the coordinate information.
在采集目标物图片后,批量上传采集到的目标物图片,或者,在采集目标物图片时,实时上传采集到的目标物图片,前者降低对通信的要求,提高检测效率,后者对通信要求较高。一种实施例中,在无人机针对多个目标区域进行采集后,获得多个目标物图片,通过批量上传方式传输至服务器端(可以几十、上百、成千张图一起上传)。After collecting the target object pictures, upload the collected target object pictures in batches, or upload the collected target object pictures in real time when collecting the target object pictures. The former reduces the communication requirements and improves the detection efficiency, while the latter requires communication. higher. In one embodiment, after the drone collects multiple target areas, it obtains multiple target images, and transmits them to the server through batch uploading (tens, hundreds, or thousands of images can be uploaded together).
为了提高检测准确度和检测效率,步骤S104中:通过第一特征模型并行识别多个所述目标物图片中的第一特征,所述第一特征模型是预先经过深度学习历史第一特征图片习得的。In order to improve the detection accuracy and detection efficiency, in step S104: identify the first features in the plurality of target object pictures in parallel by using the first feature model, the first feature model is pre-learned by the deep learning history of the first feature picture Got it.
本实施例通过云计算与AI结合的方法,预选通过深度学习历史第一特征模型,获得第一特征模型,基于第一特征模型高并发处理上传的目标物图片,快速识别第一特征,并标识出第一特征。应用于玉米雄穗检测中,极大地缩短了满天星父母本雄穗识别的时间,实现对满天星去雄效果的实时检测。服务器端可预先通过深度学习历史玉米雄穗图片,获得玉米雄穗模型,基于玉米雄穗模型进而高并发处理所有上传的玉米图片(目标物图片),并行处理每张上传的玉米图片,识别玉米雄穗(第一特征)。需要说明的是,此时的玉米雄穗模型用于识别出玉米雄穗,识别出的玉米雄穗图片中包括父本雄穗图片以及母本雄穗图片(第二特征图片),需要进一步筛选确定以获得母本雄穗图片。In this embodiment, by combining cloud computing and AI, the first feature model is preselected through deep learning history to obtain the first feature model, and based on the first feature model, the uploaded target image is processed with high concurrency, and the first feature is quickly identified and marked. out the first feature. Applied to the detection of maize tassel, the time for identifying the parent tassel of Gypsophila has been greatly shortened, and the real-time detection of the effect of Gypsophila emasculation is realized. The server side can obtain the corn tassel model through deep learning of historical corn tassel pictures in advance, and then process all uploaded corn pictures (target images) in high concurrency based on the corn tassel model, process each uploaded corn picture in parallel, and identify the corn. Tassel (first feature). It should be noted that the corn tassel model at this time is used to identify the corn tassel, and the identified corn tassel picture includes the male parent tassel picture and the female parent tassel picture (second feature picture), which needs to be further screened. OK to get a picture of the female tassel.
可以理解,通过深度学习的方法,并且通过并行处理识别多个目标物图片的方法,一种实施例中,可以同时处理所有的目标物图片,快速确定目标物图片中的第一特征,提高检测效率,并且由于目标物图片的采集方法一致,极大提高了识别特征的准确率,提高检测精度。It can be understood that through the method of deep learning and the method of recognizing multiple target object pictures through parallel processing, in one embodiment, all the target object pictures can be processed at the same time, the first feature in the target object picture can be quickly determined, and the detection rate can be improved. In addition, because the acquisition method of the target image is consistent, the accuracy of the recognition feature is greatly improved, and the detection accuracy is improved.
在步骤S106中,在并行识别了第一特征之后,并行标示第一特征,并且将标示的第一特征图片并行保存为第一特征图片。其中,标示可以通过任意的标识来实现,只要能醒目并且清晰的看到第一特征即可,例如,可以为圆形框、矩形框、多边形框等等。此方法中,通过并行识别、标示、保存的方法,获得多个第一特征图片,提高检测效率。In step S106, after the first features are identified in parallel, the first features are marked in parallel, and the marked first feature pictures are stored in parallel as the first feature pictures. Wherein, the marking can be realized by any marking, as long as the first feature can be seen conspicuously and clearly, for example, it can be a circular frame, a rectangular frame, a polygonal frame and so on. In this method, a plurality of first feature pictures are obtained through the methods of parallel identification, marking and saving, thereby improving the detection efficiency.
一种实施例中,目标物图片是包括玉米雄穗特征的玉米图片,如图3所示,而白色方框标示的为识别的第一特征。其中第一特征图片是从目标物图片中识别到的第一特征的小图,如图4所示,即将图3中每个白色方框区域从大图(目标物图片)中提取出的小图(第一特征图片)。通过保存第一特征图片,便于后续筛选的下载量,提高了检测效率,并且便于进一步从第一特征图片中识别筛选第二特征,避免了直接从目标物图片中筛选第二特征的步骤,大大提高了检测准确率。In one embodiment, the target object picture is a corn picture including corn tassel features, as shown in FIG. 3 , and the white box marks the identified first feature. The first feature picture is a small picture of the first feature identified from the target object picture, as shown in Figure 4, that is, each white box area in Figure 3 is extracted from the large picture (target object picture). Figure (first feature picture). By saving the first feature picture, the download volume of subsequent screening is facilitated, the detection efficiency is improved, and it is convenient to further identify and screen the second feature from the first feature picture, avoiding the step of directly screening the second feature from the target object picture, greatly improving the detection efficiency. Improved detection accuracy.
在一些实施例中,步骤S108,根据图像参数对多个所述第一特征图片进行排序,并按照顺序同时展示于检测界面,其中,图像参数包括RGB参数、HSV参数和图像纹理参数。In some embodiments, in step S108, the plurality of first feature pictures are sorted according to image parameters, and displayed on the detection interface simultaneously in order, wherein the image parameters include RGB parameters, HSV parameters and image texture parameters.
其中,检测界面如图5所示,将保存的第一特征图片在界面上进行排布展示,使得一个页面中可以展示多个第一特征图片。如果第一特征图片的数量较多,超出了界面的范围,或者第一特征图片较小无法准确筛选,或者第一特征图片排布较少时筛选效率低时,可以根据用户输入的操作指令,适应性调整第一特征图片的排布,以便提高筛选体验。例如,在一些实施例中,响应于针对所述第一特征图片的第二操作指令,选择并查看所述第一特征图片所在的目标物图片,即点击小图,也可以查看小图所在的大图,使得难以确认的第一特征图片仍可通过打开其链接的大图的方式以辅助确认。又如,响应于针对所述第一特征图片的第三操作指令,放大或缩小所述第一特征图片,对每个第一特征图片进行进一步确认,进一步的,还可以对所有的第一特征图片进行放大或缩小,以便适应性排布特征图片,根据不用的筛选环境调节第一特征图片至合适的大小,以及调节在检测界面展示的第一特征图片的数量,便于后续操作,提高检测效率。在其他实施例中,还可通过拖动操作,使得超出界面范围的第一特征图片进行展示,保证全部的第一特征图片经过后续筛选。The detection interface is shown in FIG. 5 , and the saved first feature pictures are arranged and displayed on the interface, so that a plurality of first feature pictures can be displayed on one page. If the number of the first feature pictures is too large and exceeds the scope of the interface, or the first feature pictures are too small to be accurately screened, or the screening efficiency is low when the first feature pictures are arranged in a small number, you can, according to the operation instructions input by the user, The arrangement of the first feature pictures is adaptively adjusted to improve the screening experience. For example, in some embodiments, in response to the second operation instruction for the first feature picture, select and view the target object picture where the first feature picture is located, that is, click on the thumbnail image, or view the image where the thumbnail image is located. A large picture, so that the first feature picture that is difficult to confirm can still be confirmed by opening its linked large picture. For another example, in response to the third operation instruction for the first feature picture, the first feature picture is enlarged or reduced, and each first feature picture is further confirmed, and further, all the first feature pictures can be further confirmed. The picture is enlarged or reduced so that the feature pictures can be arranged adaptively, the first feature picture can be adjusted to an appropriate size according to the different screening environment, and the number of the first feature pictures displayed on the detection interface can be adjusted, which is convenient for subsequent operations and improves the detection efficiency. . In other embodiments, a drag operation can also be used to display the first feature pictures beyond the interface range, so as to ensure that all the first feature pictures undergo subsequent screening.
需要说明的是,第一特征图片通过并排排列的方式,展示于检测界面,便于同步检测多个特征图片,如图5所示,其中第一特征图片内容仅仅是示例,实际应用中的第一特征图片各不相同。进一步的,通过多行并排排列的方式,提高第一特征图片的排布的规律性,便于后续筛选时按照规律进行筛选,提高用户体验,进而提高检测效率。在一种实施例中,在检测界面展示所有的第一特征图片,可以同时对所有的第一特征图片进行筛选,更加提高检测效率。It should be noted that the first feature pictures are displayed on the detection interface in a side-by-side arrangement, which is convenient for synchronous detection of multiple feature pictures, as shown in FIG. 5 , the content of the first feature picture is only an example, and the first Feature pictures vary. Further, by arranging multiple rows side by side, the regularity of the arrangement of the first feature pictures is improved, which facilitates the subsequent screening according to the rules, improves the user experience, and further improves the detection efficiency. In one embodiment, all the first feature pictures are displayed on the detection interface, and all the first feature pictures can be screened at the same time, which further improves the detection efficiency.
为了提高特征的检测准确率和检测效率,步骤S110,包括:响应于第一操作指令,通过并行识别的方式确定所述第一特征图片中具有第二特征的第二特征图片,其中,所述操作指令包括以下一种或多种:人工并行选择所述第二特征图片、人工并行删除第二特征图片、人工并行逆选所述第二特征图片。In order to improve the detection accuracy and detection efficiency of the feature, step S110 includes: in response to the first operation instruction, determining a second feature picture with the second feature in the first feature picture by means of parallel identification, wherein the The operation instructions include one or more of the following: manual parallel selection of the second feature picture, manual parallel deletion of the second feature picture, manual parallel inverse selection of the second feature picture.
通过人工筛选的方式,从检测界面直接筛选第二特征图片,可以加大提高检测效率,需要说明的是,该人工筛选的用户了解该目标区域的第二特征图片对应的第二特征,进而通过快速识别第二特征快速确定第二特征图片。在检测界面上展示第一特征图片集合,通过人工筛选的方式并行处理多个第一特征图片,同时筛选出多个第二特征图片,提高检测效率。需要说明的是,本实施例能够通用于高通量的AI及人工辅助识别相结合的特征检测与确认,可以应用于任何需要对AI识别结果进行人工确认微调的场景。By means of manual screening, the second feature picture is directly screened from the detection interface, which can increase the detection efficiency. It should be noted that the manual screening user knows the second feature corresponding to the second feature picture of the target area, and then passes Quickly identify the second feature and quickly determine the second feature picture. The first feature picture set is displayed on the detection interface, and a plurality of first feature pictures are processed in parallel by manual screening, and a plurality of second feature pictures are screened at the same time, so as to improve the detection efficiency. It should be noted that this embodiment can be generally used for feature detection and confirmation in a combination of high-throughput AI and artificially assisted recognition, and can be applied to any scenario that requires manual confirmation and fine-tuning of AI recognition results.
具体的,进入检测界面,如图5所示为局部界面,第一特征图片被规律性的排布于检测界面上,通过人工筛选、分拣的方式直接选择第二特征图片,进一步的还可以删除除第二特征图片以外的图片。在玉米去雄应用中,当玉米雄穗图片规则排布于检测界面时,通过人工筛选雄穗颜色、形状、颜色等,综合考虑确定该玉米雄穗图片中是否为母本雄穗,当确定为母本雄穗,则确定为母本雄穗图片,否则可以进行删除。由于没有固定的母本雄穗,即父母本角色不固定,机器学习的方法无法识别不固定的母本雄穗,而作业人员由于已知父母本雄穗和现场环境,可以很快根据玉米雄穗图片识别出此目标区域/地块中的母本雄穗,进而实现筛选。Specifically, enter the detection interface, as shown in Figure 5 as a partial interface, the first feature pictures are regularly arranged on the detection interface, and the second feature pictures are directly selected by manual screening and sorting. Pictures other than the second feature picture are deleted. In the application of corn tassel, when the corn tassel pictures are regularly arranged on the detection interface, the color, shape, and color of the tassel are manually screened to determine whether the picture of the corn tassel is the female parent tassel. If it is the female parent tassel, it is determined as the female parent tassel picture, otherwise it can be deleted. Since there is no fixed female parent tassel, that is, the role of the parent is not fixed, the machine learning method cannot identify the unfixed female parent tassel, and the operator can quickly identify the maize tassel based on the known parental tassel and the field environment. The ear picture identifies the female parent tassel in this target area/plot, which enables screening.
需要说明的是,第二特征不仅包括第一特征的自身特征,还包括第一特征的环境特征、生长特征等等,可以通过一种第二特征确定第二特征图片,也可以通过多种第二特征融合确定第二特征图片,确定方法不限制,对第二特征也不做限制,只要能通过第二特征确定第二特征图片即可。而第一特征图片至少包括第二特征图片,从第一特征图片中确定第二特征图片,从而确定第二特征图片对应的目标特征,达到从目标物图片中检测目标特征的目的。在玉米去雄领域,从目标物图片(玉米图片)中确定第二特征图片(母本雄穗图片),第二特征图片的目标特征为母本雄穗,其通过第二特征(雄穗颜色、形状、叶子颜色等)而确定。It should be noted that the second feature includes not only the own features of the first feature, but also the environmental features, growth features, etc. of the first feature. The second feature picture is determined by fusion of the two features, and the determination method is not limited, and the second feature is not limited, as long as the second feature picture can be determined by the second feature. The first feature picture includes at least a second feature picture, and the second feature picture is determined from the first feature picture, thereby determining the target feature corresponding to the second feature picture, so as to achieve the purpose of detecting the target feature from the target object picture. In the field of corn tasseling, the second feature picture (the female parent tassel picture) is determined from the target object picture (the corn picture), and the target feature of the second feature picture is the female parent tassel, which is determined by the second feature (tassel color , shape, leaf color, etc.)
本申请实施例可通过排序、筛选、标注、删除功能中的一种或多种的任意组合辅助筛选第二特征图片的步骤,提高第二特征图片的确认效率,提高检测方法的适应性,进而提高用户体验。示例性地,在上述筛选过程中,可以根据作业人员的操作进行批量父本雄穗的删除,也可以进行批量母本雄穗的提取。在无法确定时,可以针对第一特征图片进行单独批注或批量批注的操作。通过颜色等因素进行筛选,可以加快筛选速度,通过在检测界面对第一特征图片进行排序,例如通过颜色排序,配合批量删除和提取,可以进一步提高第二特征图片的检测效率。在删除或提取错误时,还可以恢复前一步操作,以便提高用户体验,避免操作失误。同时,还可以对已经筛选的图片进行逆选,提高筛选的多样化和适用性,便于提高筛选速度。In the embodiment of the present application, the step of screening the second feature picture can be assisted by any combination of one or more of the functions of sorting, screening, labeling, and deletion, so as to improve the confirmation efficiency of the second feature picture, improve the adaptability of the detection method, and further Improve user experience. Exemplarily, in the above screening process, the male parent tassel can be deleted in batches according to the operation of the operator, and the female parent tassel can also be extracted in batches. When it cannot be determined, an operation of individual annotation or batch annotation can be performed for the first feature picture. Screening by factors such as color can speed up the screening. By sorting the first feature pictures on the detection interface, for example, sorting by color, combined with batch deletion and extraction, the detection efficiency of the second feature pictures can be further improved. When deleting or extracting errors, you can also restore the previous operation, so as to improve the user experience and avoid operation mistakes. At the same time, it is also possible to perform inverse selection on the already screened pictures, so as to improve the diversification and applicability of the screening, and facilitate the improvement of the screening speed.
作为一种可选的实施例,为了提高检测的适用性,所述方法还包括以下步骤:As an optional embodiment, in order to improve the applicability of detection, the method further includes the following steps:
基于所述第二特征图片的数量和所述目标区域中目标物数量,获得所述目标区域的所述第二特征图片对应的目标特征去除率。Based on the number of the second feature pictures and the number of objects in the target area, a target feature removal rate corresponding to the second feature picture in the target area is obtained.
这里,可基于本申请实施例实现准确的去除率计算或校验,即通过实时上传的目标物图片,快速确定第二特征图片,实现第二特征图片的检测。进一步,基于采集到的目标物图片中植株的数量,可以确定目标区域、目标区域所属的地块中的目标特征去除率。Here, accurate removal rate calculation or verification can be implemented based on the embodiments of the present application, that is, the second feature picture can be quickly determined through the real-time upload of the target object picture, so as to realize the detection of the second feature picture. Further, based on the number of plants in the collected image of the target object, the target feature removal rate in the target area and the plot to which the target area belongs can be determined.
本实施例中,目标区域的目标物图片不限制数量,可以从个位数、几十、上百、或者上千不等。首先通过深度学习检测算法检测出所有的玉米雄穗,然后将所有玉米雄穗内容保存到新的第一特征图片中,并将所有的第一特征图片展示到检测界面上,通过系统响应作业用户的操作指令,对第一特征图片进行一系列相应处理操作,其中该操作包括排序(例如按RGB/HSV各个颜色通道)、选择,删除、批注、逆选等,实现对目标特征(母本雄穗)的快速提取和非目标特征(父本雄穗)的快速删除,从而达到准确检测母本雄穗的目的。In this embodiment, the number of target object pictures in the target area is not limited, and may range from single digits, dozens, hundreds, or thousands. First, all the corn tassel is detected by the deep learning detection algorithm, then all the corn tassel content is saved in the new first feature picture, and all the first feature pictures are displayed on the detection interface, and the system responds to the job user The first feature image is subjected to a series of corresponding processing operations, wherein the operations include sorting (for example, according to each color channel of RGB/HSV), selection, deletion, annotation, inverse selection, etc. Rapid extraction of non-target features (male parent tassel) and rapid deletion of non-target features (male parent tassel), so as to achieve the purpose of accurate detection of female parent tassel.
另外,由于所有的人工辅助筛选过程都发生在第一特征图片上,使所有目标物图片的确认工作可以同步完成(一个目标物图片可能存在多个第一特征图片),从而实现检测效率的十倍乃至上百倍的提高。In addition, since all the artificially assisted screening process takes place on the first feature picture, the confirmation work of all target object pictures can be completed synchronously (a target object picture may have multiple first feature pictures), thereby achieving ten percent improvement in detection efficiency. times or even hundreds of times.
在一些应用场景中,特别是玉米育种检测雄穗时,对检测时效的要求较高,由于植株处于不断的生长过程中,其检测如果无法及时得出(一般的图像检测需要的时间以天计数),将无法反应现场真实的情况。而本实施例通过实时采集目标物图片,并行识别第一特征得到第一特征图片集合,批量呈现第一特征图片集合避免大量数据下载,同时便于筛选识别第二特征图片,及时得到检测结果,将检测时间节约至分钟级别,大大提高检测效率。本实施例及时获得现场情况的检测结果,可真正应用于种植育种等应用场景中。In some application scenarios, especially when detecting tassel in corn breeding, the requirement for detection time is relatively high. Since the plant is in the process of continuous growth, if the detection cannot be obtained in time (the time required for general image detection is counted in days) ), will not reflect the real situation on site. In this embodiment, the first feature picture set is obtained by collecting the target object pictures in real time, identifying the first feature in parallel, and presenting the first feature picture set in batches to avoid downloading a large amount of data, and at the same time, it is convenient to screen and identify the second feature picture, and the detection result can be obtained in time. The detection time is saved to the minute level, which greatly improves the detection efficiency. This embodiment obtains the detection result of the on-site situation in time, and can be truly applied to application scenarios such as planting and breeding.
本实施例应用于难以通过机器训练方法识别区分出图像精细特征的场合,如杂交育种领域中父母本雄穗识别、玉米花苞识别中母本花苞和父本花苞的识别、大豆杂交育种中父母本的识别,又如无人机巡检领域中,用于从图像中检测螺丝、开口销、线夹等特征部分。This embodiment is applied to the occasions where it is difficult to identify and distinguish the fine features of the image by the machine training method, such as the identification of the parental tassel in the field of cross-breeding, the identification of the female and male buds in the identification of corn buds, the identification of the parental buds in the soybean cross-breeding For example, in the field of drone inspection, it is used to detect characteristic parts such as screws, cotter pins, and wire clips from images.
进一步的,如图6所示,本申请实施例还提供一种目标物的特征检测装置600,包括:Further, as shown in FIG. 6 , an embodiment of the present application further provides a feature detection device 600 of a target object, including:
获取模块601,获得在目标区域中采集的目标物图片;识别模块602,并行处理多个所述目标物图片,识别所述目标物图片中的第一特征;保存模块603, 保存所述目标物图片中识别的所述第一特征为第一特征图片;展示模块604,在检测界面中展示多个所述第一特征图片;筛选模块605,从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片;提取模块606,提取筛选的所述第二特征图片。The acquisition module 601 obtains the target object pictures collected in the target area; the identification module 602 processes a plurality of the target object pictures in parallel to identify the first feature in the target object pictures; the saving module 603 saves the target object The first feature identified in the picture is a first feature picture; the display module 604 displays a plurality of the first feature pictures in the detection interface; the screening module 605 filters the first features from the detection interface in parallel A second feature picture with the second feature in the picture; the extraction module 606 extracts the screened second feature picture.
本申请实施例公开了一种目标物的特征检测方法和装置,对目标区域中采集到的目标物图片进行上传,并行识别第一特征,将具有该第一特征的图片进行保存,于检测界面展示,基于操作指令从检测界面筛选确定第二特征图片,并提取第二特征图片,通过级联识别的方式达到准确检测目标物第二特征图片的目的,极大地提高检测效率。The embodiment of the present application discloses a method and a device for detecting a feature of a target object, uploading a picture of the target object collected in a target area, identifying a first feature in parallel, saving the picture with the first feature, and displaying it on a detection interface. It is shown that the second feature picture is screened and determined from the detection interface based on the operation instruction, and the second feature picture is extracted, and the purpose of accurately detecting the second feature picture of the target object is achieved through cascade recognition, which greatly improves the detection efficiency.
本申请实施例提供的目标物的特征检测装置,与上述实施例提供的目标物的特征检测方法具有相同的技术特征,所以也能解决相同的技术问题,达到相同的技术效果。The target feature detection device provided by the embodiment of the present application has the same technical features as the target feature detection method provided by the above embodiments, so it can also solve the same technical problem and achieve the same technical effect.
本申请实施例所提供的目标物的特征检测方法、装置的计算机程序产品,包括存储了程序代码的计算机可读存储介质,所述程序代码包括的指令可用于执行前面方法实施例中所述的方法,具体实现可参见方法实施例,在此不再赘述。The computer program product of the method and device for detecting the feature of a target provided by the embodiments of the present application includes a computer-readable storage medium storing program codes, and the instructions included in the program codes can be used to execute the methods described in the foregoing method embodiments. For the specific implementation, reference may be made to the method embodiments, which will not be repeated here.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统和装置的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, for the specific working process of the system and device described above, reference may be made to the corresponding process in the foregoing method embodiments, which will not be repeated here.
本申请实施例还提供一种电子设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,处理器执行计算机程序时实现上述实施例提供的目标物的特征检测方法的步骤。Embodiments of the present application further provide an electronic device, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, the method for detecting a feature of a target provided by the foregoing embodiments is implemented. A step of.
本申请实施例还提供一种计算机可读存储介质,计算机可读存储介质上存储有计算机程序,计算机程序被处理器运行时执行上述实施例的目标物的特征检测方法的步骤。Embodiments of the present application further provide a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and when the computer program is run by a processor, the steps of the method for detecting a feature of a target object of the foregoing embodiments are executed.

Claims (10)

  1. 一种目标物的特征检测方法,包括:A feature detection method for a target, comprising:
    获得在目标区域中采集的目标物图片;Obtain the image of the object collected in the target area;
    并行处理多个所述目标物图片,识别所述目标物图片中的第一特征;processing a plurality of the target object pictures in parallel, and identifying the first feature in the target object pictures;
    保存所述目标物图片中识别的所述第一特征为第一特征图片;Save the first feature identified in the target object picture as a first feature picture;
    在检测界面中展示多个所述第一特征图片;displaying a plurality of the first feature pictures in the detection interface;
    从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片;Screen the second feature pictures with the second feature in the first feature pictures in parallel from the detection interface;
    提取筛选的所述第二特征图片。Extracting the filtered second feature picture.
  2. 根据权利要求1所述的目标物的特征检测方法,其中,获得在目标区域中采集的目标物图片的步骤,包括:The feature detection method of the target object according to claim 1, wherein the step of obtaining the target object picture collected in the target area comprises:
    批量上传采集到的所述目标物图片,其中,所述目标物图片通过相同的方法在所述目标区域中采集,所述目标区域为抽样区域。Upload the collected pictures of the target objects in batches, wherein the pictures of the target objects are collected in the target area by the same method, and the target area is a sampling area.
  3. 根据权利要求1所述的目标物的特征检测方法,其中,并行处理多个所述目标物图片,识别所述目标物图片中的第一特征的步骤,包括:The feature detection method of the target object according to claim 1, wherein the step of processing a plurality of the target object pictures in parallel, and recognizing the first feature in the target object pictures, comprises:
    通过第一特征模型并行识别多个所述目标物图片中的第一特征,所述第一特征模型是预先经过深度学习历史第一特征图片习得的。The first features in the plurality of target object pictures are identified in parallel by using a first feature model, and the first feature model is learned in advance through the deep learning history of the first feature pictures.
  4. 根据权利要求1所述的目标物的特征检测方法,其中,从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片的步骤,包括:The feature detection method of the target object according to claim 1, wherein the step of screening the second feature picture with the second feature in the first feature picture from the detection interface in parallel comprises:
    响应于第一操作指令,通过并行识别的方式确定所述第一特征图片中具有第二特征的第二特征图片,其中,所述操作指令包括以下一种或多种:人工并行选择所述第二特征图片、人工并行删除第二特征图片、人工并行逆选所述第二特征图片。In response to the first operation instruction, a second feature picture with the second feature in the first feature picture is determined by means of parallel identification, wherein the operation instruction includes one or more of the following: manually selecting the first feature picture in parallel. Two feature pictures, manual parallel deletion of the second feature picture, manual parallel inverse selection of the second feature picture.
  5. 根据权利要求1所述的目标物的特征检测方法,其中,在检测界面中展示多个所述第一特征图片的步骤,包括:The feature detection method of the target object according to claim 1, wherein the step of displaying a plurality of the first feature pictures in the detection interface comprises:
    根据图像参数对多个所述第一特征图片进行排序,并按照顺序同时展示于检测界面,其中,图像参数包括RGB参数、HSV参数和图像纹理参数。The plurality of first feature pictures are sorted according to image parameters, and displayed simultaneously on the detection interface in order, wherein the image parameters include RGB parameters, HSV parameters and image texture parameters.
  6. 根据权利要求1所述的目标物的特征检测方法,其中,在检测界面中展示多个所述第一特征图片的步骤,包括:The feature detection method of the target object according to claim 1, wherein the step of displaying a plurality of the first feature pictures in the detection interface comprises:
    响应于针对所述第一特征图片的第二操作指令,选择并查看所述第一特征图片所在的目标物图片。In response to the second operation instruction for the first feature picture, the target object picture where the first feature picture is located is selected and viewed.
  7. 根据权利要求1所述的目标物的特征检测方法,其中,在检测界面中展示多个所述第一特征图片的步骤,包括:The feature detection method of the target object according to claim 1, wherein the step of displaying a plurality of the first feature pictures in the detection interface comprises:
    响应于针对所述第一特征图片的第三操作指令,放大或缩小所述第一特征图片。In response to a third operation instruction for the first feature picture, the first feature picture is enlarged or reduced.
  8. 根据权利要求1所述的目标物的特征检测方法,还包括:The feature detection method of the target object according to claim 1, further comprising:
    基于所述第二特征图片的数量和所述目标区域中目标物数量,获得所述目标区域的第二特征去除率。Based on the number of the second feature pictures and the number of objects in the target area, a second feature removal rate of the target area is obtained.
  9. 根据权利要求1所述的目标物的特征检测方法,其中,所述第一特征为玉米雄穗,所述第二特征为雄穗形状、雄穗颜色、叶子颜色中的一种或多种;或者,所述第一特征为电力线异物,所述第二特征为开口销、防震锤、线夹中的一种或多种;或者,所述第一特征为玉米花苞,所述第二特征为花苞形状、花苞颜色、叶子颜色中的一种或多种。The feature detection method of a target object according to claim 1, wherein the first feature is a corn tassel, and the second feature is one or more of a tassel shape, a tassel color, and a leaf color; Alternatively, the first feature is a foreign body on a power line, and the second feature is one or more of cotter pins, anti-vibration hammers, and wire clips; or, the first feature is popcorn buds, and the second feature is One or more of bud shape, bud color, and leaf color.
  10. 一种目标物的特征检测装置,包括:A feature detection device for a target, comprising:
    获取模块,获得在目标区域中采集的目标物图片;The acquisition module obtains the image of the target object collected in the target area;
    识别模块,并行处理多个所述目标物图片,识别所述目标物图片中的第一特征;an identification module, which processes a plurality of the target object pictures in parallel, and identifies the first feature in the target object pictures;
    保存模块,保存所述目标物图片中识别的所述第一特征为第一特征图片;a saving module, saving the first feature identified in the target object picture as a first feature picture;
    展示模块,在检测界面中展示多个所述第一特征图片;a display module, displaying a plurality of the first characteristic pictures in the detection interface;
    筛选模块,从所述检测界面中并行筛选所述第一特征图片中具有第二特征的第二特征图片;A screening module, which screens the second feature picture with the second feature in the first feature picture in parallel from the detection interface;
    提取模块,提取筛选的所述第二特征图片。The extraction module extracts the screened second feature picture.
PCT/CN2020/131746 2020-11-23 2020-11-26 Feature detection method and device for target object WO2022104867A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011325389.9A CN112381028A (en) 2020-11-23 2020-11-23 Target feature detection method and device
CN202011325389.9 2020-11-23

Publications (1)

Publication Number Publication Date
WO2022104867A1 true WO2022104867A1 (en) 2022-05-27

Family

ID=74587778

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/131746 WO2022104867A1 (en) 2020-11-23 2020-11-26 Feature detection method and device for target object

Country Status (2)

Country Link
CN (1) CN112381028A (en)
WO (1) WO2022104867A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116098055A (en) * 2023-04-13 2023-05-12 北京市农林科学院智能装备技术研究中心 Corn emasculation and weak removal robot and method for emasculation and weak removal by using same
CN116098056A (en) * 2023-04-13 2023-05-12 北京市农林科学院智能装备技术研究中心 Corn emasculation inspection robot and emasculation method using same

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324654A (en) * 2012-03-21 2013-09-25 卡西欧计算机株式会社 Image processing device that displays retrieved image similar to target image and image processing method
US20150286908A1 (en) * 2013-01-30 2015-10-08 Fujifilm Corporation Image processing device and method, program, and image forming device
CN109614989A (en) * 2018-11-13 2019-04-12 平安科技(深圳)有限公司 Training method, device, computer equipment and the storage medium of accelerated model
CN111062314A (en) * 2019-12-13 2020-04-24 腾讯科技(深圳)有限公司 Image selection method and device, computer readable storage medium and electronic equipment

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107873510B (en) * 2017-12-14 2022-10-14 河北工业大学 Automatic pollination machine for apple trees based on binocular vision technology
JP7137426B2 (en) * 2018-10-03 2022-09-14 戸田建設株式会社 Harvest prediction system for greenhouse-grown fruits
CN111401442A (en) * 2020-03-16 2020-07-10 中科立业(北京)科技有限公司 Fruit identification method based on deep learning

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103324654A (en) * 2012-03-21 2013-09-25 卡西欧计算机株式会社 Image processing device that displays retrieved image similar to target image and image processing method
US20150286908A1 (en) * 2013-01-30 2015-10-08 Fujifilm Corporation Image processing device and method, program, and image forming device
CN109614989A (en) * 2018-11-13 2019-04-12 平安科技(深圳)有限公司 Training method, device, computer equipment and the storage medium of accelerated model
CN111062314A (en) * 2019-12-13 2020-04-24 腾讯科技(深圳)有限公司 Image selection method and device, computer readable storage medium and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116098055A (en) * 2023-04-13 2023-05-12 北京市农林科学院智能装备技术研究中心 Corn emasculation and weak removal robot and method for emasculation and weak removal by using same
CN116098056A (en) * 2023-04-13 2023-05-12 北京市农林科学院智能装备技术研究中心 Corn emasculation inspection robot and emasculation method using same

Also Published As

Publication number Publication date
CN112381028A (en) 2021-02-19

Similar Documents

Publication Publication Date Title
CN111709489B (en) Citrus identification method based on improved YOLOv4
Fu et al. A novel image processing algorithm to separate linearly clustered kiwifruits
Sun et al. Image processing algorithms for infield single cotton boll counting and yield prediction
CN110796011B (en) Rice ear recognition method, system, device and medium based on deep learning
WO2020007363A1 (en) Method and apparatus for identifying number of targets, and computer-readable storage medium
WO2022104867A1 (en) Feature detection method and device for target object
Rasti et al. A survey of high resolution image processing techniques for cereal crop growth monitoring
CN113657469B (en) Automatic observation method and system for woody plant waiting period based on image recognition
CN112084977B (en) Image and time characteristic fused apple phenological period automatic identification method
CN112836623B (en) Auxiliary method and device for agricultural decision of facility tomatoes
Li et al. An automatic approach for detecting seedlings per hill of machine-transplanted hybrid rice utilizing machine vision
Díaz et al. Grapevine buds detection and localization in 3D space based on structure from motion and 2D image classification
JP4961555B2 (en) Method for locating target part of plant, target part locating device by the method, and working robot using the device
CN114818909A (en) Weed detection method and device based on crop growth characteristics
CN115861686A (en) Litchi key growth period identification and detection method and system based on edge deep learning
Tirkey et al. Performance analysis of AI-based solutions for crop disease identification, detection, and classification
CN117058607A (en) Plant growth state monitoring system based on image visual analysis
Guan et al. A corn canopy organs detection method based on improved DBi-YOLOv8 network
CN112329697B (en) Improved YOLOv 3-based on-tree fruit identification method
James et al. Citdet: A benchmark dataset for citrus fruit detection
CN114663652A (en) Image processing method, image processing apparatus, management system, electronic device, and storage medium
de Ocampo et al. Integrated Weed Estimation and Pest Damage Detection in Solanum melongena Plantation via Aerial Vision-based Proximal Sensing.
Nguyen et al. Ready or Not? A Robot-Assisted Crop Harvest Solution in Smart Agriculture Contexts
WO2022104866A1 (en) Target male parent processing method and target female parent detection method
Yihang et al. Automatic recognition of rape seeding emergence stage based on computer vision technology

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20962158

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20962158

Country of ref document: EP

Kind code of ref document: A1