AU2021368390A1 - Multi-target recognition system and method for follow-up robot based on coded thermal infrared mark - Google Patents

Multi-target recognition system and method for follow-up robot based on coded thermal infrared mark Download PDF

Info

Publication number
AU2021368390A1
AU2021368390A1 AU2021368390A AU2021368390A AU2021368390A1 AU 2021368390 A1 AU2021368390 A1 AU 2021368390A1 AU 2021368390 A AU2021368390 A AU 2021368390A AU 2021368390 A AU2021368390 A AU 2021368390A AU 2021368390 A1 AU2021368390 A1 AU 2021368390A1
Authority
AU
Australia
Prior art keywords
image
thermal radiation
thermal
mark
heating wires
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
AU2021368390A
Other versions
AU2021368390B2 (en
Inventor
Fengying MA
Shang Wang
Yongfei XIAO
Zhiguo Yan
Hui Zhang
Yongguo Zhao
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qilu University of Technology
Original Assignee
Qilu University of Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qilu University of Technology filed Critical Qilu University of Technology
Publication of AU2021368390A1 publication Critical patent/AU2021368390A1/en
Application granted granted Critical
Publication of AU2021368390B2 publication Critical patent/AU2021368390B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes

Abstract

A following robot multi-target identification system and method based on a coded thermal infrared marker. The system comprises: a thermal radiation mark, which is arranged on a target to be identified, wherein a plurality of heating coils are arranged in the thermal radiation mark, and the heating coils are heated according to different coding rules; a thermal infrared image collection module, which is used for collecting a thermal infrared image of said target and transferring the thermal infrared image to a data processing module; and the data processing module, which is used for identifying a thermal radiation marker image from the thermal infrared image, identifying coding information of the thermal radiation marker according to the thermal radiation marker image, and identifying said target by means of the coding information. A thermal radiation mark worn by a target to be identified is identified, and coding information in the thermal radiation mark is extracted, such that the identification of different targets by a following robot is realized according to the coding information.

Description

MULTI-TARGET RECOGNITION SYSTEM AND METHOD FOR FOLLOW-UP ROBOT BASED ON CODED THERMAL INFRARED MARK TECHNICAL FIELD
The present disclosure relates to the technical field of target recognition of robots, in particular to a multi-target recognition system and method for a follow-up robot based on a coded thermal infrared mark.
BACKGROUND
The description in this section merely provides background information related to the present disclosure and does not necessarily constitute the prior art. Target person recognition is the key to realize follow-up walking tasks of robots. However, the existing target person recognition technology is still in the laboratory stage, and cannot meet the application requirements of follow-up walking robots in real circumstances. In addition, when the number of the follow-up robots operated in the same scene increases, the number of targets followed up by the robots will increase correspondingly. However, an existing target recognition method for the follow-up robots is usually applicable for a single target object, and a satisfactory solution is not provided to solve the autonomous recognition problem of the robots when there are multiple target persons at the same time. In order to improve the stability in target person recognition and achieve a multi-target recognition function, a target recognition system and method for a follow-up walking robot based on a thermal radiation mark and thermal infrared image recognition is provided. The target recognition method based on a thermal infrared image overcomes the defect that a traditional color image recognition method is easily affected by the ambient light variation, can meet the application requirements in indoor and outdoor environments and has good environmental adaptability. The inventor finds that the thermal imaging technology also has the defects that the edges of the infrared thermal images are blurred, and the features are difficult to extract; and the infrared thermal images are easily affected by the surface characteristics of objects and external factors such as the radiation wavelength and the like, and the brightness of the images can be affected by the navigator clothing thickness and the direction of movement as well as materials of clothing. Therefore, human detection based on infrared thermal imaging is still a very challenging problem.
SUMMARY
In order to solve the problems, the present disclosure provides a multi-target recognition system and method for a follow-up robot based on a coded thermal infrared mark. A thermal radiation mark worn by a to-be-recognized target is recognized, coded information in the thermal radiation mark is extracted, and the follow-up robot recognizes different targets according to the coded information. To achieve the foregoing objective, the present disclosure uses the following technical solutions: In a first aspect, a multi-target recognition system for a follow-up robot based on a coded thermal infrared mark is provided, the system including: a thermal radiation mark arranged on a to-be-recognized target, where a plurality of heating wires are arranged in the thermal radiation mark, and the heating wires are heated according to different coding rules; a thermal infrared image collecting module used for collecting a thermal infrared image of the to-be-recognized target and transmitting to a data processing module; and the data processing module used for recognizing a thermal radiation mark image from the thermal infrared image, recognizing coded information of the thermal radiation mark according to the thermal radiation mark image and recognizing the to-be-recognized target by means of the coded information. In a second aspect, a multi-target recognition method for the follow-up robot based on the coded thermal infrared mark is provided, the method including: collecting the thermal infrared image of the to-be-recognized target; recognizing the thermal radiation mark image from the thermal infrared image; recognizing the coded information of the thermal radiation mark according to the thermal radiation mark image; and recognizing the to-be-recognized target by means of the coded information. In a third aspect, an electronic device is provided, the electronic device including a memory, a processor and a computer instruction stored in the memory and run on the processor, where when the computer instruction is run by the processor, the steps of the multi-target recognition method for the follow-up robot based on the coded thermal infrared mark are completed. In a fourth aspect, a computer-readable storage medium is provided, the computer-readable storage medium being used for storing the computer instruction, where when the computer instruction is executed by the processor, the steps of the multi-target recognition method for the follow-up robot based on the coded thermal infrared mark are completed. Compared with the prior art, the present disclosure has the beneficial effects: 1. The present disclosure has the multi-target recognition capability by coding the heating wires in the thermal radiation marks, and recognizes the coded information of the thermal radiation marks heated according to the coding rules, so that the follow-up robot recognizes different targets according to the coded information. The advantages of the additional aspects of the present disclosure will be set forth in part in the description below, parts of which will become apparent from the description below, or will be understood by the practice of the present disclosure.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings constituting a part of this application are used for providing further understanding for this application. Exemplary embodiments of this application and descriptions thereof are used for explaining this application and do not constitute any inappropriate limitation to this application. FIG. 1 is a structural diagram of Embodiment 1 of the present disclosure. FIG. 2 is a recognition flow diagram of Embodiment 1 of the present disclosure. FIG. 3 is the coding rule of the thermal radiation mark in Embodiment 1 of the present disclosure. FIG. 4 is the thermal infrared images collected by Embodiment 1 of the present disclosure. FIG. 5 is an image after median filtering is performed on the thermal infrared images by Embodiment 1 of the present disclosure. FIG. 6 is an edge detection image extracted by Embodiment 1 of the present disclosure. FIG. 7 is vertical edge pixel searching rules of Embodiment 1 of the present disclosure. FIG. 8 is an image after the vertical edge of the edge detection image is eliminated by Embodiment 1 of the present disclosure. FIG. 9 is an image after the image in FIG. 8 is expanded for three times by Embodiment
1 of the present disclosure. FIG. 10 is an image after the image in FIG. 9 is corroded for four times by Embodiment 1 of the present disclosure. FIG. 11 is an image, which is determined by Embodiment 1 of the present disclosure, of an area where the thermal radiation mark is located. FIG. 12 is a thermal radiation mark image extracted by Embodiment 1 of the present disclosure. FIG. 13 is a bright and dark stripe image recognized by Embodiment 1 of the present disclosure. FIG. 14 is a code recognition image verified by Embodiment 1 of the present disclosure. where: 1 represents the follow-up robot, 2 represents a thermal infrared camera, and 3 represents the thermal radiation mark.
DETAILED DESCRIPTION
The present disclosure is further described below with reference to the accompanying drawings and embodiments. It should be noted that the following detailed descriptions are all exemplary and are intended to provide a further understanding of this application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by a person of ordinary skill in the art to which this application belongs. It should be noted that terms used herein are only for describing specific implementations and are not intended to limit exemplary implementations according to this application. As used herein, the singular form is intended to include the plural form, unless the context clearly indicates otherwise. In addition, it should further be understood that terms "comprise" and/or "include" used in this specification indicate that there are features, steps, operations, devices, components, and/or combinations thereof. In the present disclosure, orientation or position relationships indicated by the terms such as "upper", "lower", "left", "right" "front", "rear", "vertical", "horizontal", "side", and "bottom" are based on orientation or position relationships shown in the accompanying drawings, and are merely relationship words that are determined for ease of describing the structural relationship between components or elements in the present disclosure, and are not intended to specifically refer to any component or element in the present disclosure. Therefore, such terms should not be construed as a limitation on the present disclosure.
In the present disclosure, terms such as "fixedly connected", "interconnection", and "connection" should be understood in a broad sense. The connection may be a fixing connection, an integral connection or a detachable connection; or the connection may be a direct connection, or an indirect connection by using an intermediary. Relevant scientific research or technical personnel in the art may determine the specific meanings of the foregoing terms in the present disclosure according to specific situations, and such terms should not be construed as a limitation on the present disclosure. Embodiment 1 In this embodiment, in order to achieve the objective that a follow-up robot recognizes multiple targets, a multi-target recognition system for a follow-up robot based on a coded thermal infrared mark is disclosed, the system including: a thermal radiation mark arranged on a to-be-recognized target, where a plurality of heating wires are arranged in the thermal radiation mark, and the heating wires are heated according to different coding rules; a thermal infrared image collecting module used for collecting a thermal infrared image of the to-be-recognized target and transmitting to a data processing module; and the data processing module used for recognizing a thermal radiation mark image from the thermal infrared image, recognizing coded information of the thermal radiation mark according to the thermal radiation mark image and recognizing the to-be-recognized target by means of the coded information. Furthermore, the heating wires in the thermal radiation mark are coded by using a binary rule. Furthermore, the coded information carried by the thermal radiation mark is in one-to-one correspondence to the to-be-recognized target. Furthermore, the heating wires in the thermal radiation mark are arranged in parallel at equal intervals. Furthermore, the specific process that the data processing module recognizes the thermal radiation mark image from the thermal infrared image includes: performing filtering processing on the thermal infrared image; extracting the edges of the heating wires from the thermal infrared image after filtering processing so as to obtain an edge detection image; and eliminating the vertical edge and divergent edge of the edge detection image, and extracting the thermal radiation mark image from the edge detection image according to the largest area where the thermal radiation mark is located.
Furthermore, the specific process that the data processing module recognizes the coded information of the thermal radiation mark according to the thermal radiation mark image includes: recognizing the image of the heated heating wires and the image of the non-heated heating wires in the thermal radiation mark image according to pixel gray values, and determining the coded information of the thermal radiation mark according to height information of the image of the heated heating wires and the image of the non-heated heating wires in a vertical direction. Furthermore, the data processing module judges whether the image of the heated heating wires and the image of the non-heated heating wires in the thermal radiation mark image satisfy the morphological constraint, and determines the coded information of the thermal radiation mark according to the height information of the image of the heated heating wires and the image of the non-heated heating wires in the vertical direction if the image of the heated heating wires and the image of the non-heated heating wires in the thermal radiation mark image satisfy the morphological constraint. The multi-target recognition system for the follow-up robot based on the coded thermal infrared mark is described detailedly with reference to FIG. 1 to FIG. 14. As shown in FIG. 1, the multi-target recognition system for the follow-up robot based on the coded thermal infrared mark includes a thermal radiation mark 1 worn by a to-be-recognized target, where a plurality of parallel carbon fiber heating wires are arranged in the thermal radiation mark, the carbon fiber heating wires are heated according to different coding rules, so that gray images with obvious feature differences can be obtained by the thermal infrared camera, and thus, the independent coded information carried by different thermal radiation marks is extracted in an image processing manner so as to recognize different targets. The heating wires in the thermal radiation mark are coded by using the binary rule. As shown in FIG. 3, the coding rule is described by taking the thermal radiation mark containing five heating wires as an example, the uppermost heating wire and the lowest heating wire as boundary determination marks of the thermal radiation mark are always heated, the internal three heating wires are heated by using the binary coding rule, eight combinations from 0 to 7 are provided, i.e., all the heating wires are not heated if the number is 0, only the lowest heating wire is heated if the number is 1, only the middle heating wire is heated if the number is 2, ... , and all the three heating wires are heated if the number is 7. The multi-feature differentiation of the same thermal radiation mark can be achieved by using the method.
Therefore, the recognition requirements of the robot in the presence of multiple target persons can be met. FIG. 3 shows the thermal infrared images, which are obtained by the thermal infrared camera and have the corresponding numbers of 0, 2, 5 and 7, of the to-be-recognized target when the thermal radiation mark formed by five heating wires uses the coding rule. It can be seen from FIG. 3 that the heated heating wires are clearly distinguished from the surrounding environment, and the feasibility of the recognition solution is proved. Although human eyes can easily recognize the positions of barcode areas in the images, the features of the images need to be analyzed step by step by using a digital image processing technique if the robot needs to achieve the recognition function. Thus, the thermal infrared images are recognized by the data processing module of the follow-up robot 3. The specific principle of the data processing module for recognizing the thermal infrared images is described below only by taking the recognition process of the thermal infrared image of the to-be-recognized target when the number is 7 as an example. The first step: performing image filtering. Generally, the actually obtained image is inevitably interfered by external noise and internal noise in the processes of forming, transmission, receiving and treatment, thus, the quality of the image is affected, the image is blurred, the features are submerged, and the analysis is difficult. It is very important to remove noise from the image polluted by noise and recover the image during image preprocessing. Here, median filtering is mainly used to remove impulse noise brought by an optical acquisition system from the barcode image. When strong impulse noise interference exists in the image, the gray values corresponding to these interference points greatly differ from that of adjacent pixels. Therefore, by using the method of sorting to remove median, the gray values of these interference points become similar to that of some adjacent pixels so as to achieve the effect of removing noise. Median filtering is a nonlinear smoothing method for reducing edge blur. Its basic idea is
as follows: a one-dimensional sequence 'f 2 3''flf is set, the window length is set to m, median filtering is performed on the one-dimensional sequence, i.e., m numbers
f-',-f-1 ,fiX 1 -,f+v are sequentially extracted from the sequence as center point values of a window, then the m numbers are sorted according to the value size, the number in the middle is taken as the filtering output, i.e.:
y, = median{t f_- - - f_, fl , f---, f} where EZ,v=(m-1)/2
The effect of median filtering depends on two factors: the spatial range of a neighborhood and the number of pixels involved in median calculation. Median filtering can suppress random noise without blurring edges. Median filtering is performed on the original image with noise by using a 3*3 template, and the obtained processed result is shown in FIG. 5. The second step: performing edge detection. For the heated thermal radiation mark image, the gradient on edge points of the heating wire is consistent, the color reflectivity on both sides of the edge of the heating wire has great difference, and the edge is relatively dense. The described features can be processed by extracting pixels with obvious features and large amount of information in the thermal infrared image after filtering processing in the edge detection manner, thereby reducing the amount of calculation and improving the algorithm efficiency. Common edge detection algorithms include classical edge detection operators such as a Prewitts operator, a Roberts operator, a Soble operator, a Canny operator, etc. The heating wire is basically horizontal when moving with a human body. Therefore, the Prewitts operator is more favorable for edge extraction of the thermal radiation mark. The Prewitt operator is a differential operator for image edge detection. Its principle is to realize edge detection by using the difference generated by the gray values of pixels in a specific area. The Prewitt operator uses the 3*3 template to calculate the pixel values in the area. Therefore, the edge detection results are more obvious in horizontal and vertical directions. The Prewitt operator is suitable for recognizing the image with more noise and gray gradient. FIG. 6 is the edge detection image after edge detection is performed by using the Prewitt operator. The third step: eliminating the vertical edge. The original edge information of the above edge detection image includes more edge data unrelated to the thermal radiation mark, such as body edge information of the target person and edge information of other objects. These edges may introduce unnecessary interference information to subsequent processing. Therefore, a certain filtering operation needs to be used to eliminate excessive edge data. It can be seen from FIG. 6 that the edge of the heating wire is approximately horizontal, therefore, the obvious vertical edge is deleted by using the following rules, 1 is set as an edge
pixel, 0 is set as a background pixel, and if the pixel P(iA satisfies the following formula, the pixel is considered as a vertical edge point:
P(i-1, j-1) & (P(i-2, j-2) = 1 I P(i-2, j-1) = 1 P(i-2, j) =1) or P(i-1, j) & (P(i-2,j-1)= 1I P(i-2, j) = l I P(i-2, j+1) =1) or P(i-,j+) &(P(i-2, jl)= l I P(i-2, j+1)= l I P(i-2, j+2) =1) or P(i+l,j-1) & (P(i+2,j-2)= 1I P(i+2,j-1) = 1 P(i+2,j) =1) or P(i+l,j) & (P(i+2,j-1) = 1I P(i+2,j) = 1 I P(i+2,j+1) =1) or P(i+1,j+1) & (P(i+2,j)= 1I P(i+2,j+1) = 1 P(i+2,j+2) =1) The image description of the formula is shown in FIG. 7. The result after the above method is used is shown in FIG. 8. Compared with FIG. 7, it can be seen that the vertical edge information can be effectively eliminated by using the algorithm. The fourth step: eliminating the discrete edge. The upper and lower edges of a single heating wire are close to each other in thermal imaging, and the edges of other objects are relatively dispersed. Therefore, the edges of the heating wire will fuse to form an area with a larger connected area after expansion calculation is used, and the pixels after the edges of other objects are expanded will not overlap and thus do not form a connected area. Thus, the discrete edge is eliminated by expanding the image in FIG. 8 for n times and then corroding the image for n+1 times. FIG. 9 shows the result after the image is expanded for three times. FIG. 10 shows the result after the image is corroded for four times. The fifth step: extracting the thermal radiation mark image The image shown in FIG. 10 has multiple connected areas of different sizes, and the area where the thermal radiation mark is located is the largest. Therefore, the connection of the image pixels can be analyzed, and the area with the largest connected area in the image is extracted, which is the area where the thermal radiation mark is located. The result is shown in FIG. 11. The connected area shown in FIG. 11 is the result after the edge image is expanded for three times and then is corroded for four times. Therefore, the edge area of the thermal radiation mark is formed after expanding for one time again on the basis of FIG. 11, thereby obtaining the thermal radiation mark image shown in FIG. 12. The sixth step: recognizing bright and dark stripes. The average gray value of pixels in the thermal radiation mark area in the thermal radiation mark image is calculated. Then, the pixel with the gray value higher than the average value is considered as a heated heating wire image, and the remaining pixels are considered as non-heated heating wire and background images. The processing result is shown in FIG. 13. Bright stripes refer to the heated heating wire image, and dark stripes refer to the non-heated heating wire image. The seventh step: verifying the thermal radiation mark image. According to a column image where the center pixel in the thermal radiation mark area is located, the number L(LI,L 2 ,---,L) of pixels in each bright stripe and the corresponding number D(D, D2,---,D.) of pixels in each dark stripe in the vertical direction are counted in sequence from top to bottom, and the average value A of the numbers of the pixels in the bright stripes and the pixel sum T of all the stripes are calculated.
A= Lk/H k=1
T= L + L m=1 n=1
The five heating wires are arranged in parallel at equal intervals. Therefore, in the vertical direction, the average value of pixel heights occupied by the bright stripes is proportional to the pixel height of the whole thermal radiation mark, so that it is considered that the above stripe information satisfies the morphological constraint of thermal radiation mark when the following formula is satisfied. 6*A ! T ! 14*A The eighth step: performing code recognition. For the thermal radiation mark image that satisfies the morphological constraint as
shown in FIG. 14, the coded information Num of the current thermal radiation mark is obtained according to the height information of the bright and dark stripes in the vertical direction by using the following formula. if i = 2 = Num =0 if L2 >3.5*A= Num=1 if i=3elseif L 2 >2.5*A= Num=2 if L4 >3.5*A= Num=4 if L 2 >2.5*A= Num=3 if i = 4 if L6 > 2.5*A = Num = 6 if L 4 >2.5*A= Num=5 if i = 5 = Num =7
The complete recognition steps are shown in FIG. 2. The data processing module recognizes the to-be-recognized target by means of the coded information. According to the embodiment, in order to solve the inherent problems that the edges of the infrared thermal images are blurred, the features are difficult to extract, the infrared thermal images are easily affected by the surface characteristics of objects and external factors such as the radiation wavelength and the like, and the brightness of the images can be affected by the navigator clothing thickness and the direction of movement as well as materials of clothing in the target recognition field based on the thermal infrared images, the present disclosure provides the multi-target recognition system for the follow-up robot based on the coded thermal infrared mark. The thermal infrared images recognized by the system have the characteristics of clear structures, obvious features, easiness in distinguishing and the like so as to be accurately distinguished from the background. The heating wires in the thermal radiation mark are coded in a binary form, thereby having the multi-target recognition capability. According to the system, by implementing the steps of performing image filtering, performing edge detection, eliminating the vertical edge, eliminating the discrete edge, extracting the thermal radiation mark image, recognizing bright and dark stripes, determining whether the morphological constraint is satisfied, verifying the thermal radiation mark image and performing code recognition on the infrared image of the thermal radiation mark heated according to the coding rule, the thermal radiation mark can be accurately recognized, and the coded information can be extracted, so that the robot can recognize the target. Embodiment 2 In this embodiment, a multi-target recognition method for a follow-up robot based on a coded thermal infrared mark is disclosed, the method including: collecting a thermal infrared image of a to-be-recognized target; recognizing a thermal radiation mark image from the thermal infrared image; recognizing coded information of the thermal radiation mark according to the thermal radiation mark image; and recognizing the to-be-recognized target by means of the coded information. Furthermore, the specific process of recognizing the thermal radiation mark image from the thermal infrared image includes: performing filtering processing on the thermal infrared image; performing heating wire edge detection on the thermal infrared image after filtering processing so as to obtain an edge detection image; and eliminating the vertical edge and divergent edge of the image after edge detection, and extracting the thermal radiation mark image from the image after edge detection according to the largest area where the thermal radiation mark is located. Furthermore, the specific process of recognizing the coded information of the thermal radiation mark according to the thermal radiation mark image includes: recognizing the curve of the heated heating wires and the curve of the non-heated heating wires in the thermal radiation mark image according to pixel gray values, and determining the coded information of the thermal radiation mark according to height information of the curve of the heated heating wires and the curve of the non-heated heating wires in a vertical direction. Embodiment 3 In this embodiment, an electronic device is disclosed, the electronic device including a memory, a processor and a computer instruction stored in the memory and run on the processor, where when the computer instruction is run by the processor, the steps of the multi-target recognition method for the follow-up robot based on the coded thermal infrared mark in Embodiment 2 are completed. Embodiment 4 In this embodiment, a computer-readable storage medium is disclosed, the computer-readable storage medium being used for storing the computer instruction, where when the computer instruction is executed by the processor, the steps of the multi-target recognition method for the follow-up robot based on the coded thermal infrared mark in Embodiment 2 are completed. The above descriptions are merely preferred embodiments of this application and are not intended to limit this application. For a person skilled in the art, this application may have various modifications and changes. Any modification, equivalent replacement, or improvement made without departing from the spirit and principle of this application shall fall within the protection scope of this application. A person skilled in the art can understand that the embodiments of this application may be provided as a method, a system, or a computer program product. Therefore, this application may use a form of hardware-only embodiments, software-only embodiments, or embodiments combining software and hardware. Moreover, this application may use a form of a computer program product that is implemented on one or more computer-usable storage media (including but not limited to a disk memory, a CD-ROM, an optical memory, and the like) that include computer-usable program code. This application is described with reference to flowcharts and/or block diagrams of the method, the device (system), and the computer program product according to the embodiments of this application. It should be understood that computer program instructions can implement each procedure and/or block in the flowcharts and/or block diagrams and a combination of procedures and/or blocks in the flowcharts and/or block diagrams. These computer program instructions may be provided to a general-purpose computer, a special-purpose computer, an embedded processor, or a processor of another programmable data processing device to generate a machine, so that an apparatus configured to implement functions specified in one or more procedures in the flowcharts and/or one or more blocks in the block diagrams is generated by using instructions executed by the computer or the processor of another programmable data processing device. These computer program instructions may alternatively be stored in a computer-readable memory that can instruct a computer or another programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory generate an artifact that includes an instruction apparatus. The instruction apparatus implements a specific function in one or more procedures in the flowcharts and/or in one or more blocks in the block diagrams. These computer program instructions may further be loaded onto a computer or another programmable data processing device, so that a series of operations and steps are performed on the computer or the another programmable device, thereby generating computer-implemented processing. Therefore, the instructions executed on the computer or the another programmable device provide steps for implementing a specific function in one or more processes in the flowcharts and/or in one or more blocks in the block diagrams. Finally, it should be noted that: The foregoing embodiments are merely used for describing the technical solution of the present disclosure, but are not intended to limit the present disclosure. Although the present disclosure is described in detail with reference to the foregoing embodiments, it should be appreciated by a person ordinarily skilled in the art that: modifications or equivalent replacements can still be made to the detailed description of the present disclosure, and any modification or equivalent replacement without departing from the spirit and scope of the present disclosure shall fall within the protection scope of claims of the present disclosure.

Claims (10)

CLAIMS What is claimed is:
1. A multi-target recognition system for a follow-up robot based on a coded thermal infrared mark, comprising: a thermal radiation mark arranged on a to-be-recognized target, a plurality of heating wires arranged in the thermal radiation mark, and the heating wires heated according to different coding rules; a thermal infrared image collecting module used for collecting a thermal infrared image of the to-be-recognized target and transmitting to a data processing module; and the data processing module used for recognizing a thermal radiation mark image from the thermal infrared image, recognizing coded information of the thermal radiation mark according to the thermal radiation mark image, and recognizing the to-be-recognized target by means of the coded information.
2. The multi-target recognition system for the follow-up robot based on the coded thermal infrared mark according to claim 1, wherein the heating wires in the thermal radiation mark are coded by using a binary rule.
3. The multi-target recognition system for the follow-up robot based on the coded thermal infrared mark according to claim 1, wherein the heating wires in the thermal radiation mark are arranged in parallel at equal intervals.
4. The multi-target recognition system for the follow-up robot based on the coded thermal infrared mark according to claim 1, wherein the specific process that the data processing module recognizes the thermal radiation mark image from the thermal infrared image comprises: performing filtering processing on the thermal infrared image; extracting the edges of the heating wires from the thermal infrared image after filtering processing so as to obtain an edge detection image; and eliminating the vertical edge and divergent edge of the edge detection image, and extracting the thermal radiation mark image from the edge detection image according to the largest area where the thermal radiation mark is located.
5. The multi-target recognition system for the follow-up robot based on the coded thermal infrared mark according to claim 1, wherein the specific process that the data processing module recognizes the coded information of the thermal radiation mark according to the thermal radiation mark image comprises: recognizing the image of the heated heating wires and the image of the non-heated heating wires in the thermal radiation mark image according to pixel gray values, and determining the coded information of the thermal radiation mark according to height information of the image of the heated heating wires and the image of the non-heated heating wires in a vertical direction.
6. The multi-target recognition system for the follow-up robot based on the coded thermal infrared mark according to claim 5, wherein the data processing module judges whether the image of the heated heating wires and the image of the non-heated heating wires in the thermal radiation mark image satisfy the morphological constraint, and determines the coded information of the thermal radiation mark according to the height information of the image of the heated heating wires and the image of the non-heated heating wires in the vertical direction if the image of the heated heating wires and the image of the non-heated heating wires in the thermal radiation mark image satisfy the morphological constraint.
7. A multi-target recognition method for the follow-up robot based on the coded thermal infrared mark, wherein the method comprises: collecting a thermal infrared image of a to-be-recognized target; recognizing a thermal radiation mark image from the thermal infrared image; recognizing coded information of the thermal radiation mark according to the thermal radiation mark image; and recognizing the to-be-recognized target by means of the coded information.
8. The multi-target recognition method for the follow-up robot based on the coded thermal infrared mark according to claim 7, wherein the specific process of recognizing the coded information of the thermal radiation mark according to the thermal radiation mark image comprises: recognizing the curve of the heated heating wires and the curve of the non-heated heating wires in the thermal radiation mark image according to pixel gray values, and determining the coded information of the thermal radiation mark according to height information of the curve of the heated heating wires and the curve of the non-heated heating wires in a vertical direction.
9. An electronic device, comprising a memory, a processor and a computer instruction stored in the memory and run on the processor, wherein when the computer instruction is run by the processor, the steps of the multi-target recognition method for the follow-up robot based on the coded thermal infrared mark according to any one of claims 7-8 are completed.
10. A computer-readable storage medium, wherein the computer-readable storage medium is used for storing the computer instruction, and when the computer instruction is executed by the processor, the steps of the multi-target recognition method for the follow-up robot based on the coded thermal infrared mark according to any one of claims 7-8 are completed.
AU2021368390A 2020-10-29 2021-02-02 Multi-target recognition system and method for follow-up robot based on coded thermal infrared mark Active AU2021368390B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN202011181170.6 2020-10-29
CN202011181170.6A CN112287831B (en) 2020-10-29 2020-10-29 Following robot multi-target identification system and method based on coded thermal infrared mark
PCT/CN2021/074877 WO2022088544A1 (en) 2020-10-29 2021-02-02 Following robot multi-target identification system and method based on coded thermal infrared marker

Publications (2)

Publication Number Publication Date
AU2021368390A1 true AU2021368390A1 (en) 2023-06-22
AU2021368390B2 AU2021368390B2 (en) 2024-03-28

Family

ID=74352388

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2021368390A Active AU2021368390B2 (en) 2020-10-29 2021-02-02 Multi-target recognition system and method for follow-up robot based on coded thermal infrared mark

Country Status (3)

Country Link
CN (1) CN112287831B (en)
AU (1) AU2021368390B2 (en)
WO (1) WO2022088544A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112287831B (en) * 2020-10-29 2022-11-04 齐鲁工业大学 Following robot multi-target identification system and method based on coded thermal infrared mark

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN208402864U (en) * 2018-06-25 2019-01-22 龙勇 Unmanned plane warm-blooded animal based on thermal imaging monitors system
CN110320523B (en) * 2019-07-05 2020-12-11 齐鲁工业大学 Target positioning device and method for following robot
CN110298334B (en) * 2019-07-05 2021-03-30 齐鲁工业大学 Tracking robot multi-target recognition device based on thermal infrared image processing
CN110834132B (en) * 2019-11-28 2021-07-09 西南交通大学 Method for manufacturing aluminum alloy flange arc fuse wire additive on bottom of ellipsoidal box
CN111354011A (en) * 2020-05-25 2020-06-30 江苏华丽智能科技股份有限公司 Multi-moving-target information capturing and tracking system and method
CN112287831B (en) * 2020-10-29 2022-11-04 齐鲁工业大学 Following robot multi-target identification system and method based on coded thermal infrared mark

Also Published As

Publication number Publication date
CN112287831A (en) 2021-01-29
CN112287831B (en) 2022-11-04
AU2021368390B2 (en) 2024-03-28
WO2022088544A1 (en) 2022-05-05

Similar Documents

Publication Publication Date Title
CN110349207B (en) Visual positioning method in complex environment
US8848978B2 (en) Fast obstacle detection
CN112712512A (en) Hot-rolled strip steel scab defect detection method and system based on artificial intelligence
CN110084243B (en) File identification and positioning method based on two-dimensional code and monocular camera
CN110097596B (en) Object detection system based on opencv
Teknomo et al. Tracking system to automate data collection of microscopic pedestrian traffic flow
CN111046880A (en) Infrared target image segmentation method and system, electronic device and storage medium
CN110473221B (en) Automatic target object scanning system and method
CN109166125A (en) A kind of three dimensional depth image partitioning algorithm based on multiple edge syncretizing mechanism
CN109559324A (en) A kind of objective contour detection method in linear array images
CN109684941B (en) Litchi fruit picking area division method based on MATLAB image processing
Wang et al. Edge extraction by merging 3D point cloud and 2D image data
Li et al. Road markings extraction based on threshold segmentation
CN108734172A (en) Target identification method, system based on linear edge feature
CN108182704A (en) Localization method based on Shape context feature
CN108109154A (en) A kind of new positioning of workpiece and data capture method
AU2021368390B2 (en) Multi-target recognition system and method for follow-up robot based on coded thermal infrared mark
Gal Automatic obstacle detection for USV’s navigation using vision sensors
RU2510897C2 (en) Method for segmentation of complex-structure half-tone images based on composite morphologic operators
Gupta et al. Robust lane detection using multiple features
CN116188763A (en) Method for measuring carton identification positioning and placement angle based on YOLOv5
CN115661110A (en) Method for identifying and positioning transparent workpiece
JP2021163502A (en) Three-dimensional pose estimation by multiple two-dimensional cameras
Antunes et al. All-in-focus imaging using a series of images on different focal planes
CN110717500A (en) Two-dimensional bar code initial positioning method

Legal Events

Date Code Title Description
DA3 Amendments made section 104

Free format text: THE NATURE OF THE AMENDMENT IS: AMEND THE INVENTION TITLE TO READ MULTI-TARGET RECOGNITION SYSTEM AND METHOD FOR FOLLOW-UP ROBOT BASED ON CODED THERMAL INFRARED MARK