CN105608444A - Wild animal image identification method used for automatic driving - Google Patents

Wild animal image identification method used for automatic driving Download PDF

Info

Publication number
CN105608444A
CN105608444A CN201610055926.XA CN201610055926A CN105608444A CN 105608444 A CN105608444 A CN 105608444A CN 201610055926 A CN201610055926 A CN 201610055926A CN 105608444 A CN105608444 A CN 105608444A
Authority
CN
China
Prior art keywords
image
wild animal
sample
matrix
distance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610055926.XA
Other languages
Chinese (zh)
Other versions
CN105608444B (en
Inventor
田雨农
范玉涛
周秀田
于维双
陆振波
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dalian Roiland Technology Co Ltd
Original Assignee
Dalian Roiland Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dalian Roiland Technology Co Ltd filed Critical Dalian Roiland Technology Co Ltd
Priority to CN201610055926.XA priority Critical patent/CN105608444B/en
Publication of CN105608444A publication Critical patent/CN105608444A/en
Application granted granted Critical
Publication of CN105608444B publication Critical patent/CN105608444B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • G06F18/232Non-hierarchical techniques
    • G06F18/2321Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/56Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G06V20/58Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

The invention relates to a wild animal image identification method used for automatic driving. The method comprises the following steps: performing manifold learning on an acquired image by use of an LLE algorithm to obtain an image feature; training a nerve network through the image feature; and substituting an image acquired in real time into the nerve network for identification, obtaining a wild animal type label, and notifying a driver of a wild animal type corresponding to the label. According to the invention, a manifold learning idea is integrated into the method, and through obtaining low-dimensional expression of data, the original feature of the data can be better represented. Hidden layer nodes of the nerve network are solved by use of a K-means algorithm, due to a set c-type initial center, the iteration frequency of a K-means algorithm is substantially reduced, the time consumption of the algorithm is reduced, and the operation speed is fast.

Description

A kind of wild animal image-recognizing method for automatic Pilot
Technical field
The present invention relates to wild animal image-recognizing method, is a kind of wild moving for automatic Pilot specificallyObject image recognition methods.
Background technology
Along with the high speed development of human civilization, the coverage of mankind's activity is also accelerating expansion, along with highwayConstantly build, increasing highway has been built in the scope of activities of wild animal, many wild animalsBe faced with survival pressure be exactly and the mankind fight for living space, in our life, often can see this typeConflict. On Mou Tiao highway, the unexpected jaywalk of wild animal, the driver of automobile is expert at and crossesIn journey, do not expect, cause unnecessary injury. All a kind of loss for the mankind and the earth.
Along with automotive performance promotes, automobile has made the mankind's scope of activities more next as a kind of instrument of riding instead of walkMore next, even threatened the daily life of animals, and the high speed of automobile is for animal and Yan ShixiangWhen danger, animal cannot effectively be hidden the automobile of telling highway, how to driver's road that steps up vigilanceThe appearance of upper wild animal is a problem always.
Existing technology mostly, for pedestrian's detection, does not also have at present for the detection of wild animal, and movesThing and people's difference is the diversity of animal, and manifold learning arithmetic is seldom made the extraction effect of featureUse image processing techniques.
Summary of the invention
For above-mentioned technical deficiency, object of the present invention provides a kind of wild animal image for automatic PilotRecognition methods.
The technical solution adopted for the present invention to solve the technical problems is: a kind of wild moving for automatic PilotObject image recognition methods, comprises the following steps:
Adopt LLE algorithm to carry out manifold learning to gathering image, obtain characteristics of image;
By characteristics of image, neutral net is trained;
The image substitution neutral net of Real-time Collection is identified, obtained wild animal kind label, and willThe wild animal kind driver that this label is corresponding.
Described employing LLE algorithm carries out manifold learning to collection image and comprises the following steps:
The figure using image as sample architecture k-neighbour, and calculate similarity between any two images as closelySeemingly geodesic curve distance:
min(dG(i,j),dG(i,k)+dG(k,j))
Wherein, dGFor k-neighbour schemes the Euclidean distance between upper any two images, image index i, j,K is 1,2 ..., N, wherein N is image number;
Structural matrix M=(I-W)T(I-W), wherein I is N × N unit matrix, and W is the nearly k-of N × NAdjacent figure matrix, k-neighbour schemes the approximate geodesic curve distance matrix between upper any two images;
Metzler matrix is carried out to feature decomposition, and X gets front m the characteristic vector of M as the result of feature extraction,Be characteristics of image X1 ... Xm.
Describedly by characteristics of image, neutral net is trained and is comprised the following steps:
Using characteristics of image as input, type of vehicle label is output, and hidden node is that K-means algorithm is poly-The center that class obtains;
Neutral net is trained to the weight that obtains the each node output of hidden layer.
Described K-means algorithm comprises the following steps:
1) select the initial center of c class: c is number of samples some/mono-, first sample is for severalJu Ji center, c sample is front c-1 the data point of distance point farthest in all data points; WhereinData set is X, and data point represents certain characteristics of image;
2) to any one sample, ask its distance that arrives c center, this sample is grouped into apart from the shortestThe class at heart place;
3) point in each class is averaged as such cluster centre; Return to step 2), until work asBefore till the cluster centre of all classes and the last iteration difference that obtains the cluster centre of all classes is less than threshold value.
The described image substitution neutral net by Real-time Collection is identified and is comprised the following steps:
Adopt LLE algorithm to carry out manifold learning to gathering image the image of Real-time Collection, obtain characteristics of image;
By characteristics of image and weight substitution neutral net, obtain wild animal kind label:
YNFor type of vehicle label, W is weight, DNFor the distance matrix of current sample and each cluster centre, DFor the distance matrix between all cluster centres, p is hidden node number.
The present invention has following beneficial effect and advantage:
1. the present invention, by the thought of manifold learning, obtains the expression of image in low-dimensional, thus more effective generationThe feature of table original sample, for follow-up study and training provide the obvious characteristic of sample.
2. the present invention has incorporated the thought of manifold learning, express by the low-dimensional of obtaining data, thereby betterThe feature that representative data is original.
3. the present invention adopts K-means algorithm to ask for the hidden node of neutral net, and due to the c class of settingInitial center, the iterations of K-means algorithm is significantly reduced, reduce algorithm time loss, computing speedDegree is fast.
Brief description of the drawings
Fig. 1 is method flow diagram of the present invention;
Fig. 2 is neutral net schematic diagram of the present invention.
Detailed description of the invention
Below in conjunction with embodiment, the present invention is described in further detail.
Along with the rise of manifold learning, high dimensional data can better be expressed higher-dimension the potential stream shape of low-dimensionalFeature, the dimension that can find out image pattern of the pixel of image, can pass through manifold learning like thisAlgorithm realize the extraction of animal painting feature.
The low-dimensional that the present invention obtains various wild animal images by manifold learning LLE algorithm is expressed, as studyThe feature of machine is learnt learning machine, and object of the present invention makes running car arrive a certain region, intelligent vehicleLoading system can identify the wild animal that lives in this region appearing on front side road automatically, fromAnd dodge to driver with enough attentions, concrete step is as follows.
As shown in Figure 1, concrete step is as follows:
For all known type wild animals (the wild animal kind of zones of different is different, forThe wild animal kind that different region is detected is also different) feature extraction of image set, by all kind open countryLively thing is that main wild animal picture carries out feature extraction, is cut into the picture of fixed size, does with imageFor sample architecture k-neighbour figure, calculate the similarity matrix of any two pictures by calculating Euclidean distance:
Picture is lined up to vector according to row, and the distance between two vectors is constructed as the similarity of imageNeighbour figure, in the present invention, neighbour's number is total sample number 5%, for each sample its apart from minimumFront k is the neighbour of this sample. The front k width of every width picture and this picture are linked to be to a limit structure neighbour figure,Wherein in neighbour figure, there is the limit W on limitijValue is 1, and what all the other were boundless is 0, calculates institute's being similar between a little the shortestGeodesic curve distance:
min(dG(i,j),dG(i,k)+dG(k,j))
dGFor the Euclidean distance between any two images, i, j, k=1,2 ..., N, wherein N is that image is openedNumber; According to the distance between the shortest calculating of the distance between a figure mid point point, finally obtain the D of sample data collectionDistance matrix, wherein i, j=1,2 ..., N, wherein N is number of samples.
2. structure M=(I-W)T(I-W), wherein I is N × N unit matrix, and W is N × N neighbour figure squareBattle array, carries out feature decomposition to Metzler matrix, and X gets a front M characteristic vector of M as the result of feature extraction, obtainsBe that the M dimension of data set is expressed.
3. as shown in Figure 2, RBF neural network model is learnt, and Y is carried out to k-means cluster, first to instituteThe feature that has image to obtainCarry out cluster (as the X1 in Fig. 2 ... Xm), M=m is input layerNumber, uses K-means algorithm to realize:
3-1 selects the initial center of c class: c is number of samples 1/10th, and first is data setCenter, first point of distance point farthest in second data point that is all formations, the 3rd is data setMiddle apart from the first two point distance point farthest ... by that analogy. Wherein data set is X, and data point represents certain figurePicture feature.
3-2, in the k time iteration, to any one sample, asks its distance that arrives c center, by this sampleBe grouped into the class apart from place, Duan center;
3-3 utilizes and calculates all points in such and average as the cluster centre that upgrades such;
3-4 is for all c cluster centre, if after utilizing (3-2) iterative method (3-3) to upgrade,Difference is less than 0.01, and iteration finishes, otherwise continues iteration.
Difference is the poor of the cluster centre of current all classes and the last iteration cluster centre that obtains all classes.
Training sample: by the barycenter { C obtaining1,C2,…,CqAs the hidden node of neutral net, in Fig. 2's
Obtain sample as center by centre indexing:
Calculate the distance B D that arrives a little barycenter;
Design factor σ
σ = D p * p - p
Wherein p is hidden layer number, and D is for arriving a little the distance of barycenter.
The input of calculating neuron
By what obtainIndependent a line that element of vector interpolation is 1 is as RBF's (radial base neural net)Coefficient
Design factor matrix is weights W
The label that wherein Y is sample is the Y in Fig. 2.
Also to there is the output of response for the vehicle of other types of not paying close attention to of output of result, unifiedly be output as itHis type.
4. according to the parameter obtaining, new samples is predicted
Calculate the Distance matrix D of target sample and barycenter CN
Calculate input coefficient
Added elements is that 1 row form RBF coefficient, and RBF coefficient is multiplied by weight and obtains the tag along sort of target
The Y finally obtainingNBe the label of new samples.
The region in the process of travelling, the road in image being covered, as target area, is fixed at cameraIn time, is selected, and Real time identification is carried out in target area, sends police if be found to be known sample typeReport reminds driver to note, driver makes further deceleration again and can significantly reduce wild movingThe injury of thing.

Claims (5)

1. for a wild animal image-recognizing method for automatic Pilot, it is characterized in that comprising the following steps:
Adopt LLE algorithm to carry out manifold learning to gathering image, obtain characteristics of image;
By characteristics of image, neutral net is trained;
The image substitution neutral net of Real-time Collection is identified, obtained wild animal kind label, and willThe wild animal kind driver that this label is corresponding.
2. a kind of wild animal image-recognizing method for automatic Pilot according to claim 1, its featureBe that described employing LLE algorithm carries out manifold learning to collection image and comprises the following steps:
The figure using image as sample architecture k-neighbour, and calculate similarity between any two images as closelySeemingly geodesic curve distance:
min(dG(i,j),dG(i,k)+dG(k,j))
Wherein, dGFor k-neighbour schemes the Euclidean distance between upper any two images, image index i, j,K is 1,2 ..., N, wherein N is image number;
Structural matrix M=(I-W)T(I-W), wherein I is N × N unit matrix, and W is the nearly k-of N × NAdjacent figure matrix, k-neighbour schemes the approximate geodesic curve distance matrix between upper any two images;
Metzler matrix is carried out to feature decomposition, and X gets front m the characteristic vector of M as the result of feature extraction,Be characteristics of image X1 ... Xm.
3. a kind of wild animal image-recognizing method for automatic Pilot according to claim 1, its featureDescribed in being, by characteristics of image, neutral net is trained and is comprised the following steps:
Using characteristics of image as input, type of vehicle label is output, and hidden node is that K-means algorithm is poly-The center that class obtains;
Neutral net is trained to the weight that obtains the each node output of hidden layer.
4. a kind of wild animal image-recognizing method for automatic Pilot according to claim 3, its featureBe that described K-means algorithm comprises the following steps:
1) select the initial center of c class: c is number of samples some/mono-, first sample is for severalJu Ji center, c sample is front c-1 the data point of distance point farthest in all data points; WhereinData set is X, and data point represents certain characteristics of image;
2) to any one sample, ask its distance that arrives c center, this sample is grouped into apart from the shortestThe class at heart place;
3) point in each class is averaged as such cluster centre; Return to step 2), until work asBefore till the cluster centre of all classes and the last iteration difference that obtains the cluster centre of all classes is less than threshold value.
5. a kind of wild animal image-recognizing method for automatic Pilot according to claim 1, its featureBeing that the described image substitution neutral net by Real-time Collection is identified comprises the following steps:
Adopt LLE algorithm to carry out manifold learning to gathering image the image of Real-time Collection, obtain characteristics of image;
By characteristics of image and weight substitution neutral net, obtain wild animal kind label:
σ = D p * p - p
YNFor wild animal kind label, W is weight, DNFor the distance matrix of current sample and each cluster centre,D is the distance matrix between all cluster centres, and p is hidden node number.
CN201610055926.XA 2016-01-27 2016-01-27 A kind of wild animal image-recognizing method for automatic Pilot Active CN105608444B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610055926.XA CN105608444B (en) 2016-01-27 2016-01-27 A kind of wild animal image-recognizing method for automatic Pilot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610055926.XA CN105608444B (en) 2016-01-27 2016-01-27 A kind of wild animal image-recognizing method for automatic Pilot

Publications (2)

Publication Number Publication Date
CN105608444A true CN105608444A (en) 2016-05-25
CN105608444B CN105608444B (en) 2018-12-28

Family

ID=55988370

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610055926.XA Active CN105608444B (en) 2016-01-27 2016-01-27 A kind of wild animal image-recognizing method for automatic Pilot

Country Status (1)

Country Link
CN (1) CN105608444B (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108074224A (en) * 2016-11-09 2018-05-25 环境保护部环境规划院 A kind of terrestrial mammal and the monitoring method and its monitoring device of birds
CN108171274A (en) * 2018-01-17 2018-06-15 百度在线网络技术(北京)有限公司 For identifying the method and apparatus of animal
CN108460428A (en) * 2018-04-11 2018-08-28 波奇(上海)信息科技有限公司 A kind of method and apparatus of pet image recognition
CN108545021A (en) * 2018-04-17 2018-09-18 济南浪潮高新科技投资发展有限公司 A kind of auxiliary driving method and system of identification special objective
CN109034109A (en) * 2018-08-16 2018-12-18 新智数字科技有限公司 A kind of pedestrian based on clustering algorithm recognition methods and device again
CN109963460A (en) * 2016-11-24 2019-07-02 夏普株式会社 The control method and program of animal identifier, animal identifier
WO2020029580A1 (en) * 2018-08-08 2020-02-13 华为技术有限公司 Method and apparatus for training control strategy model for generating automatic driving strategy
CN113397562A (en) * 2021-07-20 2021-09-17 电子科技大学 Sleep spindle wave detection method based on deep learning

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210334645A1 (en) * 2020-04-28 2021-10-28 Nvidia Corporation Notifications determined using one or more neural networks

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040017947A1 (en) * 2002-07-29 2004-01-29 Ming-Hsuan Yang Extended Isomap using fisher linear discriminant and kernel fisher linear discriminant
CN101706871A (en) * 2009-11-05 2010-05-12 上海交通大学 Isometric mapping based facial image recognition method
CN101976373A (en) * 2010-11-02 2011-02-16 上海电机学院 Neural network structural design method based on high-dimensional space classifier
CN103020657A (en) * 2012-12-28 2013-04-03 沈阳聚德视频技术有限公司 License plate Chinese character recognition method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040017947A1 (en) * 2002-07-29 2004-01-29 Ming-Hsuan Yang Extended Isomap using fisher linear discriminant and kernel fisher linear discriminant
CN101706871A (en) * 2009-11-05 2010-05-12 上海交通大学 Isometric mapping based facial image recognition method
CN101976373A (en) * 2010-11-02 2011-02-16 上海电机学院 Neural network structural design method based on high-dimensional space classifier
CN103020657A (en) * 2012-12-28 2013-04-03 沈阳聚德视频技术有限公司 License plate Chinese character recognition method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
吴俊强 等: "基于LLE和BP神经网络的人脸识别", 《激光杂志》 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108074224A (en) * 2016-11-09 2018-05-25 环境保护部环境规划院 A kind of terrestrial mammal and the monitoring method and its monitoring device of birds
CN108074224B (en) * 2016-11-09 2021-11-05 生态环境部环境规划院 Method and device for monitoring terrestrial mammals and birds
CN109963460A (en) * 2016-11-24 2019-07-02 夏普株式会社 The control method and program of animal identifier, animal identifier
CN108171274A (en) * 2018-01-17 2018-06-15 百度在线网络技术(北京)有限公司 For identifying the method and apparatus of animal
CN108171274B (en) * 2018-01-17 2019-08-09 百度在线网络技术(北京)有限公司 The method and apparatus of animal for identification
CN108460428A (en) * 2018-04-11 2018-08-28 波奇(上海)信息科技有限公司 A kind of method and apparatus of pet image recognition
CN108545021A (en) * 2018-04-17 2018-09-18 济南浪潮高新科技投资发展有限公司 A kind of auxiliary driving method and system of identification special objective
WO2020029580A1 (en) * 2018-08-08 2020-02-13 华为技术有限公司 Method and apparatus for training control strategy model for generating automatic driving strategy
CN109034109A (en) * 2018-08-16 2018-12-18 新智数字科技有限公司 A kind of pedestrian based on clustering algorithm recognition methods and device again
CN109034109B (en) * 2018-08-16 2021-03-23 新智数字科技有限公司 Pedestrian re-identification method and device based on clustering algorithm
CN113397562A (en) * 2021-07-20 2021-09-17 电子科技大学 Sleep spindle wave detection method based on deep learning

Also Published As

Publication number Publication date
CN105608444B (en) 2018-12-28

Similar Documents

Publication Publication Date Title
CN105608444A (en) Wild animal image identification method used for automatic driving
US10902615B2 (en) Hybrid and self-aware long-term object tracking
Brust et al. Convolutional patch networks with spatial prior for road detection and urban scene understanding
Majdi et al. Drive-net: Convolutional network for driver distraction detection
US10896342B2 (en) Spatio-temporal action and actor localization
CN108491827B (en) Vehicle detection method and device and storage medium
Lange et al. Online vehicle detection using deep neural networks and lidar based preselected image patches
US20160070673A1 (en) Event-driven spatio-temporal short-time fourier transform processing for asynchronous pulse-modulated sampled signals
Zhou et al. Image classification using biomimetic pattern recognition with convolutional neural networks features
US20180121791A1 (en) Temporal difference estimation in an artificial neural network
CN103065158B (en) The behavior recognition methods of the ISA model based on relative gradient
CN107704924B (en) Construction method of synchronous self-adaptive space-time feature expression learning model and related method
Turay et al. Toward performing image classification and object detection with convolutional neural networks in autonomous driving systems: A survey
CN117157678A (en) Method and system for graph-based panorama segmentation
Gikunda et al. State-of-the-art convolutional neural networks for smart farms: A review
JP6778842B2 (en) Image processing methods and systems, storage media and computing devices
CN112001309A (en) Target searching method, device and equipment based on unmanned aerial vehicle cluster and storage medium
CN114299607A (en) Human-vehicle collision risk degree analysis method based on automatic driving of vehicle
Abukmeil et al. Towards explainable semantic segmentation for autonomous driving systems by multi-scale variational attention
Fung et al. Using deep learning to find victims in unknown cluttered urban search and rescue environments
Mittal et al. On the performance evaluation of object classification models in low altitude aerial data
Zhang et al. Faster R-CNN for small traffic sign detection
US10181100B1 (en) Hierarchical clustering method and apparatus for a cognitive recognition system based on a combination of temporal and prefrontal cortex models
Alajlan et al. Automatic lane marking prediction using convolutional neural network and S-Shaped Binary Butterfly Optimization
Huang et al. A multiclass boosting approach for integrating weak classifiers in parking space detection

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant