WO2018067080A1 - A marine vessel identification method - Google Patents

A marine vessel identification method Download PDF

Info

Publication number
WO2018067080A1
WO2018067080A1 PCT/TR2016/050374 TR2016050374W WO2018067080A1 WO 2018067080 A1 WO2018067080 A1 WO 2018067080A1 TR 2016050374 W TR2016050374 W TR 2016050374W WO 2018067080 A1 WO2018067080 A1 WO 2018067080A1
Authority
WO
WIPO (PCT)
Prior art keywords
images
descriptors
identification method
marine vessel
marine
Prior art date
Application number
PCT/TR2016/050374
Other languages
English (en)
French (fr)
Inventor
Erhan GUNDOGDU
Aykut KOC
Berkan SOLMAZ
Veysel YUCESOY
Original Assignee
Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi filed Critical Aselsan Elektronik Sanayi Ve Ticaret Anonim Sirketi
Publication of WO2018067080A1 publication Critical patent/WO2018067080A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00Indexing scheme relating to image or video recognition or understanding
    • G06V2201/08Detecting or categorising vehicles

Definitions

  • the present invention relates to an application for Identification of marine vessels using at least one image
  • Identifying a marine vessel (e.g. determining whether a marine vessel is a cargo ship a tanker, or a military ship) using an image thereof obtained by means of an image capturing device can be performed with the aid of image processing, techniques.
  • This representing procedure is of high Importance particularly in the defense industry.
  • typically deep learning-based applications are used for representing an object visually. According to deep learning- based applications, first the features/descriptors belonging to various objects are extracted In a learning step, and then the objects are classified using said features/descriptors.
  • the features of the objeca are extracted from the image of that object and then it Is calculated on a probability basis as to which class or classes acquired In the learning step the extracted feature Information may belong to Thus, the respective object is classified.
  • VGG-F descriptors for descriptor extraction purposes is reported In the papers by Chatfield. K. Simonyan, K., Vedaldi A.. Zissermam .A. , "Return of the devil in the details' Delving deep into convolutional nets.” and Vedaldi, A,. Lenc, K. "Matconvnet - convolutional neural networks for MATLAB.”
  • VAIS A Dataset for Recognizing Maritime Imagery- In the Visible and Infrared Speetrums
  • a visible image and an infrared image are used for recognising marine vessels.
  • deep convoiuiionai neural networks and gnostic fields are used in combination, in said method, however, vessel classrfication cannot be performed sufficiently accurately
  • an identification method for identifying marine vessels using, at least one image.
  • This method comprises the steps cf acquiring the images of a large number of marine vessels of different classes from at least one source and saving the images to a database; generating at least two superclasses according to the warine vessels in the saved images, obtaining models of said superclasses by means of deep teaming; extracting the descriptors belonging to at least one query image of at least one marine vessel and determining as to which superclass, associated with said models, the descriptors belong to. such that the marine vessel of said query image Is classified,
  • the learning process can be carried out using images of different marine vessels. Additionally, since the images are separated into superclasses, a more accurate classification of the marine vessels can be provided. Furthermore, the Identification method according to the present invention makes if possible to recognize a marine vessel of a given query image among other manne vessels belonging lo the same class and to provide the recognition information to a user, to retrieve those images which are similar to a query Image, and to determine if two different, query images belong to trie same marine vessel.
  • the object of the present invention is to develop an identification method for identifying marine vessels using at least one image.
  • Another object of the present invention is to develop an identification method With a high accuracy rate.
  • a fuiiher object of fie present invention is to develop an identification method aiding to detect if two images do belong to the same marine vehicle.
  • a different object of the present invention is to develop an Identification method allowing to retrieve similar images by using an image of a marine vehicle. Description of Drawings
  • FIG. 1 is flowchart of the identification method according to the present: Invention
  • Figure 2 is a comparative graph, showing the mean average precision versus the number of retrieved images of the present identification method and a conwhtlonai application.
  • Determining the class of a marine vessel using at least one image of that marine vessel is quite important In terms of the defense field. For Instance, as a result of identifying whether a marine vessel is a military ship or a cargo ship, any required measures pan da taken beforehand. A. rapid and accurate identification of a marine vessel makes it possible to lake the required measures in a timely and correct manner. Accordingly with the present Invention, an identification method has been developed for identifying marine vessels using at least one Image.
  • the Identification method developed according to the present invention and of which an exemplary flowchart is given in Figure 1 comprises the steps of acquiring the images of a large number of marine vessels of different classes from at least one source (e.g. the Internet) (1 ) and saving the Images to a database; generating at least two superclasses according to the marine vessels in the saved images (2); obtaining models belonging to said superclasses by means of deep learning (4); extracting ihe descriptors belonging to at least one query image (I), of at least one marine vessel and determining as to which superclass, associated with said models, said descriptors belong to, such that the marine vessel of said query image (1) Is classified (5).
  • a source e.g. the Internet
  • the descriptors of the marine vessels In the images collected to generate said superclass (2) are extracted and the size of descriptors is reduced by principal components analysis . Then, the classes, which have similar distributions according to an interclass distance matrix and which are also related to each other semantical are combined each into a superclass by a spectral clustering method
  • the collected Images were separated Into datssets In the form of a training set and a test set (3)
  • the vessels in the test dataset are classified using the models learned in said training dataset
  • the identification method comprises in the set separation step (3) another step of generating training and test datssets. using representations made from models of image pairs belonging to the same marine vessels (positive) and different marine vessels (negative).
  • 91 ,01% verification success can be provided using the phoetpal components analysis and a support vector machine.
  • images which are similar to a given query image (I) ere retrieved from an available large dataset (8) are extracted and the images, among these present In the database, the descriptors of which are close to the descriptors of the query image (1), are provided to the user in Figure Z a comparison Is given comparing the simitar image retrieval (61 application of the method according to the present invention to a conventional application (VGG-F application)...According, to the graph given ImFignre 2 the probability of retrieving Images of the same class with that of the query image (I) is higher than with the conventional application, particularly when a tow number of simliar images are retrieved, According : to another preferred embodiment of the: present invention, a marine vessel ss recognised (7) using its query image (I).
  • identification information e.g. IMO-International. Maritime Organization number
  • identification information e.g. IMO-International. Maritime Organization number
  • the descriptors: of said query image (I) are extracted, and first the class of the marine vessel ss determined- then It as determined which, the image(s) In the determined class belong(s) to the marine vessel . Thereafter, the Identification Information belonging to the determined Image Is provided to the user and the recognition process (7) is realized accordingly,.
  • the identification method according: to the present Invention makes It possible to recognize (7) a marine vessel of a given query Image (I) among other marine vessels feeionging to the same class and to provide the recognition information to a user, to receive those images which are similar to a query Image (I), and to determine if two different query Images (1) belong to the same marine vessel

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
PCT/TR2016/050374 2016-10-07 2016-10-10 A marine vessel identification method WO2018067080A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
TR2016/14118A TR201614118A1 (tr) 2016-10-07 2016-10-07 Bir deniz aracı tanıma yöntemi.
TR2016/14118 2016-10-07

Publications (1)

Publication Number Publication Date
WO2018067080A1 true WO2018067080A1 (en) 2018-04-12

Family

ID=57485848

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/TR2016/050374 WO2018067080A1 (en) 2016-10-07 2016-10-10 A marine vessel identification method

Country Status (2)

Country Link
TR (1) TR201614118A1 (tr)
WO (1) WO2018067080A1 (tr)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109376591A (zh) * 2018-09-10 2019-02-22 武汉大学 深度学习特征与视觉特征联合训练的船只目标检测方法
CN109657541A (zh) * 2018-11-09 2019-04-19 南京航空航天大学 一种基于深度学习的无人机航拍图像中的船舶检测方法
CN109754014A (zh) * 2018-12-29 2019-05-14 北京航天数据股份有限公司 工业模型训练方法、装置、设备及介质
CN110175535A (zh) * 2019-05-08 2019-08-27 广州中交通信有限公司 一种基于深度学习的船舶识别系统及其识别方法
CN110569844A (zh) * 2019-08-26 2019-12-13 中国人民解放军91550部队 基于深度学习的船舶识别方法及系统
CN111259812A (zh) * 2020-01-17 2020-06-09 上海交通大学 基于迁移学习的内河船舶重识别方法、设备及存储介质
CN113139077A (zh) * 2020-11-04 2021-07-20 西安天和防务技术股份有限公司 一种识别船舶身份的方法、装置、终端及存储介质
CN114007050A (zh) * 2021-10-14 2022-02-01 桂林电子科技大学 一种基于北斗通信的目标识别图像传输方法

Non-Patent Citations (6)

* Cited by examiner, † Cited by third party
Title
BARIS YUCE ET AL: "Neural network design and feature selection using principal component analysis and Taguchi method for identifying wood veneer defects", PRODUCTION & MANUFACTURING RESEARCH, vol. 2, no. 1, 13 July 2014 (2014-07-13), pages 291, XP055373245, DOI: 10.1080/21693277.2014.892442 *
CHRIS PILCHER ET AL: "Nonlinear classifier combination for a maritime target recognition task", RADAR CONFERENCE, 2009 IEEE, IEEE, PISCATAWAY, NJ, USA, 4 May 2009 (2009-05-04), pages 1 - 5, XP031461436, ISBN: 978-1-4244-2870-0 *
CUONG DAO-DUC ET AL: "Maritime Vessel Images Classification Using Deep Convolutional Neural Networks", PROCEEDINGS OF THE SIXTH INTERNATIONAL SYMPOSIUM ON INFORMATION AND COMMUNICATION TECHNOLOGY, SOICT 2015, 3 December 2015 (2015-12-03), New York, New York, USA, pages 1 - 6, XP055371744, ISBN: 978-1-4503-3843-1, DOI: 10.1145/2833258.2833266 *
H SAHOOLIZADEH ET AL: "A new face recognition method using PCA, LDA and Neural Network", CYBERNETIC INTELLIGENT SYSTEMS, 2008. CIS 2008. 7TH IEEE INTERNATIONAL CONFERENCE ON, vol. 2, no. 5, 2008, Piscataway, NJ, USA, pages 1 - 6, XP055373251, ISBN: 978-1-4244-2914-1, DOI: 10.1109/UKRICIS.2008.4798953 *
MABEL M. ZHANG ET AL.: "VAIS A Dataset for Recognizing Maritime Imagery in the Visible and Infrared Spectrums", pages 1 - 7, Retrieved from the Internet <URL:http://www.chriskanan.com/wp-content/uploads/vais.pdf>
ODEGAARD NINA ET AL: "Classification of ships using real and simulated data in a convolutional neural network", 2016 IEEE RADAR CONFERENCE (RADARCONF), IEEE, 2 May 2016 (2016-05-02), pages 1 - 6, XP032909101, DOI: 10.1109/RADAR.2016.7485270 *

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109376591B (zh) * 2018-09-10 2021-04-16 武汉大学 深度学习特征与视觉特征联合训练的船只目标检测方法
CN109376591A (zh) * 2018-09-10 2019-02-22 武汉大学 深度学习特征与视觉特征联合训练的船只目标检测方法
CN109657541A (zh) * 2018-11-09 2019-04-19 南京航空航天大学 一种基于深度学习的无人机航拍图像中的船舶检测方法
CN109754014A (zh) * 2018-12-29 2019-05-14 北京航天数据股份有限公司 工业模型训练方法、装置、设备及介质
CN109754014B (zh) * 2018-12-29 2021-04-27 北京航天数据股份有限公司 工业模型训练方法、装置、设备及介质
CN110175535A (zh) * 2019-05-08 2019-08-27 广州中交通信有限公司 一种基于深度学习的船舶识别系统及其识别方法
CN110175535B (zh) * 2019-05-08 2023-07-04 广州中交通信有限公司 一种基于深度学习的船舶识别系统及其识别方法
CN110569844A (zh) * 2019-08-26 2019-12-13 中国人民解放军91550部队 基于深度学习的船舶识别方法及系统
CN110569844B (zh) * 2019-08-26 2022-02-08 中国人民解放军91550部队 基于深度学习的船舶识别方法及系统
CN111259812A (zh) * 2020-01-17 2020-06-09 上海交通大学 基于迁移学习的内河船舶重识别方法、设备及存储介质
CN111259812B (zh) * 2020-01-17 2023-04-18 上海交通大学 基于迁移学习的内河船舶重识别方法、设备及存储介质
CN113139077A (zh) * 2020-11-04 2021-07-20 西安天和防务技术股份有限公司 一种识别船舶身份的方法、装置、终端及存储介质
CN113139077B (zh) * 2020-11-04 2023-03-10 西安天和防务技术股份有限公司 一种识别船舶身份的方法、装置、终端及存储介质
CN114007050A (zh) * 2021-10-14 2022-02-01 桂林电子科技大学 一种基于北斗通信的目标识别图像传输方法

Also Published As

Publication number Publication date
TR201614118A1 (tr) 2018-04-24

Similar Documents

Publication Publication Date Title
WO2018067080A1 (en) A marine vessel identification method
JP4721830B2 (ja) 画像検索方法及び装置
CN109902223B (zh) 一种基于多模态信息特征的不良内容过滤方法
US11847418B2 (en) Few-shot language model training and implementation
CN105117740B (zh) 字体识别方法及装置
WO2020164278A1 (zh) 一种图像处理方法、装置、电子设备和可读存储介质
Sugamya et al. A CBIR classification using support vector machines
Lawrence Fernandes et al. Development and analysis of various state of the art techniques for face recognition under varying poses
CN112784754A (zh) 一种车辆再识别方法、装置、设备及存储介质
Zhang et al. Automatic shoeprint retrieval system for use in forensic investigations
Fajas et al. Automatic Number Plate Recognition for indian standard number plates
Jindal et al. Aircraft detection from remote sensing images using YOLOV5 architecture
Rezaei et al. Plant disease recognition in a low data scenario using few-shot learning
Du et al. Large-scale signature matching using multi-stage hashing
CN114022684B (zh) 人体姿态估计方法及装置
Gopal et al. Content based image retrieval using enhanced surf
CN113553947B (zh) 生成描述多模态行人重识别方法、装置及电子设备
Ambai et al. SPADE: scalar product accelerator by integer decomposition for object detection
Gál et al. Multiple kernel learning based modality classification for medical images
Ahmad et al. A fusion of labeled-grid shape descriptors with weighted ranking algorithm for shapes recognition
Kumar et al. Cross domain descriptor for sketch based image retrieval using siamese network
Gang et al. Improved bags-of-words algorithm for scene recognition
Bakheet et al. Content-based image retrieval using brisk and surf as bag-of-visual-words for naïve Bayes classifier
CN107092875B (zh) 一种新的场景识别方法
Manimekalai et al. Taxonomic classification of Plant species using support vector machine

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16806305

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16806305

Country of ref document: EP

Kind code of ref document: A1