AU2018292176B2 - Detection of manipulated images - Google Patents

Detection of manipulated images Download PDF

Info

Publication number
AU2018292176B2
AU2018292176B2 AU2018292176A AU2018292176A AU2018292176B2 AU 2018292176 B2 AU2018292176 B2 AU 2018292176B2 AU 2018292176 A AU2018292176 A AU 2018292176A AU 2018292176 A AU2018292176 A AU 2018292176A AU 2018292176 B2 AU2018292176 B2 AU 2018292176B2
Authority
AU
Australia
Prior art keywords
morphed
images
averaged
image
feature
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
AU2018292176A
Other languages
English (en)
Other versions
AU2018292176A1 (en
Inventor
Christoph Busch
Kiran Bylappa RAJA
Raghavendra Ramachandra
Sushma VENKATESH
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Norwegian University of Science and Technology NTNU
Original Assignee
Norwegian University of Science and Technology NTNU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Norwegian University of Science and Technology NTNU filed Critical Norwegian University of Science and Technology NTNU
Publication of AU2018292176A1 publication Critical patent/AU2018292176A1/en
Application granted granted Critical
Publication of AU2018292176B2 publication Critical patent/AU2018292176B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G06F18/253—Fusion techniques of extracted features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/04—Inference or reasoning models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • G06V10/806—Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level of extracted features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168—Feature extraction; Face representation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40—Spoof detection, e.g. liveness detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2415—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on parametric or probabilistic models, e.g. based on likelihood ratio or false acceptance rate versus a false rejection rate

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Mathematical Physics (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Computational Linguistics (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Computer Hardware Design (AREA)
  • Image Analysis (AREA)
AU2018292176A 2017-06-30 2018-06-29 Detection of manipulated images Active AU2018292176B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GBGB1710560.2A GB201710560D0 (en) 2017-06-30 2017-06-30 Detection of manipulated images
GB1710560.2 2017-06-30
PCT/EP2018/067692 WO2019002602A1 (en) 2017-06-30 2018-06-29 DETECTION OF MANIPULATED IMAGES

Publications (2)

Publication Number Publication Date
AU2018292176A1 AU2018292176A1 (en) 2020-01-23
AU2018292176B2 true AU2018292176B2 (en) 2022-10-20

Family

ID=59592689

Family Applications (1)

Application Number Title Priority Date Filing Date
AU2018292176A Active AU2018292176B2 (en) 2017-06-30 2018-06-29 Detection of manipulated images

Country Status (8)

Country Link
US (1) US11450152B2 (enExample)
EP (1) EP3646238A1 (enExample)
JP (1) JP2020525947A (enExample)
CN (1) CN110998598A (enExample)
AU (1) AU2018292176B2 (enExample)
CA (1) CA3068177A1 (enExample)
GB (1) GB201710560D0 (enExample)
WO (1) WO2019002602A1 (enExample)

Families Citing this family (34)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10944767B2 (en) * 2018-02-01 2021-03-09 International Business Machines Corporation Identifying artificial artifacts in input data to detect adversarial attacks
WO2020075306A1 (ja) * 2018-10-12 2020-04-16 日本電気株式会社 情報処理装置、情報処理方法及び記録媒体
CN109801267B (zh) * 2018-12-27 2023-06-09 北京航天福道高技术股份有限公司 基于特征点检测与svm分类器的巡检目标缺陷检测方法
CN109919888B (zh) * 2019-02-26 2023-09-19 腾讯科技（深圳）有限公司 一种图像融合的方法、模型训练的方法以及相关装置
KR20210128505A (ko) * 2019-03-13 2021-10-26 주식회사 토모큐브 3차원 정량적 위상 이미징을 이용하여 미생물들을 식별
EP3948597A4 (en) * 2019-03-29 2022-12-14 Drexel University LEARNED FORENSIC SOURCE SYSTEM FOR IMAGE CAPTURE DEVICE PATTERN IDENTIFICATION AND FORENSIC SIMILARITY OF DIGITAL IMAGES
US11495041B2 (en) * 2019-03-29 2022-11-08 Jumio Corporation Biometric identification using composite hand images
US10769263B1 (en) 2019-05-07 2020-09-08 Alibaba Group Holding Limited Certificate verification
US11263467B2 (en) * 2019-05-15 2022-03-01 Apical Limited Image processing
FR3100070B1 (fr) 2019-08-21 2021-09-24 Idemia Identity & Security France Procédé de reconnaissance biométrique à contrôle de dérive et installation associée
CN111104852B (zh) * 2019-11-06 2020-10-16 重庆邮电大学 一种基于启发式高斯云变换的人脸识别技术
JP7400959B2 (ja) 2020-05-11 2023-12-19 日本電気株式会社 判定装置、判定方法およびプログラム
CN111862030B (zh) * 2020-07-15 2024-02-09 北京百度网讯科技有限公司 一种人脸合成图检测方法、装置、电子设备及存储介质
US11694480B2 (en) * 2020-07-27 2023-07-04 Samsung Electronics Co., Ltd. Method and apparatus with liveness detection
CN116636217A (zh) * 2020-12-18 2023-08-22 华为技术有限公司 使用神经网络编码图像和解码码流的方法和装置
JP7415202B2 (ja) * 2021-01-27 2024-01-17 富士通株式会社 判定方法、判定プログラム、および情報処理装置
WO2022217294A1 (en) * 2021-04-09 2022-10-13 Qualcomm Incorporated Personalized biometric anti-spoofing protection using machine learning and enrollment data
CN113436302B (zh) * 2021-06-08 2024-02-13 合肥综合性国家科学中心人工智能研究院(安徽省人工智能实验室) 一种人脸动画合成方法及系统
EP4105815A1 (en) * 2021-06-14 2022-12-21 Onfido Ltd Signal based machine learning fraud detection
EP4105825A1 (en) 2021-06-14 2022-12-21 Onfido Ltd Generalised anomaly detection
CN114078274B (zh) * 2021-10-29 2024-11-01 北京百度网讯科技有限公司 人脸图像检测方法、装置、电子设备以及存储介质
CN114092864B (zh) * 2022-01-19 2022-04-12 湖南信达通信息技术有限公司 伪造视频的识别方法、装置、电子设备及计算机存储介质
US11816174B2 (en) * 2022-03-29 2023-11-14 Ebay Inc. Enhanced search with morphed images
CN114913554A (zh) * 2022-04-22 2022-08-16 北京迈格威科技有限公司 一种训练攻击物料识别模型的方法、识别攻击物料的方法
CN115953780B (zh) * 2023-03-10 2023-06-20 清华大学 多维光场复杂场景图智能生成方法与系统
US20240370833A1 (en) * 2023-05-03 2024-11-07 Strategic Coach Method and an apparatus for schedule element classification
DE102023114634A1 (de) * 2023-06-02 2024-12-05 Bundesdruckerei Gmbh Trainingsdaten zur erkennung von bildmorphing
WO2025009057A1 (ja) * 2023-07-04 2025-01-09 日本電気株式会社 情報処理装置、情報処理方法、及び、記録媒体
US12437583B2 (en) 2023-10-17 2025-10-07 The Government of the United States of America, Secretary of Homeland Security Morphed image detection logic and surveillance systems
US12354412B1 (en) * 2023-10-17 2025-07-08 The Government of the United States of America, as represented by the Secretary of Homeland Security Morphed image detection logic and surveillance systems
US20250190549A1 (en) * 2023-12-08 2025-06-12 Oz Forensics Software Trading Llc Out-of-distribution model for liveness detection
US12307826B1 (en) * 2024-11-26 2025-05-20 Daon Technology Electronic device and method for enhancing detection of morphed biometric data
US12450952B1 (en) * 2024-11-26 2025-10-21 Daon Technology Methods and systems for enhancing detection of morphed biometric modality data
US12413402B1 (en) 2025-01-23 2025-09-09 Daon Technology Methods and systems for enhancing detection of fraudulent authentication data

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6661906B1 (en) * 1996-12-19 2003-12-09 Omron Corporation Image creating apparatus
US7327860B2 (en) 2005-05-04 2008-02-05 West Virginia University Conjunctival scans for personal identification
CN106462549B (zh) * 2014-04-09 2020-02-21 尹度普有限公司 使用从显微变化中进行的机器学习来鉴定实体对象
WO2016074247A1 (en) * 2014-11-15 2016-05-19 Beijing Kuangshi Technology Co., Ltd. Face detection using machine learning
CN104504362A (zh) * 2014-11-19 2015-04-08 南京艾柯勒斯网络科技有限公司 基于卷积神经网络的人脸检测方法
US9552510B2 (en) * 2015-03-18 2017-01-24 Adobe Systems Incorporated Facial expression capture for character animation
HK1251691B (zh) 2015-06-16 2020-02-21 居米奥公司 用於假冒检测及活跃度分析的系统及方法
CN105760821B (zh) * 2016-01-31 2017-06-06 中国石油大学(华东) 基于核空间的分类聚集稀疏表示的人脸识别方法
CN106384083A (zh) * 2016-08-31 2017-02-08 上海交通大学 一种自动面部表情识别并进行信息推荐的方法
US10637874B2 (en) * 2016-09-01 2020-04-28 Cylance Inc. Container file analysis using machine learning model
CN106651830A (zh) * 2016-09-28 2017-05-10 华南理工大学 一种基于并行卷积神经网络的图像质量测试方法
CN106485251B (zh) * 2016-10-08 2019-12-24 天津工业大学 基于深度学习的鸡蛋胚胎分类

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
BHARATI, A. et al., "Detecting Facial Retouching Using Supervised Deep Learning", IEEE Transactions on Information Forensics and Security, 1 September 2016, vol. 11, no. 9, pp. 1903-1913, DOI: 10.1109/TIFS.2016.2561898 *
RAGHAVENDRA, R. et al., "Detecting Morphed Face Images", In Proceedings of the IEEE International Conference on Biometrics Theory, Applications and Systems (BTAS), 6-9 September 2016, pp. 1-7, DOI: 10.1109/BTAS.2016.7791169 *

Also Published As

Publication number Publication date
US11450152B2 (en) 2022-09-20
WO2019002602A1 (en) 2019-01-03
EP3646238A1 (en) 2020-05-06
US20200175290A1 (en) 2020-06-04
AU2018292176A1 (en) 2020-01-23
JP2020525947A (ja) 2020-08-27
CN110998598A (zh) 2020-04-10
CA3068177A1 (en) 2019-01-03
GB201710560D0 (en) 2017-08-16

Similar Documents

Publication Publication Date Title
AU2018292176B2 (en) Detection of manipulated images
Raghavendra et al. Robust scheme for iris presentation attack detection using multiscale binarized statistical image features
Raja et al. Transferable deep-cnn features for detecting digital and print-scanned morphed face images
Ramachandra et al. Towards making morphing attack detection robust using hybrid scale-space colour texture features
Silva et al. An approach to iris contact lens detection based on deep image representations
US20210019519A1 (en) Detection of fraudulently generated and photocopied credential documents
US9189686B2 (en) Apparatus and method for iris image analysis
Liu et al. Data-fusion-based two-stage cascade framework for multimodality face anti-spoofing
Hu et al. Iris liveness detection using regional features
Raghavendra et al. Presentation attack detection algorithms for finger vein biometrics: A comprehensive study
US20230069960A1 (en) Generalized anomaly detection
Raghavendra et al. Improved ear verification after surgery-An approach based on collaborative representation of locally competitive features
Pinto et al. Counteracting presentation attacks in face, fingerprint, and iris recognition
Yeh et al. Face liveness detection based on perceptual image quality assessment features with multi-scale analysis
Raja et al. Color adaptive quantized patterns for presentation attack detection in ocular biometric systems
Kadiri et al. Morphed Picture Recognition using Machine Learning Algorithms
Gebremeskel et al. Developing a model for detection of Ethiopian fake banknote using deep learning
Sharifi Score-level-based face anti-spoofing system using handcrafted and deep learned characteristics
Scherhag Face morphing and morphing attack detection
Mandalapu et al. Image quality and texture-based features for reliable textured contact lens detection
Nossam et al. Signature Forgery Detection and Verification using Deep Learning Techniques
Khan et al. Security issues in face recognition
Maruthirao et al. Face recognition with morphing attack removal using deep learning models
Kamboj et al. EIQA: ear image quality assessment using deep convolutional neural network
Mehta et al. Enhancing Image Authenticity Detection: Swin Transformers and Color Frame Analysis for CGI vs. Real Images

Legal Events

Date Code Title Description
FGA Letters patent sealed or granted (standard patent)