CN107646113A - 识别视频序列中的活的皮肤组织 - Google Patents

识别视频序列中的活的皮肤组织 Download PDF

Info

Publication number
CN107646113A
CN107646113A CN201680029354.6A CN201680029354A CN107646113A CN 107646113 A CN107646113 A CN 107646113A CN 201680029354 A CN201680029354 A CN 201680029354A CN 107646113 A CN107646113 A CN 107646113A
Authority
CN
China
Prior art keywords
video
frame
video sequence
sequence
similarity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201680029354.6A
Other languages
English (en)
Chinese (zh)
Inventor
王文锦
G·德哈恩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of CN107646113A publication Critical patent/CN107646113A/zh
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/02Detecting, measuring or recording for evaluating the cardiovascular system, e.g. pulse, heart rate, blood pressure or blood flow
    • A61B5/024Measuring pulse rate or heart rate
    • A61B5/02416Measuring pulse rate or heart rate using photoplethysmograph signals, e.g. generated by infrared radiation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0077Devices for viewing the surface of the body, e.g. camera, magnifying lens
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/74Details of notification to user or communication with user or patient; User input means
    • A61B5/7475User input or interface means, e.g. keyboard, pointing device, joystick
    • A61B5/748Selection of a region of interest, e.g. using a graphics tablet
    • A61B5/7485Automatic selection of region of interest
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2134Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on separation criteria, e.g. independent component analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/762Arrangements for image or video recognition or understanding using pattern recognition or machine learning using clustering, e.g. of similar faces in social networks
    • G06V10/763Non-hierarchical techniques, e.g. based on statistics of modelling distributions
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/7715Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/12Fingerprints or palmprints
    • G06V40/1382Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger
    • G06V40/1388Detecting the live character of the finger, i.e. distinguishing from a fake or cadaver finger using image processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/15Biometric patterns based on physiological signals, e.g. heartbeat, blood flow
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/162Detection; Localisation; Normalisation using pixel segmentation or colour matching
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0233Special features of optical sensors or probes classified in A61B5/00
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00Medical imaging apparatus involving image processing or analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2218/00Aspects of pattern recognition specially adapted for signal processing
    • G06F2218/12Classification; Matching
    • G06F2218/16Classification; Matching by matching signal segments
    • G06F2218/18Classification; Matching by matching signal segments by plotting the signal segments against each other, e.g. analysing scattergrams
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30088Skin; Dermal
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/40Spoof detection, e.g. liveness detection
    • G06V40/45Detection of the body part being alive
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Biophysics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Human Computer Interaction (AREA)
  • Molecular Biology (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Biomedical Technology (AREA)
  • Cardiology (AREA)
  • Software Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Physiology (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Image Analysis (AREA)
CN201680029354.6A 2015-05-21 2016-05-20 识别视频序列中的活的皮肤组织 Pending CN107646113A (zh)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP15168566 2015-05-21
EP15168566.6 2015-05-21
PCT/EP2016/061376 WO2016185004A1 (en) 2015-05-21 2016-05-20 Identifying living skin tissue in a video sequence

Publications (1)

Publication Number Publication Date
CN107646113A true CN107646113A (zh) 2018-01-30

Family

ID=53189742

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680029354.6A Pending CN107646113A (zh) 2015-05-21 2016-05-20 识别视频序列中的活的皮肤组织

Country Status (5)

Country Link
US (1) US10242441B2 (https=)
EP (1) EP3298539A1 (https=)
JP (1) JP6549734B2 (https=)
CN (1) CN107646113A (https=)
WO (1) WO2016185004A1 (https=)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107635457A (zh) * 2015-05-21 2018-01-26 皇家飞利浦有限公司 识别视频序列中的活的皮肤组织
CN114913608A (zh) * 2022-06-17 2022-08-16 支付宝(杭州)信息技术有限公司 活体检测方法和系统
CN115410138A (zh) * 2022-11-02 2022-11-29 山东省人工智能研究院 基于特征编码器分类和定位串行的视频动作检测方法

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3298536A1 (en) * 2015-05-21 2018-03-28 Koninklijke Philips N.V. Determining a pulse signal from a video sequence
US10242441B2 (en) * 2015-05-21 2019-03-26 Koninklijke Philips N.V. Identifying living skin tissue in a video sequence using color and spatial similarities
US10335045B2 (en) 2016-06-24 2019-07-02 Universita Degli Studi Di Trento Self-adaptive matrix completion for heart rate estimation from face videos under realistic conditions
US10515199B2 (en) 2017-04-19 2019-12-24 Qualcomm Incorporated Systems and methods for facial authentication
US11311202B2 (en) 2017-11-14 2022-04-26 Arizona Board Of Regents On Behalf Of Arizona State University Robust real-time heart rate monitoring method based on heartbeat harmonics using small-scale radar
JP6826733B2 (ja) * 2018-03-26 2021-02-10 国立大学法人東北大学 信号制御装置、信号制御プログラム、及び信号制御方法
WO2020072297A1 (en) 2018-10-03 2020-04-09 Arizona Board Of Regents On Behalf Of Arizona State University Direct rf signal processing for heart-rate monitoring using uwb impulse radar
US11783483B2 (en) 2019-03-19 2023-10-10 Arizona Board Of Regents On Behalf Of Arizona State University Detecting abnormalities in vital signs of subjects of videos
US11771380B2 (en) 2019-03-19 2023-10-03 Arizona Board Of Regents On Behalf Of Arizona State University Vital sign monitoring system using an optical sensor
EP3941342A4 (en) 2019-03-20 2022-12-07 Arizona Board of Regents on behalf of Arizona State University RADAR CARDIGRAPHY: PROCEDURE FOR ACCURATE RECONSTRUCTION OF HEART DATA
CN111860079B (zh) * 2019-04-30 2024-05-14 北京嘀嘀无限科技发展有限公司 活体图像检测方法、装置以及电子设备
WO2021112950A1 (en) * 2019-12-05 2021-06-10 Alibaba Group Holding Limited Method and apparatus for chroma sampling
US11317137B2 (en) * 2020-06-18 2022-04-26 Disney Enterprises, Inc. Supplementing entertainment content with ambient lighting
US12322205B1 (en) * 2021-04-02 2025-06-03 Affective Software, Inc. Methods and systems that determine heartbeat rate from video recordings
EP4098183A1 (en) 2021-06-02 2022-12-07 Koninklijke Philips N.V. Blood pressure detection

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100092037A1 (en) * 2007-02-01 2010-04-15 Yissum Research Develpoment Company of the Hebrew University of Jerusalem Method and system for video indexing and video synopsis
CN101702198A (zh) * 2009-11-19 2010-05-05 浙江大学 基于背景比对的视频和活体人脸的鉴别方法
CN101807246A (zh) * 2010-03-17 2010-08-18 上海大学 多特征活体识别方法及装置
CN102549621A (zh) * 2009-10-06 2012-07-04 皇家飞利浦电子股份有限公司 用于处理至少包含代表生物中的周期现象的分量的信号的方法和系统
CN102622588A (zh) * 2012-03-08 2012-08-01 无锡数字奥森科技有限公司 双验证人脸防伪方法及装置
CN103294989A (zh) * 2011-10-20 2013-09-11 比奥Id股份公司 生物数据采集过程中区别真实脸部和二维脸部图像的方法
US20130345569A1 (en) * 2012-06-25 2013-12-26 Xerox Corporation Determining cardiac arrhythmia from a video of a subject being monitored for cardiac function
CN104239869A (zh) * 2014-09-25 2014-12-24 武汉华和机电技术有限公司 一种智能指纹识别装置及方法

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPWO2007043328A1 (ja) * 2005-10-12 2009-04-16 コニカミノルタホールディングス株式会社 データ検出装置及びデータ検出方法
JP2007295946A (ja) * 2006-04-27 2007-11-15 Konica Minolta Holdings Inc 酒気帯び検知システム及び酒気帯び検知方法
CN102576458B (zh) * 2009-10-06 2015-08-19 皇家飞利浦电子股份有限公司 用于获得第一信号进行分析以便表征该第一信号的至少一个周期性分量的方法和系统
WO2014045217A1 (en) * 2012-09-21 2014-03-27 Koninklijke Philips N.V. Motion robust vital signal monitoring
US9336594B2 (en) * 2014-03-07 2016-05-10 Xerox Corporation Cardiac pulse rate estimation from source video data
US10242441B2 (en) * 2015-05-21 2019-03-26 Koninklijke Philips N.V. Identifying living skin tissue in a video sequence using color and spatial similarities
WO2016184703A1 (en) * 2015-05-21 2016-11-24 Koninklijke Philips N.V. Identifying living skin tissue in a video sequence
EP3298536A1 (en) * 2015-05-21 2018-03-28 Koninklijke Philips N.V. Determining a pulse signal from a video sequence

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100092037A1 (en) * 2007-02-01 2010-04-15 Yissum Research Develpoment Company of the Hebrew University of Jerusalem Method and system for video indexing and video synopsis
CN102549621A (zh) * 2009-10-06 2012-07-04 皇家飞利浦电子股份有限公司 用于处理至少包含代表生物中的周期现象的分量的信号的方法和系统
CN101702198A (zh) * 2009-11-19 2010-05-05 浙江大学 基于背景比对的视频和活体人脸的鉴别方法
CN101807246A (zh) * 2010-03-17 2010-08-18 上海大学 多特征活体识别方法及装置
CN103294989A (zh) * 2011-10-20 2013-09-11 比奥Id股份公司 生物数据采集过程中区别真实脸部和二维脸部图像的方法
CN102622588A (zh) * 2012-03-08 2012-08-01 无锡数字奥森科技有限公司 双验证人脸防伪方法及装置
US20130345569A1 (en) * 2012-06-25 2013-12-26 Xerox Corporation Determining cardiac arrhythmia from a video of a subject being monitored for cardiac function
CN104239869A (zh) * 2014-09-25 2014-12-24 武汉华和机电技术有限公司 一种智能指纹识别装置及方法

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
FABIO GALASSO ET AL: "Video Segmentation with Superpixels", 《COMPUTER VISION ACCV 2012》 *
GUILLAUME GIBERT ET AL: "Face detection method based on photoplethysmography", 《2013 10TH IEEE INTERNATIONAL CONFERENCE ON ADVANCED VIDEO AND SIGNAL BASED SURVEILLANCE》 *
MATTHIAS RESO ET AL: "Temporally Consistent Superpixels", 《2013 IEEE INTERNATIONAL CONFERENCE ON COMPUTER VISION》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107635457A (zh) * 2015-05-21 2018-01-26 皇家飞利浦有限公司 识别视频序列中的活的皮肤组织
CN114913608A (zh) * 2022-06-17 2022-08-16 支付宝(杭州)信息技术有限公司 活体检测方法和系统
CN115410138A (zh) * 2022-11-02 2022-11-29 山东省人工智能研究院 基于特征编码器分类和定位串行的视频动作检测方法

Also Published As

Publication number Publication date
JP2018515854A (ja) 2018-06-14
JP6549734B2 (ja) 2019-07-24
US10242441B2 (en) 2019-03-26
EP3298539A1 (en) 2018-03-28
US20160343130A1 (en) 2016-11-24
WO2016185004A1 (en) 2016-11-24

Similar Documents

Publication Publication Date Title
US10290104B2 (en) Determining a pulse signal from concatenated video sub-sequences generated from a video sequence
CN107635457B (zh) 识别视频序列中的活的皮肤组织
US10242441B2 (en) Identifying living skin tissue in a video sequence using color and spatial similarities
Boccignone et al. An open framework for remote-PPG methods and their assessment
Bobbia et al. Unsupervised skin tissue segmentation for remote photoplethysmography
Heusch et al. A reproducible study on remote heart rate measurement
Wang et al. Unsupervised subject detection via remote PPG
Yang et al. Estimating heart rate and rhythm via 3D motion tracking in depth video
US20200178809A1 (en) Device, system and method for determining a physiological parameter of a subject
CN102549620A (zh) 至少表示基于像素值的值的变化的时变信号的形成
Bobbia et al. Remote photoplethysmography based on implicit living skin tissue segmentation
Speth et al. Unifying frame rate and temporal dilations for improved remote pulse detection
Macwan et al. Periodic variance maximization using generalized eigenvalue decomposition applied to remote photoplethysmography estimation
Demirezen et al. Heart rate estimation from facial videos using nonlinear mode decomposition and improved consistency check
Jaiswal et al. Heart rate estimation network from facial videos using spatiotemporal feature image
Lampier et al. A deep learning approach to estimate pulse rate by remote photoplethysmography
Wang et al. Accurate face alignment and adaptive patch selection for heart rate estimation from videos under realistic scenarios
CN118247708A (zh) 一种去除非规律性运动伪迹的非接触式心率检测方法
Li et al. Comparison of region of interest segmentation methods for video-based heart rate measurements
Malacarne et al. Improved remote estimation of heart rate in face videos
Liu et al. Non-Contact Heart Rate Estimation From Photoplethysmography Using EEMD and Convolution-Transformer Network
CN116343086B (zh) 一种去除非规律性运动伪迹的视频心率检测方法
Gupta et al. Heart-Rate Evaluation Using Remote Photoplethysmography–A Case Study
Demirezen Remote heart rate estimation using non-contact photoplethysmography
Raseena et al. A maximum likelihood formulation to exploit heart rate variability for robust heart rate estimation from facial video

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20180130

WD01 Invention patent application deemed withdrawn after publication