SG11201911777QA - Deep learning-based techniques for pre-training deep convolutional neural networks - Google Patents

Deep learning-based techniques for pre-training deep convolutional neural networks

Info

Publication number
SG11201911777QA
SG11201911777QA SG11201911777QA SG11201911777QA SG11201911777QA SG 11201911777Q A SG11201911777Q A SG 11201911777QA SG 11201911777Q A SG11201911777Q A SG 11201911777QA SG 11201911777Q A SG11201911777Q A SG 11201911777QA SG 11201911777Q A SG11201911777Q A SG 11201911777QA
Authority
SG
Singapore
Prior art keywords
convolutional neural
neural networks
based techniques
training
deep
Prior art date
Application number
SG11201911777QA
Other languages
English (en)
Inventor
Kai-How FARH
Hong Gao
Padigepati Samskruthi Reddy
Original Assignee
Illumina Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/US2018/055840 external-priority patent/WO2019079166A1/fr
Priority claimed from US16/407,149 external-priority patent/US10540591B2/en
Application filed by Illumina Inc filed Critical Illumina Inc
Publication of SG11201911777QA publication Critical patent/SG11201911777QA/en

Links

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B20/00—ICT specially adapted for functional genomics or proteomics, e.g. genotype-phenotype associations
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
    • G06F18/2413—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on distances to training or reference patterns
    • G06F18/24133—Distances to prototypes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/443—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by matching or filtering
    • G06V10/449—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters
    • G06V10/451—Biologically inspired filters, e.g. difference of Gaussians [DoG] or Gabor filters with interaction between the filter responses, e.g. cortical complex cells
    • G06V10/454—Integrating the filters into a hierarchical structure, e.g. convolutional neural networks [CNN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B20/00—ICT specially adapted for functional genomics or proteomics, e.g. genotype-phenotype associations
    • G16B20/20—Allele or variant detection, e.g. single nucleotide polymorphism [SNP] detection
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B20/00—ICT specially adapted for functional genomics or proteomics, e.g. genotype-phenotype associations
    • G16B20/30—Detection of binding sites or motifs
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B30/00—ICT specially adapted for sequence analysis involving nucleotides or amino acids
    • G16B30/10—Sequence alignment; Homology search
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B40/00—ICT specially adapted for biostatistics; ICT specially adapted for bioinformatics-related machine learning or data mining, e.g. knowledge discovery or pattern finding
    • G16B40/20—Supervised data analysis
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B50/00—ICT programming tools or database systems specially adapted for bioinformatics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/048—Activation functions
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/082—Learning methods modifying the architecture, e.g. adding, deleting or silencing nodes or connections

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • Evolutionary Computation (AREA)
  • Data Mining & Analysis (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Molecular Biology (AREA)
  • General Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Biotechnology (AREA)
  • Mathematical Physics (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Chemical & Material Sciences (AREA)
  • Proteomics, Peptides & Aminoacids (AREA)
  • Analytical Chemistry (AREA)
  • Genetics & Genomics (AREA)
  • Databases & Information Systems (AREA)
  • Bioethics (AREA)
  • Multimedia (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Epidemiology (AREA)
  • Public Health (AREA)
  • Image Analysis (AREA)
  • Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
  • Machine Translation (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
SG11201911777QA 2018-10-15 2019-05-09 Deep learning-based techniques for pre-training deep convolutional neural networks SG11201911777QA (en)

Applications Claiming Priority (8)

Application Number Priority Date Filing Date Title
PCT/US2018/055840 WO2019079166A1 (fr) 2017-10-16 2018-10-15 Techniques basées sur l'apprentissage profond d'apprentissage de réseaux neuronaux à convolution profonde
PCT/US2018/055878 WO2019079180A1 (fr) 2017-10-16 2018-10-15 Réseaux neuronaux à convolution profonde de classification de variants
US16/160,903 US10423861B2 (en) 2017-10-16 2018-10-15 Deep learning-based techniques for training deep convolutional neural networks
US16/160,986 US11315016B2 (en) 2017-10-16 2018-10-15 Deep convolutional neural networks for variant classification
PCT/US2018/055881 WO2019079182A1 (fr) 2017-10-16 2018-10-15 Apprentissage semi-supervisé pour l'apprentissage d'un ensemble de réseaux neuronaux à convolution profonde
US16/160,968 US11798650B2 (en) 2017-10-16 2018-10-15 Semi-supervised learning for training an ensemble of deep convolutional neural networks
US16/407,149 US10540591B2 (en) 2017-10-16 2019-05-08 Deep learning-based techniques for pre-training deep convolutional neural networks
PCT/US2019/031621 WO2020081122A1 (fr) 2018-10-15 2019-05-09 Techniques de pré-entraînement de réseaux neuronaux à convolution profonde fondées sur l'apprentissage profond

Publications (1)

Publication Number Publication Date
SG11201911777QA true SG11201911777QA (en) 2020-05-28

Family

ID=70283180

Family Applications (2)

Application Number Title Priority Date Filing Date
SG11201911777QA SG11201911777QA (en) 2018-10-15 2019-05-09 Deep learning-based techniques for pre-training deep convolutional neural networks
SG10202108013QA SG10202108013QA (en) 2018-10-15 2019-05-09 Deep learning-based techniques for pre-training deep convolutional neural networks

Family Applications After (1)

Application Number Title Priority Date Filing Date
SG10202108013QA SG10202108013QA (en) 2018-10-15 2019-05-09 Deep learning-based techniques for pre-training deep convolutional neural networks

Country Status (8)

Country Link
JP (3) JP6888123B2 (fr)
KR (1) KR102165734B1 (fr)
CN (2) CN111328419B (fr)
AU (2) AU2019272062B2 (fr)
IL (2) IL271091B (fr)
NZ (1) NZ759665A (fr)
SG (2) SG11201911777QA (fr)
WO (1) WO2020081122A1 (fr)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111680762B (zh) * 2018-11-27 2023-08-04 成都大学 中药材适生地的分类方法及装置
KR102418073B1 (ko) * 2020-06-08 2022-07-06 고려대학교 산학협력단 인공지능 기반 비디오 투시 연하검사 자동화 분석 장치 및 방법
CN111830408B (zh) * 2020-06-23 2023-04-18 朗斯顿科技(北京)有限公司 一种基于边缘计算和深度学习的电机故障诊断系统及方法
CN112003735B (zh) * 2020-07-28 2021-11-09 四川大学 一种感知风险的深度学习驱动的极限传输容量调整方法
CN112183088B (zh) * 2020-09-28 2023-11-21 云知声智能科技股份有限公司 词语层级确定的方法、模型构建方法、装置及设备
KR102279056B1 (ko) * 2021-01-19 2021-07-19 주식회사 쓰리빌리언 지식전이를 이용한 유전자변이의 병원성 예측 시스템
CN113299345B (zh) * 2021-06-30 2024-05-07 中国人民解放军军事科学院军事医学研究院 病毒基因分类的方法、装置及电子设备
CN113539354B (zh) * 2021-07-19 2023-10-27 浙江理工大学 一种高效预测革兰氏阴性菌ⅲ型和ⅳ型效应蛋白的方法
CN113822342B (zh) * 2021-09-02 2023-05-30 湖北工业大学 一种安全图卷积网络的文献分类方法及系统
CN113836892B (zh) * 2021-09-08 2023-08-08 灵犀量子(北京)医疗科技有限公司 样本量数据提取方法、装置、电子设备及存储介质
CN113963746B (zh) * 2021-09-29 2023-09-19 西安交通大学 一种基于深度学习的基因组结构变异检测系统及方法
US20240087683A1 (en) * 2022-09-14 2024-03-14 Microsoft Technology Licensing, Llc Classification using a machine learning model trained with triplet loss
CN115662520B (zh) * 2022-10-27 2023-04-14 黑龙江金域医学检验实验室有限公司 Bcr/abl1融合基因的检测方法及相关设备
CN116153396A (zh) * 2023-04-21 2023-05-23 鲁东大学 一种基于迁移学习的非编码变异预测方法
CN117688785B (zh) * 2024-02-02 2024-04-16 东北大学 一种基于种植思想的全张量重力梯度数据反演方法

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0450060A1 (fr) 1989-10-26 1991-10-09 Sri International Sequen age d'adn
US5641658A (en) 1994-08-03 1997-06-24 Mosaic Technologies, Inc. Method for performing amplification of nucleic acid with two primers bound to a single solid support
EP1498494A3 (fr) 1997-04-01 2007-06-20 Solexa Ltd. Procédé de séquencage d'acides nucléiques
AR021833A1 (es) 1998-09-30 2002-08-07 Applied Research Systems Metodos de amplificacion y secuenciacion de acido nucleico
GB0006153D0 (en) * 2000-03-14 2000-05-03 Inpharmatica Ltd Database
DE60131194T2 (de) 2000-07-07 2008-08-07 Visigen Biotechnologies, Inc., Bellaire Sequenzbestimmung in echtzeit
AU2002227156A1 (en) 2000-12-01 2002-06-11 Visigen Biotechnologies, Inc. Enzymatic nucleic acid synthesis: compositions and methods for altering monomer incorporation fidelity
AR031640A1 (es) 2000-12-08 2003-09-24 Applied Research Systems Amplificacion isotermica de acidos nucleicos en un soporte solido
US7057026B2 (en) 2001-12-04 2006-06-06 Solexa Limited Labelled nucleotides
US20040002090A1 (en) 2002-03-05 2004-01-01 Pascal Mayer Methods for detecting genome-wide sequence variations associated with a phenotype
DK3002289T3 (en) 2002-08-23 2018-04-23 Illumina Cambridge Ltd MODIFIED NUCLEOTIDES FOR POLYNUCLEOTIDE SEQUENCE
GB2423819B (en) 2004-09-17 2008-02-06 Pacific Biosciences California Apparatus and method for analysis of molecules
GB0427236D0 (en) 2004-12-13 2005-01-12 Solexa Ltd Improved method of nucleotide detection
DK1907583T4 (da) 2005-06-15 2020-01-27 Complete Genomics Inc Enkeltmolekyle-arrays til genetisk og kemisk analyse
GB0514910D0 (en) 2005-07-20 2005-08-24 Solexa Ltd Method for sequencing a polynucleotide template
US7405281B2 (en) 2005-09-29 2008-07-29 Pacific Biosciences Of California, Inc. Fluorescent nucleotide analogs and uses therefor
GB0522310D0 (en) 2005-11-01 2005-12-07 Solexa Ltd Methods of preparing libraries of template polynucleotides
WO2007107710A1 (fr) 2006-03-17 2007-09-27 Solexa Limited Procédés isothermiques pour créer des réseaux moléculaires clonales simples
US8241573B2 (en) 2006-03-31 2012-08-14 Illumina, Inc. Systems and devices for sequence by synthesis analysis
US7754429B2 (en) 2006-10-06 2010-07-13 Illumina Cambridge Limited Method for pair-wise sequencing a plurity of target polynucleotides
EP2089517A4 (fr) 2006-10-23 2010-10-20 Pacific Biosciences California Enzymes polymèrases et réactifs pour le séquençage amélioré d'acides nucléiques
NZ590851A (en) * 2008-07-16 2012-08-31 Dana Farber Cancer Inst Inc Signatures and pcdeterminants associated with prostate cancer and methods of use thereof
US8762072B2 (en) * 2008-10-02 2014-06-24 Koninklijke Philips N.V. Method of determining a reliability indicator for signatures obtained from clinical data and use of the reliability indicator for favoring one signature over the other
JP5773406B2 (ja) 2010-07-28 2015-09-02 学校法人明治大学 Ｇｐｉアンカー型タンパク質の判定装置、判定方法及び判定プログラム
WO2012095872A1 (fr) 2011-01-13 2012-07-19 Decode Genetics Ehf Variants génétiques comme marqueurs à utiliser dans l'évaluation du risque, le diagnostic, le pronostic et le traitement du cancer de la vessie
ES2875892T3 (es) * 2013-09-20 2021-11-11 Spraying Systems Co Boquilla de pulverización para craqueo catalítico fluidizado
CN107002121B (zh) 2014-09-18 2020-11-13 亿明达股份有限公司 用于分析核酸测序数据的方法和系统
AU2016263026A1 (en) * 2015-05-15 2017-11-09 Pioneer Hi-Bred International, Inc. Guide RNA/Cas endonuclease systems
WO2016209999A1 (fr) * 2015-06-22 2016-12-29 Counsyl, Inc. Procédés de prédiction de pathogénicité de variants de séquence génétique
CN107622182B (zh) * 2017-08-04 2020-10-09 中南大学 蛋白质局部结构特征的预测方法及系统
CN108197427B (zh) * 2018-01-02 2020-09-04 山东师范大学 基于深度卷积神经网络的蛋白质亚细胞定位方法和装置
CN108595909A (zh) * 2018-03-29 2018-09-28 山东师范大学 基于集成分类器的ta蛋白靶向预测方法

Also Published As

Publication number Publication date
AU2019272062A1 (en) 2020-04-30
IL282689A (en) 2021-06-30
IL271091A (en) 2020-04-30
WO2020081122A1 (fr) 2020-04-23
KR20200044731A (ko) 2020-04-29
AU2021269351B2 (en) 2023-12-14
CN113705585A (zh) 2021-11-26
CN111328419A (zh) 2020-06-23
JP2021152907A (ja) 2021-09-30
JP6888123B2 (ja) 2021-06-16
JP2023052011A (ja) 2023-04-11
SG10202108013QA (en) 2021-09-29
KR102165734B1 (ko) 2020-10-14
NZ759665A (en) 2022-07-01
AU2021269351A1 (en) 2021-12-09
AU2019272062B2 (en) 2021-08-19
IL271091B (en) 2021-05-31
JP7200294B2 (ja) 2023-01-06
JP2021501923A (ja) 2021-01-21
CN111328419B (zh) 2021-10-19

Similar Documents

Publication Publication Date Title
EP3659143C0 (fr) Techniques de pré-entraînement de réseaux neuronaux à convolution profonde fondées sur l'apprentissage profond
IL271091B (en) Methods based on deep learning for pre-training deep and complex neural networks
GB201915390D0 (en) Machine-learning techniques for monotonic neural networks
IL281321A (en) Efficient data layouts for convolutional neural networks
HK1249627A1 (zh) 用於卷積神經網絡的超像素方法
IL261245A (en) Structure learning in convolutional neural systems
GB2568087B (en) Activation functions for deep neural networks
IL271092A (en) Classification of variants based on deep neural networks
GB201607713D0 (en) Convolutional neural network
SG11202000350RA (en) Automated seismic interpretation using fully convolutional neural networks
EP3857409A4 (fr) Reconnaissance d'entité nommée avec des réseaux convolutifs
PL3542316T3 (pl) Oparte na uwadze sieci neuronowe z transdukcją sekwencji
PL3459017T3 (pl) Progresywne sieci neuronowe
HK1257682A1 (zh) 硅酮彈性體-水凝膠混成的隱形眼鏡
GB201718756D0 (en) Neural interface
EP3213261A4 (fr) Réseau neuronal hiérarchique à convolution profonde
EP3391290A4 (fr) Réseaux pyramidaux entièrement à convolution pour une détection de piéton
EP3861481A4 (fr) Réseaux neuronaux convolutionnels quantiques
ZA201905869B (en) Octree-based convolutional neural network
GB201901307D0 (en) Electrolytes
PL3462081T3 (pl) Korpus optyczny, sposób wytwarzania korpusu optycznego i urządzenie emitujące światło
GB201512195D0 (en) Adaptive beaconing for vehicular networks
GB201813762D0 (en) Neural interface
GB201804451D0 (en) Artificial neural networks
GB201803083D0 (en) Artificial Neural Networks