JP7002404B2 - データから潜在因子を発見するニューラルネットワーク - Google Patents

データから潜在因子を発見するニューラルネットワーク Download PDF

Info

Publication number
JP7002404B2
JP7002404B2 JP2018094146A JP2018094146A JP7002404B2 JP 7002404 B2 JP7002404 B2 JP 7002404B2 JP 2018094146 A JP2018094146 A JP 2018094146A JP 2018094146 A JP2018094146 A JP 2018094146A JP 7002404 B2 JP7002404 B2 JP 7002404B2
Authority
JP
Japan
Prior art keywords
data
latent
model
code
neural network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018094146A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019200551A (ja
JP2019200551A5 (https=
Inventor
チャブラ，モヒト
クリンキグト，マルティン
智一 村上
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Ltd
Original Assignee
Hitachi Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Ltd filed Critical Hitachi Ltd
Priority to JP2018094146A priority Critical patent/JP7002404B2/ja
Priority to US16/389,532 priority patent/US11468265B2/en
Priority to EP19171496.3A priority patent/EP3570221A1/en
Publication of JP2019200551A publication Critical patent/JP2019200551A/ja
Publication of JP2019200551A5 publication Critical patent/JP2019200551A5/ja
Application granted granted Critical
Publication of JP7002404B2 publication Critical patent/JP7002404B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G06N3/0455—Auto-encoder networks; Encoder-decoder networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/211—Selection of the most significant subset of features
    • G06F18/2113—Selection of the most significant subset of features by ranking or filtering the set of features, e.g. using a measure of variance or of feature cross-correlation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2148—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the process organisation or structure, e.g. boosting cascade
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214—Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • G06F18/2155—Generating training patterns; Bootstrap methods, e.g. bagging or boosting characterised by the incorporation of unlabelled data, e.g. multiple instance learning [MIL], semi-supervised techniques using expectation-maximisation [EM] or naïve labelling
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0464—Convolutional networks [CNN, ConvNet]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0495—Quantised networks; Sparse networks; Compressed networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/091—Active learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/096—Transfer learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N5/00—Computing arrangements using knowledge-based models
    • G06N5/02—Knowledge representation; Symbolic representation
    • G06N5/022—Knowledge engineering; Knowledge acquisition
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/08—Computing arrangements based on specific mathematical models using chaos models or non-linear system models

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Health & Medical Sciences (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Nonlinear Science (AREA)
  • Algebra (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Image Analysis (AREA)
  • Machine Translation (AREA)
JP2018094146A 2018-05-15 2018-05-15 データから潜在因子を発見するニューラルネットワーク Active JP7002404B2 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
JP2018094146A JP7002404B2 (ja) 2018-05-15 2018-05-15 データから潜在因子を発見するニューラルネットワーク
US16/389,532 US11468265B2 (en) 2018-05-15 2019-04-19 Neural networks for discovering latent factors from data
EP19171496.3A EP3570221A1 (en) 2018-05-15 2019-04-29 Neural networks for discovering latent factors from data

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2018094146A JP7002404B2 (ja) 2018-05-15 2018-05-15 データから潜在因子を発見するニューラルネットワーク

Publications (3)

Publication Number Publication Date
JP2019200551A JP2019200551A (ja) 2019-11-21
JP2019200551A5 JP2019200551A5 (https=) 2020-11-26
JP7002404B2 true JP7002404B2 (ja) 2022-01-20

Family

ID=66323710

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018094146A Active JP7002404B2 (ja) 2018-05-15 2018-05-15 データから潜在因子を発見するニューラルネットワーク

Country Status (3)

Country Link
US (1) US11468265B2 (https=)
EP (1) EP3570221A1 (https=)
JP (1) JP7002404B2 (https=)

Families Citing this family (45)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105308640A (zh) 2013-01-31 2016-02-03 泽斯特财务公司 用于自动生成高质量不良行为通知的方法和系统
WO2016061576A1 (en) 2014-10-17 2016-04-21 Zestfinance, Inc. Api for implementing scoring functions
US11941650B2 (en) 2017-08-02 2024-03-26 Zestfinance, Inc. Explainable machine learning financial credit approval model for protected classes of borrowers
US11489866B2 (en) 2018-03-07 2022-11-01 Private Identity Llc Systems and methods for private authentication with helper networks
US11502841B2 (en) 2018-03-07 2022-11-15 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11138333B2 (en) 2018-03-07 2021-10-05 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US10938852B1 (en) 2020-08-14 2021-03-02 Private Identity Llc Systems and methods for private authentication with helper networks
US11210375B2 (en) 2018-03-07 2021-12-28 Private Identity Llc Systems and methods for biometric processing with liveness
US11170084B2 (en) 2018-06-28 2021-11-09 Private Identity Llc Biometric authentication
US11394552B2 (en) 2018-03-07 2022-07-19 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11392802B2 (en) 2018-03-07 2022-07-19 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US10721070B2 (en) 2018-03-07 2020-07-21 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11265168B2 (en) 2018-03-07 2022-03-01 Private Identity Llc Systems and methods for privacy-enabled biometric processing
US11789699B2 (en) 2018-03-07 2023-10-17 Private Identity Llc Systems and methods for private authentication with helper networks
US11960981B2 (en) 2018-03-09 2024-04-16 Zestfinance, Inc. Systems and methods for providing machine learning model evaluation by using decomposition
EP3788560A4 (en) 2018-05-04 2022-07-13 Zestfinance, Inc. SYSTEMS AND METHODS FOR ENRICHING MODELING TOOLS AND INFRASTRUCTURE WITH SEMANTICS
US11816541B2 (en) 2019-02-15 2023-11-14 Zestfinance, Inc. Systems and methods for decomposition of differentiable and non-differentiable models
US11977388B2 (en) * 2019-02-21 2024-05-07 Nvidia Corporation Quantizing autoencoders in a neural network
CA3134043C (en) 2019-03-18 2024-10-29 Zestfinance, Inc. MODEL EQUITY SYSTEMS AND METHODS
DE102019127795A1 (de) * 2019-10-15 2021-04-15 Infineon Technologies Ag Schaltung und ein Verfahren zum Bestimmen einer Lage eines Magneten und Joystick
US12014529B2 (en) * 2020-01-21 2024-06-18 Samsung Electronics Co., Ltd. Image processing method and apparatus using neural network
CN111368976B (zh) * 2020-02-27 2022-09-02 杭州国芯科技股份有限公司 基于神经网络特征识别的数据压缩方法
KR102428334B1 (ko) * 2020-03-02 2022-08-02 단국대학교 산학협력단 딥러닝 네트워크를 이용한 전자코 가스 데이터 재구성 시스템 및 방법
US11494976B2 (en) 2020-03-06 2022-11-08 Nvidia Corporation Neural rendering for inverse graphics generation
US11776679B2 (en) * 2020-03-10 2023-10-03 The Board Of Trustees Of The Leland Stanford Junior University Methods for risk map prediction in AI-based MRI reconstruction
JP7396159B2 (ja) * 2020-03-26 2023-12-12 富士通株式会社 画像処理装置、画像認識システム及び画像処理プログラム
CN112001248B (zh) 2020-07-20 2024-03-01 北京百度网讯科技有限公司 主动交互的方法、装置、电子设备和可读存储介质
EP3975054A1 (en) * 2020-09-29 2022-03-30 Robert Bosch GmbH Device and method for classifying an input signal using an invertible factorization model
WO2022093249A1 (en) * 2020-10-29 2022-05-05 Hewlett-Packard Development Company, L.P. Latent representation scrambler and generative network adjustments
US20230410472A1 (en) * 2020-11-10 2023-12-21 Nippon Telegraph And Telephone Corporation Learning device, learning method and program
JP7436928B2 (ja) * 2020-11-10 2024-02-22 日本電信電話株式会社 学習装置、学習方法およびプログラム
US11720962B2 (en) 2020-11-24 2023-08-08 Zestfinance, Inc. Systems and methods for generating gradient-boosted models with improved fairness
US11915343B2 (en) * 2020-12-04 2024-02-27 Adobe Inc. Color representations for textual phrases
US20220253856A1 (en) * 2021-02-11 2022-08-11 The Toronto-Dominion Bank System and method for machine learning based detection of fraud
CN113127058B (zh) * 2021-04-28 2024-01-16 北京百度网讯科技有限公司 数据标注方法、相关装置及计算机程序产品
US12346479B2 (en) * 2021-05-14 2025-07-01 Siemens Aktiengesellschaft Privacy preservation of data over a shared network
JP7617811B2 (ja) * 2021-05-21 2025-01-20 株式会社日立ハイテク 機械学習システム
US12254406B2 (en) * 2021-06-22 2025-03-18 Google Llc Object observation prediction in images using encoder-decoder models
CN113703986B (zh) * 2021-10-29 2022-03-11 苏州优鲜信网络生活服务科技有限公司 一种基于大数据的信息管理系统与方法
EP4454281A1 (en) * 2021-12-22 2024-10-30 Deep Render Ltd Method and data processing system for lossy image or video encoding, transmission and decoding
US11886955B2 (en) * 2022-02-16 2024-01-30 Protopia AI, Inc. Self-supervised data obfuscation in foundation models
JP7813185B2 (ja) * 2022-05-26 2026-02-12 Kddi株式会社 予測装置、プログラム及び学習方法
US20250217934A1 (en) * 2023-12-27 2025-07-03 Faurecia Irystec Inc. Noise, flare, and/or other degradation suppression and/or removal for images
US20250307546A1 (en) * 2024-03-31 2025-10-02 Cyberark Software Ltd. Systems and methods for large language model optimization using prompt structuring
CN118229441B (zh) * 2024-05-27 2024-08-23 江西微博科技有限公司 一种基于智能关联图谱的电子凭证数据应用方法及系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017094899A1 (en) 2015-12-02 2017-06-08 Preferred Networks, Inc. Generative machine learning systems for drug design
WO2017094267A1 (ja) 2015-12-01 2017-06-08 株式会社Ｐｒｅｆｅｒｒｅｄ Ｎｅｔｗｏｒｋｓ 異常検出システム、異常検出方法、異常検出プログラム及び学習済モデル生成方法

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170328194A1 (en) * 2016-04-25 2017-11-16 University Of Southern California Autoencoder-derived features as inputs to classification algorithms for predicting failures
US10373055B1 (en) * 2016-05-20 2019-08-06 Deepmind Technologies Limited Training variational autoencoders to generate disentangled latent factors
CN109923560A (zh) 2016-11-04 2019-06-21 谷歌有限责任公司 使用变分信息瓶颈来训练神经网络
US10679129B2 (en) * 2017-09-28 2020-06-09 D5Ai Llc Stochastic categorical autoencoder network

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017094267A1 (ja) 2015-12-01 2017-06-08 株式会社Ｐｒｅｆｅｒｒｅｄ Ｎｅｔｗｏｒｋｓ 異常検出システム、異常検出方法、異常検出プログラム及び学習済モデル生成方法
WO2017094899A1 (en) 2015-12-02 2017-06-08 Preferred Networks, Inc. Generative machine learning systems for drug design

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Pascal Vincent et al.，Extracting and Composing Robust Features with Denoising Autoencoders，Proceedings of the 25th International Conference on Machine Learning，ACM，2008年07月05日

Also Published As

Publication number Publication date
JP2019200551A (ja) 2019-11-21
US11468265B2 (en) 2022-10-11
EP3570221A1 (en) 2019-11-20
US20190354806A1 (en) 2019-11-21

Similar Documents

Publication Publication Date Title
JP7002404B2 (ja) データから潜在因子を発見するニューラルネットワーク
Liang et al. ResWCAE: Biometric pattern image denoising using residual wavelet-conditioned autoencoder
US20230021661A1 (en) Forgery detection of face image
US10650276B1 (en) Learning to process images depicting faces without leveraging sensitive attributes in deep learning models
Sun et al. An information theoretic approach for attention-driven face forgery detection
Song et al. Machine learning models that remember too much
US20230222762A1 (en) Adversarially robust visual fingerprinting and image provenance models
Wang et al. JPEG artifacts removal via contrastive representation learning
US20210150369A1 (en) Weight demodulation for a generative neural network
Yang et al. Self-feature distillation with uncertainty modeling for degraded image recognition
Ilyas et al. E-Cap Net: an efficient-capsule network for shallow and deepfakes forgery detection
Berrahal et al. A comparative analysis of fake image detection in generative adversarial networks and variational autoencoders
Agarwal et al. Unmasking the potential: evaluating image inpainting techniques for masked face reconstruction
Li et al. On mask-based image set desensitization with recognition support: Q. Li et al.
Guo et al. MalFSLDF: A Few‐Shot Learning‐Based Malware Family Detection Framework
Xiao et al. Region-aware sequence-to-sequence learning for hyperspectral denoising
CN118071867B (zh) 将文本数据转换为图像数据的方法和装置
Uyyala et al. SECURE CRYPTO-BIOMETRIC SYSTEM FOR CLOUD COMPUTING
CN118797685A (zh) 一种基于分类任务的图像加密方法
CN117636430A (zh) 基于对抗语义掩膜的隐蔽性人脸攻击对抗方法及系统
Harby et al. Ai-guided vectorization for efficient storage and semantic retrieval of visual data
Korsipati et al. Multi-resolution transfer learning for tampered image classification using SE-enhanced fused-MBConv and optimized CNN heads
Wang Enhancing emotion detection through CNN-based facial expression recognition
Li et al. Face inpainting with dynamic structural information of facial action units
Polezhaev et al. Mds-vitnet: Improving saliency prediction for eye-tracking with vision transformer

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20201013

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20201013

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210928

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20211102

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20211206

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20211221

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20211227

R150 Certificate of patent or registration of utility model

Ref document number: 7002404

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150