CN111670438A - 对鲁棒推理问题进行随机优化的系统与方法 - Google Patents
对鲁棒推理问题进行随机优化的系统与方法 Download PDFInfo
- Publication number
- CN111670438A CN111670438A CN201880088360.8A CN201880088360A CN111670438A CN 111670438 A CN111670438 A CN 111670438A CN 201880088360 A CN201880088360 A CN 201880088360A CN 111670438 A CN111670438 A CN 111670438A
- Authority
- CN
- China
- Prior art keywords
- functions
- loss
- objective
- function
- gradients
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 128
- 238000005457 optimization Methods 0.000 title claims abstract description 66
- 230000006870 function Effects 0.000 claims abstract description 475
- 238000005070 sampling Methods 0.000 claims abstract description 88
- 238000009826 distribution Methods 0.000 claims abstract description 25
- 238000000137 annealing Methods 0.000 claims abstract description 11
- 239000013598 vector Substances 0.000 claims description 141
- 238000004422 calculation algorithm Methods 0.000 claims description 54
- 230000003287 optical effect Effects 0.000 claims description 51
- 230000015654 memory Effects 0.000 claims description 44
- 238000012545 processing Methods 0.000 claims description 40
- 230000008878 coupling Effects 0.000 claims description 20
- 238000010168 coupling process Methods 0.000 claims description 20
- 238000005859 coupling reaction Methods 0.000 claims description 20
- 230000003044 adaptive effect Effects 0.000 claims description 18
- 238000011478 gradient descent method Methods 0.000 claims description 16
- 238000003709 image segmentation Methods 0.000 claims description 11
- 230000003252 repetitive effect Effects 0.000 claims description 10
- 238000012706 support-vector machine Methods 0.000 claims description 10
- 230000009977 dual effect Effects 0.000 claims description 9
- 238000002922 simulated annealing Methods 0.000 claims description 9
- 238000013528 artificial neural network Methods 0.000 claims description 8
- 238000012549 training Methods 0.000 claims description 8
- ORILYTVJVMAKLC-UHFFFAOYSA-N Adamantane Natural products C1C(C2)CC3CC1CC2C3 ORILYTVJVMAKLC-UHFFFAOYSA-N 0.000 claims description 6
- 230000009467 reduction Effects 0.000 claims description 6
- 230000008569 process Effects 0.000 abstract description 22
- 238000009499 grossing Methods 0.000 abstract description 6
- 238000003860 storage Methods 0.000 description 13
- 238000004891 communication Methods 0.000 description 11
- 238000010801 machine learning Methods 0.000 description 7
- 239000002131 composite material Substances 0.000 description 6
- 238000012986 modification Methods 0.000 description 5
- 230000004048 modification Effects 0.000 description 5
- IJGRMHOSHXDMSA-UHFFFAOYSA-N Atomic nitrogen Chemical compound N#N IJGRMHOSHXDMSA-UHFFFAOYSA-N 0.000 description 4
- 229910003460 diamond Inorganic materials 0.000 description 4
- 239000010432 diamond Substances 0.000 description 4
- 239000002096 quantum dot Substances 0.000 description 4
- 238000005481 NMR spectroscopy Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 238000004519 manufacturing process Methods 0.000 description 3
- XMWRBQBLMFGWIX-UHFFFAOYSA-N C60 fullerene Chemical compound C12=C3C(C4=C56)=C7C8=C5C5=C9C%10=C6C6=C4C1=C1C4=C6C6=C%10C%10=C9C9=C%11C5=C8C5=C8C7=C3C3=C7C2=C1C1=C2C4=C6C4=C%10C6=C9C9=C%11C5=C5C8=C3C3=C7C1=C1C2=C4C6=C2C9=C5C3=C12 XMWRBQBLMFGWIX-UHFFFAOYSA-N 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 230000006835 compression Effects 0.000 description 2
- 238000007906 compression Methods 0.000 description 2
- 239000013078 crystal Substances 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 229910003472 fullerene Inorganic materials 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 150000002500 ions Chemical class 0.000 description 2
- 238000003058 natural language processing Methods 0.000 description 2
- 229910052757 nitrogen Inorganic materials 0.000 description 2
- 229910052761 rare earth metal Inorganic materials 0.000 description 2
- -1 rare earth metal ions Chemical class 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- RYGMFSIKBFXOCR-UHFFFAOYSA-N Copper Chemical compound [Cu] RYGMFSIKBFXOCR-UHFFFAOYSA-N 0.000 description 1
- NHTMVDHEPJAVLT-UHFFFAOYSA-N Isooctane Chemical compound CC(C)CC(C)(C)C NHTMVDHEPJAVLT-UHFFFAOYSA-N 0.000 description 1
- 238000007476 Maximum Likelihood Methods 0.000 description 1
- 238000000342 Monte Carlo simulation Methods 0.000 description 1
- 238000012896 Statistical algorithm Methods 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000000875 corresponding effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- JVSWJIKNEAIKJW-UHFFFAOYSA-N dimethyl-hexane Natural products CCCCCC(C)C JVSWJIKNEAIKJW-UHFFFAOYSA-N 0.000 description 1
- 230000005520 electrodynamics Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000001307 helium Substances 0.000 description 1
- 229910052734 helium Inorganic materials 0.000 description 1
- SWQJXJOGLNCZEY-UHFFFAOYSA-N helium atom Chemical compound [He] SWQJXJOGLNCZEY-UHFFFAOYSA-N 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000013178 mathematical model Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000003909 pattern recognition Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000000371 solid-state nuclear magnetic resonance spectroscopy Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 239000002887 superconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/11—Complex mathematical operations for solving equations, e.g. nonlinear equations, general mathematical optimization problems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
- G06F17/10—Complex mathematical operations
- G06F17/18—Complex mathematical operations for evaluating statistical data, e.g. average values, frequency distributions, probability functions, regression analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/211—Selection of the most significant subset of features
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N10/00—Quantum computing, i.e. information processing based on quantum-mechanical phenomena
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N20/00—Machine learning
- G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/01—Dynamic search techniques; Heuristics; Dynamic trees; Branch-and-bound
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N7/00—Computing arrangements based on specific mathematical models
- G06N7/08—Computing arrangements based on specific mathematical models using chaos models or non-linear system models
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Artificial Intelligence (AREA)
- Evolutionary Computation (AREA)
- Computational Mathematics (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Pure & Applied Mathematics (AREA)
- Computing Systems (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Algebra (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Bioinformatics & Computational Biology (AREA)
- Databases & Information Systems (AREA)
- Operations Research (AREA)
- Probability & Statistics with Applications (AREA)
- Computational Linguistics (AREA)
- Condensed Matter Physics & Semiconductors (AREA)
- Medical Informatics (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- General Health & Medical Sciences (AREA)
- Molecular Biology (AREA)
- Nonlinear Science (AREA)
- Complex Calculations (AREA)
Applications Claiming Priority (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201762593563P | 2017-12-01 | 2017-12-01 | |
US62/593,563 | 2017-12-01 | ||
US201862716041P | 2018-08-08 | 2018-08-08 | |
US62/716,041 | 2018-08-08 | ||
PCT/CA2018/051534 WO2019104443A1 (en) | 2017-12-01 | 2018-11-30 | Systems and methods for stochastic optimization of a robust inference problem |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111670438A true CN111670438A (zh) | 2020-09-15 |
CN111670438B CN111670438B (zh) | 2023-12-29 |
Family
ID=66664257
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201880088360.8A Active CN111670438B (zh) | 2017-12-01 | 2018-11-30 | 对鲁棒推理问题进行随机优化的系统与方法 |
Country Status (6)
Country | Link |
---|---|
US (1) | US20200364597A1 (enIt.pdf) |
EP (1) | EP3718026B1 (enIt.pdf) |
JP (1) | JP7288905B2 (enIt.pdf) |
CN (1) | CN111670438B (enIt.pdf) |
CA (1) | CA3083008A1 (enIt.pdf) |
WO (1) | WO2019104443A1 (enIt.pdf) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023051101A1 (zh) * | 2021-09-29 | 2023-04-06 | 株式会社日立制作所 | 电力管理系统的优化方法及装置 |
CN116880438A (zh) * | 2023-04-03 | 2023-10-13 | 材谷金带(佛山)金属复合材料有限公司 | 退火设备控制系统的故障检测方法及系统 |
US12019202B2 (en) | 2021-03-25 | 2024-06-25 | Saudi Arabian Oil Company | Fast variogram modeling driven by artificial intelligence |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CA2881033C (en) | 2015-02-03 | 2016-03-15 | 1Qb Information Technologies Inc. | Method and system for solving lagrangian dual of a constrained binary quadratic programming problem |
US11797641B2 (en) | 2015-02-03 | 2023-10-24 | 1Qb Information Technologies Inc. | Method and system for solving the lagrangian dual of a constrained binary quadratic programming problem using a quantum annealer |
US11615329B2 (en) * | 2019-06-14 | 2023-03-28 | Zapata Computing, Inc. | Hybrid quantum-classical computer for Bayesian inference with engineered likelihood functions for robust amplitude estimation |
CA3126553A1 (en) | 2019-06-19 | 2020-12-24 | 1Qb Information Technologies Inc. | Method and system for mapping a dataset from a hilbert space of a given dimension to a hilbert space of a different dimension |
CN113128444B (zh) * | 2021-04-28 | 2023-02-03 | 奇瑞汽车股份有限公司 | 一种损失函数获取方法、计算机可读存储介质及电子设备 |
CN113705793B (zh) * | 2021-09-03 | 2023-04-07 | 北京百度网讯科技有限公司 | 决策变量确定方法及装置、电子设备和介质 |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3568055A (en) * | 1966-10-06 | 1971-03-02 | Norma Gmbh | Electronic device for measuring statistical parameters of stochastical processes |
US20130325401A1 (en) * | 2012-05-29 | 2013-12-05 | Xerox Corporation | Adaptive weighted stochastic gradient descent |
US20140052408A1 (en) * | 2012-08-17 | 2014-02-20 | International Business Machines Corporation | Data-driven distributionally robust optimization |
CN103618315A (zh) * | 2013-12-10 | 2014-03-05 | 广州供电局有限公司 | 一种基于bart算法和超吸收壁的电网电压无功优化方法 |
US20150363358A1 (en) * | 2014-06-12 | 2015-12-17 | 1Qb Information Technologies Inc. | Method and system for continuous optimization using a binary sampling device |
CN105426882A (zh) * | 2015-12-24 | 2016-03-23 | 上海交通大学 | 一种人脸图像中快速定位人眼的方法 |
CN106503803A (zh) * | 2016-10-31 | 2017-03-15 | 天津大学 | 一种基于拟牛顿方法的受限玻尔兹曼机迭代映射训练方法 |
CN106651089A (zh) * | 2016-09-19 | 2017-05-10 | 清华大学 | 生产调度问题的分布集鲁棒模型的建模及优化求解方法 |
CN106847248A (zh) * | 2017-01-05 | 2017-06-13 | 天津大学 | 基于鲁棒性音阶轮廓特征和向量机的和弦识别方法 |
US20170323195A1 (en) * | 2016-05-09 | 2017-11-09 | 1Qb Information Technologies Inc. | Method and system for improving a policy for a stochastic control problem |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3745322A1 (en) * | 2011-07-06 | 2020-12-02 | D-Wave Systems Inc. | Quantum processor based systems and methods that minimize an objective function |
JP6628494B2 (ja) | 2015-04-17 | 2020-01-08 | Kddi株式会社 | 実空間情報によって学習する識別器を用いて物体を追跡する装置、プログラム及び方法 |
US10366745B2 (en) | 2015-08-27 | 2019-07-30 | Hitachi, Ltd. | Semiconductor device and information processing device |
WO2017168865A1 (ja) | 2016-03-28 | 2017-10-05 | ソニー株式会社 | 情報処理装置及び情報処理方法 |
CN109983481B (zh) * | 2016-09-26 | 2023-08-15 | D-波系统公司 | 用于从采样服务器中采样的系统、方法和装置 |
-
2018
- 2018-11-30 CA CA3083008A patent/CA3083008A1/en active Pending
- 2018-11-30 EP EP18884196.9A patent/EP3718026B1/en active Active
- 2018-11-30 JP JP2020529188A patent/JP7288905B2/ja active Active
- 2018-11-30 WO PCT/CA2018/051534 patent/WO2019104443A1/en unknown
- 2018-11-30 CN CN201880088360.8A patent/CN111670438B/zh active Active
-
2020
- 2020-05-29 US US16/888,419 patent/US20200364597A1/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3568055A (en) * | 1966-10-06 | 1971-03-02 | Norma Gmbh | Electronic device for measuring statistical parameters of stochastical processes |
US20130325401A1 (en) * | 2012-05-29 | 2013-12-05 | Xerox Corporation | Adaptive weighted stochastic gradient descent |
US20140052408A1 (en) * | 2012-08-17 | 2014-02-20 | International Business Machines Corporation | Data-driven distributionally robust optimization |
CN103618315A (zh) * | 2013-12-10 | 2014-03-05 | 广州供电局有限公司 | 一种基于bart算法和超吸收壁的电网电压无功优化方法 |
US20150363358A1 (en) * | 2014-06-12 | 2015-12-17 | 1Qb Information Technologies Inc. | Method and system for continuous optimization using a binary sampling device |
CN105426882A (zh) * | 2015-12-24 | 2016-03-23 | 上海交通大学 | 一种人脸图像中快速定位人眼的方法 |
US20170323195A1 (en) * | 2016-05-09 | 2017-11-09 | 1Qb Information Technologies Inc. | Method and system for improving a policy for a stochastic control problem |
CN106651089A (zh) * | 2016-09-19 | 2017-05-10 | 清华大学 | 生产调度问题的分布集鲁棒模型的建模及优化求解方法 |
CN106503803A (zh) * | 2016-10-31 | 2017-03-15 | 天津大学 | 一种基于拟牛顿方法的受限玻尔兹曼机迭代映射训练方法 |
CN106847248A (zh) * | 2017-01-05 | 2017-06-13 | 天津大学 | 基于鲁棒性音阶轮廓特征和向量机的和弦识别方法 |
Non-Patent Citations (1)
Title |
---|
孙晓明: "量子计算若干前沿问题综述", 《中国科学:信息科学》, pages 982 - 1002 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US12019202B2 (en) | 2021-03-25 | 2024-06-25 | Saudi Arabian Oil Company | Fast variogram modeling driven by artificial intelligence |
WO2023051101A1 (zh) * | 2021-09-29 | 2023-04-06 | 株式会社日立制作所 | 电力管理系统的优化方法及装置 |
CN116880438A (zh) * | 2023-04-03 | 2023-10-13 | 材谷金带(佛山)金属复合材料有限公司 | 退火设备控制系统的故障检测方法及系统 |
CN116880438B (zh) * | 2023-04-03 | 2024-04-26 | 材谷金带(佛山)金属复合材料有限公司 | 退火设备控制系统的故障检测方法及系统 |
Also Published As
Publication number | Publication date |
---|---|
CA3083008A1 (en) | 2019-06-06 |
EP3718026A1 (en) | 2020-10-07 |
JP2021504836A (ja) | 2021-02-15 |
JP7288905B2 (ja) | 2023-06-08 |
EP3718026A4 (en) | 2021-08-18 |
CN111670438B (zh) | 2023-12-29 |
US20200364597A1 (en) | 2020-11-19 |
EP3718026B1 (en) | 2023-11-29 |
WO2019104443A1 (en) | 2019-06-06 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111670438B (zh) | 对鲁棒推理问题进行随机优化的系统与方法 | |
US20210004709A1 (en) | Constructing and programming quantum hardware for quantum annealing processes | |
US11042811B2 (en) | Discrete variational auto-encoder systems and methods for machine learning using adiabatic quantum computers | |
US20210166148A1 (en) | Variationally and adiabatically navigated quantum eigensolvers | |
US11157817B2 (en) | Discrete variational auto-encoder systems and methods for machine learning using adiabatic quantum computers | |
CN112116104B (zh) | 自动集成机器学习的方法、装置、介质及电子设备 | |
Du | The frontier of SGD and its variants in machine learning | |
Patti et al. | Markov chain Monte Carlo enhanced variational quantum algorithms | |
Wang et al. | DeepParticle: learning invariant measure by a deep neural network minimizing Wasserstein distance on data generated from an interacting particle method | |
Ben-Shaul et al. | Deep learning solution of the eigenvalue problem for differential operators | |
Chancellor | Modernizing quantum annealing II: Genetic algorithms with the inference primitive formalism | |
Xiao et al. | Structure-preserving recurrent neural networks for a class of Birkhoffian systems | |
US20230267170A1 (en) | Information processing system, information processing method, and non-transitory computer-readable recording medium for information processing program | |
Pellatt et al. | Speeding up deep neural architecture search for wearable activity recognition with early prediction of converged performance | |
US20230350976A1 (en) | System and method for optimization using quantum hamiltonian descent | |
EP4273760A1 (en) | Quantum extremal learning | |
Flugsrud | Solving Quantum Mechanical Problems with Machine Learning | |
Ferrer-Sánchez et al. | Physics-informed neural networks for an optimal counterdiabatic quantum computation | |
Zekri et al. | Can LLMs predict the convergence of Stochastic Gradient Descent? |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |