AU2019461059B2 - Secure softmax function calculation system, secure softmax function calculation apparatus, secure softmax function calculation method, secure neural network calculation system, secure neural network learning system, and program - Google Patents
Secure softmax function calculation system, secure softmax function calculation apparatus, secure softmax function calculation method, secure neural network calculation system, secure neural network learning system, and program Download PDFInfo
- Publication number
- AU2019461059B2 AU2019461059B2 AU2019461059A AU2019461059A AU2019461059B2 AU 2019461059 B2 AU2019461059 B2 AU 2019461059B2 AU 2019461059 A AU2019461059 A AU 2019461059A AU 2019461059 A AU2019461059 A AU 2019461059A AU 2019461059 B2 AU2019461059 B2 AU 2019461059B2
- Authority
- AU
- Australia
- Prior art keywords
- exp
- share
- secure
- softmax
- parameter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000004364 calculation method Methods 0.000 title claims abstract description 263
- 230000006870 function Effects 0.000 title claims description 152
- 238000013528 artificial neural network Methods 0.000 title claims description 72
- 238000013507 mapping Methods 0.000 claims description 90
- 101100075995 Schizosaccharomyces pombe (strain 972 / ATCC 24843) fma2 gene Proteins 0.000 claims description 29
- 239000013598 vector Substances 0.000 claims description 24
- 101150002692 artJ gene Proteins 0.000 claims description 11
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000012545 processing Methods 0.000 description 47
- 238000000034 method Methods 0.000 description 19
- 238000010586 diagram Methods 0.000 description 18
- 238000004891 communication Methods 0.000 description 12
- 230000004913 activation Effects 0.000 description 10
- NRNCYVBFPDDJNE-UHFFFAOYSA-N pemoline Chemical compound O1C(N)=NC(=O)C1C1=CC=CC=C1 NRNCYVBFPDDJNE-UHFFFAOYSA-N 0.000 description 10
- 238000007796 conventional method Methods 0.000 description 4
- 238000013461 design Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000008859 change Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000007667 floating Methods 0.000 description 1
- 238000011478 gradient descent method Methods 0.000 description 1
- 238000012886 linear function Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007477 logistic regression Methods 0.000 description 1
- PWPJGUXAGUPAHP-UHFFFAOYSA-N lufenuron Chemical compound C1=C(Cl)C(OC(F)(F)C(C(F)(F)F)F)=CC(Cl)=C1NC(=O)NC(=O)C1=C(F)C=CC=C1F PWPJGUXAGUPAHP-UHFFFAOYSA-N 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/60—Protecting data
- G06F21/62—Protecting access to data via a platform, e.g. using keys or access control rules
- G06F21/6218—Protecting access to data via a platform, e.g. using keys or access control rules to a system of files or objects, e.g. local or distributed file system or database
- G06F21/6245—Protecting personal data, e.g. for financial or medical purposes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
- G06N3/084—Backpropagation, e.g. using gradient descent
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/50—Monitoring users, programs or devices to maintain the integrity of platforms, e.g. of processors, firmware or operating systems
- G06F21/57—Certifying or maintaining trusted computer platforms, e.g. secure boots or power-downs, version controls, system software checks, secure updates or assessing vulnerabilities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/048—Activation functions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L9/00—Cryptographic mechanisms or cryptographic arrangements for secret or secure communications; Network security protocols
- H04L9/08—Key distribution or management, e.g. generation, sharing or updating, of cryptographic keys or passwords
- H04L9/0816—Key establishment, i.e. cryptographic processes or cryptographic protocols whereby a shared secret becomes available to two or more parties, for subsequent use
- H04L9/085—Secret sharing or secret splitting, e.g. threshold schemes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L2209/00—Additional information or applications relating to cryptographic mechanisms or cryptographic arrangements for secret or secure communication H04L9/00
- H04L2209/46—Secure multiparty computation, e.g. millionaire problem
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Data Mining & Analysis (AREA)
- Artificial Intelligence (AREA)
- Mathematical Physics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Biomedical Technology (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Bioethics (AREA)
- Medical Informatics (AREA)
- Databases & Information Systems (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Complex Calculations (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/JP2019/031916 WO2021029024A1 (ja) | 2019-08-14 | 2019-08-14 | 秘密ソフトマックス関数計算システム、秘密ソフトマックス関数計算装置、秘密ソフトマックス関数計算方法、秘密ニューラルネットワーク計算システム、秘密ニューラルネットワーク学習システム、プログラム |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| AU2019461059A1 AU2019461059A1 (en) | 2022-03-03 |
| AU2019461059B2 true AU2019461059B2 (en) | 2023-02-02 |
Family
ID=74570968
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| AU2019461059A Active AU2019461059B2 (en) | 2019-08-14 | 2019-08-14 | Secure softmax function calculation system, secure softmax function calculation apparatus, secure softmax function calculation method, secure neural network calculation system, secure neural network learning system, and program |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20220292362A1 (de) |
| EP (1) | EP4016506B1 (de) |
| JP (1) | JP7226562B2 (de) |
| CN (1) | CN114245917B (de) |
| AU (1) | AU2019461059B2 (de) |
| WO (1) | WO2021029024A1 (de) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3882823A1 (de) * | 2020-03-17 | 2021-09-22 | Samsung Electronics Co., Ltd. | Verfahren und vorrichtung mit softmax-approximation |
| JP2022150498A (ja) * | 2021-03-26 | 2022-10-07 | エヌ・ティ・ティ・コミュニケーションズ株式会社 | 学習プログラム、学習方法及び学習装置 |
| CN113407793A (zh) * | 2021-07-13 | 2021-09-17 | 南京宁麒智能计算芯片研究院有限公司 | 一种softmax函数的硬件实现方法、模块、芯片和系统 |
| CN117592527A (zh) * | 2024-01-18 | 2024-02-23 | 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) | 基于函数秘密共享的隐私保护神经网络训练方法及装置 |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4092735B2 (ja) * | 1997-12-10 | 2008-05-28 | セイコーエプソン株式会社 | 情報処理システム及び暗号／復号システム |
| US20040086117A1 (en) * | 2002-06-06 | 2004-05-06 | Petersen Mette Vesterager | Methods for improving unpredictability of output of pseudo-random number generators |
| JP2005084568A (ja) * | 2003-09-11 | 2005-03-31 | Nippon Telegr & Teleph Corp <Ntt> | セキュリティ方法、セキュリティ装置及びセキュリティプログラム |
| JP2007034927A (ja) * | 2005-07-29 | 2007-02-08 | Canon Inc | べき乗演算装置 |
| JP4685621B2 (ja) * | 2005-12-20 | 2011-05-18 | 日本電信電話株式会社 | 鍵生成装置、暗号化装置、復号化装置、乗法型ナップザック暗号システム、乗法型ナップザック暗号復号方法およびプログラム |
| CN101436932A (zh) * | 2008-12-18 | 2009-05-20 | 天津大学 | 一种抵抗简单电耗攻击的模幂计算方法 |
| WO2013001021A1 (en) * | 2011-06-28 | 2013-01-03 | Nec Europe Ltd. | Method and system for obtaining a result of a joint public function for a plurality of parties |
| US10372886B2 (en) * | 2015-05-05 | 2019-08-06 | Nxp B.V. | Protecting the input/output of modular encoded white-box RSA/ECC |
| TW201810989A (zh) * | 2016-05-18 | 2018-03-16 | 納格維遜股份有限公司 | 用以保護密碼指數的方法及系統 |
| EP3602422B1 (de) * | 2017-03-22 | 2022-03-16 | Visa International Service Association | Maschinelles lernen mit bewahrung des datenschutzes |
| CN109190395B (zh) * | 2018-08-21 | 2020-09-04 | 浙江大数据交易中心有限公司 | 一种基于数据变换的全同态加密方法及系统 |
-
2019
- 2019-08-14 JP JP2021539755A patent/JP7226562B2/ja active Active
- 2019-08-14 WO PCT/JP2019/031916 patent/WO2021029024A1/ja unknown
- 2019-08-14 AU AU2019461059A patent/AU2019461059B2/en active Active
- 2019-08-14 EP EP19941023.4A patent/EP4016506B1/de active Active
- 2019-08-14 CN CN201980099136.3A patent/CN114245917B/zh active Active
- 2019-08-14 US US17/632,509 patent/US20220292362A1/en active Pending
Non-Patent Citations (2)
| Title |
|---|
| SATSUYA OHATA: "Round-Efficient Secure Two-Party Computation, Application to Privacy-Preserving Convolutional Neural Networks", PROCEEDINGS OF COMP SEC SYMP, vol. 2018, no.2, 15-25 Oct 2018, Japan, pgs 615-622, XP009533503, ISSN: 1882-0840 * |
| TANAKA, SATOSHI ET AL.: "Cost Evaluation of Neural Network using Secret-sharing-based Secure Computation", 2017 INTERNATIONAL SYMPOSIUM ON NONLINEAR THEORY AND ITS APPLICATIONS, NOLTA2017, CANCUN, MEXICO, DECEMBER 4-7, 2017, IEICE, JP, vol. 116, no. 6, 19 May 2016 (2016-05-19), JP , pages 119 - 126, XP009523659 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114245917A (zh) | 2022-03-25 |
| JP7226562B2 (ja) | 2023-02-21 |
| JPWO2021029024A1 (de) | 2021-02-18 |
| WO2021029024A1 (ja) | 2021-02-18 |
| AU2019461059A1 (en) | 2022-03-03 |
| EP4016506B1 (de) | 2023-10-25 |
| EP4016506A4 (de) | 2023-04-12 |
| US20220292362A1 (en) | 2022-09-15 |
| CN114245917B (zh) | 2023-12-05 |
| EP4016506A1 (de) | 2022-06-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU2019461059B2 (en) | Secure softmax function calculation system, secure softmax function calculation apparatus, secure softmax function calculation method, secure neural network calculation system, secure neural network learning system, and program | |
| US11164484B2 (en) | Secure computation system, secure computation device, secure computation method, and program | |
| Çetin et al. | Depth optimized efficient homomorphic sorting | |
| EP3863002B1 (de) | System zur berechnung einer versteckten sigmoidfunktion, system zur berechnung einer versteckten logistischen regression, vorrichtung zur berechnung einer versteckten sigmoidfunktion, vorrichtung zur berechnung einer versteckten logistischen regression, verfahren zur berechnung einer versteckten sigmoidfunktion, verfahren zur berechnung einer versteckten logistischen regression sowie ein programm | |
| CN112805769B (zh) | 秘密s型函数计算系统、装置、方法及记录介质 | |
| US20180357534A1 (en) | Multi-directional Reduction in Large Scale Deep-Learning | |
| JP7060115B2 (ja) | 秘密配列アクセス装置、秘密配列アクセス方法、およびプログラム | |
| WO2019225531A1 (ja) | 秘密一括近似システム、秘密計算装置、秘密一括近似方法、およびプログラム | |
| JPWO2019059042A1 (ja) | 秘密読み込み装置、秘密書き込み装置、それらの方法、およびプログラム | |
| JP6981473B2 (ja) | 秘密読み書き装置、秘密読み書き方法、およびプログラム | |
| JPWO2016114309A1 (ja) | 行列・キー生成装置、行列・キー生成システム、行列結合装置、行列・キー生成方法、プログラム | |
| JP6474741B2 (ja) | 秘匿決定木計算システム、装置、方法及びプログラム | |
| WO2022079894A1 (ja) | 秘密指数部統一システム、秘密指数部統一装置、秘密指数部統一方法、秘密和計算システム、秘密積和計算システム、プログラム | |
| WO2023228273A1 (ja) | 秘密属性選択システム、秘密属性選択装置、秘密属性選択方法、プログラム | |
| WO2024018504A1 (ja) | クライアント装置、秘密テーブル管理システム、レコード登録要求生成方法、レコード登録方法、処理要求実行方法、プログラム | |
| JP7485067B2 (ja) | 秘密シフトシステム、秘密シフト装置、秘密シフト方法、プログラム | |
| JP7322976B2 (ja) | 秘密最大値計算装置、方法及びプログラム | |
| WO2023281693A1 (ja) | 秘密計算システム、装置、方法及びプログラム | |
| WO2023188261A1 (ja) | 秘密グローバルモデル計算装置、ローカルモデル登録方法、プログラム | |
| US20240039692A1 (en) | Private vertical federated learning | |
| US20220350638A1 (en) | Secret multiple repetition calculation apparatus, method and program | |
| CN118511210A (zh) | 秘密集群计算系统、秘密集群计算装置、秘密集群计算方法、程序 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| DA3 | Amendments made section 104 |
Free format text: THE NATURE OF THE AMENDMENT IS: AMEND THE INVENTION TITLE TO READ SECURE SOFTMAX FUNCTION CALCULATION SYSTEM, SECURE SOFTMAX FUNCTION CALCULATION APPARATUS, SECURE SOFTMAX FUNCTION CALCULATION METHOD, SECURE NEURAL NETWORK CALCULATION SYSTEM, SECURE NEURAL NETWORK LEARNING SYSTEM, AND PROGRAM |
|
| FGA | Letters patent sealed or granted (standard patent) |