JP2024539003A5 - - Google Patents
Info
- Publication number
- JP2024539003A5 JP2024539003A5 JP2024522110A JP2024522110A JP2024539003A5 JP 2024539003 A5 JP2024539003 A5 JP 2024539003A5 JP 2024522110 A JP2024522110 A JP 2024522110A JP 2024522110 A JP2024522110 A JP 2024522110A JP 2024539003 A5 JP2024539003 A5 JP 2024539003A5
- Authority
- JP
- Japan
- Prior art keywords
- layers
- machine learning
- learning model
- layer
- parameter values
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Applications Claiming Priority (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US202163254740P | 2021-10-12 | 2021-10-12 | |
| US63/254,740 | 2021-10-12 | ||
| US17/735,651 | 2022-05-03 | ||
| US17/735,651 US12512091B2 (en) | 2021-10-12 | 2022-05-03 | Fine-tuning multi-head network from a single transformer layer of pre-trained language model |
| PCT/US2022/040530 WO2023064033A1 (en) | 2021-10-12 | 2022-08-17 | Fine-tuning multi-head network from a single transformer layer of pre-trained language model |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| JP2024539003A JP2024539003A (ja) | 2024-10-28 |
| JP2024539003A5 true JP2024539003A5 (enExample) | 2025-08-04 |
Family
ID=85798249
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| JP2024522110A Pending JP2024539003A (ja) | 2021-10-12 | 2022-08-17 | 事前トレーニングされた言語モデルの単一のトランスフォーマ層からのマルチヘッドネットワークの微調整 |
Country Status (6)
| Country | Link |
|---|---|
| US (2) | US12512091B2 (enExample) |
| JP (1) | JP2024539003A (enExample) |
| KR (1) | KR20240089615A (enExample) |
| CN (1) | CN118140230A (enExample) |
| GB (1) | GB2631139A (enExample) |
| WO (1) | WO2023064033A1 (enExample) |
Families Citing this family (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US12548552B2 (en) * | 2021-11-19 | 2026-02-10 | International Business Machines Corporation | Dynamic language selection of an AI voice assistance system |
| US11947935B2 (en) * | 2021-11-24 | 2024-04-02 | Microsoft Technology Licensing, Llc. | Custom models for source code generation via prefix-tuning |
| US20240061835A1 (en) * | 2022-08-22 | 2024-02-22 | Oracle International Corporation | System and method of selective fine-tuning for custom training of a natural language to logical form model |
| US20240169165A1 (en) * | 2022-11-17 | 2024-05-23 | Samsung Electronics Co., Ltd. | Automatically Generating Annotated Ground-Truth Corpus for Training NLU Model |
| US12562163B2 (en) * | 2023-05-12 | 2026-02-24 | Servicenow, Inc. | Bidirectional assistant for development platforms |
| CN116774140A (zh) * | 2023-06-26 | 2023-09-19 | 南京邮电大学 | 基于残差注意力网络的无网格信号源doa估计方法 |
| US20250005282A1 (en) * | 2023-06-29 | 2025-01-02 | Amazon Technologies, Inc. | Domain entity extraction for performing text analysis tasks |
| CN118446218B (zh) * | 2024-05-16 | 2024-11-01 | 西南交通大学 | 一种对抗式阅读理解嵌套命名实体识别方法 |
| CA3253531A1 (en) * | 2024-06-14 | 2026-01-19 | The Toronto-Dominion Bank | Context retrieval for in-context learning model |
| EP4699019A1 (en) * | 2024-06-27 | 2026-02-25 | Beijing Youzhuju Network Technology Co. Ltd | Model-based task processing |
| JP7658644B1 (ja) * | 2024-10-21 | 2025-04-08 | スパーブエーアイ カンパニー リミテッド | 事前学習されたベースモデルに基づいたカスタムモデルを学習する方法及びそれを用いた学習装置｛ｍｅｔｈｏｄ ｆｏｒ ｔｒａｉｎｉｎｇ ｃｕｓｔｏｍ ｍｏｄｅｌ ｂａｓｅｄ ｏｎ ｐｒｅ－ｔｒａｉｎｅｄ ｂａｓｅ ｍｏｄｅｌ ａｎｄ ｌｅａｒｎｉｎｇ ｄｅｖｉｃｅ ｕｓｉｎｇ ｔｈｅ ｓａｍｅ｝ |
| CN119418320B (zh) * | 2024-10-30 | 2025-09-30 | 上海哔哩哔哩科技有限公司 | 一种模型训练方法、装置、介质和程序产品 |
| CN119418319B (zh) * | 2024-10-30 | 2025-09-30 | 上海哔哩哔哩科技有限公司 | 模型训练方法、文本检测方法、装置、介质和程序产品 |
| CN119418321B (zh) * | 2024-10-30 | 2025-09-30 | 上海哔哩哔哩科技有限公司 | 模型训练方法、用于检测和识别文本的方法及相关装置 |
| CN119915374B (zh) * | 2025-04-03 | 2025-11-14 | 浙江潮汐力科技有限公司 | 故障监测方法、装置、设备、存储介质和程序产品 |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11138392B2 (en) * | 2018-07-26 | 2021-10-05 | Google Llc | Machine translation using neural network models |
| US20200042864A1 (en) | 2018-08-02 | 2020-02-06 | Veritone, Inc. | Neural network orchestration |
| US11556778B2 (en) | 2018-12-07 | 2023-01-17 | Microsoft Technology Licensing, Llc | Automated generation of machine learning models |
| US20210279596A1 (en) | 2020-03-06 | 2021-09-09 | Hitachi, Ltd. | System for predictive maintenance using trace norm generative adversarial networks |
| US20220094713A1 (en) * | 2020-09-21 | 2022-03-24 | Sophos Limited | Malicious message detection |
| US12141701B2 (en) * | 2021-01-21 | 2024-11-12 | International Business Machines Corporation | Channel scaling: a scale-and-select approach for selective transfer learning |
| US11875898B2 (en) * | 2021-05-26 | 2024-01-16 | Merative Us L.P. | Automatic condition diagnosis using an attention-guided framework |
| US20230106669A1 (en) * | 2021-09-27 | 2023-04-06 | X Development Llc | Binding affinity prediction using neural networks |
-
2022
- 2022-05-03 US US17/735,651 patent/US12512091B2/en active Active
- 2022-08-17 KR KR1020247015690A patent/KR20240089615A/ko active Pending
- 2022-08-17 WO PCT/US2022/040530 patent/WO2023064033A1/en not_active Ceased
- 2022-08-17 JP JP2024522110A patent/JP2024539003A/ja active Pending
- 2022-08-17 GB GB2403625.3A patent/GB2631139A/en active Pending
- 2022-08-17 CN CN202280069151.5A patent/CN118140230A/zh active Pending
-
2025
- 2025-11-26 US US19/402,418 patent/US20260080864A1/en active Pending
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP2024539003A5 (enExample) | ||
| GB2631139A (en) | Fine-tuning multi-head network from a single transformer layer of pre-trained language model | |
| JP2024503517A5 (enExample) | ||
| US11886998B2 (en) | Attention-based decoder-only sequence transduction neural networks | |
| JP2022547704A5 (enExample) | ||
| US9519859B2 (en) | Deep structured semantic model produced using click-through data | |
| JP6939384B2 (ja) | データ処理装置、方法およびプログラム | |
| JP2023538923A5 (enExample) | ||
| JP7100422B2 (ja) | データプロパティ認識のための装置、プログラム、及び方法 | |
| CN119272872B (zh) | 通过应用机器学习模型来执行一批请求的方法以及非暂态计算机可读存储介质 | |
| US11372830B2 (en) | Interactive splitting of a column into multiple columns | |
| JP2024543062A5 (enExample) | ||
| CN108010514A (zh) | 一种基于深度神经网络的语音分类方法 | |
| JP2022531882A (ja) | ニューラルネットワークを初期化する方法及びシステム | |
| US10459767B2 (en) | Performing data analytics utilizing a user configurable group of reusable modules | |
| GB2579789A (en) | Runtime parameter selection in simulations | |
| CN114691891B (zh) | 一种面向知识图谱的问答推理方法 | |
| JP2020057386A5 (enExample) | ||
| JP2022171502A5 (enExample) | ||
| CN109033084B (zh) | 一种语义层次树构建方法以及装置 | |
| EP3655862A1 (en) | Multiscale quantization for fast similarity search | |
| CN115481256A (zh) | 基于卷积四元数的逆向关系旋转嵌入知识表示方法及系统 | |
| CN107315843A (zh) | 海量结构化数据的存储方法和系统 | |
| FI3607436T3 (fi) | Latenttien aiheuttajien erittely tietokonejärjestelmän optimoimiseksi | |
| Mazilu et al. | Schema mapping generation in the wild |