JP7513396B2 - 関連性を算出する方法、関連性を算出する装置、データクエリ装置及び非一時的なコンピュータ可読記録媒体 - Google Patents

関連性を算出する方法、関連性を算出する装置、データクエリ装置及び非一時的なコンピュータ可読記録媒体 Download PDF

Info

Publication number
JP7513396B2
JP7513396B2 JP2019569437A JP2019569437A JP7513396B2 JP 7513396 B2 JP7513396 B2 JP 7513396B2 JP 2019569437 A JP2019569437 A JP 2019569437A JP 2019569437 A JP2019569437 A JP 2019569437A JP 7513396 B2 JP7513396 B2 JP 7513396B2
Authority
JP
Japan
Prior art keywords
text
semantic
differences
similarities
calculating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019569437A
Other languages
English (en)
Japanese (ja)
Other versions
JP2021510858A (ja
JP2021510858A5 (enExample
Inventor
ジェンジョン・ジャン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
BOE Technology Group Co Ltd
Original Assignee
BOE Technology Group Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by BOE Technology Group Co Ltd filed Critical BOE Technology Group Co Ltd
Publication of JP2021510858A publication Critical patent/JP2021510858A/ja
Publication of JP2021510858A5 publication Critical patent/JP2021510858A5/ja
Application granted granted Critical
Publication of JP7513396B2 publication Critical patent/JP7513396B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/3332—Query translation
    • G06F16/3334—Selection or weighting of terms from queries, including natural language queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3344—Query execution using natural language analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3347—Query execution using vector based model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/338—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/194—Calculation of difference between files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2019569437A 2018-01-22 2018-06-19 関連性を算出する方法、関連性を算出する装置、データクエリ装置及び非一時的なコンピュータ可読記録媒体 Active JP7513396B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201810060942.7 2018-01-22
CN201810060942.7A CN108170684B (zh) 2018-01-22 2018-01-22 文本相似度计算方法及系统、数据查询系统和计算机产品
PCT/CN2018/091822 WO2019140863A1 (en) 2018-01-22 2018-06-19 Method of calculating relevancy, apparatus for calculating relevancy, data query apparatus, and non-transitory computer-readable storage medium

Publications (3)

Publication Number Publication Date
JP2021510858A JP2021510858A (ja) 2021-04-30
JP2021510858A5 JP2021510858A5 (enExample) 2024-05-15
JP7513396B2 true JP7513396B2 (ja) 2024-07-09

Family

ID=62515240

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019569437A Active JP7513396B2 (ja) 2018-01-22 2018-06-19 関連性を算出する方法、関連性を算出する装置、データクエリ装置及び非一時的なコンピュータ可読記録媒体

Country Status (6)

Country Link
US (1) US11281861B2 (enExample)
EP (1) EP3743831A4 (enExample)
JP (1) JP7513396B2 (enExample)
KR (1) KR102411921B1 (enExample)
CN (1) CN108170684B (enExample)
WO (1) WO2019140863A1 (enExample)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108170684B (zh) * 2018-01-22 2020-06-05 京东方科技集团股份有限公司 文本相似度计算方法及系统、数据查询系统和计算机产品
CN110688119A (zh) * 2018-07-04 2020-01-14 阿里巴巴集团控股有限公司 业务功能和单元的生成、实现方法和服务器、设备、介质
CN109145085B (zh) * 2018-07-18 2020-11-27 北京市农林科学院 语义相似度的计算方法及系统
CN110852056B (zh) * 2018-07-25 2024-09-24 中兴通讯股份有限公司 一种获取文本相似度的方法、装置、设备及可读存储介质
CN110852057A (zh) * 2018-07-27 2020-02-28 北京京东尚科信息技术有限公司 一种计算文本相似度的方法和装置
CN111382246B (zh) * 2018-12-29 2023-03-14 深圳市优必选科技有限公司 文本的匹配方法、匹配装置、终端及计算机可读存储介质
CN110147429B (zh) * 2019-04-15 2023-08-15 平安科技（深圳）有限公司 文本比较方法、装置、计算机设备和存储介质
CN110265104B (zh) * 2019-05-08 2022-04-29 长沙市中心医院 诊断报告符合度检测方法、装置、计算机设备和存储介质
CN110176315B (zh) * 2019-06-05 2022-06-28 京东方科技集团股份有限公司 医疗问答方法及系统、电子设备、计算机可读介质
CN110750977B (zh) * 2019-10-23 2023-06-02 支付宝(杭州)信息技术有限公司 一种文本相似度计算方法及系统
CN110969006B (zh) * 2019-12-02 2023-03-21 支付宝(杭州)信息技术有限公司 一种文本排序模型的训练方法和系统
CN111159343A (zh) * 2019-12-26 2020-05-15 上海科技发展有限公司 基于文本嵌入的文本相似性搜索方法、装置、设备和介质
CN111160028B (zh) * 2019-12-31 2023-05-16 东软集团股份有限公司 判断两个文本语义相似度的方法、装置、存储介质及设备
WO2021191938A1 (ja) * 2020-03-23 2021-09-30 日本電信電話株式会社 要約生成装置、要約生成方法及びプログラム
DE102020109953A1 (de) * 2020-04-09 2021-10-14 Contexon GmbH Verfahren und Computersystem zur Bestimmung der Relevanz eines Textes
CN112819893A (zh) * 2021-02-08 2021-05-18 北京航空航天大学 三维语义地图的构建方法和装置
CN114973219B (zh) * 2021-02-25 2025-12-12 阿里巴巴集团控股有限公司 一种文字内容提取方法和装置
CN113761868B (zh) * 2021-04-20 2023-06-09 腾讯科技（深圳）有限公司 文本处理方法、装置、电子设备及可读存储介质
US12259912B2 (en) 2021-06-23 2025-03-25 Servicenow Canada Inc. Method and system for interactive searching based on semantic similarity of semantic representations of text objects
CN114168837A (zh) * 2021-11-18 2022-03-11 深圳市梦网科技发展有限公司 一种Chatbot的搜索方法、设备及存储介质

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130054612A1 (en) 2006-10-10 2013-02-28 Abbyy Software Ltd. Universal Document Similarity
US20150120720A1 (en) 2012-06-22 2015-04-30 Krishna Kishore Dhara Method and system of identifying relevant content snippets that include additional information
JP2017010249A (ja) 2015-06-22 2017-01-12 日本電信電話株式会社 パラメタ学習装置、文類似度算出装置、方法、及びプログラム
JP2017027106A (ja) 2015-07-15 2017-02-02 日本放送協会 類似度算出装置、類似検索装置、および類似度算出プログラム

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6658626B1 (en) * 1998-07-31 2003-12-02 The Regents Of The University Of California User interface for displaying document comparison information
US6990628B1 (en) * 1999-06-14 2006-01-24 Yahoo! Inc. Method and apparatus for measuring similarity among electronic documents
US6560620B1 (en) * 1999-08-03 2003-05-06 Aplix Research, Inc. Hierarchical document comparison system and method
US6766316B2 (en) * 2001-01-18 2004-07-20 Science Applications International Corporation Method and system of ranking and clustering for document indexing and retrieval
US20040093564A1 (en) * 2002-11-07 2004-05-13 International Business Machines Corporation Method and apparatus for visualizing changes in data
JP4391157B2 (ja) 2003-08-15 2009-12-24 株式会社リコー 文書処理装置、文書処理方法、文書処理プログラム、および記録媒体
EP1866738A4 (en) * 2005-03-18 2010-09-15 Search Engine Technologies Llc SEARCH ENGINE THAT APPLIES USER REPORTS TO IMPROVE SEARCH RESULTS
US9189482B2 (en) * 2012-10-10 2015-11-17 Abbyy Infopoisk Llc Similar document search
US20080114750A1 (en) * 2006-11-14 2008-05-15 Microsoft Corporation Retrieval and ranking of items utilizing similarity
US8082233B2 (en) * 2007-03-29 2011-12-20 Microsoft Corporation Comparing data sets through identification of matching blocks
US8122032B2 (en) * 2007-07-20 2012-02-21 Google Inc. Identifying and linking similar passages in a digital text corpus
US7945525B2 (en) * 2007-11-09 2011-05-17 International Business Machines Corporation Methods for obtaining improved text similarity measures which replace similar characters with a string pattern representation by using a semantic data tree
US20090240498A1 (en) * 2008-03-19 2009-09-24 Microsoft Corporation Similiarity measures for short segments of text
JP5458880B2 (ja) * 2009-03-02 2014-04-02 富士通株式会社 文書検査装置、コンピュータ読み取り可能な記録媒体および文書検査方法
WO2011029474A1 (en) * 2009-09-09 2011-03-17 Universität Bremen Document comparison
JP2013149061A (ja) * 2012-01-19 2013-08-01 Nec Corp 文書類似性評価システム、文書類似性評価方法およびコンピュータ・プログラム
US20140249799A1 (en) * 2013-03-04 2014-09-04 Microsoft Corporation Relational similarity measurement
US20150212993A1 (en) * 2014-01-30 2015-07-30 International Business Machines Corporation Impact Coverage
US9477654B2 (en) * 2014-04-01 2016-10-25 Microsoft Corporation Convolutional latent semantic models and their applications
US20160196342A1 (en) * 2015-01-06 2016-07-07 Inha-Industry Partnership Plagiarism Document Detection System Based on Synonym Dictionary and Automatic Reference Citation Mark Attaching System
JP2016197289A (ja) * 2015-04-02 2016-11-24 日本電信電話株式会社 パラメタ学習装置、類似度算出装置、方法、及びプログラム
CN105138647A (zh) * 2015-08-26 2015-12-09 陕西师范大学 一种基于Simhash算法的旅游网络社区划分方法
US9836671B2 (en) 2015-08-28 2017-12-05 Microsoft Technology Licensing, Llc Discovery of semantic similarities between images and text
CN106485507B (zh) * 2015-09-01 2019-10-18 阿里巴巴集团控股有限公司 一种软件推广作弊的检测方法、装置及系统
CN105893410A (zh) 2015-11-18 2016-08-24 乐视网信息技术（北京）股份有限公司 一种关键词提取方法和装置
CN107220220A (zh) * 2016-03-22 2017-09-29 索尼公司 用于文本处理的电子设备和方法
US10102191B2 (en) * 2016-06-16 2018-10-16 Adobe Systems Incorporated Propagation of changes in master content to variant content
US10769522B2 (en) * 2017-02-17 2020-09-08 Wipro Limited Method and system for determining classification of text
CN107133202A (zh) * 2017-06-01 2017-09-05 北京百度网讯科技有限公司 基于人工智能的文本校验方法和装置
CN107436864B (zh) * 2017-08-04 2021-03-02 识因智能科技(北京)有限公司 一种基于Word2Vec的中文问答语义相似度计算方法
CN107491547B (zh) * 2017-08-28 2020-11-10 北京百度网讯科技有限公司 基于人工智能的搜索方法和装置
CN108170684B (zh) * 2018-01-22 2020-06-05 京东方科技集团股份有限公司 文本相似度计算方法及系统、数据查询系统和计算机产品

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130054612A1 (en) 2006-10-10 2013-02-28 Abbyy Software Ltd. Universal Document Similarity
US20150120720A1 (en) 2012-06-22 2015-04-30 Krishna Kishore Dhara Method and system of identifying relevant content snippets that include additional information
JP2017010249A (ja) 2015-06-22 2017-01-12 日本電信電話株式会社 パラメタ学習装置、文類似度算出装置、方法、及びプログラム
JP2017027106A (ja) 2015-07-15 2017-02-02 日本放送協会 類似度算出装置、類似検索装置、および類似度算出プログラム

Also Published As

Publication number Publication date
EP3743831A4 (en) 2021-09-29
WO2019140863A1 (en) 2019-07-25
US20210334464A1 (en) 2021-10-28
JP2021510858A (ja) 2021-04-30
US11281861B2 (en) 2022-03-22
EP3743831A1 (en) 2020-12-02
CN108170684A (zh) 2018-06-15
KR20200078576A (ko) 2020-07-01
CN108170684B (zh) 2020-06-05
KR102411921B1 (ko) 2022-06-23

Similar Documents

Publication Publication Date Title
KR102411921B1 (ko) 관련성을 계산하는 방법, 관련성을 계산하기 위한 장치, 데이터 쿼리 장치, 및 비-일시적 컴퓨터-판독가능 저장 매체
CN114565104B (zh) 语言模型的预训练方法、结果推荐方法及相关装置
JP7584642B2 (ja) 自己適応閾値及びローカルコンテキストプーリングを用いて関係抽出を行うシステム及び方法
CN114547267B (zh) 智能问答模型的生成方法、装置、计算设备和存储介质
CN110019701B (zh) 用于问答服务的方法、问答服务系统以及存储介质
EP3376400A1 (en) Dynamic context adjustment in language models
CN120873195A (zh) 用于基于图谱的动态信息检索及合成的系统和方法
CN117521814B (zh) 一种基于多模态输入和知识图谱的问答方法及装置
JP5662961B2 (ja) レビュー処理方法およびシステム
WO2023029506A1 (zh) 病情分析方法、装置、电子设备及存储介质
CN111476029B (zh) 资源推荐方法和装置
CN114385930B (zh) 一种兴趣点推荐方法及系统
Jung et al. Expansive data, extensive model: Investigating discussion topics around LLM through unsupervised machine learning in academic papers and news
Chun et al. Gene regulation network inference with joint sparse gaussian graphical models
CN118377875A (zh) 一种基于颈椎疾病知识图谱的大语言模型问答方法及装置
Fernández-Reyes et al. CV Retrieval System based on job description matching using hybrid word embeddings
CN113515589B (zh) 数据推荐方法、装置、设备以及介质
US20260058018A1 (en) Methods and systems for confirming an advisory interaction with an artificial intelligence platform
CN106407316A (zh) 基于主题模型的软件问答推荐方法和装置
Wang et al. A meta-learning based stress category detection framework on social media
WO2022003997A1 (ja) パスウェイ生成装置、パスウェイ生成方法およびパスウェイ生成用プログラム
Vekariya et al. A novel approach for semantic similarity measurement for high quality answer selection in question answering using deep learning methods
CN119719349A (zh) 用户问题的推荐方法、装置、电子设备以及可读存储介质
EP3499386A1 (en) Apparatus, program, and method for storing and processing graph data
JP7034453B1 (ja) 情報解析装置、情報解析方法および情報解析用プログラム

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210616

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20210616

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20220729

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20220905

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20221205

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20230403

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20230803

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20230804

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20230824

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20231013

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20240326

A524 Written submission of copy of amendment under article 19 pct

Free format text: JAPANESE INTERMEDIATE CODE: A524

Effective date: 20240426

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20240627

R150 Certificate of patent or registration of utility model

Ref document number: 7513396

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150