KR102411921B1 - 관련성을 계산하는 방법, 관련성을 계산하기 위한 장치, 데이터 쿼리 장치, 및 비-일시적 컴퓨터-판독가능 저장 매체 - Google Patents

관련성을 계산하는 방법, 관련성을 계산하기 위한 장치, 데이터 쿼리 장치, 및 비-일시적 컴퓨터-판독가능 저장 매체 Download PDF

Info

Publication number
KR102411921B1
KR102411921B1 KR1020207014877A KR20207014877A KR102411921B1 KR 102411921 B1 KR102411921 B1 KR 102411921B1 KR 1020207014877 A KR1020207014877 A KR 1020207014877A KR 20207014877 A KR20207014877 A KR 20207014877A KR 102411921 B1 KR102411921 B1 KR 102411921B1
Authority
KR
South Korea
Prior art keywords
text
similar
dissimilar
vectors
semantic
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020207014877A
Other languages
English (en)
Korean (ko)
Other versions
KR20200078576A (ko
Inventor
전중 장
Original Assignee
보에 테크놀로지 그룹 컴퍼니 리미티드
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 보에 테크놀로지 그룹 컴퍼니 리미티드 filed Critical 보에 테크놀로지 그룹 컴퍼니 리미티드
Publication of KR20200078576A publication Critical patent/KR20200078576A/ko
Application granted granted Critical
Publication of KR102411921B1 publication Critical patent/KR102411921B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3347—Query execution using vector based model
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/30—Semantic analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/3332—Query translation
    • G06F16/3334—Selection or weighting of terms from queries, including natural language queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/3331—Query processing
    • G06F16/334—Query execution
    • G06F16/3344—Query execution using natural language analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/338—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/10—Text processing
    • G06F40/194—Calculation of difference between files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00—Handling natural language data
    • G06F40/20—Natural language analysis
    • G06F40/279—Recognition of textual entities
    • G06F40/289—Phrasal analysis, e.g. finite state techniques or chunking
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G06N3/0442—Recurrent networks, e.g. Hopfield networks characterised by memory or gating, e.g. long short-term memory [LSTM] or gated recurrent units [GRU]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • General Physics & Mathematics (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Molecular Biology (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Biophysics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
KR1020207014877A 2018-01-22 2018-06-19 관련성을 계산하는 방법, 관련성을 계산하기 위한 장치, 데이터 쿼리 장치, 및 비-일시적 컴퓨터-판독가능 저장 매체 Active KR102411921B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201810060942.7 2018-01-22
CN201810060942.7A CN108170684B (zh) 2018-01-22 2018-01-22 文本相似度计算方法及系统、数据查询系统和计算机产品
PCT/CN2018/091822 WO2019140863A1 (en) 2018-01-22 2018-06-19 Method of calculating relevancy, apparatus for calculating relevancy, data query apparatus, and non-transitory computer-readable storage medium

Publications (2)

Publication Number Publication Date
KR20200078576A KR20200078576A (ko) 2020-07-01
KR102411921B1 true KR102411921B1 (ko) 2022-06-23

Family

ID=62515240

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020207014877A Active KR102411921B1 (ko) 2018-01-22 2018-06-19 관련성을 계산하는 방법, 관련성을 계산하기 위한 장치, 데이터 쿼리 장치, 및 비-일시적 컴퓨터-판독가능 저장 매체

Country Status (6)

Country Link
US (1) US11281861B2 (enExample)
EP (1) EP3743831A4 (enExample)
JP (1) JP7513396B2 (enExample)
KR (1) KR102411921B1 (enExample)
CN (1) CN108170684B (enExample)
WO (1) WO2019140863A1 (enExample)

Families Citing this family (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108170684B (zh) * 2018-01-22 2020-06-05 京东方科技集团股份有限公司 文本相似度计算方法及系统、数据查询系统和计算机产品
CN110688119A (zh) * 2018-07-04 2020-01-14 阿里巴巴集团控股有限公司 业务功能和单元的生成、实现方法和服务器、设备、介质
CN109145085B (zh) * 2018-07-18 2020-11-27 北京市农林科学院 语义相似度的计算方法及系统
CN110852056B (zh) * 2018-07-25 2024-09-24 中兴通讯股份有限公司 一种获取文本相似度的方法、装置、设备及可读存储介质
CN110852057A (zh) * 2018-07-27 2020-02-28 北京京东尚科信息技术有限公司 一种计算文本相似度的方法和装置
CN111382246B (zh) * 2018-12-29 2023-03-14 深圳市优必选科技有限公司 文本的匹配方法、匹配装置、终端及计算机可读存储介质
CN110147429B (zh) * 2019-04-15 2023-08-15 平安科技（深圳）有限公司 文本比较方法、装置、计算机设备和存储介质
CN110265104B (zh) * 2019-05-08 2022-04-29 长沙市中心医院 诊断报告符合度检测方法、装置、计算机设备和存储介质
CN110176315B (zh) * 2019-06-05 2022-06-28 京东方科技集团股份有限公司 医疗问答方法及系统、电子设备、计算机可读介质
CN110750977B (zh) * 2019-10-23 2023-06-02 支付宝(杭州)信息技术有限公司 一种文本相似度计算方法及系统
CN110969006B (zh) * 2019-12-02 2023-03-21 支付宝(杭州)信息技术有限公司 一种文本排序模型的训练方法和系统
CN111159343A (zh) * 2019-12-26 2020-05-15 上海科技发展有限公司 基于文本嵌入的文本相似性搜索方法、装置、设备和介质
CN111160028B (zh) * 2019-12-31 2023-05-16 东软集团股份有限公司 判断两个文本语义相似度的方法、装置、存储介质及设备
WO2021191938A1 (ja) * 2020-03-23 2021-09-30 日本電信電話株式会社 要約生成装置、要約生成方法及びプログラム
DE102020109953A1 (de) * 2020-04-09 2021-10-14 Contexon GmbH Verfahren und Computersystem zur Bestimmung der Relevanz eines Textes
CN112819893A (zh) * 2021-02-08 2021-05-18 北京航空航天大学 三维语义地图的构建方法和装置
CN114973219B (zh) * 2021-02-25 2025-12-12 阿里巴巴集团控股有限公司 一种文字内容提取方法和装置
CN113761868B (zh) * 2021-04-20 2023-06-09 腾讯科技（深圳）有限公司 文本处理方法、装置、电子设备及可读存储介质
US12259912B2 (en) 2021-06-23 2025-03-25 Servicenow Canada Inc. Method and system for interactive searching based on semantic similarity of semantic representations of text objects
CN114168837A (zh) * 2021-11-18 2022-03-11 深圳市梦网科技发展有限公司 一种Chatbot的搜索方法、设备及存储介质

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020129015A1 (en) 2001-01-18 2002-09-12 Maureen Caudill Method and system of ranking and clustering for document indexing and retrieval
JP2005063220A (ja) * 2003-08-15 2005-03-10 Ricoh Co Ltd 文書処理装置、文書処理システム、文書処理方法、文書処理プログラムおよび記録媒体
US20080114750A1 (en) * 2006-11-14 2008-05-15 Microsoft Corporation Retrieval and ranking of items utilizing similarity
JP2012212455A (ja) 2005-03-18 2012-11-01 Search Engine Technologies Llc 格付け方法及び格付けシステム
JP2016197289A (ja) 2015-04-02 2016-11-24 日本電信電話株式会社 パラメタ学習装置、類似度算出装置、方法、及びプログラム

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6658626B1 (en) * 1998-07-31 2003-12-02 The Regents Of The University Of California User interface for displaying document comparison information
US6990628B1 (en) * 1999-06-14 2006-01-24 Yahoo! Inc. Method and apparatus for measuring similarity among electronic documents
US6560620B1 (en) * 1999-08-03 2003-05-06 Aplix Research, Inc. Hierarchical document comparison system and method
US20040093564A1 (en) * 2002-11-07 2004-05-13 International Business Machines Corporation Method and apparatus for visualizing changes in data
US9189482B2 (en) * 2012-10-10 2015-11-17 Abbyy Infopoisk Llc Similar document search
US9892111B2 (en) * 2006-10-10 2018-02-13 Abbyy Production Llc Method and device to estimate similarity between documents having multiple segments
US8082233B2 (en) * 2007-03-29 2011-12-20 Microsoft Corporation Comparing data sets through identification of matching blocks
US8122032B2 (en) * 2007-07-20 2012-02-21 Google Inc. Identifying and linking similar passages in a digital text corpus
US7945525B2 (en) * 2007-11-09 2011-05-17 International Business Machines Corporation Methods for obtaining improved text similarity measures which replace similar characters with a string pattern representation by using a semantic data tree
US20090240498A1 (en) * 2008-03-19 2009-09-24 Microsoft Corporation Similiarity measures for short segments of text
JP5458880B2 (ja) * 2009-03-02 2014-04-02 富士通株式会社 文書検査装置、コンピュータ読み取り可能な記録媒体および文書検査方法
WO2011029474A1 (en) * 2009-09-09 2011-03-17 Universität Bremen Document comparison
JP2013149061A (ja) * 2012-01-19 2013-08-01 Nec Corp 文書類似性評価システム、文書類似性評価方法およびコンピュータ・プログラム
US9720979B2 (en) * 2012-06-22 2017-08-01 Krishna Kishore Dhara Method and system of identifying relevant content snippets that include additional information
US20140249799A1 (en) * 2013-03-04 2014-09-04 Microsoft Corporation Relational similarity measurement
US20150212993A1 (en) * 2014-01-30 2015-07-30 International Business Machines Corporation Impact Coverage
US9477654B2 (en) * 2014-04-01 2016-10-25 Microsoft Corporation Convolutional latent semantic models and their applications
US20160196342A1 (en) * 2015-01-06 2016-07-07 Inha-Industry Partnership Plagiarism Document Detection System Based on Synonym Dictionary and Automatic Reference Citation Mark Attaching System
JP2017010249A (ja) * 2015-06-22 2017-01-12 日本電信電話株式会社 パラメタ学習装置、文類似度算出装置、方法、及びプログラム
JP6555810B2 (ja) * 2015-07-15 2019-08-07 日本放送協会 類似度算出装置、類似検索装置、および類似度算出プログラム
CN105138647A (zh) * 2015-08-26 2015-12-09 陕西师范大学 一种基于Simhash算法的旅游网络社区划分方法
US9836671B2 (en) 2015-08-28 2017-12-05 Microsoft Technology Licensing, Llc Discovery of semantic similarities between images and text
CN106485507B (zh) * 2015-09-01 2019-10-18 阿里巴巴集团控股有限公司 一种软件推广作弊的检测方法、装置及系统
CN105893410A (zh) 2015-11-18 2016-08-24 乐视网信息技术（北京）股份有限公司 一种关键词提取方法和装置
CN107220220A (zh) * 2016-03-22 2017-09-29 索尼公司 用于文本处理的电子设备和方法
US10102191B2 (en) * 2016-06-16 2018-10-16 Adobe Systems Incorporated Propagation of changes in master content to variant content
US10769522B2 (en) * 2017-02-17 2020-09-08 Wipro Limited Method and system for determining classification of text
CN107133202A (zh) * 2017-06-01 2017-09-05 北京百度网讯科技有限公司 基于人工智能的文本校验方法和装置
CN107436864B (zh) * 2017-08-04 2021-03-02 识因智能科技(北京)有限公司 一种基于Word2Vec的中文问答语义相似度计算方法
CN107491547B (zh) * 2017-08-28 2020-11-10 北京百度网讯科技有限公司 基于人工智能的搜索方法和装置
CN108170684B (zh) * 2018-01-22 2020-06-05 京东方科技集团股份有限公司 文本相似度计算方法及系统、数据查询系统和计算机产品

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020129015A1 (en) 2001-01-18 2002-09-12 Maureen Caudill Method and system of ranking and clustering for document indexing and retrieval
JP2005063220A (ja) * 2003-08-15 2005-03-10 Ricoh Co Ltd 文書処理装置、文書処理システム、文書処理方法、文書処理プログラムおよび記録媒体
JP2012212455A (ja) 2005-03-18 2012-11-01 Search Engine Technologies Llc 格付け方法及び格付けシステム
US20080114750A1 (en) * 2006-11-14 2008-05-15 Microsoft Corporation Retrieval and ranking of items utilizing similarity
JP2016197289A (ja) 2015-04-02 2016-11-24 日本電信電話株式会社 パラメタ学習装置、類似度算出装置、方法、及びプログラム

Also Published As

Publication number Publication date
JP7513396B2 (ja) 2024-07-09
EP3743831A4 (en) 2021-09-29
WO2019140863A1 (en) 2019-07-25
US20210334464A1 (en) 2021-10-28
JP2021510858A (ja) 2021-04-30
US11281861B2 (en) 2022-03-22
EP3743831A1 (en) 2020-12-02
CN108170684A (zh) 2018-06-15
KR20200078576A (ko) 2020-07-01
CN108170684B (zh) 2020-06-05

Similar Documents

Publication Publication Date Title
JP7513396B2 (ja) 関連性を算出する方法、関連性を算出する装置、データクエリ装置及び非一時的なコンピュータ可読記録媒体
CN114547267B (zh) 智能问答模型的生成方法、装置、计算设备和存储介质
US9607014B2 (en) Image tagging
US8612369B2 (en) System and methods for finding hidden topics of documents and preference ranking documents
KR102371167B1 (ko) 데이터 아이템을 성긴 분포 표현으로 매핑하는 방법 및 시스템
CN112119388A (zh) 训练图像嵌入模型和文本嵌入模型
CN120873195A (zh) 用于基于图谱的动态信息检索及合成的系统和方法
CN112074828A (zh) 训练图像嵌入模型和文本嵌入模型
CN106156023B (zh) 语义匹配的方法、装置和系统
CN117271818B (zh) 视觉问答方法、系统、电子设备及存储介质
CA3047353A1 (en) Learning document embeddings with convolutional neural network architectures
CN108345702A (zh) 实体推荐方法和装置
CN107368515A (zh) 应用程序页面推荐方法及系统
WO2021017306A1 (zh) 根据用户画像的个性化搜索方法、系统、设备及存储介质
CN116601626A (zh) 个人知识图谱构建方法、装置及相关设备
CN112463914A (zh) 一种用于互联网服务的实体链接方法、装置及存储介质
WO2018121198A1 (en) Topic based intelligent electronic file searching
CN114492669B (zh) 关键词推荐模型训练方法、推荐方法和装置、设备、介质
CN113515589B (zh) 数据推荐方法、装置、设备以及介质
JP7257553B2 (ja) 化粧品製品推奨のための方法及び装置
CN106407316A (zh) 基于主题模型的软件问答推荐方法和装置
CN111506596A (zh) 信息检索方法、装置、计算机设备和存储介质
CN117009621A (zh) 信息搜索方法、装置、电子设备、存储介质及程序产品
CN115630144A (zh) 一种文档搜索方法、装置及相关设备
CN119537564B (zh) 基于大数据的专利检索方法、装置、设备及存储介质

Legal Events

Date Code Title Description
A201 Request for examination
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

D13-X000 Search requested

St.27 status event code: A-1-2-D10-D13-srh-X000

D14-X000 Search report completed

St.27 status event code: A-1-2-D10-D14-srh-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-OTH-PR1001 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 5