JP6159908B6 - 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム - Google Patents

異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム Download PDF

Info

Publication number
JP6159908B6
JP6159908B6 JP2017523549A JP2017523549A JP6159908B6 JP 6159908 B6 JP6159908 B6 JP 6159908B6 JP 2017523549 A JP2017523549 A JP 2017523549A JP 2017523549 A JP2017523549 A JP 2017523549A JP 6159908 B6 JP6159908 B6 JP 6159908B6
Authority
JP
Japan
Prior art keywords
data
field
query
similarity
fields
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017523549A
Other languages
English (en)
Japanese (ja)
Other versions
JP6159908B1 (ja
JPWO2017170459A1 (ja
JPWO2017170459A6 (ja
Inventor
ラフール アガワラ
ラフール アガワラ
潔 町田
潔 町田
敏明 中川
敏明 中川
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SMART INSIGHT CORPORATION
Original Assignee
SMART INSIGHT CORPORATION
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SMART INSIGHT CORPORATION filed Critical SMART INSIGHT CORPORATION
Priority to JP2017115395A priority Critical patent/JP6964384B2/ja
Publication of JP6159908B1 publication Critical patent/JP6159908B1/ja
Publication of JPWO2017170459A1 publication Critical patent/JPWO2017170459A1/ja
Publication of JPWO2017170459A6 publication Critical patent/JPWO2017170459A6/ja
Application granted granted Critical
Publication of JP6159908B6 publication Critical patent/JP6159908B6/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F12/00—Accessing, addressing or allocating within memory systems or architectures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24553—Query execution of query operations
    • G06F16/24558—Binary matching operations
    • G06F16/2456—Join operations
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/256—Integrating or interfacing systems involving database management systems in federated or virtual databases
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/288—Entity relationship models
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/901—Indexing; Data structures therefor; Storage structures
    • G06F16/9024—Graphs; Linked lists
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G06F17/10—Complex mathematical operations
    • G06F17/11—Complex mathematical operations for solving equations, e.g. nonlinear equations, general mathematical optimization problems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Analysis (AREA)
  • Mathematical Optimization (AREA)
  • Pure & Applied Mathematics (AREA)
  • Fuzzy Systems (AREA)
  • Probability & Statistics with Applications (AREA)
  • Operations Research (AREA)
  • Algebra (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2017523549A 2016-03-31 2017-03-27 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム Active JP6159908B6 (ja)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2017115395A JP6964384B2 (ja) 2016-03-31 2017-06-12 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662315784P 2016-03-31 2016-03-31
US62/315,784 2016-03-31
PCT/JP2017/012496 WO2017170459A1 (ja) 2016-03-31 2017-03-27 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2017115395A Division JP6964384B2 (ja) 2016-03-31 2017-06-12 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム

Publications (4)

Publication Number Publication Date
JP6159908B1 JP6159908B1 (ja) 2017-07-05
JPWO2017170459A1 JPWO2017170459A1 (ja) 2018-04-05
JPWO2017170459A6 JPWO2017170459A6 (ja) 2018-04-05
JP6159908B6 true JP6159908B6 (ja) 2018-06-27

Family

ID=59965634

Family Applications (2)

Application Number Title Priority Date Filing Date
JP2017523549A Active JP6159908B6 (ja) 2016-03-31 2017-03-27 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム
JP2017115395A Active JP6964384B2 (ja) 2016-03-31 2017-06-12 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム

Family Applications After (1)

Application Number Title Priority Date Filing Date
JP2017115395A Active JP6964384B2 (ja) 2016-03-31 2017-06-12 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム

Country Status (3)

Country Link
US (1) US20190317938A1 (enExample)
JP (2) JP6159908B6 (enExample)
WO (1) WO2017170459A1 (enExample)

Families Citing this family (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110110211B (zh) * 2018-01-22 2024-10-18 北京京东尚科信息技术有限公司 基于通用模型的数据查询方法和装置
CN111198898B (zh) * 2018-11-16 2023-10-27 浙江宇视科技有限公司 大数据查询方法及大数据查询装置
US11829391B2 (en) * 2019-01-14 2023-11-28 Salesforce, Inc. Systems, methods, and apparatuses for executing a graph query against a graph representing a plurality of data stores
KR20200094853A (ko) * 2019-01-25 2020-08-10 삼성전자주식회사 전자 장치 및 이의 제어 방법
CN111459789B (zh) * 2019-08-28 2023-11-03 南京意博软件科技有限公司 一种应用程序编程接口的检测方法及装置
CN110879901B (zh) * 2019-11-22 2022-03-18 浙江大学 一种基于关系图谱的数据自适应脱敏方法及系统
CN111666274B (zh) * 2020-06-05 2023-08-25 北京妙医佳健康科技集团有限公司 数据融合方法、装置、电子设备及计算机可读存储介质
CN111767320B (zh) * 2020-06-29 2023-08-18 中国银行股份有限公司 数据血缘关系确定方法及装置
WO2022049680A1 (ja) * 2020-09-02 2022-03-10 日本電気株式会社 結合テーブル特定システム、結合テーブル探索装置、方法およびプログラム
WO2022049681A1 (ja) * 2020-09-02 2022-03-10 日本電気株式会社 相関索引構築装置、相関テーブル探索装置、方法およびプログラム
JP7434117B2 (ja) 2020-09-10 2024-02-20 株式会社東芝 対話装置、方法、及びプログラム
JP7494090B2 (ja) 2020-10-29 2024-06-03 株式会社東芝 情報処理装置、情報処理方法、およびプログラム
KR102576146B1 (ko) * 2020-11-20 2023-09-07 주식회사 와이즈넛 필드 간 유사도 분석을 이용한 이종 데이터 결합 방법
CN113656372B (zh) * 2021-08-13 2022-06-21 南方电网数字电网研究院有限公司 标准指标库数据集市架构装置及方法
CN113656650B (zh) * 2021-08-16 2025-03-25 智慧芽信息科技(苏州)有限公司 数据融合方法及装置、电子设备和存储介质
US11636085B2 (en) 2021-09-01 2023-04-25 International Business Machines Corporation Detection and utilization of similarities among tables in different data systems
CN113760918B (zh) * 2021-09-13 2024-11-19 上海航空工业(集团)有限公司 一种确定数据血缘关系的方法、装置、计算机设备和介质
CN114037304B (zh) * 2021-11-16 2025-04-22 浪潮通用软件有限公司 一种成本资料的数据归集方法、设备及介质
JP7731820B2 (ja) * 2022-02-16 2025-09-01 株式会社東芝 データサービスシステム及び方法
JP7682117B2 (ja) * 2022-03-03 2025-05-23 株式会社日立製作所 データ処理装置及び方法
CN114896361B (zh) * 2022-03-30 2025-08-29 中广核智能科技(深圳)有限责任公司 基于数据列的数据检索方法及系统
CN116662346B (zh) * 2023-06-13 2025-12-19 国网信通亿力科技有限责任公司 一种基于字段语义识别的表关联关系自动判别方法
CN116483840B (zh) * 2023-06-19 2023-11-07 广东奥飞数据科技股份有限公司 一种基于分布式计算的多源异构数据集成系统
US12579192B2 (en) * 2023-06-29 2026-03-17 Sap Se Promise keys for result caches of database systems
US20250156404A1 (en) * 2023-11-09 2025-05-15 Hitachi, Ltd. Enhanced methodology for optimizing data query prompts
KR102708886B1 (ko) * 2023-12-15 2024-09-24 주식회사 싸인텔레콤 빅데이터 분석 및 처리 시스템 기반의 교통 데이터 융합정보 생성 방법
CN118568670B (zh) * 2024-07-31 2024-10-29 中移动信息技术有限公司 数据融合方法、装置、设备、存储介质及产品
CN119474344B (zh) * 2024-11-26 2025-05-30 中国航空综合技术研究所 基于大模型的航空多领域数据自适应提取方法及系统
CN120144592B (zh) * 2025-05-12 2025-07-25 山东省城市商业银行合作联盟有限公司 基于元数据文件的异构数据库间表结构自适应方法及装置

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000222430A (ja) * 1999-02-03 2000-08-11 Osaka Gas Co Ltd 仮想データベース管理システム
JP2004227037A (ja) * 2003-01-20 2004-08-12 Sangaku Renkei Kiko Kyushu:Kk フィールドマッチング装置とそのプログラム、コンピュータ読み取り可能な記録媒体、及び同一フィールド判定方法
JP4451624B2 (ja) * 2003-08-19 2010-04-14 富士通株式会社 情報体系対応付け装置および対応付け方法
JP4997856B2 (ja) * 2006-07-19 2012-08-08 富士通株式会社 データベース分析プログラム、データベース分析装置、データベース分析方法
JP5194818B2 (ja) * 2008-01-16 2013-05-08 富士通株式会社 データ分類方法およびデータ処理装置
US9507824B2 (en) * 2014-08-22 2016-11-29 Attivio Inc. Automated creation of join graphs for unrelated data sets among relational databases

Also Published As

Publication number Publication date
JP2017188137A (ja) 2017-10-12
JP6159908B1 (ja) 2017-07-05
JP6964384B2 (ja) 2021-11-10
JPWO2017170459A1 (ja) 2018-04-05
US20190317938A1 (en) 2019-10-17
WO2017170459A1 (ja) 2017-10-05

Similar Documents

Publication Publication Date Title
JP6159908B1 (ja) 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム
JPWO2017170459A6 (ja) 異種データソース混在環境におけるフィールド間の関係性の自動的発見のための方法、プログラム、および、システム
JP6617117B2 (ja) 半構造データのためのスケーラブルな分析プラットフォーム
Khasawneh et al. Sql, newsql, and nosql databases: A comparative survey
US10860562B1 (en) Dynamic predicate indexing for data stores
CN114461603A (zh) 多源异构数据融合方法及装置
Khan et al. SQL Database with physical database tuning technique and NoSQL graph database comparisons
Chung et al. JackHare: a framework for SQL to NoSQL translation using MapReduce
US20200320091A1 (en) Schemaless to relational representation conversion
EP3014488B1 (en) Incremental maintenance of range-partitioned statistics for query optimization
EP3740880A1 (en) Pick and applicator for use with a stringed instrument
JP2017037648A (ja) ハイブリッドデータを保存するためのハイブリッドデータストレージシステム、方法及びプログラム
CN103678520A (zh) 一种基于云计算的多维区间查询方法及其系统
WO2015128756A1 (en) A method, system and computer program for scanning a plurality of storage regions within memory for a specified quantity of results
Khan et al. Predictive performance comparison analysis of relational & NoSQL graph databases
US20160070707A1 (en) Keyword search on databases
Ramchand et al. Big data architectures for data lakes: A systematic literature review
US11822582B2 (en) Metadata clustering
Hasan et al. Data transformation from sql to nosql mongodb based on r programming language
Lovalekar Big Data: an emerging trend in future
Greca et al. Optimizing Data Retrieval by Using Mongodb with Elasticsearch.
US20250110937A1 (en) Efficient sorting techniques facilitating the creation and use of dataset summary metadata
Subramanian et al. Modern trends in NoSQL databases
Binnig et al. Towards interactive data exploration
US12265535B1 (en) Dataset summary metadata providing improved query performance

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20170428

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20170510

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20170522

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170530

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170612

R150 Certificate of patent or registration of utility model

Ref document number: 6159908

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

S111 Request for change of ownership or part of ownership

Free format text: JAPANESE INTERMEDIATE CODE: R313111

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250