JP6096182B2 - 物理的に相違する複数のストリームに対する効率的な論理マージ - Google Patents

物理的に相違する複数のストリームに対する効率的な論理マージ Download PDF

Info

Publication number
JP6096182B2
JP6096182B2 JP2014515928A JP2014515928A JP6096182B2 JP 6096182 B2 JP6096182 B2 JP 6096182B2 JP 2014515928 A JP2014515928 A JP 2014515928A JP 2014515928 A JP2014515928 A JP 2014515928A JP 6096182 B2 JP6096182 B2 JP 6096182B2
Authority
JP
Japan
Prior art keywords
stream
output
module
merge module
logical merge
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2014515928A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014524175A5 (enExample
JP2014524175A (ja
Inventor
チャンドラモウリ，バドリシュ
イー． メイヤー，デイヴィッド
イー． メイヤー，デイヴィッド
ディー． ゴールドスタイン，ジョナサン
ディー． ゴールドスタイン，ジョナサン
エー． ザバック，ピーター
エー． ザバック，ピーター
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Corp
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Corp
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Microsoft Corp, Microsoft Technology Licensing LLC filed Critical Microsoft Corp
Publication of JP2014524175A publication Critical patent/JP2014524175A/ja
Publication of JP2014524175A5 publication Critical patent/JP2014524175A5/ja
Application granted granted Critical
Publication of JP6096182B2 publication Critical patent/JP6096182B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F17/00—Digital computing or data processing equipment or methods, specially adapted for specific functions
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/25—Fusion techniques
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F7/00—Methods or arrangements for processing data by operating upon the order or content of the data handled
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Computational Linguistics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Evolutionary Computation (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Mathematical Physics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Stored Programmes (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Error Detection And Correction (AREA)
  • Design And Manufacture Of Integrated Circuits (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Amplifiers (AREA)
  • Stereophonic System (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
JP2014515928A 2011-06-17 2012-06-13 物理的に相違する複数のストリームに対する効率的な論理マージ Expired - Fee Related JP6096182B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US13/162,973 US9965520B2 (en) 2011-06-17 2011-06-17 Efficient logical merging over physically divergent streams
US13/162,973 2011-06-17
PCT/US2012/042105 WO2012174023A2 (en) 2011-06-17 2012-06-13 Efficient logical merging over physically divergent streams

Publications (3)

Publication Number Publication Date
JP2014524175A JP2014524175A (ja) 2014-09-18
JP2014524175A5 JP2014524175A5 (enExample) 2015-07-09
JP6096182B2 true JP6096182B2 (ja) 2017-03-15

Family

ID=47354822

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014515928A Expired - Fee Related JP6096182B2 (ja) 2011-06-17 2012-06-13 物理的に相違する複数のストリームに対する効率的な論理マージ

Country Status (11)

Country Link
US (1) US9965520B2 (enExample)
EP (1) EP2721511A4 (enExample)
JP (1) JP6096182B2 (enExample)
KR (1) KR101960985B1 (enExample)
CN (1) CN103620584B (enExample)
AU (1) AU2012271776B2 (enExample)
BR (1) BR112013032186A2 (enExample)
CA (1) CA2838966C (enExample)
MX (1) MX2013015009A (enExample)
RU (1) RU2608474C2 (enExample)
WO (1) WO2012174023A2 (enExample)

Families Citing this family (41)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100057737A1 (en) 2008-08-29 2010-03-04 Oracle International Corporation Detection of non-occurrences of events using pattern matching
US9305057B2 (en) 2009-12-28 2016-04-05 Oracle International Corporation Extensible indexing framework using data cartridges
US9430494B2 (en) 2009-12-28 2016-08-30 Oracle International Corporation Spatial data cartridge for event processing systems
US8782434B1 (en) 2010-07-15 2014-07-15 The Research Foundation For The State University Of New York System and method for validating program execution at run-time
US8713049B2 (en) 2010-09-17 2014-04-29 Oracle International Corporation Support for a parameterized query/view in complex event processing
US9189280B2 (en) 2010-11-18 2015-11-17 Oracle International Corporation Tracking large numbers of moving objects in an event processing system
US8990416B2 (en) 2011-05-06 2015-03-24 Oracle International Corporation Support for a new insert stream (ISTREAM) operation in complex event processing (CEP)
US9329975B2 (en) 2011-07-07 2016-05-03 Oracle International Corporation Continuous query language (CQL) debugger in complex event processing (CEP)
US8990452B2 (en) 2011-07-26 2015-03-24 International Business Machines Corporation Dynamic reduction of stream backpressure
US9148495B2 (en) 2011-07-26 2015-09-29 International Business Machines Corporation Dynamic runtime choosing of processing communication methods
US9405553B2 (en) 2012-01-30 2016-08-02 International Business Machines Corporation Processing element management in a streaming data system
US9146775B2 (en) 2012-04-26 2015-09-29 International Business Machines Corporation Operator graph changes in response to dynamic connections in stream computing applications
US9122873B2 (en) 2012-09-14 2015-09-01 The Research Foundation For The State University Of New York Continuous run-time validation of program execution: a practical approach
US9563663B2 (en) 2012-09-28 2017-02-07 Oracle International Corporation Fast path evaluation of Boolean predicates
US9805095B2 (en) 2012-09-28 2017-10-31 Oracle International Corporation State initialization for continuous queries over archived views
US9069782B2 (en) 2012-10-01 2015-06-30 The Research Foundation For The State University Of New York System and method for security and privacy aware virtual machine checkpointing
US9930081B2 (en) * 2012-11-13 2018-03-27 International Business Machines Corporation Streams optional execution paths depending upon data rates
US10956422B2 (en) 2012-12-05 2021-03-23 Oracle International Corporation Integrating event processing with map-reduce
US10298444B2 (en) 2013-01-15 2019-05-21 Oracle International Corporation Variable duration windows on continuous data streams
US9098587B2 (en) 2013-01-15 2015-08-04 Oracle International Corporation Variable duration non-event pattern matching
US9390135B2 (en) 2013-02-19 2016-07-12 Oracle International Corporation Executing continuous event processing (CEP) queries in parallel
US9047249B2 (en) 2013-02-19 2015-06-02 Oracle International Corporation Handling faults in a continuous event processing (CEP) system
JP6201417B2 (ja) * 2013-05-17 2017-09-27 富士通株式会社 データ抽出プログラム、データ抽出方法およびデータ抽出装置
US9418113B2 (en) 2013-05-30 2016-08-16 Oracle International Corporation Value based windows on relations in continuous data streams
US9130831B2 (en) * 2013-11-07 2015-09-08 International Business Machines Corporation Streaming state data for cloud management
US9934279B2 (en) * 2013-12-05 2018-04-03 Oracle International Corporation Pattern matching across multiple input data streams
US9244978B2 (en) 2014-06-11 2016-01-26 Oracle International Corporation Custom partitioning of a data stream
US9712645B2 (en) 2014-06-26 2017-07-18 Oracle International Corporation Embedded event processing
US9886486B2 (en) 2014-09-24 2018-02-06 Oracle International Corporation Enriching events with dynamically typed big data for event processing
US10120907B2 (en) 2014-09-24 2018-11-06 Oracle International Corporation Scaling event processing using distributed flows and map-reduce operations
US9734038B2 (en) 2014-09-30 2017-08-15 International Business Machines Corporation Path-specific break points for stream computing
US9632846B2 (en) 2015-04-02 2017-04-25 Microsoft Technology Licensing, Llc Complex event processor for historic/live/replayed data
WO2017018901A1 (en) 2015-07-24 2017-02-02 Oracle International Corporation Visually exploring and analyzing event streams
WO2017135837A1 (en) 2016-02-01 2017-08-10 Oracle International Corporation Pattern based automated test data generation
WO2017135838A1 (en) 2016-02-01 2017-08-10 Oracle International Corporation Level of detail control for geostreaming
US10178161B2 (en) * 2016-05-11 2019-01-08 Microsoft Technology Licensing, Llc Digital signal processing over data streams
US10616316B2 (en) * 2016-09-15 2020-04-07 International Business Machines Corporation Processing element host management in a stream computing environment
US10341189B2 (en) * 2016-09-22 2019-07-02 International Business Machines Corporation Operator fusion management in a stream computing environment
US11563789B2 (en) * 2017-05-09 2023-01-24 EMC IP Holding Company LLC Executing streaming data writes without duplication or loss
WO2019060943A1 (en) * 2017-09-29 2019-04-04 Metamako General Pty Ltd In Its Capacity As General Partner Of Metamako Technology Lp SYSTEM AND METHOD FOR DISTRIBUTING INFORMATION
EP3915021A1 (en) * 2019-02-15 2021-12-01 Huawei Technologies Co., Ltd. A system for embedding stream processing execution in a database

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5539749A (en) 1993-09-13 1996-07-23 Siemens Aktiengesellschaft Method for merging data streams
US5745906A (en) 1995-11-14 1998-04-28 Deltatech Research, Inc. Method and apparatus for merging delta streams to reconstruct a computer file
US6029239A (en) * 1997-12-01 2000-02-22 Advanced Micro Devices, Inc. Configuring a communications system with a configurable data transfer architecture
FI112271B (fi) 2000-02-04 2003-11-14 Sandvik Tamrock Oy Menetelmä ja sovitelma pölyhaittojen vähentämiseksi kallionporauksessa
US20030002474A1 (en) * 2001-03-21 2003-01-02 Thomas Alexander Multi-stream merge network for data width conversion and multiplexing
US20040260829A1 (en) * 2001-04-13 2004-12-23 Husak David J. Manipulating data streams in data stream processors
US7117278B2 (en) 2001-07-12 2006-10-03 Sun Micro Systems, Inc. Method for merging a plurality of data streams into a single data stream
WO2005018124A1 (en) 2003-08-15 2005-02-24 Xyratex Technology Limited A data merge unit, a method of producing an interleaved data stream, a network analyser and a method of analysing a network
US7668856B2 (en) 2004-09-30 2010-02-23 Alcatel-Lucent Usa Inc. Method for distinct count estimation over joins of continuous update stream
US9182228B2 (en) 2006-02-13 2015-11-10 Sony Corporation Multi-lens array system and method
US20070226362A1 (en) 2006-03-21 2007-09-27 At&T Corp. Monitoring regular expressions on out-of-order streams
US8457214B2 (en) 2007-09-10 2013-06-04 Cisco Technology, Inc. Video compositing of an arbitrary number of source streams using flexible macroblock ordering
JP5337447B2 (ja) 2008-10-28 2013-11-06 株式会社日立製作所 ストリームデータ処理方法、及びシステム
FR2940487A1 (fr) 2008-12-19 2010-06-25 Thales Sa Procede et systeme pour la fusion de donnees ou d'informations
RU2413277C1 (ru) 2009-09-17 2011-02-27 Российская Федерация, от имени которой выступает Министерство обороны Российской Федерации Устройство перепаковки потоков для вывода данных

Also Published As

Publication number Publication date
CA2838966A1 (en) 2012-12-20
KR101960985B1 (ko) 2019-03-21
AU2012271776B2 (en) 2016-09-29
BR112013032186A2 (pt) 2016-12-20
RU2608474C2 (ru) 2017-01-18
EP2721511A2 (en) 2014-04-23
CA2838966C (en) 2019-09-03
RU2013155910A (ru) 2015-06-27
CN103620584A (zh) 2014-03-05
CN103620584B (zh) 2018-03-20
US9965520B2 (en) 2018-05-08
US20120324453A1 (en) 2012-12-20
EP2721511A4 (en) 2014-12-24
JP2014524175A (ja) 2014-09-18
WO2012174023A3 (en) 2013-07-11
MX2013015009A (es) 2014-01-24
WO2012174023A2 (en) 2012-12-20
KR20140038462A (ko) 2014-03-28

Similar Documents

Publication Publication Date Title
JP6096182B2 (ja) 物理的に相違する複数のストリームに対する効率的な論理マージ
AU2012271776A1 (en) Efficient logical merging over physically divergent streams
US8326821B2 (en) Transforming relational queries into stream processing
US8943120B2 (en) Enhanced barrier operator within a streaming environment
Grover et al. Data Ingestion in AsterixDB.
US8290939B2 (en) Visualizing query results in stream processing systems
CN104871154A (zh) 系统级查询优化
CN103778251B (zh) 面向大规模rdf图数据的sparql并行查询方法
JP6114473B2 (ja) 時間調整を使用したストリームデータ処理方法
EP4231149B1 (en) Distributing and processing streams over one or more networks for on-the-fly schema evolution
KR101660860B1 (ko) 분산 시스템에 기반한 스트리밍 방식으로 데이터 큐브를 생성하는 방법 및 장치
CN104731800B (zh) 数据分析装置
US20230124100A1 (en) Low-Latency Data Management And Query Processing Cross-Optimizations
CN111352961A (zh) 分布式rdf流数据处理方法、系统、装置及介质
CN114510529B (zh) 数据同步方法、装置、计算机设备和存储介质
US20230122781A1 (en) Low-Latency Buffer Storage Of Static Datasets For Query Operation Optimization
HK1193194A (en) Efficient logical merging over physically divergent streams
HK1193194B (en) Efficient logical merging over physically divergent streams
Ameloot et al. On the CRON conjecture
AMELOOT Deciding correctness with fairness for simple transducer networks
Wilkin et al. Decentralized fault-tolerant event correlation
Chandramouli et al. Physically Independent Stream Merging
Chen et al. Provably Correct Distributed Provenance Compression
Istrate BOOM Analytics: Exploring Data-Centric, Declarative Programming for the Cloud
Ganjoo Real-time Stock Market Trend Analysis using Stream Processing Frameworks

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150518

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150518

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20150523

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160802

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161031

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170117

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170215

R150 Certificate of patent or registration of utility model

Ref document number: 6096182

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees