CA2755317C - Dynamically composing data stream processing applications - Google Patents

Dynamically composing data stream processing applications Download PDF

Info

Publication number
CA2755317C
CA2755317C CA2755317A CA2755317A CA2755317C CA 2755317 C CA2755317 C CA 2755317C CA 2755317 A CA2755317 A CA 2755317A CA 2755317 A CA2755317 A CA 2755317A CA 2755317 C CA2755317 C CA 2755317C
Authority
CA
Canada
Prior art keywords
data
application
profile
subscription
producer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CA2755317A
Other languages
English (en)
French (fr)
Other versions
CA2755317A1 (en
Inventor
Lisa Amini
Henrique Andrade
Bugra Gedik
Nagui Halim
Srinivasan Parthasarathy
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of CA2755317A1 publication Critical patent/CA2755317A1/en
Application granted granted Critical
Publication of CA2755317C publication Critical patent/CA2755317C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/54—Interprogram communication
    • G06F9/544—Buffers; Shared memory; Pipes

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)
CA2755317A 2009-05-14 2010-05-13 Dynamically composing data stream processing applications Active CA2755317C (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US12/465,910 US8286191B2 (en) 2009-05-14 2009-05-14 Dynamically composing data stream processing applications
US12/465,910 2009-05-14
PCT/US2010/034714 WO2010132666A1 (en) 2009-05-14 2010-05-13 Dynamically composing data stream processing applications

Publications (2)

Publication Number Publication Date
CA2755317A1 CA2755317A1 (en) 2010-11-18
CA2755317C true CA2755317C (en) 2017-09-19

Family

ID=43069412

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2755317A Active CA2755317C (en) 2009-05-14 2010-05-13 Dynamically composing data stream processing applications

Country Status (6)

Country Link
US (1) US8286191B2 (https=)
JP (1) JP5420065B2 (https=)
CN (1) CN102349056B (https=)
CA (1) CA2755317C (https=)
MX (1) MX2011010795A (https=)
WO (1) WO2010132666A1 (https=)

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9271054B2 (en) 2009-03-03 2016-02-23 Mobilitie, Llc System and method for WiFi video streaming
US10616619B2 (en) 2009-03-03 2020-04-07 Mobilitie, Llc System and method for multi-channel WiFi video streaming
US9986268B2 (en) 2009-03-03 2018-05-29 Mobilitie, Llc System and method for multi-channel WiFi video streaming
US9619291B2 (en) * 2009-12-20 2017-04-11 Yahoo! Inc. System and method for a task management library to execute map-reduce applications in a map-reduce framework
US20120047467A1 (en) * 2010-08-17 2012-02-23 International Business Machines Corporation Port compatibilty checking for stream processing
US8260803B2 (en) * 2010-09-23 2012-09-04 Hewlett-Packard Development Company, L.P. System and method for data stream processing
US8732300B2 (en) * 2011-01-10 2014-05-20 International Business Machines Corporation Application monitoring in a stream database environment
US8972923B2 (en) * 2011-02-08 2015-03-03 Maxeler Technologies Ltd. Method and apparatus and software code for generating a hardware stream processor design
US9460131B2 (en) * 2012-05-04 2016-10-04 International Business Machines Corporation Data stream quality management for analytic environments
WO2014152677A2 (en) * 2013-03-15 2014-09-25 Mobilitie, Llc System and method for multi-channel wifi video streaming
US10318895B1 (en) 2013-08-27 2019-06-11 Curb, Inc. System for promoting efficient use of resources
US9298485B2 (en) * 2013-11-19 2016-03-29 International Business Machines Corporation Maintaining virtual machines for cloud-based operators in a streaming application in a ready state
US9262222B2 (en) * 2013-12-03 2016-02-16 International Business Machines Corporation Lazy initialization of operator graph in a stream computing application
US11126627B2 (en) 2014-01-14 2021-09-21 Change Healthcare Holdings, Llc System and method for dynamic transactional data streaming
US10121557B2 (en) 2014-01-21 2018-11-06 PokitDok, Inc. System and method for dynamic document matching and merging
US10574714B2 (en) * 2014-06-25 2020-02-25 Microsoft Technology Licensing, Llc Stream-based reactive programming platform
US10007757B2 (en) 2014-09-17 2018-06-26 PokitDok, Inc. System and method for dynamic schedule aggregation
US9886486B2 (en) * 2014-09-24 2018-02-06 Oracle International Corporation Enriching events with dynamically typed big data for event processing
WO2016081510A1 (en) 2014-11-17 2016-05-26 Curb Inc. Resource monitoring system with disaggregation of devices and device-specific notifications
WO2016118619A1 (en) 2015-01-20 2016-07-28 PokitDok, Inc. Health lending system and method using probabilistic graph models
US20160239851A1 (en) * 2015-02-18 2016-08-18 PokitDok, Inc. Multi commodity system and method for calculating market dynamics in health networks systems
US10095547B1 (en) * 2015-03-13 2018-10-09 Twitter, Inc. Stream processing at scale
US20160342750A1 (en) 2015-05-18 2016-11-24 PokitDok, Inc. Dynamic topological system and method for efficient claims processing
US9967160B2 (en) 2015-05-21 2018-05-08 International Business Machines Corporation Rerouting data of a streaming application
US9531602B1 (en) 2015-07-27 2016-12-27 International Business Machines Corporation Processing element placement tool
US10366204B2 (en) 2015-08-03 2019-07-30 Change Healthcare Holdings, Llc System and method for decentralized autonomous healthcare economy platform
CA3002032A1 (en) 2015-10-15 2017-04-20 PokitDok, Inc. System and method for dynamic metadata persistence and correlation on api transactions
JP6764938B2 (ja) * 2016-01-14 2020-10-07 アビニシオ テクノロジー エルエルシー リカバリ可能なストリーム処理
DE112016006514T5 (de) 2016-02-29 2018-12-06 NEC Laboratories Europe GmbH Verfahren und Datenverarbeitungssystem zum Verwalten von Datenstromverarbeitungstasks einervordefinierten Anwendungstopologie
US10042611B2 (en) * 2016-03-21 2018-08-07 International Business Machines Corporation Stream operator management
KR102092721B1 (ko) * 2016-03-23 2020-04-23 포그혼 시스템스 인코포레이티드 실시간 데이터플로우 프로그래밍에서 패턴 구동형 반응의 구성
US10102340B2 (en) 2016-06-06 2018-10-16 PokitDok, Inc. System and method for dynamic healthcare insurance claims decision support
US10191881B2 (en) * 2016-06-06 2019-01-29 Hewlett Packard Enterprise Development Lp Modifications to a stream processing topology during processing of a data stream
US10108954B2 (en) 2016-06-24 2018-10-23 PokitDok, Inc. System and method for cryptographically verified data driven contracts
US9836467B1 (en) 2016-10-31 2017-12-05 International Business Machines Company Altering in-flight streamed data from a relational database
US10025826B2 (en) * 2016-10-31 2018-07-17 International Business Machines Corporation Querying in-flight streamed data from a relational database
US10127283B2 (en) 2016-10-31 2018-11-13 International Business Machines Corporation Projecting effect of in-flight streamed data on a relational database
CN108255862B (zh) * 2016-12-29 2019-09-17 北京国双科技有限公司 一种裁判文书的检索方法及装置
US10409811B1 (en) * 2017-01-27 2019-09-10 Intuit, Inc. Decomposition of queries
US10817334B1 (en) * 2017-03-14 2020-10-27 Twitter, Inc. Real-time analysis of data streaming objects for distributed stream processing
WO2018231832A1 (en) 2017-06-12 2018-12-20 PokitDok, Inc. System and method for autonomous dynamic person management
US10691489B2 (en) 2018-01-29 2020-06-23 International Business Machines Corporation Managing the processing of streamed data in a data streaming application using query information from a relational database
US11204926B2 (en) 2018-10-31 2021-12-21 International Business Machines Corporation Storing partial tuples from a streaming application in a database system
US12603935B2 (en) 2018-12-12 2026-04-14 International Business Machines Corporation Workflow coordination in coordination namespace
US11368549B2 (en) 2019-12-05 2022-06-21 Microsoft Technology Licensing, Llc Platform for multi-stream sampling and visualization
EP4186216B1 (en) * 2020-08-27 2025-05-21 Siemens Aktiengesellschaft Centralized management of data flow maps for distributed edge node deployment
US11645057B2 (en) * 2020-09-24 2023-05-09 SambaNova Systems, Inc. Systems and methods for memory layout determination and conflict resolution
US11558473B2 (en) * 2020-12-17 2023-01-17 International Business Machines Corporation Aspect aware streams computing
WO2023220030A1 (en) * 2022-05-09 2023-11-16 Convida Wireless, Llc Data collection enablement service
CN115495050A (zh) * 2022-09-22 2022-12-20 杭州安恒信息技术股份有限公司 一种任务处理方法、装置、设备及可读存储介质

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5566337A (en) * 1994-05-13 1996-10-15 Apple Computer, Inc. Method and apparatus for distributing events in an operating system
US20020152305A1 (en) * 2000-03-03 2002-10-17 Jackson Gregory J. Systems and methods for resource utilization analysis in information management environments
US20030225876A1 (en) * 2002-05-31 2003-12-04 Peter Oliver Method and apparatus for graphically depicting network performance and connectivity
JP2004348680A (ja) * 2003-05-26 2004-12-09 Fujitsu Ltd 複合イベント通知システムおよび複合イベント通知プログラム
US7693983B1 (en) * 2005-05-27 2010-04-06 Symantec Operating Corporation System and method providing application redeployment mappings using filtered resource usage data
US20070261041A1 (en) * 2005-08-23 2007-11-08 Lisa Amini Method and system for dynamic application composition in streaming systems
US20070050756A1 (en) * 2005-08-24 2007-03-01 Nokia Corporation Component architecture
EP1992111A2 (fr) * 2006-02-28 2008-11-19 France Telecom Procede de collecte de descriptions de flux portant sur des flux relatifs a au moins un reseau client rattache a un reseau d'interconnexion
US7493406B2 (en) * 2006-06-13 2009-02-17 International Business Machines Corporation Maximal flow scheduling for a stream processing system
US8359347B2 (en) * 2007-04-10 2013-01-22 International Business Machines Corporation Method and apparatus for cooperative data stream processing
US8320410B2 (en) * 2007-05-23 2012-11-27 Broadcom Corporation Synchronization of media data streams with separate sinks using a relay
US8102836B2 (en) * 2007-05-23 2012-01-24 Broadcom Corporation Synchronization of a split audio, video, or other data stream with separate sinks
US8893204B2 (en) * 2007-06-29 2014-11-18 Microsoft Corporation Dynamically adapting media streams
US7945745B2 (en) * 2007-09-17 2011-05-17 General Electric Company Methods and systems for exchanging data

Also Published As

Publication number Publication date
WO2010132666A1 (en) 2010-11-18
JP2012527054A (ja) 2012-11-01
CA2755317A1 (en) 2010-11-18
JP5420065B2 (ja) 2014-02-19
CN102349056B (zh) 2014-07-16
US20100293301A1 (en) 2010-11-18
CN102349056A (zh) 2012-02-08
MX2011010795A (es) 2011-10-28
US8286191B2 (en) 2012-10-09

Similar Documents

Publication Publication Date Title
CA2755317C (en) Dynamically composing data stream processing applications
CN108701254B (zh) 用于动态族系跟踪、重建和生命周期管理的系统和方法
US9363195B2 (en) Configuring cloud resources
US10949440B2 (en) Metadata-driven data management platform
US20100191716A1 (en) Structured parallel data intensive computing
Dibowski et al. Using knowledge graphs to manage a data lake
Adedugbe et al. Leveraging cloud computing for the semantic web: review and trends: O. Adedugbe et al.
US7953713B2 (en) System and method for representing and using tagged data in a management system
CN111177237A (zh) 一种数据处理系统、方法及装置
US11960616B2 (en) Virtual data sources of data virtualization-based architecture
US20110055373A1 (en) Service identification for resources in a computing environment
US11960488B2 (en) Join queries in data virtualization-based architecture
Singh Learn PySpark: Build Python-based machine learning and deep learning models
US11687513B2 (en) Virtual data source manager of data virtualization-based architecture
CN116302219B (zh) 一种数据流批处理方法、装置、设备及介质
US20230409528A1 (en) Machine learning data set management
Tereshchenko Automated classification of distributed graph problems
Cipriani et al. Exploiting constraints to build a flexible and extensible data stream processing middleware
Reddy et al. Hierarchically Distributed Data Matrix Scheme for Modeling and Building Data Processing Applications
Vercruysse et al. RDF-Connect: A declarative framework for streaming and cross-environment data processing pipelines.
EP4594880A1 (en) Multi-tenant solver execution service
WO2025072744A1 (en) Distributed orchestration of natural language tasks using a generate machine learning model
CN121834737A (zh) 基于多Agent协同的文献解读方法、装置、介质及程序产品
Xu et al. A PaaS based metadata-driven ETL framework
Atkinson Project Title ADMIRE Document Title ADMIRE–Architecture Deliverable Number D2. 1 Authorship Ally Hume, Liangxiu Han, Jano van Hemert and

Legal Events

Date Code Title Description
EEER Examination request

Effective date: 20150304

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 15TH ANNIV.) - STANDARD

Year of fee payment: 15

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20250424

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20250424

MPN Maintenance fee for patent paid

Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 16TH ANNIV.) - STANDARD

Year of fee payment: 16

U00 Fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED

Effective date: 20260422

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL

Effective date: 20260422