BR112018076658A8 - Método e dispositivo de processamento distribuído de dados em streaming - Google Patents

Método e dispositivo de processamento distribuído de dados em streaming

Info

Publication number
BR112018076658A8
BR112018076658A8 BR112018076658A BR112018076658A BR112018076658A8 BR 112018076658 A8 BR112018076658 A8 BR 112018076658A8 BR 112018076658 A BR112018076658 A BR 112018076658A BR 112018076658 A BR112018076658 A BR 112018076658A BR 112018076658 A8 BR112018076658 A8 BR 112018076658A8
Authority
BR
Brazil
Prior art keywords
real
processed
time value
data
time
Prior art date
Application number
BR112018076658A
Other languages
English (en)
Other versions
BR112018076658A2 (pt
Inventor
Feng Chenglin
Luo Liang
Original Assignee
Alibaba Group Holding Ltd
Advantageous New Tech Co Ltd
Advanced New Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd, Advantageous New Tech Co Ltd, Advanced New Technologies Co Ltd filed Critical Alibaba Group Holding Ltd
Publication of BR112018076658A2 publication Critical patent/BR112018076658A2/pt
Publication of BR112018076658A8 publication Critical patent/BR112018076658A8/pt

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24532—Query optimisation of parallel queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/52—Program synchronisation; Mutual exclusion, e.g. by means of semaphores
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24534—Query rewriting; Transformation
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2455—Query execution
    • G06F16/24568—Data stream processing; Continuous queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2471—Distributed queries
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083—Techniques for rebalancing the load in a distributed system

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Probability & Statistics with Applications (AREA)
  • Mathematical Physics (AREA)
  • Fuzzy Systems (AREA)
  • Information Transfer Between Computers (AREA)
  • Debugging And Monitoring (AREA)
  • Computer And Data Communications (AREA)
  • Multi Processors (AREA)
  • Image Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

O presente pedido provê um método de processamento distribuído de dados em streaming, compreendendo: obter informações de identificador de dados de serviço de um registro de dados de dados em streaming, um valor em tempo real a ser processado do registro de dados, e uma característica de sequência temporal do valor em tempo real a ser processado do registro de dados, as informações de identificador representando exclusivamente uma parte ou um conjunto de dados de serviço; obter uma característica de sequência temporal de um valor em tempo real processado dos dados de serviço com base em uma relação de correspondência entre as informações de identificador de dados de serviço armazenadas e a característica de sequência temporal do valor em tempo real processado; comparar a característica de sequência temporal do valor em tempo real a ser processado dos dados de serviço e a característica de sequência temporal do valor em tempo real processado dos dados de serviço e, quando uma sequência temporal do valor em tempo real a ser processado é mais avançada do que uma sequência temporal do valor em tempo real processado, empregar o valor em tempo real a ser processado na execução de computações de serviço e atualizar a característica de sequência temporal armazenada do valor em tempo real processado para a característica de sequência temporal do valor em tempo real a ser processado. Usando este esquema técnico, o processamento de dados de acordo com a sequência de atualização de dados é obtido, evitando erros de resultado de processamento causados pelo processamento de um valor em tempo real que foi atualizado posteriormente e aumentando a precisão do processamento de dados.
BR112018076658A 2016-06-20 2017-06-07 Método e dispositivo de processamento distribuído de dados em streaming BR112018076658A8 (pt)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201610447125.8 2016-06-20
CN201610447125.8A CN106874320A (zh) 2016-06-20 2016-06-20 分布式流式数据处理的方法和装置
PCT/CN2017/087380 WO2017219858A1 (zh) 2016-06-20 2017-06-07 分布式流式数据处理的方法和装置

Publications (2)

Publication Number Publication Date
BR112018076658A2 BR112018076658A2 (pt) 2019-04-02
BR112018076658A8 true BR112018076658A8 (pt) 2023-01-31

Family

ID=59239567

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112018076658A BR112018076658A8 (pt) 2016-06-20 2017-06-07 Método e dispositivo de processamento distribuído de dados em streaming

Country Status (16)

Country Link
US (1) US11036562B2 (pt)
EP (1) EP3474162A4 (pt)
JP (1) JP6716727B2 (pt)
KR (1) KR102099544B1 (pt)
CN (1) CN106874320A (pt)
AU (1) AU2017282818C1 (pt)
BR (1) BR112018076658A8 (pt)
CA (1) CA3025215C (pt)
MX (1) MX2018016067A (pt)
MY (1) MY188882A (pt)
PH (1) PH12018502494A1 (pt)
RU (1) RU2705429C1 (pt)
SG (1) SG11201810630PA (pt)
TW (1) TWI662426B (pt)
WO (1) WO2017219858A1 (pt)
ZA (1) ZA201808139B (pt)

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110019214A (zh) * 2017-12-04 2019-07-16 北京京东尚科信息技术有限公司 对数据拆分结果进行校验的方法和装置
CN109002472B (zh) * 2018-06-13 2023-07-14 平安科技（深圳）有限公司 一种数据库差异的识别方法及装置
CN109361629B (zh) * 2018-10-26 2020-11-03 江苏大学 一种基于Kafka大消息可靠传输方法
CN110033263A (zh) * 2019-01-14 2019-07-19 阿里巴巴集团控股有限公司 基于区块链的用户特征值获取、应用方法和装置
RU2722538C1 (ru) * 2019-12-13 2020-06-01 Общество С Ограниченной Ответственностью "Убик" Компьютерно-реализуемый способ обработки информации об объектах, с использованием методов совместных вычислений и методов анализа данных
CN111611252B (zh) * 2020-04-01 2023-07-18 石化盈科信息技术有限责任公司 数据同步过程中安全数据的监控、装置、设备和存储介质
WO2021230771A2 (en) * 2020-05-12 2021-11-18 Ubic Technologies Llc Method of piece data synchronization describing a single entity and stored in different databases
CN111639138B (zh) * 2020-06-03 2023-04-25 中国联合网络通信集团有限公司 数据处理方法、装置、设备及存储介质
CN112150248B (zh) * 2020-09-30 2021-08-03 欧冶云商股份有限公司 一种基于批流融合的挂货量统计方法、系统、装置
CN112200505B (zh) * 2020-12-04 2022-02-08 望海康信(北京)科技股份公司 跨业务系统的流程监控装置、方法及相应设备和存储介质
CN112988429B (zh) * 2021-05-08 2021-08-06 成都新希望金融信息有限公司 数据处理方法、装置、电子设备和计算机可读存储介质
CN113160918A (zh) * 2021-05-21 2021-07-23 山东健康医疗大数据有限公司 一种变化数据捕获的统一处理方法及工具
CN115098247A (zh) * 2022-06-06 2022-09-23 支付宝(杭州)信息技术有限公司 资源分配方法和装置

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5185871A (en) 1989-12-26 1993-02-09 International Business Machines Corporation Coordination of out-of-sequence fetching between multiple processors using re-execution of instructions
US8639625B1 (en) * 1995-02-13 2014-01-28 Intertrust Technologies Corporation Systems and methods for secure transaction management and electronic rights protection
US6055619A (en) 1997-02-07 2000-04-25 Cirrus Logic, Inc. Circuits, system, and methods for processing multiple data streams
US6748440B1 (en) 1999-05-12 2004-06-08 Microsoft Corporation Flow of streaming data through multiple processing modules
US7007096B1 (en) 1999-05-12 2006-02-28 Microsoft Corporation Efficient splitting and mixing of streaming-data frames for processing through multiple processing modules
US6880126B1 (en) 1999-08-03 2005-04-12 International Business Machines Corporation Controlling presentation of a GUI, using view controllers created by an application mediator, by identifying a destination to access a target to retrieve data
US7181017B1 (en) * 2001-03-23 2007-02-20 David Felsher System and method for secure three-party communications
US6633825B2 (en) * 2001-06-29 2003-10-14 Siemens Power Transmission & Distribution, Inc. Automatic calibration of time keeping for utility meters
US6910078B1 (en) 2001-11-15 2005-06-21 Cisco Technology, Inc. Methods and apparatus for controlling the transmission of stream data
JP4154893B2 (ja) 2002-01-23 2008-09-24 株式会社日立製作所 ネットワークストレージ仮想化方法
US7657861B2 (en) 2002-08-07 2010-02-02 Pact Xpp Technologies Ag Method and device for processing data
US7634477B2 (en) 2002-09-18 2009-12-15 Netezza Corporation Asymmetric data streaming architecture having autonomous and asynchronous job processing unit
US7051245B2 (en) * 2002-11-30 2006-05-23 International Business Machines Corporation System and method for handling out-of-order data supplied by a real-time feed
EP1463309A1 (fr) 2003-03-26 2004-09-29 THOMSON Licensing S.A. Traitement d'un format de flux de données pour la réception audiovisuelle mobile
US20080273698A1 (en) 2005-04-26 2008-11-06 Koninklijke Philips Electronics, N.V. Device for and a Method of Processing a Data Stream Having a Sequence of Packets and Timing Information Related to the Packets
US20070226226A1 (en) * 2006-03-23 2007-09-27 Elta Systems Ltd. Method and system for distributing processing of computerized tasks
KR100898465B1 (ko) * 2007-04-26 2009-05-21 엔에이치엔(주) 웹로그의 시계열 분석을 위한 데이터 저장 및 조회 방법그리고 상기 방법을 수행하는 시스템
JP5198929B2 (ja) 2008-04-25 2013-05-15 株式会社日立製作所 ストリームデータ処理方法及び計算機システム
JP5154366B2 (ja) 2008-10-28 2013-02-27 株式会社日立製作所 ストリームデータ処理プログラム及び計算機システム
JP5465413B2 (ja) 2008-10-29 2014-04-09 株式会社日立製作所 ストリームデータ処理方法、及びそのシステム
US9538142B2 (en) * 2009-02-04 2017-01-03 Google Inc. Server-side support for seamless rewind and playback of video streaming
US8402344B2 (en) 2009-10-05 2013-03-19 Cleversafe, Inc. Method and apparatus for controlling dispersed storage of streaming data
RU2494453C2 (ru) * 2011-11-24 2013-09-27 Закрытое акционерное общество "Лаборатория Касперского" Способ распределенного выполнения задач компьютерной безопасности
CN103458000B (zh) * 2013-08-07 2016-06-08 广东电网公司佛山供电局 终端数据同步系统与方法
CN104091276B (zh) * 2013-12-10 2015-08-26 深圳市腾讯计算机系统有限公司 在线分析点击流数据的方法和相关装置及系统
WO2015103615A1 (en) * 2014-01-06 2015-07-09 Yyesit, Llc Method and apparatus of surveillance system
CN104794114B (zh) * 2014-01-16 2018-04-03 阿里巴巴集团控股有限公司 一种数据处理方法及装置
US9389899B2 (en) * 2014-01-27 2016-07-12 Red Hat Israel, Ltd. Fair unidirectional multi-queue virtual machine migration
CN104866234B (zh) * 2014-02-21 2019-01-22 腾讯科技（北京）有限公司 数据迁移方法、装置及系统
KR101588375B1 (ko) * 2014-04-25 2016-01-25 네이버 주식회사 데이터베이스 관리 방법 및 데이터베이스 관리 시스템
EP3149893A4 (en) * 2014-05-29 2018-03-07 Causam Energy, Inc. System, method, and data packets for messaging for electric power grid elements over a secure internet protocol network
US20160026673A1 (en) 2014-07-25 2016-01-28 Linkedin Corporation Ensuring consistency of derived data in a distributed storage system
CN104320382B (zh) * 2014-09-30 2018-04-20 华为技术有限公司 分布式的实时流处理装置、方法和单元
US9754002B2 (en) * 2014-10-07 2017-09-05 Excalibur Ip, Llc Method and system for providing a synchronization service
GB201421674D0 (en) * 2014-12-05 2015-01-21 Business Partners Ltd Real time document indexing
RU2584471C1 (ru) * 2014-12-30 2016-05-20 Некоммерческое Партнерство "Центр Прикладных Исследований Компьютерных Сетей" УСТРОЙСТВО ДЛЯ ПРИЕМА И ПЕРЕДАЧИ ДАННЫХ С ВОЗМОЖНОСТЬЮ ОСУЩЕСТВЛЕНИЯ ВЗАИМОДЕЙСТВИЯ С OpenFlow КОНТРОЛЛЕРОМ
US10706468B2 (en) * 2015-08-03 2020-07-07 Trading Technologies International, Inc. Contextual searching

Also Published As

Publication number Publication date
CA3025215C (en) 2020-06-02
PH12018502494A1 (en) 2019-07-15
CA3025215A1 (en) 2017-12-28
MX2018016067A (es) 2019-03-28
US11036562B2 (en) 2021-06-15
EP3474162A4 (en) 2020-01-15
TW201800967A (zh) 2018-01-01
AU2017282818C1 (en) 2020-02-20
SG11201810630PA (en) 2019-01-30
MY188882A (en) 2022-01-12
RU2705429C1 (ru) 2019-11-07
US20190114213A1 (en) 2019-04-18
AU2017282818B2 (en) 2019-08-22
KR102099544B1 (ko) 2020-05-18
BR112018076658A2 (pt) 2019-04-02
JP2019523952A (ja) 2019-08-29
EP3474162A1 (en) 2019-04-24
CN106874320A (zh) 2017-06-20
WO2017219858A1 (zh) 2017-12-28
JP6716727B2 (ja) 2020-07-01
AU2017282818A1 (en) 2019-01-24
TWI662426B (zh) 2019-06-11
ZA201808139B (en) 2020-08-26
KR20190020105A (ko) 2019-02-27

Similar Documents

Publication Publication Date Title
BR112018076658A8 (pt) Método e dispositivo de processamento distribuído de dados em streaming
BR112018073902A2 (pt) sinalização de vídeo de realidade virtual em transmissão contínua adaptativa dinâmica através de http
BR112015026558A2 (pt) método e aparelho de determinação de tempo de uso restante do mesmo
BR112015018912A2 (pt) método e dispositivo para identificar comportamento de usuário
BR112015025076A2 (pt) dispositivo de computação, método implementado por computador, e, dispositivo de iluminação
BR112018073956A2 (pt) sinalização avançada de uma região mais interessada em uma imagem
BR112017003023A2 (pt) classificação enviesante de gráfico de conhecimento para dados
BR112018002040A2 (pt) controle de uma nuvem de dispositivo
BR112016014214A2 (pt) Gerenciamento de calor e de energia com codificação de vídeo
BR112018002848A2 (pt) método, aparelho, mídia de armazenamento não transitório, programa de computador, kit para medir níveis de expressão de seis ou mais genes-alvo da via de sinalização celular
BR112016001804A2 (pt) método e dispositivo para exibir fluxos de informação em rede social, e servidor
BR112017026670A2 (pt) sistema e método para fornecer informações contextuais para uma localização
GB2563340A8 (en) Labeling computing objects for improved threat detection
BR112019006093A2 (pt) método e dispositivo de envio de informação
BR112018076689A2 (pt) métodos de processamento de dados e dispositivos de processamento de dados
WO2018169567A8 (en) SHARED SOFTWARE LIBRARIES FOR COMPUTER DEVICES
BR112015008299A2 (pt) método e dispositivo para salvar um arquivo
BR112019003120A2 (pt) mapeamento entre um feixe de controle e um feixe de canal de dados
BR112015029306A2 (pt) fragmentação de banco de dados com camada de atualização
BR112016022329A2 (pt) Método para processamento de defeito, aparelho relacionado, e computador
BR112018070806A2 (pt) estimar valores de ajuste de precipitação
BR112017003261A2 (pt) método implementado por computador para estimar um movimento, produto de programa armazenado em um meio legível por computador, e, sistema para estimar um movimento.
BR112015007455A2 (pt) método executável por dispositivo cliente para executar fluxo de mídia adaptativo tendo pluralidade de faixas de áudio e dispositivo de mídia player
BR112017026743A2 (pt) aparelho e método de decodificação, programa, e, aparelho e método de codificação
SG11201808243PA (en) Data duplication elimination method and device

Legal Events

Date Code Title Description
B25A Requested transfer of rights approved

Owner name: ADVANTAGEOUS NEW TECHNOLOGIES CO., LTD. (KY)

B25A Requested transfer of rights approved

Owner name: ADVANCED NEW TECHNOLOGIES CO., LTD. (KY)

B350 Update of information on the portal [chapter 15.35 patent gazette]
B06W Patent application suspended after preliminary examination (for patents with searches from other patent authorities) chapter 6.23 patent gazette]
B15K Others concerning applications: alteration of classification

Free format text: A CLASSIFICACAO ANTERIOR ERA: G06F 17/30

Ipc: G06F 16/2453 (2019.01), G06F 16/2458 (2019.01)

B11B Dismissal acc. art. 36, par 1 of ipl - no reply within 90 days to fullfil the necessary requirements