CN103701906A - 分布式实时计算系统及其数据处理方法 - Google Patents
分布式实时计算系统及其数据处理方法 Download PDFInfo
- Publication number
- CN103701906A CN103701906A CN201310741313.8A CN201310741313A CN103701906A CN 103701906 A CN103701906 A CN 103701906A CN 201310741313 A CN201310741313 A CN 201310741313A CN 103701906 A CN103701906 A CN 103701906A
- Authority
- CN
- China
- Prior art keywords
- data
- child node
- backup file
- node
- distributed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 23
- 230000001360 synchronised effect Effects 0.000 claims abstract description 26
- 238000011084 recovery Methods 0.000 claims abstract description 12
- 238000012544 monitoring process Methods 0.000 claims abstract description 9
- 238000000034 method Methods 0.000 claims description 40
- 230000009467 reduction Effects 0.000 claims description 23
- 238000012545 processing Methods 0.000 abstract description 13
- 230000002688 persistence Effects 0.000 abstract description 6
- 230000008569 process Effects 0.000 description 22
- 238000004458 analytical method Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 230000008901 benefit Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000010223 real-time analysis Methods 0.000 description 2
- 229940126655 NDI-034858 Drugs 0.000 description 1
- 241000290929 Nimbus Species 0.000 description 1
- 230000032683 aging Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 238000013499 data model Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000002203 pretreatment Methods 0.000 description 1
- 230000001846 repelling effect Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Images
Landscapes
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310741313.8A CN103701906B (zh) | 2013-12-27 | 2013-12-27 | 分布式实时计算系统及其数据处理方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201310741313.8A CN103701906B (zh) | 2013-12-27 | 2013-12-27 | 分布式实时计算系统及其数据处理方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103701906A true CN103701906A (zh) | 2014-04-02 |
CN103701906B CN103701906B (zh) | 2017-06-09 |
Family
ID=50363300
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201310741313.8A Active CN103701906B (zh) | 2013-12-27 | 2013-12-27 | 分布式实时计算系统及其数据处理方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103701906B (zh) |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104615777A (zh) * | 2015-02-27 | 2015-05-13 | 浪潮集团有限公司 | 一种基于流式计算引擎的实时数据处理方法及装置 |
CN105630652A (zh) * | 2016-02-02 | 2016-06-01 | 中国石油大学(华东) | 一种面向实时大数据平台Storm的运行时三维可视化系统 |
CN106411684A (zh) * | 2015-07-30 | 2017-02-15 | 中兴通讯股份有限公司 | 消息处理方法及装置 |
CN106789203A (zh) * | 2016-12-09 | 2017-05-31 | 光科技股份有限公司 | 一种应用于智能网荷互动终端的通讯装置 |
CN106790464A (zh) * | 2016-12-09 | 2017-05-31 | 光科技股份有限公司 | 一种基于智能网荷互动终端的数据交换网络 |
WO2017097006A1 (zh) * | 2015-12-11 | 2017-06-15 | 华为技术有限公司 | 一种实时数据容错处理方法及系统 |
CN106874182A (zh) * | 2016-07-05 | 2017-06-20 | 阿里巴巴集团控股有限公司 | 代码异常处理、代码执行方法及装置 |
CN107608831A (zh) * | 2017-09-26 | 2018-01-19 | 甘肃万维信息技术有限责任公司 | 备份数据的处理方法及装置 |
CN109697209A (zh) * | 2018-12-25 | 2019-04-30 | 广东亿迅科技有限公司 | 一种面向分布式数据库的报表处理方法及装置 |
CN110231915A (zh) * | 2019-05-29 | 2019-09-13 | 南昌大学 | 数据管理方法、系统、装置、计算机设备及存储介质 |
CN112579121A (zh) * | 2020-12-09 | 2021-03-30 | 广州橙行智动汽车科技有限公司 | 一种数据处理的方法和装置 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102663117A (zh) * | 2012-04-18 | 2012-09-12 | 中国人民大学 | 面向数据库与Hadoop混合平台的OLAP查询处理方法 |
CN102868754A (zh) * | 2012-09-26 | 2013-01-09 | 北京联创信安科技有限公司 | 一种实现集群存储高可用性的方法、节点装置和系统 |
CN102902605A (zh) * | 2012-09-29 | 2013-01-30 | 山东浪潮齐鲁软件产业股份有限公司 | 一种分布式云计算集群组海量数据备份和还原的方法 |
CN103078941A (zh) * | 2012-12-31 | 2013-05-01 | 中金数据系统有限公司 | 一种分布式计算系统的任务调度方法及系统 |
CN103108000A (zh) * | 2011-11-09 | 2013-05-15 | 中国移动通信集团公司 | 用于任务同步的方法和系统及系统中的主节点和工作节点 |
CN103324533A (zh) * | 2012-03-22 | 2013-09-25 | 华为技术有限公司 | 分布式数据处理方法、装置及系统 |
CN103401698A (zh) * | 2013-07-02 | 2013-11-20 | 北京奇虎科技有限公司 | 用于服务器集群运算中对服务器状况报警的监控系统 |
-
2013
- 2013-12-27 CN CN201310741313.8A patent/CN103701906B/zh active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103108000A (zh) * | 2011-11-09 | 2013-05-15 | 中国移动通信集团公司 | 用于任务同步的方法和系统及系统中的主节点和工作节点 |
CN103324533A (zh) * | 2012-03-22 | 2013-09-25 | 华为技术有限公司 | 分布式数据处理方法、装置及系统 |
CN102663117A (zh) * | 2012-04-18 | 2012-09-12 | 中国人民大学 | 面向数据库与Hadoop混合平台的OLAP查询处理方法 |
CN102868754A (zh) * | 2012-09-26 | 2013-01-09 | 北京联创信安科技有限公司 | 一种实现集群存储高可用性的方法、节点装置和系统 |
CN102902605A (zh) * | 2012-09-29 | 2013-01-30 | 山东浪潮齐鲁软件产业股份有限公司 | 一种分布式云计算集群组海量数据备份和还原的方法 |
CN103078941A (zh) * | 2012-12-31 | 2013-05-01 | 中金数据系统有限公司 | 一种分布式计算系统的任务调度方法及系统 |
CN103401698A (zh) * | 2013-07-02 | 2013-11-20 | 北京奇虎科技有限公司 | 用于服务器集群运算中对服务器状况报警的监控系统 |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104615777A (zh) * | 2015-02-27 | 2015-05-13 | 浪潮集团有限公司 | 一种基于流式计算引擎的实时数据处理方法及装置 |
CN106411684A (zh) * | 2015-07-30 | 2017-02-15 | 中兴通讯股份有限公司 | 消息处理方法及装置 |
CN106411684B (zh) * | 2015-07-30 | 2020-06-16 | 中兴通讯股份有限公司 | 消息处理方法及装置 |
CN106874142B (zh) * | 2015-12-11 | 2020-08-07 | 华为技术有限公司 | 一种实时数据容错处理方法及系统 |
WO2017097006A1 (zh) * | 2015-12-11 | 2017-06-15 | 华为技术有限公司 | 一种实时数据容错处理方法及系统 |
CN106874142A (zh) * | 2015-12-11 | 2017-06-20 | 华为技术有限公司 | 一种实时数据容错处理方法及系统 |
CN105630652A (zh) * | 2016-02-02 | 2016-06-01 | 中国石油大学(华东) | 一种面向实时大数据平台Storm的运行时三维可视化系统 |
CN106874182B (zh) * | 2016-07-05 | 2020-03-10 | 阿里巴巴集团控股有限公司 | 代码异常处理、代码执行方法及装置 |
CN106874182A (zh) * | 2016-07-05 | 2017-06-20 | 阿里巴巴集团控股有限公司 | 代码异常处理、代码执行方法及装置 |
CN106790464A (zh) * | 2016-12-09 | 2017-05-31 | 光科技股份有限公司 | 一种基于智能网荷互动终端的数据交换网络 |
CN106789203A (zh) * | 2016-12-09 | 2017-05-31 | 光科技股份有限公司 | 一种应用于智能网荷互动终端的通讯装置 |
CN107608831A (zh) * | 2017-09-26 | 2018-01-19 | 甘肃万维信息技术有限责任公司 | 备份数据的处理方法及装置 |
CN107608831B (zh) * | 2017-09-26 | 2020-08-04 | 中电万维信息技术有限责任公司 | 备份数据的处理方法及装置 |
CN109697209A (zh) * | 2018-12-25 | 2019-04-30 | 广东亿迅科技有限公司 | 一种面向分布式数据库的报表处理方法及装置 |
CN110231915A (zh) * | 2019-05-29 | 2019-09-13 | 南昌大学 | 数据管理方法、系统、装置、计算机设备及存储介质 |
CN110231915B (zh) * | 2019-05-29 | 2022-04-01 | 南昌大学 | 数据管理方法、系统、装置、计算机设备及存储介质 |
CN112579121A (zh) * | 2020-12-09 | 2021-03-30 | 广州橙行智动汽车科技有限公司 | 一种数据处理的方法和装置 |
Also Published As
Publication number | Publication date |
---|---|
CN103701906B (zh) | 2017-06-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103701906A (zh) | 分布式实时计算系统及其数据处理方法 | |
US10860596B2 (en) | Employing external data stores to service data requests | |
US11238069B2 (en) | Transforming a data stream into structured data | |
CN111796983B (zh) | 一种体彩异常交易请求的监控系统及方法 | |
CN107341258B (zh) | 一种日志数据采集方法及系统 | |
US8996925B2 (en) | Managing error logs in a distributed network fabric | |
CN108021809A (zh) | 一种数据处理方法及系统 | |
CN103019879A (zh) | 浏览器崩溃信息的处理方法及系统 | |
Levin et al. | AIOps for a cloud object storage service | |
CN110753050B (zh) | 协议文档的生成方法及装置、计算机存储介质、电子设备 | |
CN103078945A (zh) | 对浏览器崩溃数据进行处理的方法与系统 | |
WO2023028442A1 (en) | Compressing digital metrics for transmission across a network utilizing a graph-based compression dictionary and time slice delta compression | |
CN105159820A (zh) | 一种系统日志数据传输方法及装置 | |
CN105320711A (zh) | 巨量数据存取方法以及使用该方法的系统 | |
CN113672668A (zh) | 大数据场景下的日志实时处理方法及装置 | |
CN112506954A (zh) | 数据库审计方法和装置 | |
CN105245394A (zh) | 一种基于分层方式分析网络访问日志的方法和设备 | |
CN111130882A (zh) | 网络设备的监控系统及方法 | |
US20160323399A1 (en) | Method of and a system for monitoring web site consistency | |
Kulkarni et al. | Analysis of system logs for pattern detection and anomaly prediction | |
US20210334154A1 (en) | Enriched high fidelity metrics | |
US20150248499A1 (en) | Optimized read/write access to a document object model | |
CN113760856A (zh) | 数据库管理方法及装置、计算机可读存储介质、电子设备 | |
CN110866165A (zh) | 一种网络视频采集方法及系统 | |
CN116546091B (zh) | 流式内容的推荐方法、装置、设备及存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C41 | Transfer of patent application or patent right or utility model | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20161212 Address after: 100015 Jiuxianqiao Chaoyang District Beijing Road No. 10, building 15, floor 17, layer 1701-26, 3 Applicant after: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. Address before: 100088 Beijing city Xicheng District xinjiekouwai Street 28, block D room 112 (Desheng Park) Applicant before: BEIJING QIHOO TECHNOLOGY Co.,Ltd. Applicant before: Qizhi software (Beijing) Co.,Ltd. |
|
GR01 | Patent grant | ||
GR01 | Patent grant | ||
TR01 | Transfer of patent right |
Effective date of registration: 20180713 Address after: 100015 15, 17 floor 1701-26, 3 building, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Co-patentee after: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Patentee after: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. Address before: 100015 15, 17 floor 1701-26, 3 building, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Patentee before: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. |
|
TR01 | Transfer of patent right | ||
CP03 | Change of name, title or address |
Address after: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Patentee after: Qianxin Technology Group Co.,Ltd. Patentee after: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Address before: 100015 15, 17 floor 1701-26, 3 building, 10 Jiuxianqiao Road, Chaoyang District, Beijing. Patentee before: BEIJING QIANXIN TECHNOLOGY Co.,Ltd. Patentee before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Address after: 100044 2nd floor, building 1, yard 26, Xizhimenwai South Road, Xicheng District, Beijing Patentee after: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Patentee after: Qianxin Technology Group Co.,Ltd. Address before: Room 332, 3 / F, Building 102, 28 xinjiekouwei street, Xicheng District, Beijing 100088 Patentee before: Qianxin Technology Group Co.,Ltd. Patentee before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. |
|
CP03 | Change of name, title or address | ||
CP03 | Change of name, title or address |
Address after: 2nd Floor, Building 1, Yard 26, Xizhimenwai South Road, Xicheng District, Beijing, 100032 Patentee after: Qianxin Wangshen information technology (Beijing) Co.,Ltd. Patentee after: Qianxin Technology Group Co.,Ltd. Address before: 100044 2nd floor, building 1, yard 26, Xizhimenwai South Road, Xicheng District, Beijing Patentee before: LEGENDSEC INFORMATION TECHNOLOGY (BEIJING) Inc. Patentee before: Qianxin Technology Group Co.,Ltd. |
|
CP03 | Change of name, title or address |