CN103778212B - 基于数据节点的并行海量数据处理方法 - Google Patents
基于数据节点的并行海量数据处理方法 Download PDFInfo
- Publication number
- CN103778212B CN103778212B CN201410020055.9A CN201410020055A CN103778212B CN 103778212 B CN103778212 B CN 103778212B CN 201410020055 A CN201410020055 A CN 201410020055A CN 103778212 B CN103778212 B CN 103778212B
- Authority
- CN
- China
- Prior art keywords
- data
- access
- back end
- data processing
- processing method
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
- G06F16/2453—Query optimisation
- G06F16/24532—Query optimisation of parallel queries
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
Description
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410020055.9A CN103778212B (zh) | 2014-01-16 | 2014-01-16 | 基于数据节点的并行海量数据处理方法 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410020055.9A CN103778212B (zh) | 2014-01-16 | 2014-01-16 | 基于数据节点的并行海量数据处理方法 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103778212A CN103778212A (zh) | 2014-05-07 |
CN103778212B true CN103778212B (zh) | 2017-04-05 |
Family
ID=50570447
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410020055.9A Active CN103778212B (zh) | 2014-01-16 | 2014-01-16 | 基于数据节点的并行海量数据处理方法 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103778212B (zh) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105677522B (zh) * | 2014-11-04 | 2019-06-28 | 国网山东省电力公司青岛供电公司 | 电网系统数据接口校验方法 |
CN105116757A (zh) * | 2015-07-23 | 2015-12-02 | 国网四川省电力公司电力科学研究院 | 一种多装置并发信号的iec61850/mms仿真方法 |
CN107305564B (zh) * | 2016-04-21 | 2021-06-11 | 阿里巴巴集团控股有限公司 | 一种数据处理的方法和设备 |
CN106055590A (zh) * | 2016-05-23 | 2016-10-26 | 环球大数据科技有限公司 | 基于大数据及图数据库的电力网络数据处理方法和系统 |
CN107277144B (zh) * | 2017-06-22 | 2021-02-09 | 浙江力石科技股份有限公司 | 一种分布式高并发云存储数据库系统及其负荷均衡方法 |
CN109587531A (zh) * | 2017-09-28 | 2019-04-05 | 华为技术有限公司 | 视频传输方法、装置及系统 |
CN111078153B (zh) * | 2019-12-20 | 2023-08-01 | 同方知网数字出版技术股份有限公司 | 一种基于文件的分布式存储方法 |
CN111935266A (zh) * | 2020-08-03 | 2020-11-13 | 成都深思科技有限公司 | 数据分流系统 |
CN114419717A (zh) * | 2022-01-27 | 2022-04-29 | 睿云联(厦门)网络通讯技术有限公司 | 一种终端设备的人脸检测、识别加速方法及系统 |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6601072B1 (en) * | 2000-06-21 | 2003-07-29 | International Business Machines Corporation | Method and system for distribution of application data to distributed databases of dissimilar formats |
AU2002224448A1 (en) * | 2000-10-26 | 2002-05-06 | Prismedia Networks, Inc. | Method and apparatus for large payload distribution in a network |
CN101197026A (zh) * | 2007-12-20 | 2008-06-11 | 浙江大学 | 高性能访问控制系统中资源及其访问控制策略的设计与存储方法 |
CN101706808B (zh) * | 2009-11-17 | 2012-07-04 | 中国科学院软件研究所 | 基于索引树的海量数据库访问控制方法 |
CN102136003A (zh) * | 2011-03-25 | 2011-07-27 | 上海交通大学 | 大规模分布式存储系统 |
CN102184105A (zh) * | 2011-05-13 | 2011-09-14 | 中国联合网络通信集团有限公司 | 基于组件方式的数据处理方法及数据中心系统 |
CN102254024A (zh) * | 2011-07-27 | 2011-11-23 | 国网信息通信有限公司 | 海量数据处理系统及方法 |
-
2014
- 2014-01-16 CN CN201410020055.9A patent/CN103778212B/zh active Active
Also Published As
Publication number | Publication date |
---|---|
CN103778212A (zh) | 2014-05-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN103778212B (zh) | 基于数据节点的并行海量数据处理方法 | |
CN104735110B (zh) | 元数据管理方法和系统 | |
CN108550930B (zh) | 基于退役动力电池包的桥接管理器、桥接系统及桥接方法 | |
CN105025053A (zh) | 基于云存储技术的分布式文件的上传方法及其系统 | |
CN110489407A (zh) | 数据补采方法、装置、计算机设备及存储介质 | |
CN104167817B (zh) | 一种电力设备实时信息集成的系统及方法 | |
CN108319623A (zh) | 一种数据重分布方法、装置及数据库集群 | |
CN110308966B (zh) | 一种基于容器技术的静态安全分析方法 | |
CN102577241A (zh) | 分布式缓存资源调度的方法、装置及系统 | |
EP3273664B1 (en) | Data processing method and device, server, and controller | |
CN105677251A (zh) | 基于Redis集群的存储系统 | |
CN109783018A (zh) | 一种数据存储的方法及装置 | |
CN105827678B (zh) | 一种基于高可用架构下的通信方法和节点 | |
CN111258978A (zh) | 一种数据存储的方法 | |
CN108848132A (zh) | 一种基于云的配电调度主站系统 | |
CN110018878A (zh) | 一种分布式系统数据加载方法以及装置 | |
CN108052569A (zh) | 数据库访问方法、装置、计算机可读存储介质和计算设备 | |
CN107070709A (zh) | 一种基于底层numa感知的nfv实现方法 | |
CN113900810A (zh) | 分布式图处理方法、系统及存储介质 | |
CN104144202A (zh) | Hadoop分布式文件系统的访问方法、系统和装置 | |
CN106202082A (zh) | 组装基础数据缓存的方法及装置 | |
CN102811152A (zh) | 一种多主总线网络通讯实时交易数据交换实现方法 | |
CN103051478B (zh) | 一种大容量电信网管系统及其设置和应用方法 | |
CN109951370B (zh) | 多大数据中心分层互联互通方法及装置 | |
CN109635161B (zh) | 一种海量数据环境下跨域异地协同设计方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C53 | Correction of patent for invention or patent application | ||
CB03 | Change of inventor or designer information |
Inventor after: Zhang Hongwei Inventor after: Pan Bin Inventor after: Wang Dedong Inventor after: Li Changlin Inventor after: Chen Ming Inventor after: Pan Xinmin Inventor after: Peng Bo Inventor after: Xiao Qingwei Inventor after: Duan Yunyi Inventor after: Zhao Shirui Inventor after: Zhao Shengchuan Inventor after: Wang Huaguang Inventor after: Cui Xiao Inventor after: Yu Qiang Inventor after: Mou Lei Inventor after: Guo Yinglei Inventor after: Li Yanzhen Inventor after: Cai Jian Inventor before: Zhang Hongwei Inventor before: Wang Dedong Inventor before: Li Changlin Inventor before: Chen Ming Inventor before: Pan Xinmin Inventor before: Peng Bo Inventor before: Xiao Qingwei Inventor before: Duan Yunyi Inventor before: Zhao Shengchuan Inventor before: Wang Huaguang Inventor before: Cui Xiao Inventor before: Yu Qiang Inventor before: Mou Lei Inventor before: Guo Yinglei Inventor before: Li Yanzhen Inventor before: Cai Jian |
|
COR | Change of bibliographic data |
Free format text: CORRECT: INVENTOR; FROM: ZHANG HONGWEI ZHAO SHENGCHUAN WANG HUAGUANG CUI XIAO YU QIANG MOU LEI GUO YINGLEI LI YANZHEN CAI JIAN WANG DEDONG LI CHANGLIN CHEN MING PAN XINMIN PENG BO XIAO QINGWEI DUAN YUNYI TO: ZHANG HONGWEI ZHAO SHENGCHUAN WANG HUAGUANG CUI XIAO YU QIANG MOU LEI GUO YINGLEI LI YANZHEN CAI JIAN PAN BIN WANG DEDONG LI CHANGLIN CHEN MING PAN XINMIN PENG BO XIAO QINGWEI DUAN YUNYI ZHAO SHIRUI |
|
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Zhang Hongwei Inventor after: Peng Bo Inventor after: Xiao Qingwei Inventor after: Duan Yunyi Inventor after: Zhao Shirui Inventor after: Cui Xiao Inventor after: Guo Yinglei Inventor after: Li Yanzhen Inventor after: Jia Xu Inventor after: Cai Jian Inventor after: Wang Dedong Inventor after: Li Changlin Inventor after: Chen Ming Inventor before: Zhang Hongwei Inventor before: Pan Bin Inventor before: Wang Dedong Inventor before: Li Changlin Inventor before: Chen Ming Inventor before: Pan Xinmin Inventor before: Peng Bo Inventor before: Xiao Qingwei Inventor before: Duan Yunyi Inventor before: Zhao Shirui Inventor before: Zhao Shengchuan Inventor before: Wang Huaguang Inventor before: Cui Xiao Inventor before: Yu Qiang Inventor before: Mou Lei Inventor before: Guo Yinglei Inventor before: Li Yanzhen Inventor before: Cai Jian |
|
COR | Change of bibliographic data | ||
GR01 | Patent grant | ||
GR01 | Patent grant |