CN105681414B - 一种避免Hbase数据热点的方法及系统 - Google Patents
一种避免Hbase数据热点的方法及系统 Download PDFInfo
- Publication number
- CN105681414B CN105681414B CN201610024940.3A CN201610024940A CN105681414B CN 105681414 B CN105681414 B CN 105681414B CN 201610024940 A CN201610024940 A CN 201610024940A CN 105681414 B CN105681414 B CN 105681414B
- Authority
- CN
- China
- Prior art keywords
- major key
- region
- data
- hbase
- several
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1001—Protocols in which an application is distributed across nodes in the network for accessing one among a plurality of replicated servers
- H04L67/1004—Server selection for load balancing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Medicines Containing Antibodies Or Antigens For Use As Internal Diagnostic Agents (AREA)
- Computer And Data Communications (AREA)
Abstract
Description
Claims (10)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610024940.3A CN105681414B (zh) | 2016-01-14 | 2016-01-14 | 一种避免Hbase数据热点的方法及系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610024940.3A CN105681414B (zh) | 2016-01-14 | 2016-01-14 | 一种避免Hbase数据热点的方法及系统 |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105681414A CN105681414A (zh) | 2016-06-15 |
CN105681414B true CN105681414B (zh) | 2019-01-01 |
Family
ID=56300794
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610024940.3A Active CN105681414B (zh) | 2016-01-14 | 2016-01-14 | 一种避免Hbase数据热点的方法及系统 |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105681414B (zh) |
Families Citing this family (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108629196B (zh) * | 2017-03-21 | 2021-04-30 | 北京京东尚科信息技术有限公司 | 数据存储和查询的方法、装置、电子设备和可读存储介质 |
CN110019528A (zh) * | 2017-12-26 | 2019-07-16 | 中国移动通信集团湖北有限公司 | 数据库操作负载均衡方法、装置、设备及介质 |
CN110427377B (zh) * | 2019-08-02 | 2023-12-26 | 北京博睿宏远数据科技股份有限公司 | 数据处理方法、装置、设备和存储介质 |
CN110888919B (zh) * | 2019-12-04 | 2023-06-30 | 阳光电源股份有限公司 | 基于HBase的对大数据统计分析的方法及装置 |
CN111259012B (zh) * | 2020-01-20 | 2024-03-12 | 中国平安人寿保险股份有限公司 | 数据均匀化方法、装置、计算机设备及存储介质 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012034470A1 (zh) * | 2010-09-13 | 2012-03-22 | 腾讯科技(深圳)有限公司 | 一种基于哈希算法的数据存储方法及装置 |
CN104158902A (zh) * | 2014-08-27 | 2014-11-19 | 浙江宇视科技有限公司 | 一种基于请求数的Hbase数据块分配方法及装置 |
CN105187498A (zh) * | 2015-08-10 | 2015-12-23 | 携程计算机技术(上海)有限公司 | HBase表的Region分配方法及系统 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104794123B (zh) * | 2014-01-20 | 2018-07-27 | 阿里巴巴集团控股有限公司 | 一种为半结构化数据构建NoSQL数据库索引的方法及装置 |
-
2016
- 2016-01-14 CN CN201610024940.3A patent/CN105681414B/zh active Active
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012034470A1 (zh) * | 2010-09-13 | 2012-03-22 | 腾讯科技(深圳)有限公司 | 一种基于哈希算法的数据存储方法及装置 |
CN104158902A (zh) * | 2014-08-27 | 2014-11-19 | 浙江宇视科技有限公司 | 一种基于请求数的Hbase数据块分配方法及装置 |
CN105187498A (zh) * | 2015-08-10 | 2015-12-23 | 携程计算机技术(上海)有限公司 | HBase表的Region分配方法及系统 |
Non-Patent Citations (1)
Title |
---|
基于HBase的网络社区海量数据存储优化研究;吴旭等;《中国科技论文在线》;20151208;1-6 |
Also Published As
Publication number | Publication date |
---|---|
CN105681414A (zh) | 2016-06-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN105681414B (zh) | 一种避免Hbase数据热点的方法及系统 | |
CN104407879B (zh) | 一种电网时序大数据并行加载方法 | |
KR101502896B1 (ko) | 맵 리듀스를 이용한 분산 메모리 클러스터 제어 장치 및 방법 | |
CN103345514B (zh) | 大数据环境下的流式数据处理方法 | |
US9235611B1 (en) | Data growth balancing | |
US8996464B2 (en) | Efficient partitioning techniques for massively distributed computation | |
CN106055277A (zh) | 一种去中心化的分布式异构存储系统数据分布方法 | |
US8321476B2 (en) | Method and system for determining boundary values dynamically defining key value bounds of two or more disjoint subsets of sort run-based parallel processing of data from databases | |
CN105354246B (zh) | 一种基于分布式内存计算的数据去重方法 | |
CN103440288A (zh) | 一种大数据存储方法及装置 | |
CN106960020B (zh) | 一种创建索引表的方法及设备 | |
CN105512167A (zh) | 一种基于混合数据库的多业务用户数据管理系统及其方法 | |
CN102110079B (zh) | 一种基于mpi的分布式共轭梯度法的调优计算方法 | |
US20120254173A1 (en) | Grouping data | |
CA2942948A1 (en) | Systems for parallel processing of datasets with dynamic skew compensation | |
CN103095788A (zh) | 一种基于网络拓扑的云资源调度策略 | |
CN103631894A (zh) | 一种基于hdfs的动态副本管理方法 | |
CN101373445A (zh) | 一种内存调度方法及装置 | |
CN109460406A (zh) | 一种数据处理方法及装置 | |
CN105095515A (zh) | 支持快速查询Map-Reduce输出结果的分桶方法、装置及设备 | |
CN106909556A (zh) | 内存集群的存储均衡方法及装置 | |
Tseng et al. | Support vector machine approach for virtual machine migration in cloud data center | |
CN104158902A (zh) | 一种基于请求数的Hbase数据块分配方法及装置 | |
CN103324577B (zh) | 基于最小化io访问冲突和文件分条的大规模分条文件分配系统 | |
CN105554069A (zh) | 一种大数据处理分布式缓存系统及其方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Lei Guo Inventor after: Ye Chunsheng Inventor after: Che Xinyi Inventor after: Cheng Taomu Inventor after: Wang Min Inventor after: Liu Junhui Inventor before: Lei Guo Inventor before: Ye Chunsheng Inventor before: Che Xinyi Inventor before: Cheng Taomu Inventor before: Liu Junhui |
|
COR | Change of bibliographic data | ||
GR01 | Patent grant | ||
GR01 | Patent grant | ||
CP03 | Change of name, title or address | ||
CP03 | Change of name, title or address |
Address after: 401120 No.2, 7th floor, Fenghuang a building, No.18, Qingfeng North Road, Yubei District, Chongqing Patentee after: Broid Technology Co.,Ltd. Address before: 518057 No.1, area a, 3 / F, building B1, Shenzhen digital technology park, 002 Gaoxin South 7th Road, Nanshan District, Shenzhen City, Guangdong Province Patentee before: SHENZHEN BROADTECH Co.,Ltd. |