CN115427943A - 一种数据存储方法及装置、存储介质 - Google Patents

一种数据存储方法及装置、存储介质 Download PDF

Info

Publication number
CN115427943A
CN115427943A CN202080100110.9A CN202080100110A CN115427943A CN 115427943 A CN115427943 A CN 115427943A CN 202080100110 A CN202080100110 A CN 202080100110A CN 115427943 A CN115427943 A CN 115427943A
Authority
CN
China
Prior art keywords
cluster
index
data
documents
processed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202080100110.9A
Other languages
English (en)
Inventor
郭子亮
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Shenzhen Huantai Technology Co Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Shenzhen Huantai Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd, Shenzhen Huantai Technology Co Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Publication of CN115427943A publication Critical patent/CN115427943A/zh
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

一种数据存储方法及装置、存储介质,包括:当创建待处理数据的索引时,获取存储待处理数据的集群参数信息、历史写入索引的文档数量和历史写入索引的文档大小(S101);根据集群参数信息、文档数量和文档大小,为待处理数据分配多个索引分片,并将待处理数据写入多个索引分片中,多个索引分片处于集群的至少一个节点上(S102)。

Description

PCT国内申请,说明书已公开。

Claims (14)

  1. PCT国内申请,权利要求书已公开。
CN202080100110.9A 2020-06-02 2020-06-02 一种数据存储方法及装置、存储介质 Pending CN115427943A (zh)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2020/093882 WO2021243549A1 (zh) 2020-06-02 2020-06-02 一种数据存储方法及装置、存储介质

Publications (1)

Publication Number Publication Date
CN115427943A true CN115427943A (zh) 2022-12-02

Family

ID=78831650

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202080100110.9A Pending CN115427943A (zh) 2020-06-02 2020-06-02 一种数据存储方法及装置、存储介质

Country Status (2)

Country Link
CN (1) CN115427943A (zh)
WO (1) WO2021243549A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116431523A (zh) * 2023-06-12 2023-07-14 建信金融科技有限责任公司 一种测试数据管理方法、装置、设备、存储介质及产品

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101198016A (zh) * 2007-12-05 2008-06-11 中兴通讯股份有限公司 交互式个人电视媒体交付系统的内容发布和存储方法
CN106649804A (zh) * 2016-12-29 2017-05-10 深圳市优必选科技有限公司 数据查询服务器的数据处理方法及装置、数据处理系统
EP3652653A4 (en) * 2017-07-14 2021-02-24 Hitachi Vantara LLC METHOD, DEVICE AND SYSTEM FOR CONTROLLING USER ACCESS TO A DATA STORAGE SYSTEM
CN108121807B (zh) * 2017-12-26 2021-06-04 云南大学 Hadoop环境下多维索引结构OBF-Index的实现方法
CN110196871B (zh) * 2019-03-07 2024-05-17 腾讯科技(深圳)有限公司 数据入库方法和系统

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116431523A (zh) * 2023-06-12 2023-07-14 建信金融科技有限责任公司 一种测试数据管理方法、装置、设备、存储介质及产品
CN116431523B (zh) * 2023-06-12 2023-08-29 建信金融科技有限责任公司 一种测试数据管理方法、装置、设备及存储介质

Also Published As

Publication number Publication date
WO2021243549A1 (zh) 2021-12-09

Similar Documents

Publication Publication Date Title
US11340812B2 (en) Efficient modification of storage system metadata
US9965196B2 (en) Resource reservation for storage system metadata updates
EP3367251B1 (en) Storage system and solid state hard disk
CN106649346B (zh) 数据重复性校验方法及装置
US11392571B2 (en) Key-value storage device and method of operating the same
CN110704214B (zh) 进程间通信方法和装置
CN104750620B (zh) 一种内存迁移方法及装置
CN105243027A (zh) 在存储设备中存储数据的方法和存储控制器
CN107844436B (zh) 一种缓存中脏数据的组织管理方法、系统及存储系统
CN103150260A (zh) 重复数据删除方法和装置
CN105808169A (zh) 用于数据去重的方法、装置和系统
CN104123237A (zh) 海量小文件分级存储方法及系统
US20220269551A1 (en) Grouping requests to reduce inter-process communication in memory systems
CN115427943A (zh) 一种数据存储方法及装置、存储介质
CN104750432A (zh) 一种数据存储方法及装置
CN107678686A (zh) 基于硬件实现闪存的ftl功能的方法及其数据存储装置
CN114003351A (zh) 一种数据处理方法及装置、存储介质
CN104506636B (zh) 一种数据同步方法及装置
CN106528876B (zh) 分布式系统的信息处理方法及分布式信息处理系统
CN104298614A (zh) 数据块在存储设备中存储方法和存储设备
CN108920278B (zh) 资源分配方法及装置
CN113703678B (zh) 一种存储桶索引重分裂的方法、装置、设备和介质
CN107562703A (zh) 字典树重构方法及系统
CN103885859A (zh) 一种基于全局统计的去碎片方法及系统
CN113344548B (zh) 一种工作流生成方法、装置、设备及存储介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination