CN110046131A - 数据的流式处理方法、装置及分布式文件系统hdfs - Google Patents
数据的流式处理方法、装置及分布式文件系统hdfs Download PDFInfo
- Publication number
- CN110046131A CN110046131A CN201910063136.XA CN201910063136A CN110046131A CN 110046131 A CN110046131 A CN 110046131A CN 201910063136 A CN201910063136 A CN 201910063136A CN 110046131 A CN110046131 A CN 110046131A
- Authority
- CN
- China
- Prior art keywords
- data
- file
- specified file
- unit data
- client
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 17
- 238000012545 processing Methods 0.000 claims abstract description 235
- 238000000034 method Methods 0.000 claims abstract description 50
- 238000003860 storage Methods 0.000 claims description 62
- 230000008569 process Effects 0.000 claims description 30
- 230000005540 biological transmission Effects 0.000 claims description 13
- 238000009826 distribution Methods 0.000 claims description 12
- 238000012544 monitoring process Methods 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 15
- 230000006870 function Effects 0.000 description 12
- 238000004590 computer program Methods 0.000 description 6
- 210000000352 storage cell Anatomy 0.000 description 6
- 239000004744 fabric Substances 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 3
- 238000004891 communication Methods 0.000 description 2
- 235000013399 edible fruits Nutrition 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 241001269238 Data Species 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000002085 persistent effect Effects 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Library & Information Science (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Description
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910063136.XA CN110046131A (zh) | 2019-01-23 | 2019-01-23 | 数据的流式处理方法、装置及分布式文件系统hdfs |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201910063136.XA CN110046131A (zh) | 2019-01-23 | 2019-01-23 | 数据的流式处理方法、装置及分布式文件系统hdfs |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110046131A true CN110046131A (zh) | 2019-07-23 |
Family
ID=67274179
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201910063136.XA Pending CN110046131A (zh) | 2019-01-23 | 2019-01-23 | 数据的流式处理方法、装置及分布式文件系统hdfs |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110046131A (zh) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114979272A (zh) * | 2022-06-17 | 2022-08-30 | 贵州东彩供应链科技有限公司 | 一种基于生态牧业平台文件存储系统 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160335287A1 (en) * | 2015-05-14 | 2016-11-17 | Alibaba Group Holding Limited | Stream computing system and method |
CN106549990A (zh) * | 2015-09-18 | 2017-03-29 | 阿里巴巴集团控股有限公司 | 一种分布式数据的处理方法和系统 |
CN108696559A (zh) * | 2017-04-11 | 2018-10-23 | 华为技术有限公司 | 流处理方法及装置 |
-
2019
- 2019-01-23 CN CN201910063136.XA patent/CN110046131A/zh active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160335287A1 (en) * | 2015-05-14 | 2016-11-17 | Alibaba Group Holding Limited | Stream computing system and method |
CN106549990A (zh) * | 2015-09-18 | 2017-03-29 | 阿里巴巴集团控股有限公司 | 一种分布式数据的处理方法和系统 |
CN108696559A (zh) * | 2017-04-11 | 2018-10-23 | 华为技术有限公司 | 流处理方法及装置 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114979272A (zh) * | 2022-06-17 | 2022-08-30 | 贵州东彩供应链科技有限公司 | 一种基于生态牧业平台文件存储系统 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106487850B (zh) | 一种云环境下获取镜像的方法、装置和系统 | |
CN105530273B (zh) | 用于数据迁移的方法和装置 | |
CN107395659A (zh) | 一种业务受理及共识的方法及装置 | |
CN110162292A (zh) | 语音播报方法及装置 | |
CN108629029A (zh) | 一种应用于数据仓库的数据处理方法和装置 | |
CN109600447A (zh) | 用于处理数据的方法、装置和系统 | |
CN104008028A (zh) | 基于多云存储的智能移动终端数据存储备份方法与系统 | |
CN109241033A (zh) | 创建实时数据仓库的方法和装置 | |
CN109002357A (zh) | 资源分配方法、装置及物联网系统 | |
CN110392084A (zh) | 在分布式系统中管理地址的方法、设备和计算机程序产品 | |
CN109947729A (zh) | 一种实时数据分析方法及装置 | |
CN106850242A (zh) | 一种信息处理方法及装置 | |
CN109561128A (zh) | 数据传输方法和装置 | |
CN108829503A (zh) | 任务调度方法、装置、系统、介质和电子设备 | |
CN109725989A (zh) | 一种任务执行的方法及装置 | |
CN110297869A (zh) | 一种ai数据仓库平台及操作方法 | |
US9424260B2 (en) | Techniques for data assignment from an external distributed file system to a database management system | |
CN109522272A (zh) | 录音文件的存储方法、装置、系统、介质和电子设备 | |
CN109145625A (zh) | 保单信息的处理方法、装置及区块链数据存储系统 | |
CN103593485B (zh) | 实现数据库实时操作的方法和设备 | |
CN109542612A (zh) | 一种热点关键字获取方法、装置及服务器 | |
CN110046131A (zh) | 数据的流式处理方法、装置及分布式文件系统hdfs | |
CN107968807A (zh) | 自动更新本地缓存资源的方法及装置 | |
CN110264217A (zh) | 一种信息处理方法、设备及存储介质 | |
CN104967631B (zh) | 一种分享云存储内容的方法和装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
TA01 | Transfer of patent application right |
Effective date of registration: 20201015 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Innovative advanced technology Co.,Ltd. Address before: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant before: Advanced innovation technology Co.,Ltd. Effective date of registration: 20201015 Address after: Cayman Enterprise Centre, 27 Hospital Road, George Town, Grand Cayman, British Islands Applicant after: Advanced innovation technology Co.,Ltd. Address before: A four-storey 847 mailbox in Grand Cayman Capital Building, British Cayman Islands Applicant before: Alibaba Group Holding Ltd. |
|
TA01 | Transfer of patent application right | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190723 |
|
RJ01 | Rejection of invention patent application after publication |