CN112286875A - System framework for processing real-time data stream and real-time data stream processing method - Google Patents
System framework for processing real-time data stream and real-time data stream processing method Download PDFInfo
- Publication number
- CN112286875A CN112286875A CN202011149931.XA CN202011149931A CN112286875A CN 112286875 A CN112286875 A CN 112286875A CN 202011149931 A CN202011149931 A CN 202011149931A CN 112286875 A CN112286875 A CN 112286875A
- Authority
- CN
- China
- Prior art keywords
- real
- data stream
- time data
- pushing
- distributed file
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/182—Distributed file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/14—Details of searching files based on file metadata
- G06F16/148—File search processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/178—Techniques for file synchronisation in file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/18—File system types
- G06F16/1805—Append-only file systems, e.g. using logs or journals to store data
- G06F16/1815—Journaling file systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/21—Design, administration or maintenance of databases
- G06F16/215—Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/242—Query formulation
- G06F16/2433—Query languages
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
Abstract
Description
Claims (9)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011149931.XA CN112286875A (en) | 2020-10-23 | 2020-10-23 | System framework for processing real-time data stream and real-time data stream processing method |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202011149931.XA CN112286875A (en) | 2020-10-23 | 2020-10-23 | System framework for processing real-time data stream and real-time data stream processing method |
Publications (1)
Publication Number | Publication Date |
---|---|
CN112286875A true CN112286875A (en) | 2021-01-29 |
Family
ID=74423286
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202011149931.XA Pending CN112286875A (en) | 2020-10-23 | 2020-10-23 | System framework for processing real-time data stream and real-time data stream processing method |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN112286875A (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106815338A (en) * | 2016-12-25 | 2017-06-09 | 北京中海投资管理有限公司 | A kind of real-time storage of big data, treatment and inquiry system |
CN106850258A (en) * | 2016-12-22 | 2017-06-13 | 北京锐安科技有限公司 | A kind of Log Administration System, method and device |
US20180341956A1 (en) * | 2017-05-26 | 2018-11-29 | Digital River, Inc. | Real-Time Web Analytics System and Method |
CN109063196A (en) * | 2018-09-03 | 2018-12-21 | 拉扎斯网络科技(上海)有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
CN109542638A (en) * | 2018-10-26 | 2019-03-29 | 深圳点猫科技有限公司 | A kind of document handling method and device based on educational system |
CN111753008A (en) * | 2020-06-30 | 2020-10-09 | 珠海迈越信息技术有限公司 | Set top box viewing method and system based on big data analysis |
-
2020
- 2020-10-23 CN CN202011149931.XA patent/CN112286875A/en active Pending
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN106850258A (en) * | 2016-12-22 | 2017-06-13 | 北京锐安科技有限公司 | A kind of Log Administration System, method and device |
CN106815338A (en) * | 2016-12-25 | 2017-06-09 | 北京中海投资管理有限公司 | A kind of real-time storage of big data, treatment and inquiry system |
US20180341956A1 (en) * | 2017-05-26 | 2018-11-29 | Digital River, Inc. | Real-Time Web Analytics System and Method |
CN109063196A (en) * | 2018-09-03 | 2018-12-21 | 拉扎斯网络科技(上海)有限公司 | Data processing method, device, electronic equipment and computer readable storage medium |
CN109542638A (en) * | 2018-10-26 | 2019-03-29 | 深圳点猫科技有限公司 | A kind of document handling method and device based on educational system |
CN111753008A (en) * | 2020-06-30 | 2020-10-09 | 珠海迈越信息技术有限公司 | Set top box viewing method and system based on big data analysis |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11182098B2 (en) | Optimization for real-time, parallel execution of models for extracting high-value information from data streams | |
US20220078097A1 (en) | Distribution of data packets with non-linear delay | |
US10262032B2 (en) | Cache based efficient access scheduling for super scaled stream processing systems | |
CN109918349B (en) | Log processing method, log processing device, storage medium and electronic device | |
US20210279265A1 (en) | Optimization for Real-Time, Parallel Execution of Models for Extracting High-Value Information from Data Streams | |
US20170357653A1 (en) | Unsupervised method for enriching rdf data sources from denormalized data | |
US11301425B2 (en) | Systems and computer implemented methods for semantic data compression | |
CN107016039B (en) | Database writing method and database system | |
CN106777046A (en) | A kind of data analysing method based on nginx daily records | |
CN117056303B (en) | Data storage method and device suitable for military operation big data | |
CN112506887A (en) | Vehicle terminal CAN bus data processing method and device | |
Jacobs et al. | Bad to the bone: Big active data at its core | |
CN112286875A (en) | System framework for processing real-time data stream and real-time data stream processing method | |
Chardonnens | Big data analytics on high velocity streams | |
Venkatesan et al. | PoN: Open source solution for real-time data analysis | |
WO2017091774A1 (en) | Optimization for real-time, parallel execution of models for extracting high-value information from data streams | |
US20160162559A1 (en) | System and method for providing instant query | |
da Silva Veith et al. | Apache Spark | |
CN113656469B (en) | Big data processing method and device | |
Jain et al. | Analysis of Bill Of Material Data using Kafka and Spark | |
Zimányi et al. | REAL-TIME DATABASES AND FIREBASE | |
Technolgy | Clasifcaton Technolgy | |
Hakeem | A Software Architectural Design for Automated Data Processing in Data-Intensive Software Systems | |
CN117742571A (en) | Data processing method, device, equipment and readable storage medium | |
CN112732165A (en) | Offset management method, device and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 266000 3rd floor, building 3, optical valley software park, 396 Emeishan Road, Huangdao District, Qingdao City, Shandong Province Applicant after: QINGDAO YISA DATA TECHNOLOGY Co.,Ltd. Applicant after: Issa Technology Co.,Ltd. Applicant after: Anhui Issa Data Technology Co.,Ltd. Address before: 266000 3rd floor, building 3, optical valley software park, 396 Emeishan Road, Huangdao District, Qingdao City, Shandong Province Applicant before: QINGDAO YISA DATA TECHNOLOGY Co.,Ltd. Applicant before: Qingdao Issa Technology Co.,Ltd. Applicant before: Anhui Issa Data Technology Co.,Ltd. Address after: 266000 3rd floor, building 3, optical valley software park, 396 Emeishan Road, Huangdao District, Qingdao City, Shandong Province Applicant after: QINGDAO YISA DATA TECHNOLOGY Co.,Ltd. Applicant after: Qingdao Issa Technology Co.,Ltd. Applicant after: Anhui Issa Data Technology Co.,Ltd. Address before: 266000 3rd floor, building 3, optical valley software park, 396 Emeishan Road, Huangdao District, Qingdao City, Shandong Province Applicant before: QINGDAO YISA DATA TECHNOLOGY Co.,Ltd. Applicant before: BEIJING YISA TECHNOLOGY Co.,Ltd. Applicant before: Anhui Issa Data Technology Co.,Ltd. |
|
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: 266400 Room 302, building 3, Office No. 77, Lingyan Road, Huangdao District, Qingdao, Shandong Province Applicant after: QINGDAO YISA DATA TECHNOLOGY Co.,Ltd. Applicant after: Issa Technology Co.,Ltd. Applicant after: Anhui Issa Data Technology Co.,Ltd. Address before: 266000 3rd floor, building 3, optical valley software park, 396 Emeishan Road, Huangdao District, Qingdao City, Shandong Province Applicant before: QINGDAO YISA DATA TECHNOLOGY Co.,Ltd. Applicant before: Issa Technology Co.,Ltd. Applicant before: Anhui Issa Data Technology Co.,Ltd. |
|
RJ01 | Rejection of invention patent application after publication | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210129 |