CN110737727B - 一种数据处理的方法及系统 - Google Patents

一种数据处理的方法及系统 Download PDF

Info

Publication number
CN110737727B
CN110737727B CN201811337593.5A CN201811337593A CN110737727B CN 110737727 B CN110737727 B CN 110737727B CN 201811337593 A CN201811337593 A CN 201811337593A CN 110737727 B CN110737727 B CN 110737727B
Authority
CN
China
Prior art keywords
data
aggregation
cluster
interval
query
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201811337593.5A
Other languages
English (en)
Chinese (zh)
Other versions
CN110737727A (zh
Inventor
单卫华
殷晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Cloud Computing Technologies Co Ltd
Original Assignee
Huawei Cloud Computing Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Cloud Computing Technologies Co Ltd filed Critical Huawei Cloud Computing Technologies Co Ltd
Priority to PCT/CN2019/087995 priority Critical patent/WO2020015453A1/fr
Priority to EP19838302.8A priority patent/EP3817432A4/fr
Publication of CN110737727A publication Critical patent/CN110737727A/zh
Priority to US17/149,877 priority patent/US11455323B2/en
Application granted granted Critical
Publication of CN110737727B publication Critical patent/CN110737727B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/04—Trading; Exchange, e.g. stocks, commodities, derivatives or currency exchange
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/28—Databases characterised by their database models, e.g. relational or object models
    • G06F16/284—Relational databases
    • G06F16/285—Clustering or classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q40/00—Finance; Insurance; Tax strategies; Processing of corporate or income taxes
    • G06Q40/02—Banking, e.g. interest calculation or account maintenance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G06Q10/063—Operations research, analysis or management
    • G06Q10/0635—Risk analysis of enterprise or organisation activities
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/02—Marketing; Price estimation or determination; Fundraising
    • G06Q30/0201—Market modelling; Market analysis; Collecting market data
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Development Economics (AREA)
  • Economics (AREA)
  • Databases & Information Systems (AREA)
  • Marketing (AREA)
  • General Business, Economics & Management (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Human Resources & Organizations (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Technology Law (AREA)
  • Game Theory and Decision Science (AREA)
  • Computational Linguistics (AREA)
  • Operations Research (AREA)
  • Quality & Reliability (AREA)
  • Tourism & Hospitality (AREA)
  • Educational Administration (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
CN201811337593.5A 2018-07-19 2018-11-12 一种数据处理的方法及系统 Active CN110737727B (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
PCT/CN2019/087995 WO2020015453A1 (fr) 2018-07-19 2019-05-22 Procédé et système de traitement de données
EP19838302.8A EP3817432A4 (fr) 2018-07-19 2019-05-22 Procédé et système de traitement de données
US17/149,877 US11455323B2 (en) 2018-07-19 2021-01-15 Data processing method and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810793637 2018-07-19
CN2018107936379 2018-07-19

Publications (2)

Publication Number Publication Date
CN110737727A CN110737727A (zh) 2020-01-31
CN110737727B true CN110737727B (zh) 2023-09-29

Family

ID=69236438

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201811337593.5A Active CN110737727B (zh) 2018-07-19 2018-11-12 一种数据处理的方法及系统
CN201811337776.7A Active CN110737673B (zh) 2018-07-19 2018-11-12 一种数据处理的方法及系统

Family Applications After (1)

Application Number Title Priority Date Filing Date
CN201811337776.7A Active CN110737673B (zh) 2018-07-19 2018-11-12 一种数据处理的方法及系统

Country Status (4)

Country Link
US (1) US11455323B2 (fr)
EP (1) EP3817432A4 (fr)
CN (2) CN110737727B (fr)
WO (1) WO2020098579A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11973846B1 (en) * 2022-11-28 2024-04-30 Salesforce, Inc. Polling command strategy for near real time updates
CN116595156B (zh) * 2023-07-17 2023-12-19 北京普华恒信技术服务有限公司 一种知识管理系统及管理方法
CN117221241B (zh) * 2023-11-08 2024-01-26 杭州鸿世电器股份有限公司 一种智能开关控制过程数据传输方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080270363A1 (en) * 2007-01-26 2008-10-30 Herbert Dennis Hunt Cluster processing of a core information matrix
CN103324724A (zh) * 2013-06-26 2013-09-25 华为技术有限公司 数据处理方法及装置
CN107077453A (zh) * 2015-03-24 2017-08-18 华为技术有限公司 用于使用集群缓存进行数据库查询的并行优化的系统和方法
CN107402863A (zh) * 2016-03-28 2017-11-28 阿里巴巴集团控股有限公司 一种用于通过日志系统处理业务系统的日志的方法与设备

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110153603A1 (en) 2009-12-17 2011-06-23 Yahoo! Inc. Time series storage for large-scale monitoring system
US10346375B2 (en) * 2012-04-26 2019-07-09 Entit Software Llc In-database parallel analytics
JP5978993B2 (ja) * 2012-12-28 2016-08-24 富士通株式会社 情報処理システム制御装置、該プログラム、及び該方法
US10466217B1 (en) * 2013-12-23 2019-11-05 Aclima Inc. Method to combine partially aggregated sensor data in a distributed sensor system
CN104750708B (zh) * 2013-12-27 2018-09-28 华为技术有限公司 一种时空数据的索引建立方法、查询方法、装置及设备
CN103997753B (zh) 2014-06-03 2017-11-07 杭州东信网络技术有限公司 间隔式追加采集移动通信无线网络性能数据的方法
CN105468651B (zh) * 2014-09-12 2020-03-27 阿里巴巴集团控股有限公司 一种关系数据库数据查询方法及系统
CN104951509A (zh) 2015-05-25 2015-09-30 中国科学院信息工程研究所 一种大数据在线交互式查询方法及系统
US20160370338A1 (en) * 2015-06-22 2016-12-22 Aclima Inc. Sensor data processing in a distributed sensor system
US10191962B2 (en) * 2015-07-30 2019-01-29 At&T Intellectual Property I, L.P. System for continuous monitoring of data quality in a dynamic feed environment
CA2999276A1 (fr) * 2015-09-21 2017-03-30 Equifax, Inc. Mise a jour de structures de donnees d'attribut pour indiquer des tendances dans des donnees d'attribut fournies a des systemes de modelisation automatisee
CN107391502B (zh) * 2016-05-16 2020-08-04 阿里巴巴集团控股有限公司 时间间隔的数据查询方法、装置及索引构建方法、装置
CN106651200A (zh) 2016-12-29 2017-05-10 中国西电电气股份有限公司 一种工业企业聚合用户电力负荷管理方法和系统
US10558647B1 (en) * 2016-12-30 2020-02-11 Amazon Technologies, Inc. High performance data aggregations
CN107562892A (zh) * 2017-09-06 2018-01-09 郑州云海信息技术有限公司 一种提高ssr违规日志统计性能的方法及装置
JP6751064B2 (ja) * 2017-09-20 2020-09-02 株式会社東芝 データ検索システム、データ検索方法、及びプログラム
CN107864071B (zh) 2017-11-02 2021-06-22 江苏物联网研究发展中心 一种面向主动安全的数据动态采集方法、装置及系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080270363A1 (en) * 2007-01-26 2008-10-30 Herbert Dennis Hunt Cluster processing of a core information matrix
CN103324724A (zh) * 2013-06-26 2013-09-25 华为技术有限公司 数据处理方法及装置
CN107077453A (zh) * 2015-03-24 2017-08-18 华为技术有限公司 用于使用集群缓存进行数据库查询的并行优化的系统和方法
CN107402863A (zh) * 2016-03-28 2017-11-28 阿里巴巴集团控股有限公司 一种用于通过日志系统处理业务系统的日志的方法与设备

Also Published As

Publication number Publication date
WO2020098579A1 (fr) 2020-05-22
US20210133215A1 (en) 2021-05-06
CN110737673B (zh) 2022-04-12
EP3817432A1 (fr) 2021-05-05
US11455323B2 (en) 2022-09-27
EP3817432A4 (fr) 2021-10-20
CN110737673A (zh) 2020-01-31
CN110737727A (zh) 2020-01-31

Similar Documents

Publication Publication Date Title
CN103748579B (zh) 在映射化简框架中处理数据
KR102522274B1 (ko) 사용자 그룹화 방법 및 장치, 컴퓨터 장비, 컴퓨터 판독가능 저장 매체 및 컴퓨터 프로그램
CN111488363B (zh) 数据处理方法、装置、电子设备及介质
CN110737727B (zh) 一种数据处理的方法及系统
CN109241159B (zh) 一种数据立方体的分区查询方法、系统及终端设备
CN111506559A (zh) 数据存储方法、装置、电子设备及存储介质
CN111400288A (zh) 数据质量检查方法及系统
US20140052727A1 (en) Data processing for database aggregation operation
CN107657357B (zh) 数据的处理方法及装置
CN111414410A (zh) 数据处理方法、装置、设备和存储介质
CN114372060A (zh) 数据存储方法、装置、设备及存储介质
CN114661736A (zh) 电子地图更新方法、装置、电子设备、存储介质及产品
CN112364021B (zh) 业务数据处理方法、装置及存储介质
CN114428813A (zh) 基于报表平台的数据统计方法、装置、设备及存储介质
CN108536525B (zh) 一种宿主机调度方法及装置
CN111427871B (zh) 数据处理方法、装置、设备
CN116611914A (zh) 一种基于分组统计的薪资预测方法及设备
US10042902B2 (en) Business rules influenced quasi-cubes with higher diligence of data optimization
CN110941536A (zh) 监控方法及系统、第一服务器集群
US20110231360A1 (en) Persistent flow method to define transformation of metrics packages into a data store suitable for analysis by visualization
CN113505172B (zh) 数据处理方法、装置、电子设备及可读存储介质
CN112559490B (zh) 一种数据分层汇总设计方法及数据自动分层汇总方法
CN115470279A (zh) 基于企业数据的数源转换方法、装置、设备及介质
CN112765170B (zh) 一种嵌入式时间序列数据管理方法及设备
CN115221174A (zh) 基于人工智能的数据分级存储方法、装置、设备及介质

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right

Effective date of registration: 20220224

Address after: 550025 Huawei cloud data center, jiaoxinggong Road, Qianzhong Avenue, Gui'an New District, Guiyang City, Guizhou Province

Applicant after: Huawei Cloud Computing Technologies Co.,Ltd.

Address before: 518129 Bantian HUAWEI headquarters office building, Longgang District, Guangdong, Shenzhen

Applicant before: HUAWEI TECHNOLOGIES Co.,Ltd.

TA01 Transfer of patent application right
GR01 Patent grant
GR01 Patent grant