CN102314460B - 数据分析方法、系统及服务器 - Google Patents

数据分析方法、系统及服务器 Download PDF

Info

Publication number
CN102314460B
CN102314460B CN201010222602.3A CN201010222602A CN102314460B CN 102314460 B CN102314460 B CN 102314460B CN 201010222602 A CN201010222602 A CN 201010222602A CN 102314460 B CN102314460 B CN 102314460B
Authority
CN
China
Prior art keywords
data
original data
preset
server
analyzed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201010222602.3A
Other languages
English (en)
Chinese (zh)
Other versions
CN102314460A (zh
Inventor
岑文初
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Group Holding Ltd
Original Assignee
Alibaba Group Holding Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Group Holding Ltd filed Critical Alibaba Group Holding Ltd
Priority to CN201010222602.3A priority Critical patent/CN102314460B/zh
Priority to US13/135,407 priority patent/US9442979B2/en
Priority to EP11803939.5A priority patent/EP2591421A4/en
Priority to JP2013518377A priority patent/JP5635691B2/ja
Priority to PCT/US2011/001186 priority patent/WO2012005765A1/en
Publication of CN102314460A publication Critical patent/CN102314460A/zh
Priority to HK12102409.7A priority patent/HK1161923B/xx
Application granted granted Critical
Publication of CN102314460B publication Critical patent/CN102314460B/zh
Priority to US15/236,022 priority patent/US20170039214A1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/16—File or folder operations, e.g. details of user interfaces specifically adapted to file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2453—Query optimisation
    • G06F16/24532—Query optimisation of parallel queries
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G06F16/2458—Special types of queries, e.g. statistical queries, fuzzy queries or distributed queries
    • G06F16/2471—Distributed queries

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Probability & Statistics with Applications (AREA)
  • Software Systems (AREA)
  • Fuzzy Systems (AREA)
  • Human Computer Interaction (AREA)
  • Debugging And Monitoring (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Computer And Data Communications (AREA)
CN201010222602.3A 2010-07-07 2010-07-07 数据分析方法、系统及服务器 Active CN102314460B (zh)

Priority Applications (7)

Application Number Priority Date Filing Date Title
CN201010222602.3A CN102314460B (zh) 2010-07-07 2010-07-07 数据分析方法、系统及服务器
US13/135,407 US9442979B2 (en) 2010-07-07 2011-07-05 Data analysis using multiple systems
JP2013518377A JP5635691B2 (ja) 2010-07-07 2011-07-06 複数のシステムを用いたデータ解析
PCT/US2011/001186 WO2012005765A1 (en) 2010-07-07 2011-07-06 Data analysis using multiple systems
EP11803939.5A EP2591421A4 (en) 2010-07-07 2011-07-06 Data analysis using multiple systems
HK12102409.7A HK1161923B (zh) 2012-03-09 数据分析方法、系统及服务器
US15/236,022 US20170039214A1 (en) 2010-07-07 2016-08-12 Data analysis using multiple systems

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201010222602.3A CN102314460B (zh) 2010-07-07 2010-07-07 数据分析方法、系统及服务器

Publications (2)

Publication Number Publication Date
CN102314460A CN102314460A (zh) 2012-01-11
CN102314460B true CN102314460B (zh) 2014-05-14

Family

ID=45427638

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201010222602.3A Active CN102314460B (zh) 2010-07-07 2010-07-07 数据分析方法、系统及服务器

Country Status (5)

Country Link
US (2) US9442979B2 (enExample)
EP (1) EP2591421A4 (enExample)
JP (1) JP5635691B2 (enExample)
CN (1) CN102314460B (enExample)
WO (1) WO2012005765A1 (enExample)

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102638456B (zh) * 2012-03-19 2015-09-23 杭州海康威视数字技术股份有限公司 基于云计算的海量实时视频码流智能分析方法及其系统
CN103942210B (zh) * 2013-01-21 2018-05-04 中国移动通信集团上海有限公司 海量日志信息的处理方法、装置与系统
CN103970738B (zh) * 2013-01-24 2017-08-29 华为技术有限公司 一种产生数据的方法和装置
CN103823846A (zh) * 2014-01-28 2014-05-28 浙江大学 一种基于图论的大数据存储及查询方法
CN103793513B (zh) * 2014-02-10 2017-04-05 济南大学 基于邻近海量数据快速分析的电信套餐优化系统与方法
CN104462287B (zh) * 2014-11-27 2018-10-12 华为技术服务有限公司 一种数据处理的方法、装置及系统
CN105843803B (zh) * 2015-01-12 2019-04-12 上海悦程信息技术有限公司 大数据安全可视化交互分析系统及方法
CN104679884B (zh) * 2015-03-16 2018-04-10 北京奇虎科技有限公司 数据库的数据分析方法、装置以及系统
US10817544B2 (en) * 2015-04-20 2020-10-27 Splunk Inc. Scaling available storage based on counting generated events
US10282455B2 (en) 2015-04-20 2019-05-07 Splunk Inc. Display of data ingestion information based on counting generated events
CN105760492B (zh) * 2016-02-18 2019-10-15 广东睿江云计算股份有限公司 数据分析方法及装置
CN107203960B (zh) * 2016-06-30 2021-03-09 北京新媒传信科技有限公司 图像渲染方法及装置
CN106250406A (zh) * 2016-07-21 2016-12-21 柳州龙辉科技有限公司 一种日志处理方法
CN106250405A (zh) * 2016-07-21 2016-12-21 柳州龙辉科技有限公司 一种海量信息处理系统
CN106227797A (zh) * 2016-07-21 2016-12-14 柳州龙辉科技有限公司 一种海量日志信息的处理方法
CN106250287A (zh) * 2016-07-21 2016-12-21 柳州龙辉科技有限公司 一种日志信息处理装置
CN106227644A (zh) * 2016-07-21 2016-12-14 柳州龙辉科技有限公司 一种海量信息处理装置
CN107959703B (zh) * 2016-10-18 2021-04-16 网宿科技股份有限公司 数据处理方法、客户端及分布式计算系统
CN107526926A (zh) * 2017-08-09 2017-12-29 沈阳东软医疗系统有限公司 一种图像体数据分割标识处理方法、装置及设备
CN109726581B (zh) * 2017-10-31 2020-04-14 阿里巴巴集团控股有限公司 一种数据统计方法和装置
CN109408214A (zh) * 2018-11-06 2019-03-01 北京字节跳动网络技术有限公司 一种数据的并行处理方法、装置、电子设备及可读介质
CN113392352B (zh) * 2021-06-17 2025-02-21 北京沃东天骏信息技术有限公司 一种元素隔离方法及装置、设备、存储介质

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1207186A (zh) * 1995-12-30 1999-02-03 时代线路股份有限公司 具有多个源容量的数据检索方法和装置

Family Cites Families (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH052610A (ja) 1991-06-25 1993-01-08 Mitsubishi Electric Corp リレーシヨナルデータベースにおける集約演算処理方式
JP3457405B2 (ja) 1994-03-09 2003-10-20 日本電信電話株式会社 情報検索装置、情報検索方法及び知識獲得システム
US5802511A (en) 1996-01-02 1998-09-01 Timeline, Inc. Data retrieval method and apparatus with multiple source capability
CA2199108C (en) 1996-03-05 2002-04-23 Hirotoshi Maegawa Parallel distributed processing system and method of same
US6714979B1 (en) * 1997-09-26 2004-03-30 Worldcom, Inc. Data warehousing infrastructure for web based reporting tool
US6882990B1 (en) * 1999-05-01 2005-04-19 Biowulf Technologies, Llc Methods of identifying biological patterns using multiple data sets
US7805388B2 (en) 1998-05-01 2010-09-28 Health Discovery Corporation Method for feature selection in a support vector machine using feature ranking
US7047232B1 (en) 1999-01-13 2006-05-16 Ab Initio Software Corporation Parallelizing applications of script-driven tools
US6408292B1 (en) 1999-08-04 2002-06-18 Hyperroll, Israel, Ltd. Method of and system for managing multi-dimensional databases using modular-arithmetic based address data mapping processes on integer-encoded business dimensions
US6385604B1 (en) * 1999-08-04 2002-05-07 Hyperroll, Israel Limited Relational database management system having integrated non-relational multi-dimensional data store of aggregated data elements
JP2001109718A (ja) 1999-10-06 2001-04-20 Yamatake Building Systems Co Ltd 情報閲覧システム
NZ507121A (en) * 2000-09-22 2003-08-29 Compudigm Int Ltd Data visualization parameters specified in query for data from database
US6704733B2 (en) * 2000-10-25 2004-03-09 Lightning Source, Inc. Distributing electronic books over a computer network
US7076482B2 (en) * 2001-10-25 2006-07-11 Bea Systems, Inc. Multi-part looked-up table fields and its use in data processing operations involving multiple tables of a relational database
CN100483333C (zh) * 2001-12-28 2009-04-29 国际商业机器公司 实时数据入库
US8577795B2 (en) * 2002-10-10 2013-11-05 Convergys Information Management Group, Inc. System and method for revenue and authorization management
US8121978B2 (en) * 2002-11-15 2012-02-21 Sybase, Inc. Database system providing improved methods for data replication
US8620937B2 (en) * 2002-12-27 2013-12-31 International Business Machines Corporation Real time data warehousing
US7610306B2 (en) * 2003-06-30 2009-10-27 International Business Machines Corporation Multi-modal fusion in content-based retrieval
US7143112B2 (en) * 2003-09-10 2006-11-28 Hitachi, Ltd. Method and apparatus for data integration
US7047252B2 (en) 2003-12-02 2006-05-16 Oracle International Corporation Complex computation across heterogenous computer systems
US7797333B1 (en) * 2004-06-11 2010-09-14 Seisint, Inc. System and method for returning results of a query from one or more slave nodes to one or more master nodes of a database system
US7650331B1 (en) * 2004-06-18 2010-01-19 Google Inc. System and method for efficient large-scale data processing
US7937344B2 (en) * 2005-07-25 2011-05-03 Splunk Inc. Machine data web
US7571151B1 (en) 2005-12-15 2009-08-04 Gneiss Software, Inc. Data analysis tool for analyzing data stored in multiple text files
US7624118B2 (en) 2006-07-26 2009-11-24 Microsoft Corporation Data processing over very large databases
US8190610B2 (en) * 2006-10-05 2012-05-29 Yahoo! Inc. MapReduce for distributed database processing
US7627551B2 (en) * 2007-01-23 2009-12-01 Gm Global Technology Operations, Inc. Retrieving case-based reasoning information from archive records
US7970872B2 (en) 2007-10-01 2011-06-28 Accenture Global Services Limited Infrastructure for parallel programming of clusters of machines
EP2063364A1 (en) * 2007-11-19 2009-05-27 Siemens Aktiengesellschaft Module for building database queries
JP5408442B2 (ja) 2010-01-21 2014-02-05 株式会社日立製作所 並列分散処理方法、及び、計算機システム

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1207186A (zh) * 1995-12-30 1999-02-03 时代线路股份有限公司 具有多个源容量的数据检索方法和装置

Also Published As

Publication number Publication date
EP2591421A1 (en) 2013-05-15
CN102314460A (zh) 2012-01-11
EP2591421A4 (en) 2017-12-06
US20120011121A1 (en) 2012-01-12
WO2012005765A1 (en) 2012-01-12
JP5635691B2 (ja) 2014-12-03
US9442979B2 (en) 2016-09-13
US20170039214A1 (en) 2017-02-09
HK1161923A1 (en) 2012-08-10
JP2013536492A (ja) 2013-09-19

Similar Documents

Publication Publication Date Title
CN102314460B (zh) 数据分析方法、系统及服务器
US10884891B2 (en) Interactive detection of system anomalies
US10175954B2 (en) Method of processing big data, including arranging icons in a workflow GUI by a user, checking process availability and syntax, converting the workflow into execution code, monitoring the workflow, and displaying associated information
CN103605747B (zh) 文件表单的处理方法和装置
US9916286B2 (en) Reformatting multiple paragraphs of text using the formatting of a sample object by creating multiple candidate combinations and selecting a closest match
CN107748752B (zh) 一种数据处理方法及装置
CN106557307B (zh) 业务数据的处理方法及处理系统
CN110377559B (zh) 一种pdf文件数据提取方法、装置及存储介质
CN113535699B (zh) 一种数据质量检测方法、装置和设备
CN111143390A (zh) 更新元数据的方法及装置
JP7078114B2 (ja) ログ分析装置、ログ分析方法、プログラム
CN106649210A (zh) 一种数据转换方法及装置
CN106919630A (zh) 一种基于sql表达式的风险指标公式生成方法及系统
US8429520B2 (en) Citation record extraction system and method
HK1161923B (zh) 数据分析方法、系统及服务器
CN109739883B (zh) 提升数据查询性能的方法、装置和电子设备
TWI524191B (zh) Data analysis methods, systems and servers
CN114745452B (zh) 设备管理方法、装置及电子设备
US11132235B2 (en) Data processing method, distributed data processing system and storage medium
CN116701406A (zh) 数据比对方法和装置、计算机设备及存储介质
CN116226214A (zh) 一种字段数据集的筛选管理方法、系统和存储介质
CN116303427A (zh) 数据处理方法及装置、电子设备和存储介质
CN115421965A (zh) 一致性校验方法、装置、电子设备及存储介质
CN109325166B (zh) 爬虫系统中解析规则配置方法及装置
CN105740449A (zh) 统计报告动态生成系统和方法

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1161923

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1161923

Country of ref document: HK