WO2023033726A3 - Method and apparatus for processing data, and server and storage medium thereof - Google Patents

Method and apparatus for processing data, and server and storage medium thereof Download PDF

Info

Publication number
WO2023033726A3
WO2023033726A3 PCT/SG2022/050611 SG2022050611W WO2023033726A3 WO 2023033726 A3 WO2023033726 A3 WO 2023033726A3 SG 2022050611 W SG2022050611 W SG 2022050611W WO 2023033726 A3 WO2023033726 A3 WO 2023033726A3
Authority
WO
WIPO (PCT)
Prior art keywords
data
server
storage medium
acquiring
analyzed
Prior art date
Application number
PCT/SG2022/050611
Other languages
French (fr)
Other versions
WO2023033726A2 (en
Inventor
Zhimeng WANG
Original Assignee
Envision Digital International Pte. Ltd.
Shanghai Envision Digital Co., Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Envision Digital International Pte. Ltd., Shanghai Envision Digital Co., Ltd. filed Critical Envision Digital International Pte. Ltd.
Publication of WO2023033726A2 publication Critical patent/WO2023033726A2/en
Publication of WO2023033726A3 publication Critical patent/WO2023033726A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24—Querying
    • G06F16/245—Query processing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/258—Data format conversion from or to a database
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25—Integrating or interfacing systems involving database management systems
    • G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Multi Processors (AREA)

Abstract

Disclosed are a method and apparatus for processing data, and a server and a storage medium thereof. The method includes: acquiring to-be-analyzed data from a distributed database, wherein a data structure of the to-be-analyzed data is resilient distributed dataset (RDD); acquiring converted data by format conversion on the to-be-analyzed data, wherein a data structure of the converted data satisfies a data structure requirement corresponding to a single-machine algorithm, acquiring processed data by parallel processing on the converted data using the single-machine algorithm at data processing nodes in a distributed framework; and storing the processed data in a distributed database.
PCT/SG2022/050611 2021-08-30 2022-08-26 Method and apparatus for processing data, and server and storage medium thereof WO2023033726A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111004548.XA CN113704340B (en) 2021-08-30 2021-08-30 Data processing method, device, server and storage medium
CN202111004548.X 2021-08-30

Publications (2)

Publication Number Publication Date
WO2023033726A2 WO2023033726A2 (en) 2023-03-09
WO2023033726A3 true WO2023033726A3 (en) 2023-05-04

Family

ID=78656821

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/SG2022/050611 WO2023033726A2 (en) 2021-08-30 2022-08-26 Method and apparatus for processing data, and server and storage medium thereof

Country Status (2)

Country Link
CN (1) CN113704340B (en)
WO (1) WO2023033726A2 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107609141A (en) * 2017-09-20 2018-01-19 国网上海市电力公司 It is a kind of that quick modelling method of probabilistic is carried out to extensive renewable energy source data
US20200334248A1 (en) * 2013-10-01 2020-10-22 Cloudera, Inc. Background format optimization for enhanced queries in a distributed computing cluster
CN112487125A (en) * 2020-12-09 2021-03-12 武汉大学 Distributed space object organization method for space-time big data calculation

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109063842A (en) * 2018-07-06 2018-12-21 无锡雪浪数制科技有限公司 A kind of machine learning platform of compatible many algorithms frame
CN109658006B (en) * 2018-12-30 2022-02-15 广东电网有限责任公司 Large-scale wind power plant group auxiliary scheduling method and device
CN110209734B (en) * 2019-05-05 2022-11-18 深圳市腾讯计算机系统有限公司 Data copying method and device, computer equipment and storage medium
CN110704995B (en) * 2019-11-28 2020-05-01 电子科技大学中山学院 Cable layout method and computer storage medium for multiple types of fans of multi-substation
CN112185572B (en) * 2020-09-25 2024-03-01 志诺维思（北京）基因科技有限公司 Tumor specific disease database construction system, method, electronic equipment and medium
CN112241872A (en) * 2020-10-12 2021-01-19 上海众言网络科技有限公司 Distributed data calculation analysis method, device, equipment and storage medium
CN113220427A (en) * 2021-04-15 2021-08-06 远景智能国际私人投资有限公司 Task scheduling method and device, computer equipment and storage medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200334248A1 (en) * 2013-10-01 2020-10-22 Cloudera, Inc. Background format optimization for enhanced queries in a distributed computing cluster
CN107609141A (en) * 2017-09-20 2018-01-19 国网上海市电力公司 It is a kind of that quick modelling method of probabilistic is carried out to extensive renewable energy source data
CN112487125A (en) * 2020-12-09 2021-03-12 武汉大学 Distributed space object organization method for space-time big data calculation

Also Published As

Publication number Publication date
WO2023033726A2 (en) 2023-03-09
CN113704340A (en) 2021-11-26
CN113704340B (en) 2023-07-21

Similar Documents

Publication Publication Date Title
US9552547B2 (en) Normalizing electronic communications using a neural-network normalizer and a neural-network flagger
WO2019186194A3 (en) Ensemble model creation and selection
CN110502509B (en) Traffic big data cleaning method based on Hadoop and Spark framework and related device
US20180247180A1 (en) Deep convolutional neural network acceleration and compression method based on parameter quantification
KR20220007160A (en) Massive Multilingual Speech Recognition Using a Streaming End-to-End Model
JP2012163918A (en) Voice signal processing apparatus, voice signal processing method, and program
CN111737355A (en) MongoDB metadata management-based heterogeneous data source synchronization method and system
US11568344B2 (en) Systems and methods for automated pattern detection in service tickets
CN116361256B (en) Data synchronization method and system based on log analysis
CN112256523A (en) Service data processing method and device
CN111339370B (en) Quick decoding method for airplane QAR data
WO2023033726A3 (en) Method and apparatus for processing data, and server and storage medium thereof
Jia et al. Federated domain adaptation for asr with full self-supervision
WO2020168675A1 (en) Sample data processing method, and system and apparatus
WO2018180106A1 (en) Information processing device, information processing method, and computer-readable recording medium
Li et al. DPATD: Dual-Phase Audio Transformer for Denoising
CN116860941A (en) Question answering method and device, electronic equipment and storage medium
JP6633556B2 (en) Acoustic model learning device, speech recognition device, acoustic model learning method, speech recognition method, and program
WO2019052389A1 (en) Task optimization method and device in mobile robot
CN114495911A (en) Speaker clustering method, device and equipment
De Silva et al. The “higher” status language does not always win: The fall of English in India and the rise of Hindi
GB2613484A (en) Shiftleft topology construction and information augmentation using machine learning
Husain et al. Counting occurrences of textual words in lecture video frames using apache hadoop framework
JP7298714B2 (en) Model learning device, speech recognition device, method thereof, and program
CN113747086A (en) Digital human video generation method and device, electronic equipment and storage medium

Legal Events

Date Code Title Description
DPE1 Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101)
NENP Non-entry into the national phase

Ref country code: DE