WO2023033726A3 - Method and apparatus for processing data, and server and storage medium thereof - Google Patents
Method and apparatus for processing data, and server and storage medium thereof Download PDFInfo
- Publication number
- WO2023033726A3 WO2023033726A3 PCT/SG2022/050611 SG2022050611W WO2023033726A3 WO 2023033726 A3 WO2023033726 A3 WO 2023033726A3 SG 2022050611 W SG2022050611 W SG 2022050611W WO 2023033726 A3 WO2023033726 A3 WO 2023033726A3
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- server
- storage medium
- acquiring
- analyzed
- Prior art date
Links
- 238000000034 method Methods 0.000 title abstract 3
- 238000006243 chemical reaction Methods 0.000 abstract 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/24—Querying
- G06F16/245—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/258—Data format conversion from or to a database
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/25—Integrating or interfacing systems involving database management systems
- G06F16/254—Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Landscapes
- Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Computational Linguistics (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Multi Processors (AREA)
Abstract
Disclosed are a method and apparatus for processing data, and a server and a storage medium thereof. The method includes: acquiring to-be-analyzed data from a distributed database, wherein a data structure of the to-be-analyzed data is resilient distributed dataset (RDD); acquiring converted data by format conversion on the to-be-analyzed data, wherein a data structure of the converted data satisfies a data structure requirement corresponding to a single-machine algorithm, acquiring processed data by parallel processing on the converted data using the single-machine algorithm at data processing nodes in a distributed framework; and storing the processed data in a distributed database.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111004548.XA CN113704340B (en) | 2021-08-30 | 2021-08-30 | Data processing method, device, server and storage medium |
CN202111004548.X | 2021-08-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2023033726A2 WO2023033726A2 (en) | 2023-03-09 |
WO2023033726A3 true WO2023033726A3 (en) | 2023-05-04 |
Family
ID=78656821
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/SG2022/050611 WO2023033726A2 (en) | 2021-08-30 | 2022-08-26 | Method and apparatus for processing data, and server and storage medium thereof |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113704340B (en) |
WO (1) | WO2023033726A2 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107609141A (en) * | 2017-09-20 | 2018-01-19 | 国网上海市电力公司 | It is a kind of that quick modelling method of probabilistic is carried out to extensive renewable energy source data |
US20200334248A1 (en) * | 2013-10-01 | 2020-10-22 | Cloudera, Inc. | Background format optimization for enhanced queries in a distributed computing cluster |
CN112487125A (en) * | 2020-12-09 | 2021-03-12 | 武汉大学 | Distributed space object organization method for space-time big data calculation |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN109063842A (en) * | 2018-07-06 | 2018-12-21 | 无锡雪浪数制科技有限公司 | A kind of machine learning platform of compatible many algorithms frame |
CN109658006B (en) * | 2018-12-30 | 2022-02-15 | 广东电网有限责任公司 | Large-scale wind power plant group auxiliary scheduling method and device |
CN110209734B (en) * | 2019-05-05 | 2022-11-18 | 深圳市腾讯计算机系统有限公司 | Data copying method and device, computer equipment and storage medium |
CN110704995B (en) * | 2019-11-28 | 2020-05-01 | 电子科技大学中山学院 | Cable layout method and computer storage medium for multiple types of fans of multi-substation |
CN112185572B (en) * | 2020-09-25 | 2024-03-01 | 志诺维思(北京)基因科技有限公司 | Tumor specific disease database construction system, method, electronic equipment and medium |
CN112241872A (en) * | 2020-10-12 | 2021-01-19 | 上海众言网络科技有限公司 | Distributed data calculation analysis method, device, equipment and storage medium |
CN113220427A (en) * | 2021-04-15 | 2021-08-06 | 远景智能国际私人投资有限公司 | Task scheduling method and device, computer equipment and storage medium |
-
2021
- 2021-08-30 CN CN202111004548.XA patent/CN113704340B/en active Active
-
2022
- 2022-08-26 WO PCT/SG2022/050611 patent/WO2023033726A2/en active Search and Examination
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20200334248A1 (en) * | 2013-10-01 | 2020-10-22 | Cloudera, Inc. | Background format optimization for enhanced queries in a distributed computing cluster |
CN107609141A (en) * | 2017-09-20 | 2018-01-19 | 国网上海市电力公司 | It is a kind of that quick modelling method of probabilistic is carried out to extensive renewable energy source data |
CN112487125A (en) * | 2020-12-09 | 2021-03-12 | 武汉大学 | Distributed space object organization method for space-time big data calculation |
Also Published As
Publication number | Publication date |
---|---|
WO2023033726A2 (en) | 2023-03-09 |
CN113704340A (en) | 2021-11-26 |
CN113704340B (en) | 2023-07-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9552547B2 (en) | Normalizing electronic communications using a neural-network normalizer and a neural-network flagger | |
WO2019186194A3 (en) | Ensemble model creation and selection | |
CN110502509B (en) | Traffic big data cleaning method based on Hadoop and Spark framework and related device | |
US20180247180A1 (en) | Deep convolutional neural network acceleration and compression method based on parameter quantification | |
KR20220007160A (en) | Massive Multilingual Speech Recognition Using a Streaming End-to-End Model | |
JP2012163918A (en) | Voice signal processing apparatus, voice signal processing method, and program | |
CN111737355A (en) | MongoDB metadata management-based heterogeneous data source synchronization method and system | |
US11568344B2 (en) | Systems and methods for automated pattern detection in service tickets | |
CN116361256B (en) | Data synchronization method and system based on log analysis | |
CN112256523A (en) | Service data processing method and device | |
CN111339370B (en) | Quick decoding method for airplane QAR data | |
WO2023033726A3 (en) | Method and apparatus for processing data, and server and storage medium thereof | |
Jia et al. | Federated domain adaptation for asr with full self-supervision | |
WO2020168675A1 (en) | Sample data processing method, and system and apparatus | |
WO2018180106A1 (en) | Information processing device, information processing method, and computer-readable recording medium | |
Li et al. | DPATD: Dual-Phase Audio Transformer for Denoising | |
CN116860941A (en) | Question answering method and device, electronic equipment and storage medium | |
JP6633556B2 (en) | Acoustic model learning device, speech recognition device, acoustic model learning method, speech recognition method, and program | |
WO2019052389A1 (en) | Task optimization method and device in mobile robot | |
CN114495911A (en) | Speaker clustering method, device and equipment | |
De Silva et al. | The “higher” status language does not always win: The fall of English in India and the rise of Hindi | |
GB2613484A (en) | Shiftleft topology construction and information augmentation using machine learning | |
Husain et al. | Counting occurrences of textual words in lecture video frames using apache hadoop framework | |
JP7298714B2 (en) | Model learning device, speech recognition device, method thereof, and program | |
CN113747086A (en) | Digital human video generation method and device, electronic equipment and storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
NENP | Non-entry into the national phase |
Ref country code: DE |