JP5939123B2 - 実行制御プログラム、実行制御方法および情報処理装置 - Google Patents

実行制御プログラム、実行制御方法および情報処理装置 Download PDF

Info

Publication number
JP5939123B2
JP5939123B2 JP2012224604A JP2012224604A JP5939123B2 JP 5939123 B2 JP5939123 B2 JP 5939123B2 JP 2012224604 A JP2012224604 A JP 2012224604A JP 2012224604 A JP2012224604 A JP 2012224604A JP 5939123 B2 JP5939123 B2 JP 5939123B2
Authority
JP
Japan
Prior art keywords
file
input
data
unit
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2012224604A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014078085A (ja
JP2014078085A5 (enExample
Inventor
晴康 上田
晴康 上田
高光 前田
高光 前田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to JP2012224604A priority Critical patent/JP5939123B2/ja
Priority to US14/048,354 priority patent/US10095699B2/en
Publication of JP2014078085A publication Critical patent/JP2014078085A/ja
Publication of JP2014078085A5 publication Critical patent/JP2014078085A5/ja
Application granted granted Critical
Publication of JP5939123B2 publication Critical patent/JP5939123B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/116—Details of conversion of file system types or formats
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2012224604A 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置 Expired - Fee Related JP5939123B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2012224604A JP5939123B2 (ja) 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置
US14/048,354 US10095699B2 (en) 2012-10-09 2013-10-08 Computer-readable recording medium, execution control method, and information processing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012224604A JP5939123B2 (ja) 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置

Publications (3)

Publication Number Publication Date
JP2014078085A JP2014078085A (ja) 2014-05-01
JP2014078085A5 JP2014078085A5 (enExample) 2014-06-19
JP5939123B2 true JP5939123B2 (ja) 2016-06-22

Family

ID=50433596

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012224604A Expired - Fee Related JP5939123B2 (ja) 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置

Country Status (2)

Country Link
US (1) US10095699B2 (enExample)
JP (1) JP5939123B2 (enExample)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014163624A1 (en) * 2013-04-02 2014-10-09 Hewlett-Packard Development Company, L.P. Query integration across databases and file systems
US10452632B1 (en) * 2013-06-29 2019-10-22 Teradata Us, Inc. Multi-input SQL-MR
US9928263B2 (en) * 2013-10-03 2018-03-27 Google Llc Persistent shuffle system
IN2013CH05424A (enExample) 2013-11-26 2015-05-29 Inmobi Pte Ltd
US9607073B2 (en) * 2014-04-17 2017-03-28 Ab Initio Technology Llc Processing data from multiple sources
JP6519111B2 (ja) * 2014-07-18 2019-05-29 富士通株式会社 データ処理制御方法、データ処理制御プログラムおよびデータ処理制御装置
JP2016206757A (ja) * 2015-04-16 2016-12-08 富士通株式会社 分散処理プログラム、分散処理方法および情報処理装置
US10331620B2 (en) 2015-11-24 2019-06-25 International Business Machines Corporation File generator
US11294858B2 (en) * 2016-06-28 2022-04-05 Anditi Pty, Ltd. Method and system for flexible, high performance structured data processing
JP6700554B2 (ja) 2016-07-28 2020-05-27 富士通株式会社 分散処理管理方法、分散処理管理プログラム、および分散処理管理装置
US10552415B2 (en) * 2017-03-30 2020-02-04 Microsoft Technology Licensing, Llc Efficient distributed joining of two large data sets
JP6967870B2 (ja) * 2017-04-13 2021-11-17 ヤフー株式会社 データベース連携システム、データベース連携方法、およびプログラム

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080052261A1 (en) * 2006-06-22 2008-02-28 Moshe Valenci Method for block level file joining and splitting for efficient multimedia data processing
US7523123B2 (en) * 2006-11-16 2009-04-21 Yahoo! Inc. Map-reduce with merge to process multiple relational datasets
US8713038B2 (en) * 2009-04-02 2014-04-29 Pivotal Software, Inc. Integrating map-reduce into a distributed relational database
US8572575B2 (en) * 2009-09-14 2013-10-29 Myspace Llc Debugging a map reduce application on a cluster
US8935232B2 (en) * 2010-06-04 2015-01-13 Yale University Query execution systems and methods
US9170848B1 (en) * 2010-07-27 2015-10-27 Google Inc. Parallel processing of data
US9798831B2 (en) * 2011-04-01 2017-10-24 Google Inc. Processing data in a MapReduce framework
US9002871B2 (en) * 2011-04-26 2015-04-07 Brian J. Bulkowski Method and system of mapreduce implementations on indexed datasets in a distributed database environment
US8954967B2 (en) * 2011-05-31 2015-02-10 International Business Machines Corporation Adaptive parallel data processing
US8938416B1 (en) * 2012-01-13 2015-01-20 Amazon Technologies, Inc. Distributed storage of aggregated data
US20130318268A1 (en) * 2012-05-22 2013-11-28 Xockets IP, LLC Offloading of computation for rack level servers and corresponding methods and systems
EP2857975A4 (en) * 2012-05-31 2016-03-02 Univ Tokyo PARALLEL DATA PROCESSING SYSTEM, COMPUTER AND PARALLEL DATA PROCESSING METHOD
US20130339972A1 (en) * 2012-06-18 2013-12-19 Zhuoyao Zhang Determining an allocation of resources to a program having concurrent jobs
WO2014004725A2 (en) * 2012-06-26 2014-01-03 Battelle Memorial Institute Methods and apparatus of analyzing electrical power grid data

Also Published As

Publication number Publication date
JP2014078085A (ja) 2014-05-01
US10095699B2 (en) 2018-10-09
US20140101213A1 (en) 2014-04-10

Similar Documents

Publication Publication Date Title
JP5939123B2 (ja) 実行制御プログラム、実行制御方法および情報処理装置
US20230126005A1 (en) Consistent filtering of machine learning data
AU2023200421B2 (en) Dataflow graph configuration
US10713589B1 (en) Consistent sort-based record-level shuffling of machine learning data
US11100420B2 (en) Input processing for machine learning
US10366053B1 (en) Consistent randomized record-level splitting of machine learning data
US11182691B1 (en) Category-based sampling of machine learning data
US10585691B2 (en) Distribution system, computer, and arrangement method for virtual machine
CN111324610A (zh) 一种数据同步的方法及装置
US20140059000A1 (en) Computer system and parallel distributed processing method
Tan et al. Hadoop framework: impact of data organization on performance
CN110781183A (zh) Hive数据库中增量数据的处理方法、装置以及计算机设备
JPWO2017033441A1 (ja) システム構築支援システム、方法および記憶媒体
CN116414801A (zh) 数据迁移方法、装置、计算机设备和存储介质
KR20140048396A (ko) 클라우드 스토리지 서비스의 파일 검색 시스템 및 방법, 및 파일 제어 방법
CN115809304A (zh) 字段级血缘解析方法、装置、计算机设备、存储介质
Theußl et al. A tm plug-in for distributed text mining in R
Lee et al. Implementation and performance of distributed text processing system using hadoop for e-discovery cloud service
CN113626510A (zh) 交易核对方法、装置、电子设备及存储介质
Grossman What is analytic infrastructure and why should you care?
Chen et al. pmTM-align: scalable pairwise and multiple structure alignment with Apache Spark and OpenMP
JP6422346B2 (ja) プログラム生成装置、及び、プログラム生成方法
Lin et al. Combining Hadoop with MPI to Solve Metagenomics Problems that are both Data-and Compute-intensive
JP2016157411A (ja) 情報管理装置並びにファイル管理方法
CN112702421B (zh) 文件同步方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140424

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150604

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160408

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160419

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160502

R150 Certificate of patent or registration of utility model

Ref document number: 5939123

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees