JP5939123B2 - 実行制御プログラム、実行制御方法および情報処理装置 - Google Patents

実行制御プログラム、実行制御方法および情報処理装置 Download PDF

Info

Publication number
JP5939123B2
JP5939123B2 JP2012224604A JP2012224604A JP5939123B2 JP 5939123 B2 JP5939123 B2 JP 5939123B2 JP 2012224604 A JP2012224604 A JP 2012224604A JP 2012224604 A JP2012224604 A JP 2012224604A JP 5939123 B2 JP5939123 B2 JP 5939123B2
Authority
JP
Japan
Prior art keywords
file
input
data
unit
processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2012224604A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014078085A5 (https=
JP2014078085A (ja
Inventor
晴康 上田
晴康 上田
高光 前田
高光 前田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Fujitsu Ltd
Original Assignee
Fujitsu Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fujitsu Ltd filed Critical Fujitsu Ltd
Priority to JP2012224604A priority Critical patent/JP5939123B2/ja
Priority to US14/048,354 priority patent/US10095699B2/en
Publication of JP2014078085A publication Critical patent/JP2014078085A/ja
Publication of JP2014078085A5 publication Critical patent/JP2014078085A5/ja
Application granted granted Critical
Publication of JP5939123B2 publication Critical patent/JP5939123B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/116—Details of conversion of file system types or formats
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2012224604A 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置 Expired - Fee Related JP5939123B2 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2012224604A JP5939123B2 (ja) 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置
US14/048,354 US10095699B2 (en) 2012-10-09 2013-10-08 Computer-readable recording medium, execution control method, and information processing apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2012224604A JP5939123B2 (ja) 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置

Publications (3)

Publication Number Publication Date
JP2014078085A JP2014078085A (ja) 2014-05-01
JP2014078085A5 JP2014078085A5 (https=) 2014-06-19
JP5939123B2 true JP5939123B2 (ja) 2016-06-22

Family

ID=50433596

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2012224604A Expired - Fee Related JP5939123B2 (ja) 2012-10-09 2012-10-09 実行制御プログラム、実行制御方法および情報処理装置

Country Status (2)

Country Link
US (1) US10095699B2 (https=)
JP (1) JP5939123B2 (https=)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105164673A (zh) * 2013-04-02 2015-12-16 惠普发展公司，有限责任合伙企业 跨数据库和文件系统的查询一体化
US10452632B1 (en) * 2013-06-29 2019-10-22 Teradata Us, Inc. Multi-input SQL-MR
US9928263B2 (en) 2013-10-03 2018-03-27 Google Llc Persistent shuffle system
IN2013CH05424A (https=) 2013-11-26 2015-05-29 Inmobi Pte Ltd
US9607073B2 (en) * 2014-04-17 2017-03-28 Ab Initio Technology Llc Processing data from multiple sources
JP6519111B2 (ja) * 2014-07-18 2019-05-29 富士通株式会社 データ処理制御方法、データ処理制御プログラムおよびデータ処理制御装置
JP2016206757A (ja) * 2015-04-16 2016-12-08 富士通株式会社 分散処理プログラム、分散処理方法および情報処理装置
US10331620B2 (en) 2015-11-24 2019-06-25 International Business Machines Corporation File generator
CN109416688B (zh) * 2016-06-28 2024-03-12 安蒂缇有限公司 用于灵活的高性能结构化数据处理的方法和系统
JP6700554B2 (ja) 2016-07-28 2020-05-27 富士通株式会社 分散処理管理方法、分散処理管理プログラム、および分散処理管理装置
US10552415B2 (en) * 2017-03-30 2020-02-04 Microsoft Technology Licensing, Llc Efficient distributed joining of two large data sets
JP6967870B2 (ja) * 2017-04-13 2021-11-17 ヤフー株式会社 データベース連携システム、データベース連携方法、およびプログラム

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080052261A1 (en) * 2006-06-22 2008-02-28 Moshe Valenci Method for block level file joining and splitting for efficient multimedia data processing
US7523123B2 (en) * 2006-11-16 2009-04-21 Yahoo! Inc. Map-reduce with merge to process multiple relational datasets
US8713038B2 (en) * 2009-04-02 2014-04-29 Pivotal Software, Inc. Integrating map-reduce into a distributed relational database
US8572575B2 (en) * 2009-09-14 2013-10-29 Myspace Llc Debugging a map reduce application on a cluster
US8935232B2 (en) * 2010-06-04 2015-01-13 Yale University Query execution systems and methods
US9170848B1 (en) * 2010-07-27 2015-10-27 Google Inc. Parallel processing of data
US9798831B2 (en) * 2011-04-01 2017-10-24 Google Inc. Processing data in a MapReduce framework
US9002871B2 (en) * 2011-04-26 2015-04-07 Brian J. Bulkowski Method and system of mapreduce implementations on indexed datasets in a distributed database environment
US8954967B2 (en) * 2011-05-31 2015-02-10 International Business Machines Corporation Adaptive parallel data processing
US8938416B1 (en) * 2012-01-13 2015-01-20 Amazon Technologies, Inc. Distributed storage of aggregated data
US20130318280A1 (en) * 2012-05-22 2013-11-28 Xockets IP, LLC Offloading of computation for rack level servers and corresponding methods and systems
WO2013179451A1 (ja) * 2012-05-31 2013-12-05 国立大学法人東京大学 並列データ処理システム、計算機および並列データ処理方法
US20130339972A1 (en) * 2012-06-18 2013-12-19 Zhuoyao Zhang Determining an allocation of resources to a program having concurrent jobs
CA2874900A1 (en) * 2012-06-26 2014-01-03 Battelle Memorial Institute Methods and apparatus of analyzing electrical power grid data

Also Published As

Publication number Publication date
US10095699B2 (en) 2018-10-09
US20140101213A1 (en) 2014-04-10
JP2014078085A (ja) 2014-05-01

Similar Documents

Publication Publication Date Title
JP5939123B2 (ja) 実行制御プログラム、実行制御方法および情報処理装置
AU2023200421B2 (en) Dataflow graph configuration
US11544623B2 (en) Consistent filtering of machine learning data
US10713589B1 (en) Consistent sort-based record-level shuffling of machine learning data
US10366053B1 (en) Consistent randomized record-level splitting of machine learning data
US11100420B2 (en) Input processing for machine learning
US11182691B1 (en) Category-based sampling of machine learning data
US10585691B2 (en) Distribution system, computer, and arrangement method for virtual machine
CN106778351B (zh) 数据脱敏方法及装置
CN108536745B (zh) 基于Shell的数据表提取方法、终端、设备及存储介质
CN103530427B (zh) 一种基于多数据库的动态切换方法和装置
CN110781183A (zh) Hive数据库中增量数据的处理方法、装置以及计算机设备
US20140059000A1 (en) Computer system and parallel distributed processing method
Tan et al. Hadoop framework: impact of data organization on performance
CN116414801A (zh) 数据迁移方法、装置、计算机设备和存储介质
KR20140048396A (ko) 클라우드 스토리지 서비스의 파일 검색 시스템 및 방법, 및 파일 제어 방법
Theußl et al. A tm plug-in for distributed text mining in R
JP6422346B2 (ja) プログラム生成装置、及び、プログラム生成方法
CN116383176B (zh) 数据库表数据迁移方法及装置
Grossman What is analytic infrastructure and why should you care?
Chen et al. pmTM-align: scalable pairwise and multiple structure alignment with Apache Spark and OpenMP
JP6251860B2 (ja) 情報管理装置並びにファイル管理方法
JP2018181121A (ja) 分析装置、分析プログラム及び分析方法
US12614113B2 (en) Using consistency metadata for filtering of machine learning data across jobs
CN112702421B (zh) 文件同步方法、装置、电子设备及存储介质

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20140424

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150604

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160408

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20160419

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20160502

R150 Certificate of patent or registration of utility model

Ref document number: 5939123

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees