WO2019231722A1 - Distributed computing system with a synthetic data as a service frameset package store - Google Patents

Distributed computing system with a synthetic data as a service frameset package store Download PDF

Info

Publication number
WO2019231722A1
WO2019231722A1 PCT/US2019/032964 US2019032964W WO2019231722A1 WO 2019231722 A1 WO2019231722 A1 WO 2019231722A1 US 2019032964 W US2019032964 W US 2019032964W WO 2019231722 A1 WO2019231722 A1 WO 2019231722A1
Authority
WO
WIPO (PCT)
Prior art keywords
frameset
frameset package
synthetic data
asset
package
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2019/032964
Other languages
English (en)
French (fr)
Inventor
Kamran ZARGAHI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Microsoft Technology Licensing LLC
Original Assignee
Microsoft Technology Licensing LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to IL278985A priority Critical patent/IL278985B2/en
Priority to SG11202011300WA priority patent/SG11202011300WA/en
Priority to CA3097073A priority patent/CA3097073A1/en
Priority to KR1020207034468A priority patent/KR102763022B1/ko
Priority to AU2019276879A priority patent/AU2019276879B2/en
Priority to MX2020012875A priority patent/MX2020012875A/es
Priority to EP19733901.3A priority patent/EP3803592B1/en
Priority to BR112020020421-8A priority patent/BR112020020421A2/pt
Priority to JP2020566954A priority patent/JP7516263B2/ja
Priority to MYPI2020005658A priority patent/MY206604A/en
Application filed by Microsoft Technology Licensing LLC filed Critical Microsoft Technology Licensing LLC
Priority to CN201980035538.7A priority patent/CN112204525B/zh
Publication of WO2019231722A1 publication Critical patent/WO2019231722A1/en
Priority to ZA2020/06248A priority patent/ZA202006248B/en
Priority to PH12020552053A priority patent/PH12020552053A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/53—Querying
    • G06F16/538—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/51—Indexing; Data structures therefor; Storage structures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/903—Querying
    • G06F16/9038—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5072—Grid computing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46—Multiprogramming arrangements
    • G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061—Partitioning or combining of resources
    • G06F9/5077—Logical partitioning of resources; Management or configuration of virtualized resources
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/047—Probabilistic or stochastic networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/0475—Generative networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/0895—Weakly supervised learning, e.g. semi-supervised or self-supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/09—Supervised learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/094—Adversarial learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00—Arrangements for program control, e.g. control units
    • G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44—Arrangements for executing specific programs
    • G06F9/455—Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
    • G06F9/45533—Hypervisors; Virtual machine monitors
    • G06F9/45558—Hypervisor-specific management and integration aspects
    • G06F2009/45579—I/O management, e.g. providing access to device drivers or storage
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/06—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons
    • G06N3/063—Physical realisation, i.e. hardware implementation of neural networks, neurons or parts of neurons using electronic means

Definitions

  • Embodiments described herein provide simple and efficient methods and systems for implementing a distributed computing system that provides synthetic data as service (“SDaaS”).
  • SDaaS may refer to a distributed (cloud) computing system service that is implemented using a service-oriented architecture to provide machine-learning training services while abstracting underlying operations that are managed via the SDaaS service.
  • the SDaaS provides a machine-learning training system that allows customers to configure, generate, access, manage and process synthetic data training datasets for machine-learning.
  • the SDaaS operates without the complexity typically associated with manual development of training datasets.
  • Embodiments of the present invention operate on a two-tier programmable parameter system
  • a machine-learning training service may automatically or based on manual intervention train a model based on accessing and determining first-tier (e.g., asset parameter) and/or a second tier (e.g., scene or frameset parameter) parameters that are needed to improve a training dataset and by extension model training.
  • a machine-learning training service may support deep learning and a deep learning network and other types of machine learning algorithms and networks.
  • the machine-learning training service may also implement a generative adversarial network as a type of unsupervised machine learning.
  • the SDaaS may leverage these underlying tiered parameters in different ways.
  • FIG. 1A includes client device 130A and interface 128A and client device
  • the distributed computing system further includes several components that support the functionality of the SDaaS, the components include asset assembly engine 110, scene assembly engine 112, frameset assembly engine 114, frameset package generator 116, frameset package store 118, feedback loop engine 120, crowdsourcing engine 122, machine-learning training service 124, and SDaaS store 126.
  • FIG. 1B illustrates assets 126A and framesets 126B stored in SDaaS store 126 and integrated with a machine-learning training service for automated access to assets, scenes, and framesets as described in more detail below.
  • the end-to-end software-based system can operate within the system components to operate computer hardware to provide system functionality.
  • hardware processors execute instructions selected from a machine language (also referred to as machine code or native) instruction set for a given processor.
  • the processor recognizes the native instructions and performs corresponding low level functions relating, for example, to logic, control and memory operations.
  • Low level software written in machine code can provide more complex functionality to higher levels of software.
  • computer-executable instructions includes any software, including low level software written in machine code, higher level software such as application software and any combination thereof.
  • the system components can manage resources and provide services for system functionality. Any other variations and combinations thereof are contemplated with embodiments of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Computing Systems (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Databases & Information Systems (AREA)
  • Library & Information Science (AREA)
  • Probability & Statistics with Applications (AREA)
  • Medical Informatics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Neurology (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Image Analysis (AREA)
  • Multi Processors (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
PCT/US2019/032964 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store Ceased WO2019231722A1 (en)

Priority Applications (13)

Application Number Priority Date Filing Date Title
JP2020566954A JP7516263B2 (ja) 2018-05-31 2019-05-17 サービスとしての合成データのフレームセットパッケージストアを伴う分散型コンピューティングシステム
CA3097073A CA3097073A1 (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store
KR1020207034468A KR102763022B1 (ko) 2018-05-31 2019-05-17 서비스로서의 합성 데이터 프레임세트 패키지 스토어를 갖는 분산 컴퓨팅 시스템
AU2019276879A AU2019276879B2 (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store
MX2020012875A MX2020012875A (es) 2018-05-31 2019-05-17 Sistema de computo distribuido con datos sinteticos como un servicio de almacenamiento de paquetes de conjuntos de marcos.
EP19733901.3A EP3803592B1 (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store
BR112020020421-8A BR112020020421A2 (pt) 2018-05-31 2019-05-17 Sistema de computação distribuída com dados sintéticos como um depósito de pacote de conjunto de quadros de serviço
IL278985A IL278985B2 (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store
SG11202011300WA SG11202011300WA (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store
MYPI2020005658A MY206604A (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store
CN201980035538.7A CN112204525B (zh) 2018-05-31 2019-05-17 具有综合数据即服务框架集包存储库的分布式计算系统
ZA2020/06248A ZA202006248B (en) 2018-05-31 2020-10-08 Distributed computing system with a synthetic data as a service frameset package store
PH12020552053A PH12020552053A1 (en) 2018-05-31 2020-11-30 Distributed computing system with a synthetic data as a service frameset package store

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/995,121 US11263256B2 (en) 2018-05-31 2018-05-31 Distributed computing system with a synthetic data as a service frameset package store
US15/995,121 2018-05-31

Publications (1)

Publication Number Publication Date
WO2019231722A1 true WO2019231722A1 (en) 2019-12-05

Family

ID=67070902

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2019/032964 Ceased WO2019231722A1 (en) 2018-05-31 2019-05-17 Distributed computing system with a synthetic data as a service frameset package store

Country Status (15)

Country Link
US (1) US11263256B2 (https=)
EP (1) EP3803592B1 (https=)
JP (1) JP7516263B2 (https=)
KR (1) KR102763022B1 (https=)
CN (1) CN112204525B (https=)
AU (1) AU2019276879B2 (https=)
BR (1) BR112020020421A2 (https=)
CA (1) CA3097073A1 (https=)
IL (1) IL278985B2 (https=)
MX (1) MX2020012875A (https=)
MY (1) MY206604A (https=)
PH (1) PH12020552053A1 (https=)
SG (1) SG11202011300WA (https=)
WO (1) WO2019231722A1 (https=)
ZA (1) ZA202006248B (https=)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20210031220A (ko) * 2019-09-11 2021-03-19 삼성전자주식회사 스토리지 장치 및 스토리지 장치의 동작 방법
US12602501B2 (en) 2024-07-29 2026-04-14 Bank Of America Corporation System and method for generating synthetic data
US20260030376A1 (en) * 2024-07-29 2026-01-29 Bank Of America Corporation System and method for generating real-time obfuscated data

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170142417A1 (en) * 2015-11-17 2017-05-18 Nbcuniversal Media, Llc System and method for optimal variable bit rate packing
WO2017130197A2 (en) * 2016-01-26 2017-08-03 Infinity Augmented Reality Israel Ltd. Method and system for generating a synthetic database of postures and gestures

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3467406B2 (ja) * 1998-05-08 2003-11-17 株式会社日立製作所 アニメーションの生成方法およびコンピュータグラフイックス
JP2003298981A (ja) * 2002-04-03 2003-10-17 Oojisu Soken:Kk 要約画像作成装置、要約画像作成方法、要約画像作成プログラム、及び要約画像作成プログラムを記憶したコンピュータ読取可能な記憶媒体
JP4568357B2 (ja) * 2008-06-30 2010-10-27 インターナショナル・ビジネス・マシーンズ・コーポレーション 動画データから検索対象である動画コンテンツを含むシーンを検索するためのコンピュータ・システム、並びにその方法及びコンピュータ・プログラム
US9589277B2 (en) * 2013-12-31 2017-03-07 Microsoft Technology Licensing, Llc Search service advertisement selection
IL236243A (en) * 2014-12-14 2016-08-31 Elbit Systems Ltd Visual enhancement of color icons is shown
JP2016151975A (ja) 2015-02-18 2016-08-22 ネオス株式会社 合成動画データ生成システムおよびプログラム
US9594776B2 (en) * 2015-05-05 2017-03-14 Microsoft Technology Licensing, Llc Dynamic, parameterized image resource selection
US11216735B2 (en) * 2015-10-05 2022-01-04 Verizon Media Inc. Method and system for providing synthetic answers to a personal question
US10133949B2 (en) * 2016-07-15 2018-11-20 University Of Central Florida Research Foundation, Inc. Synthetic data generation of time series data
US10606887B2 (en) * 2016-09-23 2020-03-31 Adobe Inc. Providing relevant video scenes in response to a video search query
US20180336509A1 (en) * 2017-07-31 2018-11-22 Seematics Systems Ltd System and method for maintaining a project schedule in a dataset management system
US10235601B1 (en) * 2017-09-07 2019-03-19 7D Labs, Inc. Method for image analysis

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170142417A1 (en) * 2015-11-17 2017-05-18 Nbcuniversal Media, Llc System and method for optimal variable bit rate packing
WO2017130197A2 (en) * 2016-01-26 2017-08-03 Infinity Augmented Reality Israel Ltd. Method and system for generating a synthetic database of postures and gestures

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3803592A1 *

Also Published As

Publication number Publication date
EP3803592B1 (en) 2026-04-29
IL278985B2 (en) 2024-05-01
US11263256B2 (en) 2022-03-01
IL278985A (en) 2021-01-31
PH12020552053A1 (en) 2021-05-31
CN112204525B (zh) 2025-02-28
MY206604A (en) 2024-12-26
AU2019276879B2 (en) 2024-05-09
CN112204525A (zh) 2021-01-08
KR20210013698A (ko) 2021-02-05
JP2021526685A (ja) 2021-10-07
EP3803592A1 (en) 2021-04-14
MX2020012875A (es) 2021-02-18
BR112020020421A2 (pt) 2021-01-12
CA3097073A1 (en) 2019-12-05
IL278985B1 (en) 2024-01-01
US20200372122A1 (en) 2020-11-26
ZA202006248B (en) 2022-12-21
SG11202011300WA (en) 2020-12-30
AU2019276879A1 (en) 2020-10-22
KR102763022B1 (ko) 2025-02-04
JP7516263B2 (ja) 2024-07-16

Similar Documents

Publication Publication Date Title
US10877927B2 (en) Distributed computing system with a synthetic data as a service asset assembly engine
AU2019276879B2 (en) Distributed computing system with a synthetic data as a service frameset package store
EP3803701B1 (en) Distributed computing system with a synthetic data as a service frameset package generator
US11023517B2 (en) Distributed computing system with a synthetic data as a service frameset assembly engine
US11550841B2 (en) Distributed computing system with a synthetic data as a service scene assembly engine
US11615137B2 (en) Distributed computing system with a crowdsourcing engine
US11281996B2 (en) Distributed computing system with a synthetic data as a service feedback loop engine
HK40036988A (en) Distributed computing system with a synthetic data as a service frameset package store

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19733901

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 3097073

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2019276879

Country of ref document: AU

Date of ref document: 20190517

Kind code of ref document: A

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112020020421

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2020566954

Country of ref document: JP

Kind code of ref document: A

Ref document number: 20207034468

Country of ref document: KR

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 112020020421

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20201005

ENP Entry into the national phase

Ref document number: 2019733901

Country of ref document: EP

Effective date: 20210111

WWG Wipo information: grant in national office

Ref document number: 201980035538.7

Country of ref document: CN