GB2586319B - Automated image synthesis using a comb neural network architecture - Google Patents

Automated image synthesis using a comb neural network architecture Download PDF

Info

Publication number
GB2586319B
GB2586319B GB2007405.0A GB202007405A GB2586319B GB 2586319 B GB2586319 B GB 2586319B GB 202007405 A GB202007405 A GB 202007405A GB 2586319 B GB2586319 B GB 2586319B
Authority
GB
United Kingdom
Prior art keywords
comb
neural network
network architecture
image synthesis
automated image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
GB2007405.0A
Other versions
GB2586319A (en
GB202007405D0 (en
Inventor
Naruniec Jacek
Weber Romann
Schroers Christopher
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Disney Enterprises Inc
Original Assignee
Disney Enterprises Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US16/447,768 external-priority patent/US10902571B2/en
Application filed by Disney Enterprises Inc filed Critical Disney Enterprises Inc
Publication of GB202007405D0 publication Critical patent/GB202007405D0/en
Publication of GB2586319A publication Critical patent/GB2586319A/en
Application granted granted Critical
Publication of GB2586319B publication Critical patent/GB2586319B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/265—Mixing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/088—Non-supervised learning, e.g. competitive learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/001—Texturing; Colouring; Generation of texture or colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00—Animation
    • G06T13/20—3D [Three Dimensional] animation
    • G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/60—Image enhancement or restoration using machine learning, e.g. neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/77—Retouching; Inpainting; Scratch removal
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T9/00—Image coding
    • G06T9/002—Image coding using neural networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20016—Hierarchical, coarse-to-fine, multiscale or multiresolution image processing; Pyramid transform
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20081—Training; Learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20084—Artificial neural networks [ANN]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Biophysics (AREA)
  • Molecular Biology (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Biomedical Technology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
GB2007405.0A 2019-05-20 2020-05-19 Automated image synthesis using a comb neural network architecture Active GB2586319B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201962850439P 2019-05-20 2019-05-20
US16/447,768 US10902571B2 (en) 2019-05-20 2019-06-20 Automated image synthesis using a comb neural network architecture

Publications (3)

Publication Number Publication Date
GB202007405D0 GB202007405D0 (en) 2020-07-01
GB2586319A GB2586319A (en) 2021-02-17
GB2586319B true GB2586319B (en) 2022-10-26

Family

ID=71135139

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2007405.0A Active GB2586319B (en) 2019-05-20 2020-05-19 Automated image synthesis using a comb neural network architecture

Country Status (2)

Country Link
CN (1) CN111968191B (en)
GB (1) GB2586319B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112991152A (en) * 2021-03-04 2021-06-18 网易（杭州）网络有限公司 Image processing method and device, electronic equipment and storage medium
CN113807361B (en) * 2021-08-11 2023-04-18 华为技术有限公司 Neural network, target detection method, neural network training method and related products

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140035929A1 (en) * 2012-08-01 2014-02-06 Disney Enterprises, Inc. Content retargeting using facial layers
WO2020190729A1 (en) * 2019-03-15 2020-09-24 NeoCortext Inc. Face-swapping apparatus and method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2016091108A (en) * 2014-10-30 2016-05-23 パナソニックＩｐマネジメント株式会社 Human body portion detection system and human body portion detection method
US10198624B2 (en) * 2016-02-18 2019-02-05 Pinscreen, Inc. Segmentation-guided real-time facial performance capture
CN106952325B (en) * 2017-03-27 2020-07-21 厦门黑镜科技有限公司 Method and apparatus for manipulating three-dimensional animated characters
US20190073580A1 (en) * 2017-09-01 2019-03-07 Facebook, Inc. Sparse Neural Network Modeling Infrastructure
US10621695B2 (en) * 2017-10-31 2020-04-14 Disney Enterprises, Inc. Video super-resolution using an artificial neural network
CN109377448B (en) * 2018-05-20 2021-05-07 北京工业大学 Face image restoration method based on generation countermeasure network
CN109523463B (en) * 2018-11-20 2023-04-07 中山大学 Face aging method for generating confrontation network based on conditions

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140035929A1 (en) * 2012-08-01 2014-02-06 Disney Enterprises, Inc. Content retargeting using facial layers
WO2020190729A1 (en) * 2019-03-15 2020-09-24 NeoCortext Inc. Face-swapping apparatus and method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Asian Conference on Computer Vision, 2018, Natsume et al., "FSNet: An Identity-Aware Generative Model for Image-Based Face Swapping", pp. 117-132, *

Also Published As

Publication number Publication date
GB2586319A (en) 2021-02-17
GB202007405D0 (en) 2020-07-01
CN111968191B (en) 2024-05-10
CN111968191A (en) 2020-11-20

Similar Documents

Publication Publication Date Title
SG10202004513QA (en) Automated image synthesis using a comb neural network architecture
GB2601929B (en) A machine-learning based architecture search method for a neural network
GB2582689B (en) Interactive image matting using neural networks
GB2603705B (en) Image aligning neural network
GB202203669D0 (en) Labeling images using a neural network
GB202200832D0 (en) Selecting annotations for training images using a neural network
IL280298A (en) Task completion using a blockchain network
GB202006556D0 (en) A cover for a camera
GB2586319B (en) Automated image synthesis using a comb neural network architecture
EP3921796A4 (en) Neural network image analysis
GB2587245B (en) Holographic image alignment
GB202201023D0 (en) Image synthesis using one or more neural networks
GB201918966D0 (en) A projector for forming images om multiple planes
GB2613336B (en) Using a neural network scene representation for mapping
PL3608836T3 (en) Method for obtaining a digital fingerprint image
GB2585232B (en) Image data pre-processing for neural networks
GB2605537B (en) Micro-optic device for producing a magnified image
EP3557486C0 (en) A neural network engine
GB2589572B (en) A hair smoothing apparatus
SG10201912472UA (en) Methods and systems for recommendation using a neural network
GB201912846D0 (en) A drone
GB202217288D0 (en) A comb
GB202217289D0 (en) A Comb
GB202217291D0 (en) A comb
GB202106093D0 (en) A comb