KR102663519B1 - 교차 도메인 이미지 변환 기법 - Google Patents

교차 도메인 이미지 변환 기법 Download PDF

Info

Publication number
KR102663519B1
KR102663519B1 KR1020217013184A KR20217013184A KR102663519B1 KR 102663519 B1 KR102663519 B1 KR 102663519B1 KR 1020217013184 A KR1020217013184 A KR 1020217013184A KR 20217013184 A KR20217013184 A KR 20217013184A KR 102663519 B1 KR102663519 B1 KR 102663519B1
Authority
KR
South Korea
Prior art keywords
image
domain
geometry
style
learning network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020217013184A
Other languages
English (en)
Korean (ko)
Other versions
KR20210083276A (ko
Inventor
징 리아오
루 유안
카이디 카오
Original Assignee
마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 마이크로소프트 테크놀로지 라이센싱, 엘엘씨 filed Critical 마이크로소프트 테크놀로지 라이센싱, 엘엘씨
Publication of KR20210083276A publication Critical patent/KR20210083276A/ko
Application granted granted Critical
Publication of KR102663519B1 publication Critical patent/KR102663519B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/04—Context-preserving transformations, e.g. by using an importance map
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
    • G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/044—Recurrent networks, e.g. Hopfield networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/04—Architecture, e.g. interconnection topology
    • G06N3/045—Combinations of networks
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00—Computing arrangements based on biological models
    • G06N3/02—Neural networks
    • G06N3/08—Learning methods
    • G06N3/084—Backpropagation, e.g. using gradient descent
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Medical Informatics (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Processing Or Creating Images (AREA)
KR1020217013184A 2018-10-31 2019-09-05 교차 도메인 이미지 변환 기법 Active KR102663519B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201811294026.6 2018-10-31
CN201811294026.6A CN111127304B (zh) 2018-10-31 2018-10-31 跨域图像转换
PCT/US2019/049619 WO2020091891A1 (en) 2018-10-31 2019-09-05 Cross-domain image translation

Publications (2)

Publication Number Publication Date
KR20210083276A KR20210083276A (ko) 2021-07-06
KR102663519B1 true KR102663519B1 (ko) 2024-05-03

Family

ID=67957460

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020217013184A Active KR102663519B1 (ko) 2018-10-31 2019-09-05 교차 도메인 이미지 변환 기법

Country Status (6)

Country Link
US (1) US11481869B2 (https=)
EP (1) EP3874458A1 (https=)
JP (1) JP7373554B2 (https=)
KR (1) KR102663519B1 (https=)
CN (1) CN111127304B (https=)
WO (1) WO2020091891A1 (https=)

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111127304B (zh) * 2018-10-31 2024-02-20 微软技术许可有限责任公司 跨域图像转换
US20200242736A1 (en) * 2019-01-29 2020-07-30 Nvidia Corporation Method for few-shot unsupervised image-to-image translation
US11556848B2 (en) * 2019-10-21 2023-01-17 International Business Machines Corporation Resolving conflicts between experts' intuition and data-driven artificial intelligence models
US12050639B2 (en) * 2019-11-12 2024-07-30 Yahoo Assets Llc Method and system for sketch based search
US11450008B1 (en) * 2020-02-27 2022-09-20 Amazon Technologies, Inc. Segmentation using attention-weighted loss and discriminative feature learning
US11501107B2 (en) * 2020-05-07 2022-11-15 Adobe Inc. Key-value memory network for predicting time-series metrics of target entities
US12505595B2 (en) 2020-05-15 2025-12-23 Nvidia Corporation Content-aware style encoding using neural networks
JP7477864B2 (ja) * 2020-05-18 2024-05-02 国立大学法人山梨大学 画像生成方法、プログラム及び画像生成装置
CN111508048B (zh) * 2020-05-22 2023-06-20 南京大学 一种可交互任意形变风格人脸漫画自动生成方法
CN111833238B (zh) * 2020-06-01 2023-07-25 北京百度网讯科技有限公司 图像的翻译方法和装置、图像翻译模型的训练方法和装置
US11508051B2 (en) * 2020-06-05 2022-11-22 Leica Microsystems Cms Gmbh Image and data analystics model compatibility regulation methods
CN111738910A (zh) * 2020-06-12 2020-10-02 北京百度网讯科技有限公司 一种图像处理方法、装置、电子设备和存储介质
US11574500B2 (en) * 2020-09-08 2023-02-07 Samsung Electronics Co., Ltd. Real-time facial landmark detection
WO2022053431A1 (en) * 2020-09-10 2022-03-17 Interdigital Ce Patent Holdings, Sas A method and an apparatus for generating a 3d face comprising at least one deformed region
US12333427B2 (en) 2020-10-16 2025-06-17 Adobe Inc. Multi-scale output techniques for generative adversarial networks
KR102770927B1 (ko) * 2020-11-04 2025-02-19 서울대학교산학협력단 손실 산입 학습 방법, 그의 장치, 기록 매체 및 이를 적용한 전자 디바이스
CN112991151B (zh) * 2021-02-09 2022-11-22 北京字跳网络技术有限公司 图像处理方法、图像生成方法、装置、设备和介质
US12136155B2 (en) * 2021-02-15 2024-11-05 Carnegie Mellon University System and method for photorealistic image synthesis using unsupervised semantic feature disentanglement
WO2022243250A1 (en) * 2021-05-18 2022-11-24 Interdigital Ce Patent Holdings, Sas A method and an apparatus for generating a 3d face comprising at least one deformed region
US12056849B2 (en) * 2021-09-03 2024-08-06 Adobe Inc. Neural network for image style translation
CN113762165A (zh) * 2021-09-09 2021-12-07 北京海航中软科技有限公司 一种嫌疑人识别追踪方法及系统
US11900519B2 (en) * 2021-11-17 2024-02-13 Adobe Inc. Disentangling latent representations for image reenactment
CN114359035B (zh) * 2021-12-27 2025-08-12 中山大学 一种基于生成对抗网络的人体风格迁移方法、设备及介质
US12450787B2 (en) 2021-12-28 2025-10-21 POSTECH Research and Business Development Foundation Automatic caricature generating method and apparatus
KR102678473B1 (ko) * 2021-12-28 2024-06-27 포항공과대학교 산학협력단 자동 캐리커처 생성 방법 및 장치
US12361614B2 (en) * 2021-12-30 2025-07-15 Snap Inc. Protecting image features in stylized representations of a source image
EP4457760A1 (en) * 2021-12-30 2024-11-06 Snap Inc. Protecting image features in stylized representations of a source image
US20230267652A1 (en) * 2022-02-24 2023-08-24 Adobe Inc. Generating artistic content from a text prompt or a style image utilizing a neural network model
US20230377324A1 (en) * 2022-05-19 2023-11-23 Nvidia Corporation Multi-domain generative adversarial networks for synthetic data generation
US20240029321A1 (en) * 2022-07-20 2024-01-25 Canon Kabushiki Kaisha Image processing method, image processing apparatus, storage medium, image processing system, method of generating machine learning model, and learning apparatus
US12249132B2 (en) * 2022-07-27 2025-03-11 Adobe Inc. Adapting generative neural networks using a cross domain translation network
US12322027B2 (en) * 2022-12-29 2025-06-03 Snap Inc. Avatar generation according to artistic styles
US12469217B2 (en) 2022-12-29 2025-11-11 Snap Inc. Infinite-scale city synthesis
WO2024206542A1 (en) * 2023-03-29 2024-10-03 Arizona Board Of Regents On Behalf Of Arizona State University Systems and methods for enhancing retinal color fundus images for retinopathy analysis
KR102636217B1 (ko) * 2023-04-14 2024-02-14 고려대학교산학협력단 가중 국소변환을 이용한 3차원 데이터 증강 방법 및 이를 위한 장치
US12591947B2 (en) 2023-05-25 2026-03-31 Samsung Electronics Co., Ltd. Distortion-based image rendering
KR102636155B1 (ko) * 2023-07-18 2024-02-13 주식회사 젠젠에이아이 콘텐츠 코드를 이용한 이미지 생성 방법 및 시스템
KR102803181B1 (ko) * 2023-11-09 2025-05-07 리벨리온 주식회사 마할라노비스 거리 기반의 지각 손실을 이용한 모델 훈련 방법 및 장치
WO2025100630A1 (ko) * 2023-11-09 2025-05-15 주식회사 사피온코리아 마할라노비스 거리 기반의 지각 손실을 이용한 모델 훈련 방법 및 장치

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180307947A1 (en) * 2017-04-25 2018-10-25 Nec Laboratories America, Inc. Cyclic generative adversarial network for unsupervised cross-domain image generation

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7483553B2 (en) 2004-03-29 2009-01-27 Microsoft Corporation Caricature exaggeration
US7660482B2 (en) * 2004-06-23 2010-02-09 Seiko Epson Corporation Method and apparatus for converting a photo to a caricature image
CN102096934B (zh) 2011-01-27 2012-05-23 电子科技大学 一种基于机器学习的人脸卡通画生成方法
US10366306B1 (en) * 2013-09-19 2019-07-30 Amazon Technologies, Inc. Item identification among item variations
US9646195B1 (en) * 2015-11-11 2017-05-09 Adobe Systems Incorporated Facial feature liquifying using face mesh
CN106548208B (zh) 2016-10-28 2019-05-28 杭州米绘科技有限公司 一种照片图像快速智能风格化方法
JPWO2018092869A1 (ja) 2016-11-21 2019-10-17 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 画像符号化装置、画像復号装置、画像符号化方法及び画像復号方法
US10916001B2 (en) * 2016-11-28 2021-02-09 Adobe Inc. Facilitating sketch to painting transformations
US10504267B2 (en) * 2017-06-06 2019-12-10 Adobe Inc. Generating a stylized image or stylized animation by matching semantic features via an appearance guide, a segmentation guide, and/or a temporal guide
US10565757B2 (en) * 2017-06-09 2020-02-18 Adobe Inc. Multimodal style-transfer network for applying style features from multi-resolution style exemplars to input images
US10430455B2 (en) * 2017-06-09 2019-10-01 Adobe Inc. Sketch and style based image retrieval
CN109426858B (zh) * 2017-08-29 2021-04-06 京东方科技集团股份有限公司 神经网络、训练方法、图像处理方法及图像处理装置
US10748314B2 (en) * 2018-02-15 2020-08-18 Microsoft Technology Licensing, Llc Controllable conditional image generation
CN108257195A (zh) * 2018-02-23 2018-07-06 深圳市唯特视科技有限公司 一种基于几何对比生成对抗网络的面部表情合成方法
CN108596024B (zh) * 2018-03-13 2021-05-04 杭州电子科技大学 一种基于人脸结构信息的肖像生成方法
EP3605465B1 (en) * 2018-07-30 2020-12-30 Siemens Healthcare GmbH A method for determining a correspondence between a source image and a reference image
US11430084B2 (en) * 2018-09-05 2022-08-30 Toyota Research Institute, Inc. Systems and methods for saliency-based sampling layer for neural networks
CN111127304B (zh) * 2018-10-31 2024-02-20 微软技术许可有限责任公司 跨域图像转换
KR102708715B1 (ko) * 2018-11-16 2024-09-24 삼성전자주식회사 영상 처리 장치 및 그 동작방법
WO2020117975A1 (en) * 2018-12-04 2020-06-11 IsoPlexis Corporation Systems, devices and methods for identification, selective ablation, and selection and collection of single cells
CN112926372B (zh) * 2020-08-22 2023-03-10 清华大学 基于序列变形的场景文字检测方法及系统

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180307947A1 (en) * 2017-04-25 2018-10-25 Nec Laboratories America, Inc. Cyclic generative adversarial network for unsupervised cross-domain image generation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Ziqiang Zheng et al., 'Unpaired photo-to-caricature translation on faces in the wild', Neurocomputing, Volume 355, 25 August 2019.*

Also Published As

Publication number Publication date
JP7373554B2 (ja) 2023-11-02
CN111127304A (zh) 2020-05-08
KR20210083276A (ko) 2021-07-06
JP2022503647A (ja) 2022-01-12
WO2020091891A1 (en) 2020-05-07
US11481869B2 (en) 2022-10-25
CN111127304B (zh) 2024-02-20
EP3874458A1 (en) 2021-09-08
US20220044352A1 (en) 2022-02-10

Similar Documents

Publication Publication Date Title
KR102663519B1 (ko) 교차 도메인 이미지 변환 기법
CN114266347B (zh) 神经网络的无监督域适应
CN113674146B (zh) 图像超分辨率
US11024060B1 (en) Generating neutral-pose transformations of self-portrait images
US20250182404A1 (en) Four-dimensional object and scene model synthesis using generative models
US12131416B2 (en) Pixel-aligned volumetric avatars
US20200151849A1 (en) Visual style transfer of images
CN113704531A (zh) 图像处理方法、装置、电子设备及计算机可读存储介质
EP4143787A1 (en) Photometric-based 3d object modeling
US20230377324A1 (en) Multi-domain generative adversarial networks for synthetic data generation
Gou et al. Cascade learning from adversarial synthetic images for accurate pupil detection
CN113822965B (zh) 图像渲染处理方法、装置和设备及计算机存储介质
KR20230167086A (ko) 공간과 시간에 따른 어텐션을 이용한 비디오 시퀀스에서 객체 표현에 대한 비지도 학습
CN118196277A (zh) 复制物理环境并生成3d资产用于合成场景生成
CN120322806A (zh) 各种类别和场景的3d生成
US20240320917A1 (en) Diffusion based cloth registration
CN117934654B (zh) 图像生成模型训练、图像生成方法、装置和计算机设备
CN117576248B (zh) 基于姿态引导的图像生成方法和装置
WO2022012179A1 (zh) 生成特征提取网络的方法、装置、设备和计算机可读介质
US20250200896A1 (en) Coherent three-dimensional portrait reconstruction via undistorting and fusing triplane representations
WO2022226744A1 (en) Texture completion
CN121368797A (zh) 基于图像和音频数据生成面部模型
US20240386661A1 (en) Method and system of generating customized three-dimensional images
Younis et al. Sparse-view 3D reconstruction: Recent advances and open challenges
CN112750164B (zh) 轻量化定位模型的构建方法、定位方法、电子设备

Legal Events

Date Code Title Description
PA0105 International application

Patent event date: 20210430

Patent event code: PA01051R01D

Comment text: International Patent Application

PG1501 Laying open of application
A201 Request for examination
PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20220905

Comment text: Request for Examination of Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20230918

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20240131

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20240430

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20240430

End annual number: 3

Start annual number: 1

PG1601 Publication of registration