KR102397343B1 - 비디오에서 가상 오브젝트를 블러링하기 위한 방법 및 디바이스 - Google Patents

비디오에서 가상 오브젝트를 블러링하기 위한 방법 및 디바이스 Download PDF

Info

Publication number
KR102397343B1
KR102397343B1 KR1020170117292A KR20170117292A KR102397343B1 KR 102397343 B1 KR102397343 B1 KR 102397343B1 KR 1020170117292 A KR1020170117292 A KR 1020170117292A KR 20170117292 A KR20170117292 A KR 20170117292A KR 102397343 B1 KR102397343 B1 KR 102397343B1
Authority
KR
South Korea
Prior art keywords
initial
current
image
virtual object
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020170117292A
Other languages
English (en)
Korean (ko)
Other versions
KR20180030446A (ko
Inventor
삐에릭 주에
필립쁘 로베르
마띠유 프라데
Original Assignee
인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스 filed Critical 인터디지털 씨이 페이튼트 홀딩스, 에스에이에스
Publication of KR20180030446A publication Critical patent/KR20180030446A/ko
Application granted granted Critical
Publication of KR102397343B1 publication Critical patent/KR102397343B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/207—Analysis of motion for motion estimation over a hierarchy of resolutions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P13/00—Indicating or recording presence, absence, or direction, of movement
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/14—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration by making use of gyroscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/215—Motion-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
KR1020170117292A 2016-09-15 2017-09-13 비디오에서 가상 오브젝트를 블러링하기 위한 방법 및 디바이스 Active KR102397343B1 (ko)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16306175.7A EP3296950A1 (en) 2016-09-15 2016-09-15 Method and device for blurring a virtual object in a video
EP16306175.7 2016-09-15

Publications (2)

Publication Number Publication Date
KR20180030446A KR20180030446A (ko) 2018-03-23
KR102397343B1 true KR102397343B1 (ko) 2022-05-13

Family

ID=56997437

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170117292A Active KR102397343B1 (ko) 2016-09-15 2017-09-13 비디오에서 가상 오브젝트를 블러링하기 위한 방법 및 디바이스

Country Status (5)

Country Link
US (1) US10825249B2 (enExample)
EP (2) EP3296950A1 (enExample)
JP (1) JP6951166B2 (enExample)
KR (1) KR102397343B1 (enExample)
CN (1) CN107833237B (enExample)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2684193C1 (ru) * 2015-05-21 2019-04-04 Хуавэй Текнолоджиз Ко., Лтд. Устройство и способ для компенсации движения в видеоизображении
CN107019915B (zh) * 2016-02-01 2018-09-07 腾讯科技（深圳）有限公司 一种确定移动轨迹的方法、用户设备及系统
CN108520568B (zh) * 2018-04-03 2019-04-09 武汉木一科技有限公司 一种设备指示灯定位识别方法及装置
CN110544280B (zh) 2018-05-22 2021-10-08 腾讯科技（深圳）有限公司 Ar系统及方法
US10818093B2 (en) * 2018-05-25 2020-10-27 Tiff's Treats Holdings, Inc. Apparatus, method, and system for presentation of multimedia content including augmented reality content
JP7210180B2 (ja) * 2018-07-25 2023-01-23 キヤノン株式会社 画像処理装置、画像表示装置、画像処理方法、及びプログラム
US10860165B2 (en) * 2018-09-26 2020-12-08 NextVPU (Shanghai) Co., Ltd. Tracking method and apparatus for smart glasses, smart glasses and storage medium
KR102715400B1 (ko) * 2020-01-03 2024-10-10 삼성전자주식회사 영상 처리를 위한 전자 장치, 방법 및 비일시적 저장 매체
KR20220040054A (ko) * 2020-09-23 2022-03-30 삼성전자주식회사 전자장치 및 그 제어방법
WO2024018166A1 (en) 2022-07-22 2024-01-25 Blackbird Plc Computer-implemented methods of blurring a digital image; computer terminals and computer program products

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150109337A1 (en) * 2011-09-30 2015-04-23 Layar B.V. Feedback to user for indicating augmentability of an image
WO2016137653A1 (en) * 2015-02-27 2016-09-01 Qualcomm Incorporated Fast adaptive estimation of motion blur for coherent rendering

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1668597A1 (en) * 2003-09-25 2006-06-14 Koninklijke Philips Electronics N.V. Generation of motion blur
US7643062B2 (en) * 2005-06-08 2010-01-05 Hewlett-Packard Development Company, L.P. Method and system for deblurring an image based on motion tracking
US8018579B1 (en) * 2005-10-21 2011-09-13 Apple Inc. Three-dimensional imaging and display system
JP4754385B2 (ja) * 2006-03-30 2011-08-24 株式会社バンダイナムコゲームス プログラム、情報記録媒体および画像生成システム
US8401081B2 (en) * 2006-08-11 2013-03-19 Thomson Licensing Accurate motion portrayal for display and digital projectors
US20080143840A1 (en) * 2006-12-19 2008-06-19 Texas Instruments Incorporated Image Stabilization System and Method for a Digital Camera
US8196166B2 (en) 2006-12-21 2012-06-05 Verizon Patent And Licensing Inc. Content hosting and advertising systems and methods
US9106873B2 (en) 2010-04-01 2015-08-11 Verizon Patent And Licensing Inc. Methods and systems for providing enhanced content by way of a virtual channel
JP5514637B2 (ja) * 2010-06-11 2014-06-04 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、及び情報処理方法
FR2967804B1 (fr) * 2010-11-19 2013-01-04 Total Immersion Procede et dispositif de detection et de suivi d'objets non rigides en mouvement, en temps reel, dans un flux video, permettant a un utilisateur d'interagir avec un systeme informatique
GB2501929B (en) * 2012-05-11 2015-06-24 Sony Comp Entertainment Europe Apparatus and method for augmented reality
JP6151355B2 (ja) * 2012-05-18 2017-06-21 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ パノラマピクチャの処理
JP2014035763A (ja) * 2012-08-10 2014-02-24 Nippon Telegr & Teleph Corp <Ntt> 情報表示装置
CN104662435A (zh) * 2012-09-27 2015-05-27 Metaio有限公司 确定与用于捕获至少一个图像的捕获装置关联的装置的位置和方向的方法
US20140333669A1 (en) * 2013-05-08 2014-11-13 Nvidia Corporation System, method, and computer program product for implementing smooth user interface animation using motion blur
EP2819095A1 (en) * 2013-06-24 2014-12-31 Thomson Licensing Method and apparatus for inserting a virtual object in a video
JP6157242B2 (ja) * 2013-06-28 2017-07-05 キヤノン株式会社 画像処理装置及び画像処理方法
US20150220996A1 (en) 2014-01-31 2015-08-06 Venkata S.J.R. Bhamidipati Systems and methods for viral promotion of content
US9495801B2 (en) * 2014-05-01 2016-11-15 Microsoft Technology Licensing, Llc Pose tracking an augmented reality device
WO2016037653A1 (en) 2014-09-11 2016-03-17 Federal-Mogul Wiesbaden Gmbh PRECIPITATION HARDENABLE ALUMINUM BASED Al-Sn-Si-Cu-Mg-V BEARING ALLOY
JP6464934B2 (ja) * 2015-06-11 2019-02-06 富士通株式会社 カメラ姿勢推定装置、カメラ姿勢推定方法およびカメラ姿勢推定プログラム
US10420472B2 (en) * 2015-08-26 2019-09-24 Canon Kabushiki Kaisha Apparatus and method
US10535193B2 (en) * 2015-09-08 2020-01-14 Canon Kabushiki Kaisha Image processing apparatus, image synthesizing apparatus, image processing system, image processing method, and storage medium
US9865062B2 (en) * 2016-02-12 2018-01-09 Qualcomm Incorporated Systems and methods for determining a region in an image

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150109337A1 (en) * 2011-09-30 2015-04-23 Layar B.V. Feedback to user for indicating augmentability of an image
WO2016137653A1 (en) * 2015-02-27 2016-09-01 Qualcomm Incorporated Fast adaptive estimation of motion blur for coherent rendering

Also Published As

Publication number Publication date
US20180075660A1 (en) 2018-03-15
KR20180030446A (ko) 2018-03-23
US10825249B2 (en) 2020-11-03
EP3296950A1 (en) 2018-03-21
JP6951166B2 (ja) 2021-10-20
CN107833237A (zh) 2018-03-23
CN107833237B (zh) 2023-08-15
JP2018049614A (ja) 2018-03-29
EP3296952B1 (en) 2020-11-04
EP3296952A1 (en) 2018-03-21

Similar Documents

Publication Publication Date Title
KR102397343B1 (ko) 비디오에서 가상 오브젝트를 블러링하기 위한 방법 및 디바이스
Karpenko et al. Digital video stabilization and rolling shutter correction using gyroscopes
JP6363863B2 (ja) 情報処理装置および情報処理方法
JP6734940B2 (ja) 三次元計測装置
CN108140247B (zh) 用于使用合成图像的相机校准的方法和装置
TWI536318B (zh) 深度測量之品質提升
KR102387891B1 (ko) 화상 처리장치, 화상 처리장치의 제어방법, 및 컴퓨터 판독가능한 기억매체
WO2017077925A1 (en) Method and system for estimating three-dimensional pose of sensor
Lee et al. Simultaneous localization, mapping and deblurring
CN112492195A (zh) 光学传感装置及方法
WO2019044038A1 (ja) 撮影対象追跡装置及び撮影対象追跡方法
TWI501193B (zh) Computer graphics using AR technology. Image processing systems and methods
JP2019003428A (ja) 画像処理装置、画像処理方法及びプログラム
CN110544278B (zh) 刚体运动捕捉方法及装置、agv位姿捕捉系统
CN113763544B (zh) 图像确定方法、装置、电子设备和计算机可读存储介质
JP2017103564A (ja) 制御装置、制御方法、およびプログラム
TW202529453A (zh) 視訊擷取處理及效果
WO2019100216A1 (zh) 3d建模方法、电子设备、存储介质及程序产品
US12205328B2 (en) System for tracking camera and control method thereof
Ringaby Geometric models for rolling-shutter and push-broom sensors
O'Sullivan et al. Empirical modelling of rolling shutter effect
Pahwa et al. Calibration of depth cameras using denoised depth images
JP7504614B2 (ja) 画像処理装置、画像処理方法及びプログラム
CN108198131B (zh) 一种基于多图像融合的空间目标抖动及运动模糊仿真方法
Ringaby Geometric computer vision for rolling-shutter and push-broom sensors

Legal Events

Date Code Title Description
PA0109 Patent application

Patent event code: PA01091R01D

Comment text: Patent Application

Patent event date: 20170913

PG1501 Laying open of application
PN2301 Change of applicant

Patent event date: 20191023

Comment text: Notification of Change of Applicant

Patent event code: PN23011R01D

PA0201 Request for examination

Patent event code: PA02012R01D

Patent event date: 20200819

Comment text: Request for Examination of Application

Patent event code: PA02011R01I

Patent event date: 20170913

Comment text: Patent Application

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

Comment text: Notification of reason for refusal

Patent event date: 20210823

Patent event code: PE09021S01D

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20220207

GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20220509

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20220510

End annual number: 3

Start annual number: 1

PG1601 Publication of registration