JP6951166B2 - ビデオにおける仮想オブジェクトをボカす方法及びデバイス - Google Patents

ビデオにおける仮想オブジェクトをボカす方法及びデバイス Download PDF

Info

Publication number
JP6951166B2
JP6951166B2 JP2017176271A JP2017176271A JP6951166B2 JP 6951166 B2 JP6951166 B2 JP 6951166B2 JP 2017176271 A JP2017176271 A JP 2017176271A JP 2017176271 A JP2017176271 A JP 2017176271A JP 6951166 B2 JP6951166 B2 JP 6951166B2
Authority
JP
Japan
Prior art keywords
initial
current
image
virtual object
pose
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017176271A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018049614A5 (cg-RX-API-DMAC7.html
JP2018049614A (ja
Inventor
ジュエ,ピエリック
ロバート,フィリップ
フラデ,マチュー
Original Assignee
インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ filed Critical インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ
Publication of JP2018049614A publication Critical patent/JP2018049614A/ja
Publication of JP2018049614A5 publication Critical patent/JP2018049614A5/ja
Application granted granted Critical
Publication of JP6951166B2 publication Critical patent/JP6951166B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/207—Analysis of motion for motion estimation over a hierarchy of resolutions
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P13/00—Indicating or recording presence, absence, or direction, of movement
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/14—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration by making use of gyroscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—Two-dimensional [2D] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/215—Motion-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
JP2017176271A 2016-09-15 2017-09-14 ビデオにおける仮想オブジェクトをボカす方法及びデバイス Active JP6951166B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16306175.7 2016-09-15
EP16306175.7A EP3296950A1 (en) 2016-09-15 2016-09-15 Method and device for blurring a virtual object in a video

Publications (3)

Publication Number Publication Date
JP2018049614A JP2018049614A (ja) 2018-03-29
JP2018049614A5 JP2018049614A5 (cg-RX-API-DMAC7.html) 2020-10-01
JP6951166B2 true JP6951166B2 (ja) 2021-10-20

Family

ID=56997437

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017176271A Active JP6951166B2 (ja) 2016-09-15 2017-09-14 ビデオにおける仮想オブジェクトをボカす方法及びデバイス

Country Status (5)

Country Link
US (1) US10825249B2 (cg-RX-API-DMAC7.html)
EP (2) EP3296950A1 (cg-RX-API-DMAC7.html)
JP (1) JP6951166B2 (cg-RX-API-DMAC7.html)
KR (1) KR102397343B1 (cg-RX-API-DMAC7.html)
CN (1) CN107833237B (cg-RX-API-DMAC7.html)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016184527A1 (en) * 2015-05-21 2016-11-24 Huawei Technologies Co., Ltd. Apparatus and method for video motion compensation
CN107019915B (zh) * 2016-02-01 2018-09-07 腾讯科技(深圳)有限公司 一种确定移动轨迹的方法、用户设备及系统
CN108520568B (zh) * 2018-04-03 2019-04-09 武汉木一科技有限公司 一种设备指示灯定位识别方法及装置
CN108734736B (zh) 2018-05-22 2021-10-26 腾讯科技(深圳)有限公司 相机姿态追踪方法、装置、设备及存储介质
US10818093B2 (en) * 2018-05-25 2020-10-27 Tiff's Treats Holdings, Inc. Apparatus, method, and system for presentation of multimedia content including augmented reality content
JP7210180B2 (ja) * 2018-07-25 2023-01-23 キヤノン株式会社 画像処理装置、画像表示装置、画像処理方法、及びプログラム
KR102242719B1 (ko) * 2018-09-26 2021-04-23 넥스트브이피유 (상하이) 코포레이트 리미티드 스마트 안경 추적 방법과 장치, 및 스마트 안경과 저장 매체
KR102715400B1 (ko) * 2020-01-03 2024-10-10 삼성전자주식회사 영상 처리를 위한 전자 장치, 방법 및 비일시적 저장 매체
KR102979307B1 (ko) 2020-09-23 2026-06-18 삼성전자주식회사 전자장치 및 그 제어방법
JP7635008B2 (ja) * 2021-02-01 2025-02-25 キヤノン株式会社 画像処理装置、撮像装置、制御方法およびプログラム
WO2024018166A1 (en) 2022-07-22 2024-01-25 Blackbird Plc Computer-implemented methods of blurring a digital image; computer terminals and computer program products
JP2024104854A (ja) 2023-01-25 2024-08-06 キヤノン株式会社 画像処理装置、画像処理方法、プログラム

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007507036A (ja) * 2003-09-25 2007-03-22 コーニンクレッカ フィリップス エレクトロニクス エヌ ヴィ 動作ぼかしの生成
US7643062B2 (en) * 2005-06-08 2010-01-05 Hewlett-Packard Development Company, L.P. Method and system for deblurring an image based on motion tracking
US8018579B1 (en) * 2005-10-21 2011-09-13 Apple Inc. Three-dimensional imaging and display system
JP4754385B2 (ja) * 2006-03-30 2011-08-24 株式会社バンダイナムコゲームス プログラム、情報記録媒体および画像生成システム
KR101305622B1 (ko) * 2006-08-11 2013-09-09 톰슨 라이센싱 디스플레이 및 디지털 프로젝터를 위한 정확한 움직임 묘사
US20080143840A1 (en) * 2006-12-19 2008-06-19 Texas Instruments Incorporated Image Stabilization System and Method for a Digital Camera
US8196166B2 (en) 2006-12-21 2012-06-05 Verizon Patent And Licensing Inc. Content hosting and advertising systems and methods
US9106873B2 (en) 2010-04-01 2015-08-11 Verizon Patent And Licensing Inc. Methods and systems for providing enhanced content by way of a virtual channel
JP5514637B2 (ja) * 2010-06-11 2014-06-04 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、及び情報処理方法
FR2967804B1 (fr) * 2010-11-19 2013-01-04 Total Immersion Procede et dispositif de detection et de suivi d'objets non rigides en mouvement, en temps reel, dans un flux video, permettant a un utilisateur d'interagir avec un systeme informatique
US9704230B2 (en) * 2011-09-30 2017-07-11 Layar B.V. Feedback to user for indicating augmentability of an image
GB2501929B (en) * 2012-05-11 2015-06-24 Sony Comp Entertainment Europe Apparatus and method for augmented reality
WO2013173670A2 (en) * 2012-05-18 2013-11-21 Thomson Licensing Processing panoramic pictures
JP2014035763A (ja) * 2012-08-10 2014-02-24 Nippon Telegr & Teleph Corp <Ntt> 情報表示装置
CN104662435A (zh) * 2012-09-27 2015-05-27 Metaio有限公司 确定与用于捕获至少一个图像的捕获装置关联的装置的位置和方向的方法
US20140333669A1 (en) * 2013-05-08 2014-11-13 Nvidia Corporation System, method, and computer program product for implementing smooth user interface animation using motion blur
EP2819095A1 (en) * 2013-06-24 2014-12-31 Thomson Licensing Method and apparatus for inserting a virtual object in a video
JP6157242B2 (ja) * 2013-06-28 2017-07-05 キヤノン株式会社 画像処理装置及び画像処理方法
US20150220996A1 (en) 2014-01-31 2015-08-06 Venkata S.J.R. Bhamidipati Systems and methods for viral promotion of content
US9495801B2 (en) * 2014-05-01 2016-11-15 Microsoft Technology Licensing, Llc Pose tracking an augmented reality device
WO2016037653A1 (en) 2014-09-11 2016-03-17 Federal-Mogul Wiesbaden Gmbh PRECIPITATION HARDENABLE ALUMINUM BASED Al-Sn-Si-Cu-Mg-V BEARING ALLOY
US9684970B2 (en) * 2015-02-27 2017-06-20 Qualcomm Incorporated Fast adaptive estimation of motion blur for coherent rendering
JP6464934B2 (ja) * 2015-06-11 2019-02-06 富士通株式会社 カメラ姿勢推定装置、カメラ姿勢推定方法およびカメラ姿勢推定プログラム
US10420472B2 (en) * 2015-08-26 2019-09-24 Canon Kabushiki Kaisha Apparatus and method
US10535193B2 (en) * 2015-09-08 2020-01-14 Canon Kabushiki Kaisha Image processing apparatus, image synthesizing apparatus, image processing system, image processing method, and storage medium
US9865062B2 (en) * 2016-02-12 2018-01-09 Qualcomm Incorporated Systems and methods for determining a region in an image

Also Published As

Publication number Publication date
KR20180030446A (ko) 2018-03-23
KR102397343B1 (ko) 2022-05-13
EP3296952B1 (en) 2020-11-04
CN107833237A (zh) 2018-03-23
US20180075660A1 (en) 2018-03-15
EP3296950A1 (en) 2018-03-21
CN107833237B (zh) 2023-08-15
JP2018049614A (ja) 2018-03-29
US10825249B2 (en) 2020-11-03
EP3296952A1 (en) 2018-03-21

Similar Documents

Publication Publication Date Title
CN107833237B (zh) 用于模糊视频中的虚拟对象的方法和设备
Nayar et al. Motion-based motion deblurring
JP6914926B2 (ja) Imuおよび画像データを使用した合成物体を含む多視点画像データの拡張
Karpenko et al. Digital video stabilization and rolling shutter correction using gyroscopes
EP2531979B1 (en) Depth camera compatibility
CN111899276A (zh) 一种基于双目事件相机的slam方法及系统
JP6793151B2 (ja) オブジェクトトラッキング装置、オブジェクトトラッキング方法およびオブジェクトトラッキングプログラム
US20030012410A1 (en) Tracking and pose estimation for augmented reality using real features
US20100204964A1 (en) Lidar-assisted multi-image matching for 3-d model and sensor pose refinement
JP2018522348A (ja) センサーの3次元姿勢を推定する方法及びシステム
Lee et al. Simultaneous localization, mapping and deblurring
JP5956248B2 (ja) 画像監視装置
KR20140033868A (ko) 증강현실 응용을 위한 환경 모델링 방법 및 장치
CN109211277A (zh) 视觉惯性里程计的状态确定方法、装置和电子设备
TWI501193B (zh) Computer graphics using AR technology. Image processing systems and methods
JP2017055397A (ja) 画像処理装置、画像合成装置、画像処理システム、画像処理方法、及びプログラム
CN109040525A (zh) 图像处理方法、装置、计算机可读介质及电子设备
CN112492195A (zh) 光学传感装置及方法
CN110544278B (zh) 刚体运动捕捉方法及装置、agv位姿捕捉系统
JP2018206285A (ja) オブジェクト追跡装置及びオブジェクト軌跡生成システム
CN104937608B (zh) 道路区域检测
CN113763544B (zh) 图像确定方法、装置、电子设备和计算机可读存储介质
CN109074658B (zh) 通过特征跟踪和模型配准进行3d多视图重建的方法
CN120013780A (zh) 场景渲染方法、装置、ar设备及存储介质
JP2005063012A (ja) 全方位カメラ運動と3次元情報の復元方法とその装置及びプログラム並びにこれを記録した記録媒体

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20181220

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20181227

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20191111

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200820

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200820

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210520

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210528

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210715

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210901

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210924

R150 Certificate of patent or registration of utility model

Ref document number: 6951166

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250