JP6951166B2 - ビデオにおける仮想オブジェクトをボカす方法及びデバイス - Google Patents

ビデオにおける仮想オブジェクトをボカす方法及びデバイス Download PDF

Info

Publication number
JP6951166B2
JP6951166B2 JP2017176271A JP2017176271A JP6951166B2 JP 6951166 B2 JP6951166 B2 JP 6951166B2 JP 2017176271 A JP2017176271 A JP 2017176271A JP 2017176271 A JP2017176271 A JP 2017176271A JP 6951166 B2 JP6951166 B2 JP 6951166B2
Authority
JP
Japan
Prior art keywords
initial
current
image
virtual object
pose
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2017176271A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018049614A5 (enExample
JP2018049614A (ja
Inventor
ジュエ，ピエリック
ロバート，フィリップ
フラデ，マチュー
Original Assignee
インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ filed Critical インターディジタル・シーイー・パテント・ホールディングス・ソシエテ・パ・アクシオンス・シンプリフィエ
Publication of JP2018049614A publication Critical patent/JP2018049614A/ja
Publication of JP2018049614A5 publication Critical patent/JP2018049614A5/ja
Application granted granted Critical
Publication of JP6951166B2 publication Critical patent/JP6951166B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/207—Analysis of motion for motion estimation over a hierarchy of resolutions
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P13/00—Indicating or recording presence, absence, or direction, of movement
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01P—MEASURING LINEAR OR ANGULAR SPEED, ACCELERATION, DECELERATION, OR SHOCK; INDICATING PRESENCE, ABSENCE, OR DIRECTION, OF MOVEMENT
    • G01P15/00—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration
    • G01P15/14—Measuring acceleration; Measuring deceleration; Measuring shock, i.e. sudden change of acceleration by making use of gyroscopes
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/20—Image enhancement or restoration using local operators
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/215—Motion-based segmentation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • G06T7/246—Analysis of motion using feature-based methods, e.g. the tracking of corners or segments
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • G06T7/73—Determining position or orientation of objects or cameras using feature-based methods
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/14—Picture signal circuitry for video frequency region
    • H04N5/144—Movement detection
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10024—Color image
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30244—Camera pose

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • Signal Processing (AREA)
  • Processing Or Creating Images (AREA)
  • Image Analysis (AREA)
JP2017176271A 2016-09-15 2017-09-14 ビデオにおける仮想オブジェクトをボカす方法及びデバイス Active JP6951166B2 (ja)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16306175.7A EP3296950A1 (en) 2016-09-15 2016-09-15 Method and device for blurring a virtual object in a video
EP16306175.7 2016-09-15

Publications (3)

Publication Number Publication Date
JP2018049614A JP2018049614A (ja) 2018-03-29
JP2018049614A5 JP2018049614A5 (enExample) 2020-10-01
JP6951166B2 true JP6951166B2 (ja) 2021-10-20

Family

ID=56997437

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2017176271A Active JP6951166B2 (ja) 2016-09-15 2017-09-14 ビデオにおける仮想オブジェクトをボカす方法及びデバイス

Country Status (5)

Country Link
US (1) US10825249B2 (enExample)
EP (2) EP3296950A1 (enExample)
JP (1) JP6951166B2 (enExample)
KR (1) KR102397343B1 (enExample)
CN (1) CN107833237B (enExample)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2684193C1 (ru) * 2015-05-21 2019-04-04 Хуавэй Текнолоджиз Ко., Лтд. Устройство и способ для компенсации движения в видеоизображении
CN107019915B (zh) * 2016-02-01 2018-09-07 腾讯科技（深圳）有限公司 一种确定移动轨迹的方法、用户设备及系统
CN108520568B (zh) * 2018-04-03 2019-04-09 武汉木一科技有限公司 一种设备指示灯定位识别方法及装置
CN110544280B (zh) 2018-05-22 2021-10-08 腾讯科技（深圳）有限公司 Ar系统及方法
US10818093B2 (en) * 2018-05-25 2020-10-27 Tiff's Treats Holdings, Inc. Apparatus, method, and system for presentation of multimedia content including augmented reality content
JP7210180B2 (ja) * 2018-07-25 2023-01-23 キヤノン株式会社 画像処理装置、画像表示装置、画像処理方法、及びプログラム
US10860165B2 (en) * 2018-09-26 2020-12-08 NextVPU (Shanghai) Co., Ltd. Tracking method and apparatus for smart glasses, smart glasses and storage medium
KR102715400B1 (ko) * 2020-01-03 2024-10-10 삼성전자주식회사 영상 처리를 위한 전자 장치, 방법 및 비일시적 저장 매체
KR20220040054A (ko) * 2020-09-23 2022-03-30 삼성전자주식회사 전자장치 및 그 제어방법
WO2024018166A1 (en) 2022-07-22 2024-01-25 Blackbird Plc Computer-implemented methods of blurring a digital image; computer terminals and computer program products

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1668597A1 (en) * 2003-09-25 2006-06-14 Koninklijke Philips Electronics N.V. Generation of motion blur
US7643062B2 (en) * 2005-06-08 2010-01-05 Hewlett-Packard Development Company, L.P. Method and system for deblurring an image based on motion tracking
US8018579B1 (en) * 2005-10-21 2011-09-13 Apple Inc. Three-dimensional imaging and display system
JP4754385B2 (ja) * 2006-03-30 2011-08-24 株式会社バンダイナムコゲームス プログラム、情報記録媒体および画像生成システム
US8401081B2 (en) * 2006-08-11 2013-03-19 Thomson Licensing Accurate motion portrayal for display and digital projectors
US20080143840A1 (en) * 2006-12-19 2008-06-19 Texas Instruments Incorporated Image Stabilization System and Method for a Digital Camera
US8196166B2 (en) 2006-12-21 2012-06-05 Verizon Patent And Licensing Inc. Content hosting and advertising systems and methods
US9106873B2 (en) 2010-04-01 2015-08-11 Verizon Patent And Licensing Inc. Methods and systems for providing enhanced content by way of a virtual channel
JP5514637B2 (ja) * 2010-06-11 2014-06-04 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、及び情報処理方法
FR2967804B1 (fr) * 2010-11-19 2013-01-04 Total Immersion Procede et dispositif de detection et de suivi d'objets non rigides en mouvement, en temps reel, dans un flux video, permettant a un utilisateur d'interagir avec un systeme informatique
WO2013044983A1 (en) * 2011-09-30 2013-04-04 Layar B.V. Feedback to user for indicating augmentability of an image
GB2501929B (en) * 2012-05-11 2015-06-24 Sony Comp Entertainment Europe Apparatus and method for augmented reality
JP6151355B2 (ja) * 2012-05-18 2017-06-21 トムソン ライセンシングＴｈｏｍｓｏｎ Ｌｉｃｅｎｓｉｎｇ パノラマピクチャの処理
JP2014035763A (ja) * 2012-08-10 2014-02-24 Nippon Telegr & Teleph Corp <Ntt> 情報表示装置
CN104662435A (zh) * 2012-09-27 2015-05-27 Metaio有限公司 确定与用于捕获至少一个图像的捕获装置关联的装置的位置和方向的方法
US20140333669A1 (en) * 2013-05-08 2014-11-13 Nvidia Corporation System, method, and computer program product for implementing smooth user interface animation using motion blur
EP2819095A1 (en) * 2013-06-24 2014-12-31 Thomson Licensing Method and apparatus for inserting a virtual object in a video
JP6157242B2 (ja) * 2013-06-28 2017-07-05 キヤノン株式会社 画像処理装置及び画像処理方法
US20150220996A1 (en) 2014-01-31 2015-08-06 Venkata S.J.R. Bhamidipati Systems and methods for viral promotion of content
US9495801B2 (en) * 2014-05-01 2016-11-15 Microsoft Technology Licensing, Llc Pose tracking an augmented reality device
WO2016037653A1 (en) 2014-09-11 2016-03-17 Federal-Mogul Wiesbaden Gmbh PRECIPITATION HARDENABLE ALUMINUM BASED Al-Sn-Si-Cu-Mg-V BEARING ALLOY
US9684970B2 (en) * 2015-02-27 2017-06-20 Qualcomm Incorporated Fast adaptive estimation of motion blur for coherent rendering
JP6464934B2 (ja) * 2015-06-11 2019-02-06 富士通株式会社 カメラ姿勢推定装置、カメラ姿勢推定方法およびカメラ姿勢推定プログラム
US10420472B2 (en) * 2015-08-26 2019-09-24 Canon Kabushiki Kaisha Apparatus and method
US10535193B2 (en) * 2015-09-08 2020-01-14 Canon Kabushiki Kaisha Image processing apparatus, image synthesizing apparatus, image processing system, image processing method, and storage medium
US9865062B2 (en) * 2016-02-12 2018-01-09 Qualcomm Incorporated Systems and methods for determining a region in an image

Also Published As

Publication number Publication date
US20180075660A1 (en) 2018-03-15
KR20180030446A (ko) 2018-03-23
KR102397343B1 (ko) 2022-05-13
US10825249B2 (en) 2020-11-03
EP3296950A1 (en) 2018-03-21
CN107833237A (zh) 2018-03-23
CN107833237B (zh) 2023-08-15
JP2018049614A (ja) 2018-03-29
EP3296952B1 (en) 2020-11-04
EP3296952A1 (en) 2018-03-21

Similar Documents

Publication Publication Date Title
JP6951166B2 (ja) ビデオにおける仮想オブジェクトをボカす方法及びデバイス
Nayar et al. Motion-based motion deblurring
JP6914926B2 (ja) Ｉｍｕおよび画像データを使用した合成物体を含む多視点画像データの拡張
Karpenko et al. Digital video stabilization and rolling shutter correction using gyroscopes
EP2531979B1 (en) Depth camera compatibility
JP6793151B2 (ja) オブジェクトトラッキング装置、オブジェクトトラッキング方法およびオブジェクトトラッキングプログラム
US20030012410A1 (en) Tracking and pose estimation for augmented reality using real features
US20100204964A1 (en) Lidar-assisted multi-image matching for 3-d model and sensor pose refinement
JP2018522348A (ja) センサーの３次元姿勢を推定する方法及びシステム
CN111899276A (zh) 一种基于双目事件相机的slam方法及系统
Lee et al. Simultaneous localization, mapping and deblurring
CN112492195A (zh) 光学传感装置及方法
JP2017055397A (ja) 画像処理装置、画像合成装置、画像処理システム、画像処理方法、及びプログラム
TWI501193B (zh) Computer graphics using AR technology. Image processing systems and methods
CN109040525B (zh) 图像处理方法、装置、计算机可读介质及电子设备
CN110544278B (zh) 刚体运动捕捉方法及装置、agv位姿捕捉系统
CN113763544B (zh) 图像确定方法、装置、电子设备和计算机可读存储介质
JP2018206285A (ja) オブジェクト追跡装置及びオブジェクト軌跡生成システム
CN104937608B (zh) 道路区域检测
CN109074658B (zh) 通过特征跟踪和模型配准进行3d多视图重建的方法
CN120013780A (zh) 场景渲染方法、装置、ar设备及存储介质
JP2005063012A (ja) 全方位カメラ運動と３次元情報の復元方法とその装置及びプログラム並びにこれを記録した記録媒体
Ringaby Geometric models for rolling-shutter and push-broom sensors
Chu Image deblur for 3d sensing mobile devices
JP2005063013A (ja) 全方位カメラの視点運動と３次元情報の復元方法とその装置及びプログラム並びにこれを記録した記録媒体

Legal Events

Date Code Title Description
RD03 Notification of appointment of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7423

Effective date: 20181220

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20181227

A711 Notification of change in applicant

Free format text: JAPANESE INTERMEDIATE CODE: A711

Effective date: 20191111

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20200820

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200820

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210520

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210528

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210715

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20210901

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20210924

R150 Certificate of patent or registration of utility model

Ref document number: 6951166

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250