JP6608700B2 - 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法 - Google Patents

制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法 Download PDF

Info

Publication number
JP6608700B2
JP6608700B2 JP2015547507A JP2015547507A JP6608700B2 JP 6608700 B2 JP6608700 B2 JP 6608700B2 JP 2015547507 A JP2015547507 A JP 2015547507A JP 2015547507 A JP2015547507 A JP 2015547507A JP 6608700 B2 JP6608700 B2 JP 6608700B2
Authority
JP
Japan
Prior art keywords
camera
image frames
camera orientation
smoothed
orientation data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2015547507A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016501497A (ja
JP2016501497A5 (cg-RX-API-DMAC7.html
Inventor
カルペンコ、アレクサンドル
Original Assignee
フェイスブック，インク．
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by フェイスブック，インク． filed Critical フェイスブック，インク．
Publication of JP2016501497A publication Critical patent/JP2016501497A/ja
Publication of JP2016501497A5 publication Critical patent/JP2016501497A5/ja
Application granted granted Critical
Publication of JP6608700B2 publication Critical patent/JP6608700B2/ja
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/682—Vibration or motion blur correction
    • H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/11—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information not detectable on the record carrier
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/681—Motion detection
    • H04N23/6812—Motion detection based on additional sensors, e.g. acceleration sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
    • H04N23/689—Motion occurring during a rolling shutter mode
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
JP2015547507A 2012-12-11 2013-12-11 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法 Expired - Fee Related JP6608700B2 (ja)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US201261735976P 2012-12-11 2012-12-11
US61/735,976 2012-12-11
US14/101,252 US9071756B2 (en) 2012-12-11 2013-12-09 Systems and methods for digital video stabilization via constraint-based rotation smoothing
US14/101,252 2013-12-09
EP13196486.8 2013-12-10
EP13196486.8A EP2744192B1 (en) 2012-12-11 2013-12-10 Systems and methods for digital video stabilization via constraint-based rotation smoothing
PCT/US2013/074444 WO2014093517A1 (en) 2012-12-11 2013-12-11 Systems and methods for digital video stabilization via constraint-based rotation smoothing

Related Child Applications (1)

Application Number Title Priority Date Filing Date
JP2018020047A Division JP6605640B2 (ja) 2012-12-11 2018-02-07 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法

Publications (3)

Publication Number Publication Date
JP2016501497A JP2016501497A (ja) 2016-01-18
JP2016501497A5 JP2016501497A5 (cg-RX-API-DMAC7.html) 2017-01-26
JP6608700B2 true JP6608700B2 (ja) 2019-11-20

Family

ID=49726634

Family Applications (3)

Application Number Title Priority Date Filing Date
JP2015547507A Expired - Fee Related JP6608700B2 (ja) 2012-12-11 2013-12-11 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法
JP2018020047A Expired - Fee Related JP6605640B2 (ja) 2012-12-11 2018-02-07 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法
JP2019189053A Expired - Fee Related JP6937809B2 (ja) 2012-12-11 2019-10-16 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法

Family Applications After (2)

Application Number Title Priority Date Filing Date
JP2018020047A Expired - Fee Related JP6605640B2 (ja) 2012-12-11 2018-02-07 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法
JP2019189053A Expired - Fee Related JP6937809B2 (ja) 2012-12-11 2019-10-16 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法

Country Status (11)

Country Link
US (4) US9071756B2 (cg-RX-API-DMAC7.html)
EP (1) EP2744192B1 (cg-RX-API-DMAC7.html)
JP (3) JP6608700B2 (cg-RX-API-DMAC7.html)
KR (1) KR102003012B1 (cg-RX-API-DMAC7.html)
CN (1) CN104982027B (cg-RX-API-DMAC7.html)
AU (3) AU2013359372B2 (cg-RX-API-DMAC7.html)
BR (1) BR112015013565A2 (cg-RX-API-DMAC7.html)
CA (1) CA2893802C (cg-RX-API-DMAC7.html)
IL (1) IL239249B (cg-RX-API-DMAC7.html)
MX (1) MX345710B (cg-RX-API-DMAC7.html)
WO (1) WO2014093517A1 (cg-RX-API-DMAC7.html)

Families Citing this family (53)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140184615A1 (en) * 2012-12-28 2014-07-03 Nokia Corporation Sequential Rendering For Field-Sequential Color Displays
US9554048B2 (en) * 2013-09-26 2017-01-24 Apple Inc. In-stream rolling shutter compensation
CN104954631B (zh) * 2014-03-25 2018-02-27 腾讯科技（深圳）有限公司 一种视频处理方法、装置和系统
US9413963B2 (en) 2014-05-30 2016-08-09 Apple Inc. Video image stabilization
US9674438B2 (en) 2014-07-06 2017-06-06 Apple Inc. Low light video image stabilization strength modulation
CN105306804B (zh) * 2014-07-31 2018-08-21 北京展讯高科通信技术有限公司 智能终端及其视频稳像方法及装置
US9596411B2 (en) 2014-08-25 2017-03-14 Apple Inc. Combined optical and electronic image stabilization
US9398217B2 (en) 2014-10-15 2016-07-19 Microsoft Technology Licensing, Llc Video stabilization using padded margin pixels
US9392174B2 (en) * 2014-12-11 2016-07-12 Facebook, Inc. Systems and methods for time-lapse selection subsequent to capturing media content
US9948920B2 (en) 2015-02-27 2018-04-17 Qualcomm Incorporated Systems and methods for error correction in structured light
US10068338B2 (en) 2015-03-12 2018-09-04 Qualcomm Incorporated Active sensing spatial resolution improvement through multiple receivers and code reuse
US9530215B2 (en) 2015-03-20 2016-12-27 Qualcomm Incorporated Systems and methods for enhanced depth map retrieval for moving objects using active sensing technology
US9635339B2 (en) 2015-08-14 2017-04-25 Qualcomm Incorporated Memory-efficient coded light error correction
US9846943B2 (en) 2015-08-31 2017-12-19 Qualcomm Incorporated Code domain power control for structured light
CN107925722B (zh) 2015-11-16 2020-05-12 谷歌有限责任公司 用于补偿相机运动的方法和设备
CN105282400B (zh) * 2015-11-20 2018-07-13 北京理工大学 一种基于几何插值的高效视频稳定方法
WO2017106076A1 (en) * 2015-12-16 2017-06-22 Gopro, Inc. Dynamic synchronization of frame rate to a detected cadence in a time lapse image sequence
CN108432222A (zh) * 2015-12-22 2018-08-21 深圳市大疆创新科技有限公司 支持包围式成像的系统、方法和移动平台
US11477382B2 (en) * 2016-02-19 2022-10-18 Fotonation Limited Method of stabilizing a sequence of images
CN108702450B (zh) * 2016-02-19 2020-10-27 快图有限公司 用于图像捕获设备的相机模块
US9787902B1 (en) 2016-06-10 2017-10-10 Apple Inc. Video image stabilization with enforced stabilization constraints
CA3043934A1 (en) 2016-10-20 2018-04-26 Spookfish Innovations Pty Ltd An image synthesis system
US20180124378A1 (en) * 2016-11-03 2018-05-03 Qualcomm Incorporated Enhanced depth map images for mobile devices
US10547784B2 (en) * 2017-06-19 2020-01-28 SighTour Technologies, Inc. Image stabilization
US10477064B2 (en) * 2017-08-21 2019-11-12 Gopro, Inc. Image stitching with electronic rolling shutter correction
WO2019054611A1 (ko) 2017-09-14 2019-03-21 삼성전자 주식회사 전자 장치 및 그 동작방법
US10462370B2 (en) 2017-10-03 2019-10-29 Google Llc Video stabilization
US10796185B2 (en) * 2017-11-03 2020-10-06 Facebook, Inc. Dynamic graceful degradation of augmented-reality effects
US10171738B1 (en) 2018-05-04 2019-01-01 Google Llc Stabilizing video to reduce camera and face movement
WO2019222544A1 (en) * 2018-05-16 2019-11-21 Iooi System and method for navigating content from multiple users on a digital device
WO2019222059A1 (en) * 2018-05-16 2019-11-21 Gopro, Inc. Systems and methods for providing rotational motion correction
US10587807B2 (en) * 2018-05-18 2020-03-10 Gopro, Inc. Systems and methods for stabilizing videos
JP2020031264A (ja) * 2018-08-20 2020-02-27 ソニーセミコンダクタソリューションズ株式会社 信号処理装置、撮像装置、信号処理方法
US10432864B1 (en) 2018-09-19 2019-10-01 Gopro, Inc. Systems and methods for stabilizing videos
KR102573302B1 (ko) 2018-10-10 2023-08-31 삼성전자 주식회사 영상의 안정화를 위한 카메라 모듈, 그것을 포함하는 전자 장치 및 전자 장치의 영상 안정화 방법
JP7206797B2 (ja) * 2018-10-22 2023-01-18 株式会社リコー 撮像装置、情報処理装置、補正値計算方法およびプログラム
US10911680B2 (en) * 2018-12-28 2021-02-02 Intel Corporation Method and system of geolocation and attitude correction for mobile rolling shutter cameras
CN109379536B (zh) * 2018-12-29 2020-07-31 深圳看到科技有限公司 画面生成方法、装置、终端及对应的存储介质
WO2020220292A1 (zh) * 2019-04-30 2020-11-05 深圳市大疆创新科技有限公司 电子增稳方法、图像采集设备、可移动平台
US11470254B1 (en) * 2019-06-21 2022-10-11 Gopro, Inc. Systems and methods for assessing stabilization of videos
WO2020257583A1 (en) * 2019-06-21 2020-12-24 Gopro, Inc. Systems and methods for stabilizing videos
KR102176273B1 (ko) * 2019-07-04 2020-11-09 재단법인대구경북과학기술원 동영상 수평 조정 시스템, 방법 및 컴퓨터 프로그램
CN112492223B (zh) * 2019-07-23 2023-05-12 影石创新科技股份有限公司 一种相机镜头平滑处理方法、装置及便携式终端
US11948242B2 (en) 2019-08-02 2024-04-02 Fmr Llc Intelligent smoothing of 3D alternative reality applications for secondary 2D viewing
US11138804B2 (en) 2019-08-02 2021-10-05 Fmr Llc Intelligent smoothing of 3D alternative reality applications for secondary 2D viewing
CN110430365B (zh) * 2019-08-26 2021-10-01 Oppo广东移动通信有限公司 防抖方法、装置、计算机设备和存储介质
US11694311B2 (en) * 2020-03-04 2023-07-04 Nec Corporation Joint rolling shutter image stitching and rectification
US11190689B1 (en) * 2020-07-29 2021-11-30 Google Llc Multi-camera video stabilization
CN112561839B (zh) * 2020-12-02 2022-08-19 北京有竹居网络技术有限公司 视频裁剪方法、装置、存储介质及电子设备
CN116829055A (zh) * 2021-01-11 2023-09-29 宝洁公司 用于生成三维（3d）图像模型的皮肤病学成像系统和方法
US11405557B1 (en) * 2021-07-20 2022-08-02 Locus Robotics Corp. Rolling shutter compensation for moving digital optical camera sensors
US11863791B1 (en) 2021-11-17 2024-01-02 Google Llc Methods and systems for non-destructive stabilization-based encoder optimization
EP4649687A1 (en) 2023-02-07 2025-11-19 Samsung Electronics Co., Ltd. Full frame media stabilization in electronic devices

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AUPO793897A0 (en) 1997-07-15 1997-08-07 Silverbrook Research Pty Ltd Image processing method and apparatus (ART25)
US6552744B2 (en) 1997-09-26 2003-04-22 Roxio, Inc. Virtual reality camera
US7015954B1 (en) 1999-08-09 2006-03-21 Fuji Xerox Co., Ltd. Automatic video system using multiple cameras
US7119837B2 (en) * 2002-06-28 2006-10-10 Microsoft Corporation Video processing system and method for automatic enhancement of digital video
US7495694B2 (en) 2004-07-28 2009-02-24 Microsoft Corp. Omni-directional camera with calibration and up look angle improvements
US8207964B1 (en) 2008-02-22 2012-06-26 Meadow William D Methods and apparatus for generating three-dimensional image data models
US7542034B2 (en) * 2004-09-23 2009-06-02 Conversion Works, Inc. System and method for processing video images
JP4793120B2 (ja) 2006-06-21 2011-10-12 ソニー株式会社 手振れ補正方法、手振れ補正方法のプログラム、手振れ補正方法のプログラムを記録した記録媒体及び手振れ補正装置
US20080165280A1 (en) 2007-01-05 2008-07-10 Deever Aaron T Digital video stabilization with manual control
US7817187B2 (en) * 2007-06-27 2010-10-19 Aptina Imaging Corporation Image blur correction using a secondary camera
JP5251410B2 (ja) * 2008-10-03 2013-07-31 株式会社ニコン カメラワーク算出プログラム、撮像装置及びカメラワーク算出方法
US8363128B2 (en) * 2009-08-10 2013-01-29 Samsung Electronics Co., Ltd. Image processing apparatus and image processing method
US20110085728A1 (en) * 2009-10-08 2011-04-14 Yuli Gao Detecting near duplicate images
JP2011114649A (ja) * 2009-11-27 2011-06-09 Sanyo Electric Co Ltd 撮像装置
CN101917602B (zh) * 2010-08-26 2012-07-04 四川大学 基于高分辨率摄像头的数字视频智能监控设备及数据处理方法
US8488010B2 (en) * 2010-09-21 2013-07-16 Hewlett-Packard Development Company, L.P. Generating a stabilized video sequence based on motion sensor data
US8531535B2 (en) 2010-10-28 2013-09-10 Google Inc. Methods and systems for processing a video for stabilization and retargeting
US8964041B2 (en) * 2011-04-07 2015-02-24 Fr Vision Ab System and method for video stabilization of rolling shutter cameras
JP5734082B2 (ja) 2011-05-11 2015-06-10 キヤノン株式会社 撮像装置及びその制御方法、並びにプログラム
US8823813B2 (en) * 2011-06-06 2014-09-02 Apple Inc. Correcting rolling shutter using image stabilization
US20130107066A1 (en) * 2011-10-27 2013-05-02 Qualcomm Incorporated Sensor aided video stabilization
US20130121559A1 (en) * 2011-11-16 2013-05-16 Sharp Laboratories Of America, Inc. Mobile device with three dimensional augmented reality
US9041819B2 (en) 2011-11-17 2015-05-26 Apple Inc. Method for stabilizing a digital video
US20130162518A1 (en) * 2011-12-23 2013-06-27 Meghan Jennifer Athavale Interactive Video System

Also Published As

Publication number Publication date
CA2893802A1 (en) 2014-06-19
US20150222818A1 (en) 2015-08-06
JP2020005326A (ja) 2020-01-09
EP2744192A3 (en) 2016-09-14
EP2744192B1 (en) 2021-05-19
US20150002686A1 (en) 2015-01-01
US9554045B2 (en) 2017-01-24
AU2017200248B2 (en) 2017-12-14
BR112015013565A2 (pt) 2019-12-17
JP6937809B2 (ja) 2021-09-22
JP2018085775A (ja) 2018-05-31
KR20150095782A (ko) 2015-08-21
US20170180647A1 (en) 2017-06-22
MX2015007499A (es) 2015-12-15
CN104982027A (zh) 2015-10-14
JP2016501497A (ja) 2016-01-18
MX345710B (es) 2017-02-13
US20140160309A1 (en) 2014-06-12
AU2018201829B2 (en) 2019-06-13
CN104982027B (zh) 2018-07-27
IL239249B (en) 2019-08-29
AU2017200248A1 (en) 2017-02-02
CA2893802C (en) 2019-08-13
US9674440B2 (en) 2017-06-06
US10511773B2 (en) 2019-12-17
WO2014093517A1 (en) 2014-06-19
AU2018201829A1 (en) 2018-04-12
AU2013359372B2 (en) 2016-10-13
JP6605640B2 (ja) 2019-11-13
EP2744192A2 (en) 2014-06-18
IL239249A0 (en) 2015-07-30
AU2013359372A1 (en) 2015-07-02
KR102003012B1 (ko) 2019-07-24
US9071756B2 (en) 2015-06-30

Similar Documents

Publication Publication Date Title
JP6937809B2 (ja) 制約ベースの回転平滑化を介してデジタルビデオを安定化するためのシステムおよび方法
JP6412129B2 (ja) 画像を変換するためのシステム及び方法
US10652465B2 (en) Systems and methods for combining multiple frames to produce media content with simulated exposure effects
US20160148648A1 (en) Systems and methods for improving stabilization in time-lapse media content
CN109040525B (zh) 图像处理方法、装置、计算机可读介质及电子设备
CN116170689A (zh) 视频生成方法、装置、计算机设备和存储介质
US10725637B2 (en) Systems and methods for providing image perspective adjustment and automatic fitting
US10721419B2 (en) Ortho-selfie distortion correction using multiple image sensors to synthesize a virtual image

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161205

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20161205

A871 Explanation of circumstances concerning accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A871

Effective date: 20161205

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20170410

A975 Report on accelerated examination

Free format text: JAPANESE INTERMEDIATE CODE: A971005

Effective date: 20170530

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170606

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170828

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20171010

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20180207

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20180216

A912 Re-examination (zenchi) completed and case transferred to appeal board

Free format text: JAPANESE INTERMEDIATE CODE: A912

Effective date: 20180420

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20190517

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190807

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20191024

R150 Certificate of patent or registration of utility model

Ref document number: 6608700

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

S533 Written request for registration of change of name

Free format text: JAPANESE INTERMEDIATE CODE: R313533

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees