CN111052732B - 一种对视频帧的序列进行处理的方法、计算机可读存储介质和数据处理系统 - Google Patents

一种对视频帧的序列进行处理的方法、计算机可读存储介质和数据处理系统 Download PDF

Info

Publication number
CN111052732B
CN111052732B CN201880058288.4A CN201880058288A CN111052732B CN 111052732 B CN111052732 B CN 111052732B CN 201880058288 A CN201880058288 A CN 201880058288A CN 111052732 B CN111052732 B CN 111052732B
Authority
CN
China
Prior art keywords
image
video
video frame
stroke
mask
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201880058288.4A
Other languages
English (en)
Chinese (zh)
Other versions
CN111052732A (zh
Inventor
T·A·波特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby Laboratories Licensing Corp
Original Assignee
Dolby Laboratories Licensing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corp filed Critical Dolby Laboratories Licensing Corp
Publication of CN111052732A publication Critical patent/CN111052732A/zh
Application granted granted Critical
Publication of CN111052732B publication Critical patent/CN111052732B/zh
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/1066—Session management
    • H04L65/1083—In-session procedures
    • H04L65/1089—In-session procedures by adding media; by removing media
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00—Geometric image transformations in the plane of the image
    • G06T3/18—Image warping, e.g. rearranging pixels individually
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/70—Denoising; Smoothing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00—Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10—Character recognition
    • G06V30/32—Digital ink
    • G06V30/333—Preprocessing; Feature extraction
    • G06V30/347—Sampling; Contour coding; Stroke extraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/40—Support for services or applications
    • H04L65/403—Arrangements for multi-party communication, e.g. for conferences
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04M—TELEPHONIC COMMUNICATION
    • H04M3/00—Automatic or semi-automatic exchanges
    • H04M3/42—Systems providing special services or facilities to subscribers
    • H04M3/56—Arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities
    • H04M3/563—User guidance or feature selection
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/14—Systems for two-way working
    • H04N7/15—Conference systems
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10016—Video; Image sequence

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • General Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Studio Devices (AREA)
  • User Interface Of Digital Computer (AREA)
CN201880058288.4A 2017-09-27 2018-09-27 一种对视频帧的序列进行处理的方法、计算机可读存储介质和数据处理系统 Active CN111052732B (zh)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US201762563719P 2017-09-27 2017-09-27
US62/563,719 2017-09-27
EP17193442 2017-09-27
EP17193442.5 2017-09-27
PCT/US2018/053097 WO2019067704A1 (en) 2017-09-27 2018-09-27 VIDEO PROCESSING COMPRISING A PHYSICAL WRITE SURFACE

Publications (2)

Publication Number Publication Date
CN111052732A CN111052732A (zh) 2020-04-21
CN111052732B true CN111052732B (zh) 2022-01-28

Family

ID=65903544

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201880058288.4A Active CN111052732B (zh) 2017-09-27 2018-09-27 一种对视频帧的序列进行处理的方法、计算机可读存储介质和数据处理系统

Country Status (5)

Country Link
US (2) US11025681B2 (enExample)
EP (1) EP3688982A4 (enExample)
JP (1) JP7326254B2 (enExample)
CN (1) CN111052732B (enExample)
WO (1) WO2019067704A1 (enExample)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11301063B2 (en) 2018-07-18 2022-04-12 John J. King, JR. Smart pen device and method of implementing a smart pen device
US11695812B2 (en) 2019-01-14 2023-07-04 Dolby Laboratories Licensing Corporation Sharing physical writing surfaces in videoconferencing
CN111930251A (zh) * 2020-08-08 2020-11-13 深圳腾千里科技有限公司 一种读取含碳码点的方法
US11044282B1 (en) 2020-08-12 2021-06-22 Capital One Services, Llc System and method for augmented reality video conferencing
US20220051006A1 (en) * 2020-08-17 2022-02-17 Konica Minolta Business Solutions U.S.A., Inc. Method for real time extraction of content written on a whiteboard
JP7200446B2 (ja) * 2020-12-16 2023-01-06 株式会社ワコム 画像処理方法
US11463499B1 (en) * 2020-12-18 2022-10-04 Vr Edu Llc Storage and retrieval of virtual reality sessions state based upon participants
EP4268447A4 (en) * 2020-12-23 2024-11-20 Canon U.S.A. Inc. SYSTEM AND METHOD FOR AUGMENTED VIEWS DURING AN ONLINE MEETING
CN116803072A (zh) * 2020-12-23 2023-09-22 佳能美国公司 用于在线会议中的增强视图的系统和方法
US20230042608A1 (en) * 2021-08-03 2023-02-09 Multiscale Technologies, Inc. Method for Measuring Dimensions Relative to Bounded Object
WO2023060207A1 (en) * 2021-10-06 2023-04-13 Tangible Play, Inc. Detection and virtualization of handwritten objects
JP7707449B2 (ja) * 2021-12-20 2025-07-14 キヤノン ユーエスエイ，インコーポレイテッド ホワイトボード画像を強調する装置及び方法
US12626028B2 (en) * 2022-01-28 2026-05-12 Hiwin Techologies Corp. Method and system for building digital twin models
CN114942738B (zh) * 2022-04-29 2026-01-23 北京奕斯伟计算技术股份有限公司 用于板书显示的处理方法和相关装置
CN114972086B (zh) * 2022-05-16 2026-04-14 联想(北京)有限公司 图像处理方法、装置及电子设备

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7171056B2 (en) * 2003-02-22 2007-01-30 Microsoft Corp. System and method for converting whiteboard content into an electronic document
KR20080045370A (ko) * 2006-11-20 2008-05-23 주식회사 대우일렉트로닉스 입체 음향을 위한 적응 간섭 제거 방법
CN102067579A (zh) * 2008-06-14 2011-05-18 微软公司 管理多媒体会议事件的白板的技术
CN104732211A (zh) * 2015-03-19 2015-06-24 杭州电子科技大学 一种基于自适应阈值的交通标志检测方法
US9329827B2 (en) * 2004-12-29 2016-05-03 Funmobility, Inc. Cropping of images for display on variably sized display devices

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5613032A (en) 1994-09-02 1997-03-18 Bell Communications Research, Inc. System and method for recording, playing back and searching multimedia events wherein video, audio and text can be searched and retrieved
US20010035976A1 (en) * 2000-02-15 2001-11-01 Andrew Poon Method and system for online presentations of writings and line drawings
US20050281467A1 (en) * 2003-01-24 2005-12-22 Stahovich Thomas F Recognizing multi-stroke symbols
US7224847B2 (en) 2003-02-24 2007-05-29 Microsoft Corp. System and method for real-time whiteboard streaming
US7428000B2 (en) * 2003-06-26 2008-09-23 Microsoft Corp. System and method for distributed meetings
US7260278B2 (en) * 2003-11-18 2007-08-21 Microsoft Corp. System and method for real-time whiteboard capture and processing
US7496229B2 (en) 2004-02-17 2009-02-24 Microsoft Corp. System and method for visual echo cancellation in a projector-camera-whiteboard system
US8019175B2 (en) 2005-03-09 2011-09-13 Qualcomm Incorporated Region-of-interest processing for video telephony
TW200731162A (en) 2006-06-19 2007-08-16 Bextech Inc Manuscript image processing system and method
US8300067B2 (en) * 2006-11-16 2012-10-30 Freedom Scientific, Inc. Distance camera having a memory module
US9300912B2 (en) * 2008-03-28 2016-03-29 Microsoft Technology Licensing, Llc Software based whiteboard capture solution for conference room meetings
US8334902B2 (en) * 2009-03-31 2012-12-18 Fuji Xerox Co., Ltd. System and method for facilitating the use of whiteboards
TWI389570B (zh) 2009-09-01 2013-03-11 圓展科技股份有限公司 視訊會議裝置及其方法
CN102170552A (zh) 2010-02-25 2011-08-31 株式会社理光 一种视频会议系统及其中使用的处理方法
US8773464B2 (en) 2010-09-15 2014-07-08 Sharp Laboratories Of America, Inc. Methods and systems for collaborative-writing-surface image formation
US8698873B2 (en) 2011-03-07 2014-04-15 Ricoh Company, Ltd. Video conferencing with shared drawing
US8380040B2 (en) * 2011-07-18 2013-02-19 Fuji Xerox Co., Ltd. Systems and methods of capturing and organizing annotated content on a mobile device
US8982177B2 (en) * 2013-07-08 2015-03-17 Avaya Inc. System and method for whiteboard collaboration
WO2015116799A1 (en) * 2014-01-31 2015-08-06 3M Innovative Properties Company Note capture, recognition, and management with hints on a user interface
US20160049082A1 (en) * 2014-08-14 2016-02-18 Albert Roy Leatherman, III System for Interactive Online Instruction
GB2536408A (en) 2015-02-13 2016-09-21 Light Blue Optics Ltd Data capture adn sharing systems
US9628757B2 (en) * 2015-08-14 2017-04-18 Microsoft Technology Licensing, Llc Dynamic communication portal between locations
US9930270B2 (en) * 2015-10-15 2018-03-27 Microsoft Technology Licensing, Llc Methods and apparatuses for controlling video content displayed to a viewer
US10074162B2 (en) * 2016-08-11 2018-09-11 Intel Corporation Brightness control for spatially adaptive tone mapping of high dynamic range (HDR) images
US20180139374A1 (en) * 2016-11-14 2018-05-17 Hai Yu Smart and connected object view presentation system and apparatus
US20180232192A1 (en) * 2017-02-14 2018-08-16 Samson Timoner System and Method for Visual Enhancement, Annotation and Broadcast of Physical Writing Surfaces

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7171056B2 (en) * 2003-02-22 2007-01-30 Microsoft Corp. System and method for converting whiteboard content into an electronic document
US9329827B2 (en) * 2004-12-29 2016-05-03 Funmobility, Inc. Cropping of images for display on variably sized display devices
KR20080045370A (ko) * 2006-11-20 2008-05-23 주식회사 대우일렉트로닉스 입체 음향을 위한 적응 간섭 제거 방법
CN102067579A (zh) * 2008-06-14 2011-05-18 微软公司 管理多媒体会议事件的白板的技术
CN104732211A (zh) * 2015-03-19 2015-06-24 杭州电子科技大学 一种基于自适应阈值的交通标志检测方法

Also Published As

Publication number Publication date
JP2020535688A (ja) 2020-12-03
JP7326254B2 (ja) 2023-08-15
US11489886B2 (en) 2022-11-01
CN111052732A (zh) 2020-04-21
US20210360042A1 (en) 2021-11-18
EP3688982A1 (en) 2020-08-05
US20200220906A1 (en) 2020-07-09
US11025681B2 (en) 2021-06-01
WO2019067704A1 (en) 2019-04-04
EP3688982A4 (en) 2021-12-29

Similar Documents

Publication Publication Date Title
US11489886B2 (en) Processing video including a physical writing surface
US11336840B2 (en) Matching foreground and virtual background during a video communication session
US5990931A (en) Automatic display update of still frame images for videoconferencing
US8854412B2 (en) Real-time automatic scene relighting in video conference sessions
US11800056B2 (en) Smart webcam system
US9282285B2 (en) Providing user video having a virtual curtain to an online conference
US9172907B2 (en) Method and apparatus for dynamically adjusting aspect ratio of images during a video call
US8749607B2 (en) Face equalization in video conferencing
US11880983B2 (en) Image enhancement system
US8570359B2 (en) Video region of interest features
US11695812B2 (en) Sharing physical writing surfaces in videoconferencing
JP2020535688A5 (enExample)
CA2724203A1 (en) Techniques to manage a whiteboard for multimedia conference events
JP7334470B2 (ja) 映像処理装置、ビデオ会議システム、映像処理方法、およびプログラム
Parker et al. Digital video processing for engineers: A foundation for embedded systems design
US10863112B1 (en) Smoothing image transitions when changing views
US20190306462A1 (en) Image processing apparatus, videoconference system, image processing method, and recording medium
Zhang Computer vision technologies for remote collaboration using physical whiteboards, projectors and cameras
CN114359306B (zh) 图像数据处理方法、电子设备及计算机存储介质
WO2025125559A1 (en) Method, video-conferencing endpoint, server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant