EP3513566A4 - Verfahren und systeme zur räumlich-zeitlichen mustererkennung für die entwicklung von videoinhalten - Google Patents

Verfahren und systeme zur räumlich-zeitlichen mustererkennung für die entwicklung von videoinhalten Download PDF

Info

Publication number
EP3513566A4
EP3513566A4 EP17851597.9A EP17851597A EP3513566A4 EP 3513566 A4 EP3513566 A4 EP 3513566A4 EP 17851597 A EP17851597 A EP 17851597A EP 3513566 A4 EP3513566 A4 EP 3513566A4
Authority
EP
European Patent Office
Prior art keywords
systems
methods
video content
pattern recognition
content development
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP17851597.9A
Other languages
English (en)
French (fr)
Other versions
EP3513566A1 (de
Inventor
Yu-Han Chang
Rajiv MAHESWARAN
Jeffrey Wayne Su
Noel Hollingsworth
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Second Spectrum Inc
Original Assignee
Second Spectrum Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/586,379 external-priority patent/US10521671B2/en
Application filed by Second Spectrum Inc filed Critical Second Spectrum Inc
Publication of EP3513566A1 publication Critical patent/EP3513566A1/de
Publication of EP3513566A4 publication Critical patent/EP3513566A4/de
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/44—Event detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Algebra (AREA)
  • Probability & Statistics with Applications (AREA)
  • Mathematical Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
EP17851597.9A 2016-09-16 2017-09-15 Verfahren und systeme zur räumlich-zeitlichen mustererkennung für die entwicklung von videoinhalten Withdrawn EP3513566A4 (de)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662395886P 2016-09-16 2016-09-16
US15/586,379 US10521671B2 (en) 2014-02-28 2017-05-04 Methods and systems of spatiotemporal pattern recognition for video content development
US201762532744P 2017-07-14 2017-07-14
PCT/US2017/051768 WO2018053257A1 (en) 2016-09-16 2017-09-15 Methods and systems of spatiotemporal pattern recognition for video content development

Publications (2)

Publication Number Publication Date
EP3513566A1 EP3513566A1 (de) 2019-07-24
EP3513566A4 true EP3513566A4 (de) 2019-09-11

Family

ID=61619742

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17851597.9A Withdrawn EP3513566A4 (de) 2016-09-16 2017-09-15 Verfahren und systeme zur räumlich-zeitlichen mustererkennung für die entwicklung von videoinhalten

Country Status (2)

Country Link
EP (1) EP3513566A4 (de)
WO (1) WO2018053257A1 (de)

Families Citing this family (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11120271B2 (en) 2014-02-28 2021-09-14 Second Spectrum, Inc. Data processing systems and methods for enhanced augmentation of interactive video content
US10521671B2 (en) 2014-02-28 2019-12-31 Second Spectrum, Inc. Methods and systems of spatiotemporal pattern recognition for video content development
US10769446B2 (en) 2014-02-28 2020-09-08 Second Spectrum, Inc. Methods and systems of combining video content with one or more augmentations
US10713494B2 (en) 2014-02-28 2020-07-14 Second Spectrum, Inc. Data processing systems and methods for generating and interactive user interfaces and interactive game systems based on spatiotemporal analysis of video content
US11861906B2 (en) 2014-02-28 2024-01-02 Genius Sports Ss, Llc Data processing systems and methods for enhanced augmentation of interactive video content
EP3619684A4 (de) 2017-05-04 2021-06-09 Second Spectrum, Inc. Verfahren und vorrichtung zur automatischen intrinsischen kamerakalibrierung unter verwendung von bildern eines planaren kalibriermusters
US10818033B2 (en) * 2018-01-18 2020-10-27 Oath Inc. Computer vision on broadcast video
US11294949B2 (en) * 2018-09-04 2022-04-05 Toyota Connected North America, Inc. Systems and methods for querying a distributed inventory of visual data
CN109600559B (zh) * 2018-11-29 2021-07-23 北京字节跳动网络技术有限公司 一种视频特效添加方法、装置、终端设备及存储介质
US10917702B2 (en) 2018-12-13 2021-02-09 At&T Intellectual Property I, L.P. Creating customized short-form content from long-form content
US11140328B2 (en) 2019-01-22 2021-10-05 Tempus Ex Machina, Inc. Systems and methods for partitioning a video feed to segment live player activity
US11172248B2 (en) 2019-01-22 2021-11-09 Tempus Ex Machina, Inc. Systems and methods for customizing and compositing a video feed at a client device
CN113508604B (zh) 2019-02-28 2023-10-31 斯塔特斯公司 从广播视频生成可跟踪视频帧的系统及方法
CN111861605A (zh) * 2019-04-28 2020-10-30 阿里巴巴集团控股有限公司 业务对象推荐方法
US11514610B2 (en) * 2019-08-14 2022-11-29 Tencent America LLC Method and apparatus for point cloud coding
US11113535B2 (en) 2019-11-08 2021-09-07 Second Spectrum, Inc. Determining tactical relevance and similarity of video sequences
CA3167079A1 (en) * 2020-03-27 2021-09-30 Mehrsan Javan Roshtkhari System and method for group activity recognition in images and videos with self-attention mechanisms
CN113709562B (zh) * 2021-04-27 2023-05-16 武汉星巡智能科技有限公司 基于婴儿动作视频自动剪辑方法、装置、设备及存储介质
US20220343253A1 (en) * 2021-04-27 2022-10-27 Stats Llc Virtual Coaching System
CN113506195B (zh) * 2021-06-15 2024-03-08 深圳十方融海科技有限公司 互联网班级管理方法、系统、计算机设备和存储介质
CN115175005A (zh) * 2022-06-08 2022-10-11 中央广播电视总台 视频处理方法、装置、电子设备及存储介质
CN116383669B (zh) * 2023-03-18 2024-04-16 宝钢工程技术集团有限公司 一种数据贯通的工厂对象位号标识生成方法及系统
CN117649608B (zh) * 2024-01-29 2024-03-29 阿坝州林业和草原科学技术研究所 基于遥感监测的松材线虫病识别系统及方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002071334A2 (en) * 2001-03-06 2002-09-12 Prozone Holdings Limited Sport analysis system and method
US20040017389A1 (en) * 2002-07-25 2004-01-29 Hao Pan Summarization of soccer video content
US20110013087A1 (en) * 2009-07-20 2011-01-20 Pvi Virtual Media Services, Llc Play Sequence Visualization and Analysis
US20150142716A1 (en) * 2013-11-15 2015-05-21 Disney Enterprises, Inc. Tracking player role using non-rigid formation priors
US20160080830A1 (en) * 2014-09-12 2016-03-17 Kiswe Mobile Inc. Methods and apparatus for content interaction
WO2016057844A1 (en) * 2014-10-09 2016-04-14 Thuuz, Inc. Customized generation of highlight show with narrative component

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6859496B1 (en) * 1998-05-29 2005-02-22 International Business Machines Corporation Adaptively encoding multiple streams of video data in parallel for multiplexing onto a constant bit rate channel
US20050146605A1 (en) * 2000-10-24 2005-07-07 Lipton Alan J. Video surveillance system employing video primitives
US7143083B2 (en) * 2001-06-12 2006-11-28 Lucent Technologies Inc. Method and apparatus for retrieving multimedia data through spatio-temporal activity maps
US10360685B2 (en) * 2007-05-24 2019-07-23 Pillar Vision Corporation Stereoscopic image capture with performance outcome prediction in sporting environments
JP4099973B2 (ja) * 2001-10-30 2008-06-11 松下電器産業株式会社 映像データ送信方法及び映像データ受信方法、並びに映像監視システム
US9740984B2 (en) * 2012-08-21 2017-08-22 Disney Enterprises, Inc. Characterizing motion patterns of one or more agents from spatiotemporal data
KR101341288B1 (ko) * 2013-10-24 2013-12-12 사회복지법인 삼성생명공익재단 방사선 치료기의 품질 보증 시스템 및 그 품질 보증 방법
AU2015222869B2 (en) * 2014-02-28 2019-07-11 Genius Sports Ss, Llc System and method for performing spatio-temporal analysis of sporting events

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002071334A2 (en) * 2001-03-06 2002-09-12 Prozone Holdings Limited Sport analysis system and method
US20040017389A1 (en) * 2002-07-25 2004-01-29 Hao Pan Summarization of soccer video content
US20110013087A1 (en) * 2009-07-20 2011-01-20 Pvi Virtual Media Services, Llc Play Sequence Visualization and Analysis
US20150142716A1 (en) * 2013-11-15 2015-05-21 Disney Enterprises, Inc. Tracking player role using non-rigid formation priors
US20160080830A1 (en) * 2014-09-12 2016-03-17 Kiswe Mobile Inc. Methods and apparatus for content interaction
WO2016057844A1 (en) * 2014-10-09 2016-04-14 Thuuz, Inc. Customized generation of highlight show with narrative component

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2018053257A1 *

Also Published As

Publication number Publication date
EP3513566A1 (de) 2019-07-24
WO2018053257A1 (en) 2018-03-22

Similar Documents

Publication Publication Date Title
EP3513566A4 (de) Verfahren und systeme zur räumlich-zeitlichen mustererkennung für die entwicklung von videoinhalten
EP3532906A4 (de) Videomarkierungssystem und -verfahren
EP3473005A4 (de) Systeme und verfahren zur codierung von videoinhalten
EP3619914A4 (de) Vorrichtungen und verfahren zur videoverarbeitung
GB201719095D0 (en) Content tracking system and method
EP3253042A4 (de) Intelligentes verfahren und system zur videodatenverarbeitung
EP3270593A4 (de) Verfahren zur videosignalverarbeitung sowie vorrichtung dafür
EP3354038A4 (de) Systeme und verfahren zur videoverarbeitung
EP3246848A4 (de) Bilderkennungssystem und -verfahren
EP3533229A4 (de) Systeme und verfahren zur ergänzung von erfassten daten
EP3354016A4 (de) Systeme und verfahren zur videoverarbeitung
IL253762A0 (en) Video coding optimization method and system
EP3513563A4 (de) Verfahren und systeme zur videodatenverarbeitung
EP3685312A4 (de) Verfahren und system zur erkennung von bildinhalten
EP3432823A4 (de) Systeme und verfahren zum scannen von gesichtsmerkmalen
EP3482569A4 (de) Verfahren und systeme zur videoüberwachung
EP3355302A4 (de) Audioerkennungsverfahren und -system
EP3446488A4 (de) System und verfahren zur echtzeitsynchronisierung zu medieninhalt über mehreren vorrichtungen und lautsprechersysteme hinweg
EP3545673A4 (de) Verfahren und systeme mit mehreren kameras
EP3472796A4 (de) Geo-fencing-system und -verfahren
EP3185545A4 (de) Verfahren und system zur steuerung von videokonferenzen
EP3553739A4 (de) Bilderkennungssystem und bilderkennungsverfahren
EP3682642A4 (de) Systeme und verfahren zur herstellung von fragmentierten videoinhalten
EP3567526A4 (de) Verfahren und system zur codierung eines fingerabdrucks der dinge
EP3465487A4 (de) System und verfahren zur satzgerichteten videoobjektcodedetektion

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20190412

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20190809

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/44 20110101ALI20190805BHEP

Ipc: G06N 99/00 20190101ALI20190805BHEP

Ipc: H04N 21/45 20110101ALI20190805BHEP

Ipc: H04N 21/234 20110101ALI20190805BHEP

Ipc: H04N 21/4223 20110101ALI20190805BHEP

Ipc: H04N 21/434 20110101ALI20190805BHEP

Ipc: H04N 21/25 20110101ALI20190805BHEP

Ipc: H04N 21/466 20110101AFI20190805BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIN1 Information on inventor provided before grant (corrected)

Inventor name: HOLLINGSWORTH, NOEL

Inventor name: MAHESWARAN, RAJIV

Inventor name: CHANG, YU-HAN

Inventor name: SU, JEFFREY WAYNE

17Q First examination report despatched

Effective date: 20200706

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20200911