EP3513566A4 - Methods and systems of spatiotemporal pattern recognition for video content development - Google Patents

Methods and systems of spatiotemporal pattern recognition for video content development Download PDF

Info

Publication number
EP3513566A4
EP3513566A4 EP17851597.9A EP17851597A EP3513566A4 EP 3513566 A4 EP3513566 A4 EP 3513566A4 EP 17851597 A EP17851597 A EP 17851597A EP 3513566 A4 EP3513566 A4 EP 3513566A4
Authority
EP
European Patent Office
Prior art keywords
systems
methods
video content
pattern recognition
content development
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP17851597.9A
Other languages
German (de)
French (fr)
Other versions
EP3513566A1 (en
Inventor
Yu-Han Chang
Rajiv MAHESWARAN
Jeffrey Wayne Su
Noel Hollingsworth
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Second Spectrum Inc
Original Assignee
Second Spectrum Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US15/586,379 external-priority patent/US10521671B2/en
Application filed by Second Spectrum Inc filed Critical Second Spectrum Inc
Publication of EP3513566A1 publication Critical patent/EP3513566A1/en
Publication of EP3513566A4 publication Critical patent/EP3513566A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/10—Machine learning using kernel methods, e.g. support vector machines [SVM]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G06N20/20—Ensemble learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N7/00—Computing arrangements based on specific mathematical models
    • G06N7/01—Probabilistic graphical models, e.g. probabilistic networks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H04N21/4725—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content using interactive regions of the image, e.g. hot spots
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/783—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/44—Event detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Mathematical Physics (AREA)
  • Artificial Intelligence (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Medical Informatics (AREA)
  • Pure & Applied Mathematics (AREA)
  • Computational Mathematics (AREA)
  • Mathematical Optimization (AREA)
  • Algebra (AREA)
  • Probability & Statistics with Applications (AREA)
  • Mathematical Analysis (AREA)
  • Human Computer Interaction (AREA)
  • Image Analysis (AREA)
EP17851597.9A 2016-09-16 2017-09-15 Methods and systems of spatiotemporal pattern recognition for video content development Withdrawn EP3513566A4 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US201662395886P 2016-09-16 2016-09-16
US15/586,379 US10521671B2 (en) 2014-02-28 2017-05-04 Methods and systems of spatiotemporal pattern recognition for video content development
US201762532744P 2017-07-14 2017-07-14
PCT/US2017/051768 WO2018053257A1 (en) 2016-09-16 2017-09-15 Methods and systems of spatiotemporal pattern recognition for video content development

Publications (2)

Publication Number Publication Date
EP3513566A1 EP3513566A1 (en) 2019-07-24
EP3513566A4 true EP3513566A4 (en) 2019-09-11

Family

ID=61619742

Family Applications (1)

Application Number Title Priority Date Filing Date
EP17851597.9A Withdrawn EP3513566A4 (en) 2016-09-16 2017-09-15 Methods and systems of spatiotemporal pattern recognition for video content development

Country Status (2)

Country Link
EP (1) EP3513566A4 (en)
WO (1) WO2018053257A1 (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10769446B2 (en) 2014-02-28 2020-09-08 Second Spectrum, Inc. Methods and systems of combining video content with one or more augmentations
US10521671B2 (en) 2014-02-28 2019-12-31 Second Spectrum, Inc. Methods and systems of spatiotemporal pattern recognition for video content development
US10713494B2 (en) 2014-02-28 2020-07-14 Second Spectrum, Inc. Data processing systems and methods for generating and interactive user interfaces and interactive game systems based on spatiotemporal analysis of video content
US11120271B2 (en) 2014-02-28 2021-09-14 Second Spectrum, Inc. Data processing systems and methods for enhanced augmentation of interactive video content
US11861906B2 (en) 2014-02-28 2024-01-02 Genius Sports Ss, Llc Data processing systems and methods for enhanced augmentation of interactive video content
EP3619684A4 (en) 2017-05-04 2021-06-09 Second Spectrum, Inc. Method and apparatus for automatic intrinsic camera calibration using images of a planar calibration pattern
US10818033B2 (en) * 2018-01-18 2020-10-27 Oath Inc. Computer vision on broadcast video
US11294949B2 (en) * 2018-09-04 2022-04-05 Toyota Connected North America, Inc. Systems and methods for querying a distributed inventory of visual data
CN109600559B (en) * 2018-11-29 2021-07-23 北京字节跳动网络技术有限公司 Video special effect adding method and device, terminal equipment and storage medium
US10917702B2 (en) 2018-12-13 2021-02-09 At&T Intellectual Property I, L.P. Creating customized short-form content from long-form content
US11172248B2 (en) 2019-01-22 2021-11-09 Tempus Ex Machina, Inc. Systems and methods for customizing and compositing a video feed at a client device
US11140328B2 (en) * 2019-01-22 2021-10-05 Tempus Ex Machina, Inc. Systems and methods for partitioning a video feed to segment live player activity
CN113508419B (en) 2019-02-28 2024-09-13 斯塔特斯公司 System and method for generating athlete tracking data from broadcast video
CN111861605B (en) * 2019-04-28 2024-07-19 阿里巴巴集团控股有限公司 Service object recommendation method
US11514610B2 (en) * 2019-08-14 2022-11-29 Tencent America LLC Method and apparatus for point cloud coding
US11113535B2 (en) 2019-11-08 2021-09-07 Second Spectrum, Inc. Determining tactical relevance and similarity of video sequences
EP4085374A4 (en) * 2020-03-27 2024-01-17 Sportlogiq Inc. System and method for group activity recognition in images and videos with self-attention mechanisms
CN113038272B (en) * 2021-04-27 2021-09-28 武汉星巡智能科技有限公司 Method, device and equipment for automatically editing baby video and storage medium
CN117222959A (en) * 2021-04-27 2023-12-12 斯塔特斯公司 virtual guidance system
CN113506195B (en) * 2021-06-15 2024-03-08 深圳十方融海科技有限公司 Internet class management method, system, computer device and storage medium
CN115175005A (en) * 2022-06-08 2022-10-11 中央广播电视总台 Video processing method and device, electronic equipment and storage medium
CN116383669B (en) * 2023-03-18 2024-04-16 宝钢工程技术集团有限公司 Method and system for generating factory object position number identification through data
CN117649608B (en) * 2024-01-29 2024-03-29 阿坝州林业和草原科学技术研究所 Pine wood nematode disease identification system and method based on remote sensing monitoring
CN118470586A (en) * 2024-04-09 2024-08-09 中南大学 Shopping behavior identification method, system, equipment and medium for visual sales counter

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002071334A2 (en) * 2001-03-06 2002-09-12 Prozone Holdings Limited Sport analysis system and method
US20040017389A1 (en) * 2002-07-25 2004-01-29 Hao Pan Summarization of soccer video content
US20110013087A1 (en) * 2009-07-20 2011-01-20 Pvi Virtual Media Services, Llc Play Sequence Visualization and Analysis
US20150142716A1 (en) * 2013-11-15 2015-05-21 Disney Enterprises, Inc. Tracking player role using non-rigid formation priors
US20160080830A1 (en) * 2014-09-12 2016-03-17 Kiswe Mobile Inc. Methods and apparatus for content interaction
WO2016057844A1 (en) * 2014-10-09 2016-04-14 Thuuz, Inc. Customized generation of highlight show with narrative component

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6859496B1 (en) * 1998-05-29 2005-02-22 International Business Machines Corporation Adaptively encoding multiple streams of video data in parallel for multiplexing onto a constant bit rate channel
US20050146605A1 (en) * 2000-10-24 2005-07-07 Lipton Alan J. Video surveillance system employing video primitives
US7143083B2 (en) * 2001-06-12 2006-11-28 Lucent Technologies Inc. Method and apparatus for retrieving multimedia data through spatio-temporal activity maps
US10360685B2 (en) * 2007-05-24 2019-07-23 Pillar Vision Corporation Stereoscopic image capture with performance outcome prediction in sporting environments
JP4099973B2 (en) * 2001-10-30 2008-06-11 松下電器産業株式会社 Video data transmission method, video data reception method, and video surveillance system
US9740984B2 (en) * 2012-08-21 2017-08-22 Disney Enterprises, Inc. Characterizing motion patterns of one or more agents from spatiotemporal data
KR101341288B1 (en) * 2013-10-24 2013-12-12 사회복지법인 삼성생명공익재단 Quality assurance system and the method for radiotherapy apparatus
AU2015222869B2 (en) * 2014-02-28 2019-07-11 Genius Sports Ss, Llc System and method for performing spatio-temporal analysis of sporting events

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002071334A2 (en) * 2001-03-06 2002-09-12 Prozone Holdings Limited Sport analysis system and method
US20040017389A1 (en) * 2002-07-25 2004-01-29 Hao Pan Summarization of soccer video content
US20110013087A1 (en) * 2009-07-20 2011-01-20 Pvi Virtual Media Services, Llc Play Sequence Visualization and Analysis
US20150142716A1 (en) * 2013-11-15 2015-05-21 Disney Enterprises, Inc. Tracking player role using non-rigid formation priors
US20160080830A1 (en) * 2014-09-12 2016-03-17 Kiswe Mobile Inc. Methods and apparatus for content interaction
WO2016057844A1 (en) * 2014-10-09 2016-04-14 Thuuz, Inc. Customized generation of highlight show with narrative component

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of WO2018053257A1 *

Also Published As

Publication number Publication date
WO2018053257A1 (en) 2018-03-22
EP3513566A1 (en) 2019-07-24

Similar Documents

Publication Publication Date Title
EP3513566A4 (en) Methods and systems of spatiotemporal pattern recognition for video content development
EP3532906A4 (en) Video tagging system and method
EP3473005A4 (en) Systems and methods for encoding video content
GB201719095D0 (en) Content tracking system and method
EP3253042A4 (en) Intelligent processing method and system for video data
EP3270593A4 (en) Method of processing video signal and device for same
EP3533229A4 (en) Systems and methods for supplementing captured data
EP3167604A4 (en) Methods and systems of video processing
EP3354038A4 (en) Systems and methods for video processing
EP3513563A4 (en) Methods and systems for video processing
IL253762A0 (en) Method and system of video encoding optimization
EP3354016A4 (en) Systems and methods for video processing
EP3246848A4 (en) Image recognition system and method
EP3685312A4 (en) Method and system for image content recognition
EP3545673A4 (en) Methods and systems of multi-camera
EP3432823A4 (en) Systems and methods of facial feature scanning
EP3482569A4 (en) Methods and systems for video streaming
EP3446488A4 (en) System and method for real-time synchronization of media content via multiple devices and speaker systems
EP3355302A4 (en) Audio recognition method and system
EP3472796A4 (en) Geo-fencing system and method
EP3185545A4 (en) Video conference control method and system
EP3682642A4 (en) Systems and methods for production of fragmented video content
EP3553739A4 (en) Image recognition system and image recognition method
EP3567526A4 (en) Method and system for encoding fingerprint of things
EP3311562A4 (en) Methods and systems for video surveillance

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20190412

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20190809

RIC1 Information provided on ipc code assigned before grant

Ipc: H04N 21/44 20110101ALI20190805BHEP

Ipc: G06N 99/00 20190101ALI20190805BHEP

Ipc: H04N 21/45 20110101ALI20190805BHEP

Ipc: H04N 21/234 20110101ALI20190805BHEP

Ipc: H04N 21/4223 20110101ALI20190805BHEP

Ipc: H04N 21/434 20110101ALI20190805BHEP

Ipc: H04N 21/25 20110101ALI20190805BHEP

Ipc: H04N 21/466 20110101AFI20190805BHEP

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIN1 Information on inventor provided before grant (corrected)

Inventor name: HOLLINGSWORTH, NOEL

Inventor name: MAHESWARAN, RAJIV

Inventor name: CHANG, YU-HAN

Inventor name: SU, JEFFREY WAYNE

17Q First examination report despatched

Effective date: 20200706

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN WITHDRAWN

18W Application withdrawn

Effective date: 20200911