JP7033587B2 - 映像ハイライトを自動的に製作する方法及びシステム - Google Patents

映像ハイライトを自動的に製作する方法及びシステム Download PDF

Info

Publication number
JP7033587B2
JP7033587B2 JP2019518600A JP2019518600A JP7033587B2 JP 7033587 B2 JP7033587 B2 JP 7033587B2 JP 2019518600 A JP2019518600 A JP 2019518600A JP 2019518600 A JP2019518600 A JP 2019518600A JP 7033587 B2 JP7033587 B2 JP 7033587B2
Authority
JP
Japan
Prior art keywords
ground
raw input
highlight
player
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2019518600A
Other languages
English (en)
Japanese (ja)
Other versions
JP2019522948A (ja
Inventor
オズ，ガル
リーベルマン，ヨアフ
シャウリ，アビ
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Pixellot Ltd
Original Assignee
Pixellot Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Pixellot Ltd filed Critical Pixellot Ltd
Publication of JP2019522948A publication Critical patent/JP2019522948A/ja
Application granted granted Critical
Publication of JP7033587B2 publication Critical patent/JP7033587B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70—Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/73—Querying
    • G06F16/738—Presentation of query results
    • G06F16/739—Presentation of query results in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N20/00—Machine learning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/41—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items
    • G06V20/42—Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items of sport video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G06V20/47—Detecting features for summarising video content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/251—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4667—Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4668—Learning process for intelligent management, e.g. learning user preferences for recommending movies for recommending content, e.g. movies
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/44—Event detection

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Computational Linguistics (AREA)
  • Medical Informatics (AREA)
  • Evolutionary Computation (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Mathematical Physics (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Television Signal Processing For Recording (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
JP2019518600A 2016-06-20 2017-06-19 映像ハイライトを自動的に製作する方法及びシステム Active JP7033587B2 (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201662352026P 2016-06-20 2016-06-20
US62/352,026 2016-06-20
PCT/IL2017/050678 WO2017221239A2 (en) 2016-06-20 2017-06-19 Method and system for automatically producing video highlights

Publications (2)

Publication Number Publication Date
JP2019522948A JP2019522948A (ja) 2019-08-15
JP7033587B2 true JP7033587B2 (ja) 2022-03-10

Family

ID=60783387

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2019518600A Active JP7033587B2 (ja) 2016-06-20 2017-06-19 映像ハイライトを自動的に製作する方法及びシステム

Country Status (9)

Country Link
US (1) US10970554B2 (he)
EP (1) EP3473016B1 (he)
JP (1) JP7033587B2 (he)
CN (1) CN109691124B (he)
BR (1) BR112018076452A2 (he)
CA (1) CA3028328A1 (he)
IL (1) IL263851B (he)
MX (1) MX2018016323A (he)
WO (1) WO2017221239A2 (he)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6482263B1 (en) 2000-10-06 2002-11-19 Memc Electronic Materials, Inc. Heat shield assembly for crystal pulling apparatus

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2580937B (en) * 2019-01-31 2022-07-13 Sony Interactive Entertainment Europe Ltd Method and system for generating audio-visual content from video game footage
CN113508604B (zh) 2019-02-28 2023-10-31 斯塔特斯公司 从广播视频生成可跟踪视频帧的系统及方法
CN110012348B (zh) * 2019-06-04 2019-09-10 成都索贝数码科技股份有限公司 一种赛事节目自动集锦系统及方法
GB2587627B (en) * 2019-10-01 2023-05-03 Sony Interactive Entertainment Inc Apparatus and method for generating a recording
US11277461B2 (en) * 2019-12-18 2022-03-15 The Nielsen Company (Us), Llc Methods and apparatus to monitor streaming media
US11561610B2 (en) 2020-03-11 2023-01-24 Moea Technologies, Inc. Augmented audio conditioning system
DE102020117372A1 (de) * 2020-07-01 2022-01-05 SPORTTOTAL TECHNOLOGY GmbH Verfahren und System zur automatischen Analyse von Sportveranstaltungen
CN112291574B (zh) * 2020-09-17 2023-07-04 上海东方传媒技术有限公司 一种基于人工智能技术的大型体育赛事内容管理系统
CN112738557A (zh) * 2020-12-22 2021-04-30 上海哔哩哔哩科技有限公司 视频处理方法及装置
CN113569942B (zh) * 2021-07-26 2024-04-05 上海明略人工智能(集团)有限公司 短视频事件分类方法、系统、电子设备及存储介质
CN114011030A (zh) * 2021-11-29 2022-02-08 同济大学 一种智能透明篮板
EP4300978A1 (en) * 2022-07-01 2024-01-03 Genius Sports SS, LLC Automatic alignment of video streams

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007073349A1 (en) 2005-12-19 2007-06-28 Agency For Science, Technology And Research Method and system for event detection in a video stream
JP2009095013A (ja) 2007-09-24 2009-04-30 Fuji Xerox Co Ltd ビデオ要約システムおよびビデオ要約のためのコンピュータプログラム
US20140176708A1 (en) 2012-12-21 2014-06-26 Robert Bosch Gmbh System And Method For Detection Of High-Interest Events In Video Data

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7143354B2 (en) * 2001-06-04 2006-11-28 Sharp Laboratories Of America, Inc. Summarization of baseball video content
US7143352B2 (en) 2002-11-01 2006-11-28 Mitsubishi Electric Research Laboratories, Inc Blind summarization of video content
US7802188B2 (en) * 2004-05-13 2010-09-21 Hewlett-Packard Development Company, L.P. Method and apparatus for identifying selected portions of a video stream
JP2007060606A (ja) 2005-08-25 2007-03-08 Yoshiaki Ito ビデオの自動構造抽出・提供方式からなるコンピュータプログラム
US7558809B2 (en) 2006-01-06 2009-07-07 Mitsubishi Electric Research Laboratories, Inc. Task specific audio classification for identifying video highlights
CN100531352C (zh) * 2007-08-10 2009-08-19 西安交通大学 一种检测足球比赛视频精彩片段的方法
US7983442B2 (en) 2007-08-29 2011-07-19 Cyberlink Corp. Method and apparatus for determining highlight segments of sport video
CN101477633B (zh) * 2009-01-21 2010-08-25 北京大学 自动估计图像和视频的视觉显著度的方法
US8923607B1 (en) * 2010-12-08 2014-12-30 Google Inc. Learning sports highlights using event detection
CN102427507B (zh) * 2011-09-30 2014-03-05 北京航空航天大学 一种基于事件模型的足球视频集锦自动合成方法
US20140328570A1 (en) * 2013-01-09 2014-11-06 Sri International Identifying, describing, and sharing salient events in images and videos
US9805268B2 (en) * 2014-07-14 2017-10-31 Carnegie Mellon University System and method for processing a video stream to extract highlights
CN104123396B (zh) * 2014-08-15 2017-07-07 三星电子（中国）研发中心 一种基于云电视的足球视频摘要生成方法及装置
CN104199933B (zh) * 2014-09-04 2017-07-07 华中科技大学 一种多模态信息融合的足球视频事件检测与语义标注方法
US10572735B2 (en) * 2015-03-31 2020-02-25 Beijing Shunyuan Kaihua Technology Limited Detect sports video highlights for mobile computing devices
US11012719B2 (en) * 2016-03-08 2021-05-18 DISH Technologies L.L.C. Apparatus, systems and methods for control of sporting event presentation based on viewer engagement

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007073349A1 (en) 2005-12-19 2007-06-28 Agency For Science, Technology And Research Method and system for event detection in a video stream
JP2009095013A (ja) 2007-09-24 2009-04-30 Fuji Xerox Co Ltd ビデオ要約システムおよびビデオ要約のためのコンピュータプログラム
US20140176708A1 (en) 2012-12-21 2014-06-26 Robert Bosch Gmbh System And Method For Detection Of High-Interest Events In Video Data

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6482263B1 (en) 2000-10-06 2002-11-19 Memc Electronic Materials, Inc. Heat shield assembly for crystal pulling apparatus

Also Published As

Publication number Publication date
JP2019522948A (ja) 2019-08-15
EP3473016B1 (en) 2024-01-24
CA3028328A1 (en) 2017-12-28
EP3473016A2 (en) 2019-04-24
EP3473016A4 (en) 2020-02-26
IL263851B (he) 2021-08-31
US10970554B2 (en) 2021-04-06
WO2017221239A2 (en) 2017-12-28
BR112018076452A2 (pt) 2019-04-09
MX2018016323A (es) 2019-09-05
IL263851A (he) 2019-01-31
CN109691124B (zh) 2021-07-27
CN109691124A (zh) 2019-04-26
US20200311433A1 (en) 2020-10-01
WO2017221239A3 (en) 2018-02-08

Similar Documents

Publication Publication Date Title
JP7033587B2 (ja) 映像ハイライトを自動的に製作する方法及びシステム
US10987596B2 (en) Spectator audio analysis in online gaming environments
US20230381624A1 (en) Method and System for Interactive, Interpretable, and Improved Match and Player Performance Predictions in Team Sports
CN109145784B (zh) 用于处理视频的方法和装置
US10643492B2 (en) Remote multiplayer interactive physical gaming with mobile computing devices
US20230206731A1 (en) Systems and methods for generation of virtual sporting events
US9278288B2 (en) Automatic generation of a game replay video
US10293260B1 (en) Player audio analysis in online gaming environments
JP6673221B2 (ja) 情報処理装置、情報処理方法、およびプログラム
US10864447B1 (en) Highlight presentation interface in a game spectating system
KR20210025711A (ko) 게임 클립 인기 기반 제어 기법
CN104618446A (zh) 一种实现多媒体推送的方法和装置
CN110505519A (zh) 一种视频剪辑方法、电子设备及存储介质
US10363488B1 (en) Determining highlights in a game spectating system
US20220270004A1 (en) Micro-Level and Macro-Level Predictions in Sports
US20230338840A1 (en) Systems and methods for manipulation of outcomes for virtual sporting events
JP2018525675A (ja) 過去のブロードキャストテキストを用いてライブテキストブロードキャストコンテンツを生成する方法およびデバイス
JP7314605B2 (ja) 表示制御装置、表示制御方法及び表示制御プログラム
CN111147871A (zh) 直播间歌唱识别方法、装置及服务器、存储介质
GB2533924A (en) An apparatus, a method, a circuitry, a multimedia communication system and a computer program product for selecting field-of-view of interest
CN107133561A (zh) 事件处理方法和装置
WO2017087641A1 (en) Recognition of interesting events in immersive video
US20230116986A1 (en) System and Method for Generating Daily-Updated Rating of Individual Player Performance in Sports
CN113542774B (zh) 视频同步方法、装置、电子设备及存储介质
US10824866B2 (en) System, method, and apparatus for augmented reality implementation

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20200617

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20210528

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20210629

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20210929

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20220201

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20220228

R150 Certificate of patent or registration of utility model

Ref document number: 7033587

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150