BR112021026664A2 - Corte de vídeo automatizado usando importância relativa de objetos identificados - Google Patents

Corte de vídeo automatizado usando importância relativa de objetos identificados

Info

Publication number
BR112021026664A2
BR112021026664A2 BR112021026664A BR112021026664A BR112021026664A2 BR 112021026664 A2 BR112021026664 A2 BR 112021026664A2 BR 112021026664 A BR112021026664 A BR 112021026664A BR 112021026664 A BR112021026664 A BR 112021026664A BR 112021026664 A2 BR112021026664 A2 BR 112021026664A2
Authority
BR
Brazil
Prior art keywords
video
relative importance
video scene
identified objects
cut
Prior art date
Application number
BR112021026664A
Other languages
English (en)
Inventor
Dilipkumar Kansara Apurvakumar
Arica Westadt
Kunal Bisla
Sameer Shah
Sanford Holsapple
Original Assignee
Netflix Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Netflix Inc filed Critical Netflix Inc
Publication of BR112021026664A2 publication Critical patent/BR112021026664A2/pt

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25825—Management of client data involving client display capabilities, e.g. screen resolution of a mobile phone
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/20—Image preprocessing
    • G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/46—Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/40—Scenes; Scene-specific elements in video content
    • G06V20/49—Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/387—Composing, repositioning or otherwise geometrically modifying originals
    • H04N1/3872—Repositioning or masking
    • H04N1/3873—Repositioning or masking defined only by a limited number of coordinate points or parameters, e.g. corners, centre; for trimming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234345—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H04N21/234372—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution for performing aspect ratio conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/23439—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements for generating different versions
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4318—Generation of visual interfaces for content selection or interaction; Content or additional data rendering by altering the content in the rendering process, e.g. blanking, blurring or masking an image region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4854—End-user interface for client configuration for modifying image parameters, e.g. image brightness, contrast
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/485—End-user interface for client configuration
    • H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Graphics (AREA)
  • Computing Systems (AREA)
  • Television Signal Processing For Recording (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)

Abstract

corte de vídeo automatizado usando importância relativa de objetos identificados. o método implementado por computador divulgado pode incluir receber, como uma entrada, cenas de vídeo segmentadas, onde cada cena de vídeo inclui um comprimento especificado de conteúdo de vídeo. o método pode incluir ainda varrer as cenas de vídeo para identificar objetos dentro da cena de vídeo e também determinar um valor de importância relativa para os objetos identificados. o valor de importância relativa pode incluir uma indicação de quais objetos devem ser incluídos em uma versão cortada da cena de vídeo. o método também pode incluir gerar um corte de vídeo que deve ser aplicado à cena de vídeo de modo que a versão cortada resultante da cena de vídeo inclua aqueles objetos identificados que devem ser incluídos com base no valor de importância relativa. o método também pode incluir aplicar o corte de vídeo gerado à cena de vídeo para produzir a versão cortada da cena de vídeo. vários outros métodos, sistemas e meios legíveis por computador também são divulgados.
BR112021026664A 2019-06-28 2020-06-17 Corte de vídeo automatizado usando importância relativa de objetos identificados BR112021026664A2 (pt)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/457,586 US10834465B1 (en) 2019-06-28 2019-06-28 Automated video cropping
PCT/US2020/038174 WO2020263655A1 (en) 2019-06-28 2020-06-17 Automated video cropping using relative importance of identified objects

Publications (1)

Publication Number Publication Date
BR112021026664A2 true BR112021026664A2 (pt) 2022-02-15

Family

ID=71465454

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112021026664A BR112021026664A2 (pt) 2019-06-28 2020-06-17 Corte de vídeo automatizado usando importância relativa de objetos identificados

Country Status (7)

Country Link
US (4) US10834465B1 (pt)
EP (1) EP3991439A1 (pt)
AU (2) AU2020304345B2 (pt)
BR (1) BR112021026664A2 (pt)
CA (1) CA3138218A1 (pt)
MX (1) MX2021014808A (pt)
WO (1) WO2020263655A1 (pt)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109074656B (zh) * 2016-04-28 2022-08-23 松下知识产权经营株式会社 运动视频分割方法、运动视频分割装置以及运动视频处理系统
US20230206636A1 (en) * 2020-05-27 2023-06-29 Nec Corporation Video processing device, video processing method, and recording medium
WO2022145929A1 (en) 2020-12-28 2022-07-07 Samsung Electronics Co., Ltd. System and method for automatic video reconstruction with dynamic point of interest
US11381853B1 (en) 2021-01-28 2022-07-05 Meta Platforms, Inc. Systems and methods for generating and distributing content for consumption surfaces
WO2023031890A1 (en) * 2021-09-05 2023-03-09 Sharma Brahmadev Context based adaptable video cropping
CN114827746B (zh) * 2022-03-30 2024-05-10 神力视界(深圳)文化科技有限公司 视频播放控制方法、装置、电子设备、介质及程序产品
CN117336571A (zh) * 2022-06-24 2024-01-02 华为技术有限公司 视频处理方法及相关设备
US20240029294A1 (en) * 2022-07-21 2024-01-25 Shopify Inc. Defining focal regions of images based on image metadata

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
RU2012119843A (ru) * 2012-05-15 2013-11-20 Общество с ограниченной ответственностью "Синезис" Способ отображения видеоданных на мобильном устройстве
KR101990089B1 (ko) * 2012-10-16 2019-06-17 삼성전자주식회사 썸네일 이미지를 생성하기 위한 방법 및 그 전자 장치
EP3413263A1 (en) * 2013-09-18 2018-12-12 Intel Corporation Automated image cropping and sharing
US20150319506A1 (en) * 2014-04-30 2015-11-05 Netflix, Inc. Displaying data associated with a program based on automatic recognition
US10445593B1 (en) * 2016-06-27 2019-10-15 Amazon Technologies, Inc. User interface for acquisition of group data
CN109716769B (zh) * 2016-07-18 2023-09-05 格莱德通讯有限公司 在多媒体信息中提供面向对象的缩放的系统和方法
US10386999B2 (en) * 2016-10-26 2019-08-20 Google Llc Timeline-video relationship presentation for alert events
WO2018106213A1 (en) * 2016-12-05 2018-06-14 Google Llc Method for converting landscape video to portrait mobile layout
JP6862164B2 (ja) * 2016-12-09 2021-04-21 キヤノン株式会社 プログラム、画像処理装置、および画像処理方法
US10825480B2 (en) * 2017-05-31 2020-11-03 Apple Inc. Automatic processing of double-system recording
JP7024308B2 (ja) * 2017-10-13 2022-02-24 セイコーエプソン株式会社 表示装置、表示方法および表示プログラム
US10628961B2 (en) * 2017-10-13 2020-04-21 Qualcomm Incorporated Object tracking for neural network systems
US11023707B2 (en) * 2017-10-27 2021-06-01 Avigilon Corporation System and method for selecting a part of a video image for a face detection operation
EP3698540A1 (en) * 2017-12-05 2020-08-26 Google LLC Method for converting landscape video to portrait mobile layout using a selection interface
US10635844B1 (en) * 2018-02-27 2020-04-28 The Mathworks, Inc. Methods and systems for simulating vision sensor detection at medium fidelity

Also Published As

Publication number Publication date
US20210021900A1 (en) 2021-01-21
AU2020304345B2 (en) 2023-02-09
US11700404B2 (en) 2023-07-11
CA3138218A1 (en) 2020-12-30
US20230059805A1 (en) 2023-02-23
US10834465B1 (en) 2020-11-10
AU2020304345A1 (en) 2021-12-23
WO2020263655A1 (en) 2020-12-30
EP3991439A1 (en) 2022-05-04
US20230300392A1 (en) 2023-09-21
AU2023202133B2 (en) 2023-05-18
US11477533B2 (en) 2022-10-18
MX2021014808A (es) 2022-01-18
AU2023202133A1 (en) 2023-05-04

Similar Documents

Publication Publication Date Title
BR112021026664A2 (pt) Corte de vídeo automatizado usando importância relativa de objetos identificados
BR112018077230A2 (pt) sistemas e métodos para identificar conteúdo correspondente
GB2561746A8 (en) Video sensor fusion and model based virtual and augmented reality systems and methods
BR112016029787A8 (pt) faixas de valor para elementos de sintaxe em criptografia de vídeo
BR112021018802A2 (pt) Sistemas e métodos para enxames de multimídia
BR112016014387A2 (pt) Sistemas, métodos e aparelho para composição e/ou recuperação digital
BR112014030215A2 (pt) métodos e aparelhos para determinar informação de notações para apresentações de mídia online
BR112017012637A2 (pt) método para exibir características termográficas em uma difusão, e, sistema para exibir características termográficas e efeitos em uma difusão
MX2021009703A (es) Metodos y sistemas para el anclaje basado en token de un objeto fisico en un entorno de libro mayor distribuido.
EP3846086A4 (en) Patent document creating device, method, computer program, computer-readable recording medium, server and system
BR112018000241A2 (pt) modelo de recursos de rede para suportar gerenciamento de ciclo de vida de virtualização de função de rede
BR112015029994A2 (pt) aparelho e método para exibição de um guia de programação
WO2016109682A3 (en) Broadcast profiling system
BR112018006098A2 (pt) sistemas e métodos para processamento de vídeo
BRPI0507539A (pt) sistema e método para gerenciamentos de visualização estereoscópica
BR112019024653A2 (pt) sinalização de alto nível para dados de vídeo fisheye
BR112017002076A8 (pt) Sistema e método para processo comandado por significado e gerenciamento de informação para melhoria da eficiência, da qualidade de trabalho e da satisfação do consumidor em geral
WO2016025623A3 (en) Image linking and sharing
BR112017025681A2 (pt) sistema e método para um servidor do sistema de criação de website
BR112021021669A2 (pt) Método e aparelho para processar dados de vídeo, e, mídias de armazenamento e de gravação legíveis por computador não transitórias
BR112015019056A2 (pt) sistemas e métodos para realização de controle de ganho
GB2553237A (en) Pre-fetched encoding for application streaming
BR112017028239A2 (pt) unidade eletrônica e método executado em uma tal unidade eletrônica
EP3876526A4 (en) INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING DEVICE, SERVER DEVICE, PROGRAM AND METHOD
EP2819026A3 (en) Method and apparatus for generating a journal