BR112019005452A2 - arquitetura para aumentar dados de vídeo obtidos por um dispositivo cliente com um ou mais efeitos durante renderização - Google Patents

arquitetura para aumentar dados de vídeo obtidos por um dispositivo cliente com um ou mais efeitos durante renderização

Info

Publication number
BR112019005452A2
BR112019005452A2 BR112019005452A BR112019005452A BR112019005452A2 BR 112019005452 A2 BR112019005452 A2 BR 112019005452A2 BR 112019005452 A BR112019005452 A BR 112019005452A BR 112019005452 A BR112019005452 A BR 112019005452A BR 112019005452 A2 BR112019005452 A2 BR 112019005452A2
Authority
BR
Brazil
Prior art keywords
video data
captured
captured video
client device
metadata
Prior art date
Application number
BR112019005452A
Other languages
English (en)
Inventor
Todd Miller Colin
Germi Pique Corchs Hermes
A Pugin Kirill
Srinivasan Ragavan
Gabriel Racasanu Razvan
Original Assignee
Facebook Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Facebook Inc filed Critical Facebook Inc
Publication of BR112019005452A2 publication Critical patent/BR112019005452A2/pt

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H04N21/4355—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172—Classification, e.g. identification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/70—Media network packetisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/762—Media network packet handling at the source 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/764—Media network packet handling at the destination 
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
    • H04L65/60—Network streaming of media packets
    • H04L65/75—Media network packet handling
    • H04L65/765—Media network packet handling intermediate
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223—Cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/65—Transmission of management data between client and server
    • H04N21/658—Transmission by the client directed to the server
    • H04N21/6582—Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30196—Human being; Person
    • G06T2207/30201—Face
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Processing Or Creating Images (AREA)

Abstract

a presente divulgação refere-se a um aplicativo de efeitos de vídeo executado em um dispositivo cliente tendo um dispositivo de captura de imagem e recebe dados de vídeo capturados pelo dispositivo de captura de imagem. o aplicativo de efeitos de vídeo extrai informação a partir dos dados de vídeo capturados e armazena a informação extraída como metadados associados com os dados de vídeo capturados. por exemplo, o aplicativo de efeitos de vídeo identifica objetos nos dados de vídeo capturados ou identifica fluxo ótico dos dados de vídeo capturados e armazena os objetos identificados ou fluxo ótico identificado como metadados associados com os dados de vídeo capturados. o aplicativo de efeitos de vídeo armazena informações que descrevem modificações aos dados de vídeo capturados em associação com os dados de vídeo capturados. quando os dados de vídeo capturados são apresentados, os dados de vídeo capturados, metadados associados, e informação que descreve as modificações são comunicados a um renderizador, que usa os metadados para executar as modificações identificadas nos dados de vídeo capturados ao apresentar os dados de vídeo capturados.
BR112019005452A 2016-10-01 2017-09-28 arquitetura para aumentar dados de vídeo obtidos por um dispositivo cliente com um ou mais efeitos durante renderização BR112019005452A2 (pt)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/283,292 US10291678B2 (en) 2016-10-01 2016-10-01 Architecture for augmenting video data obtained by a client device with one or more effects during rendering
PCT/US2017/054197 WO2018064429A1 (en) 2016-10-01 2017-09-28 Architecture for augmenting video data obtained by a client device with one or more effects during rendering

Publications (1)

Publication Number Publication Date
BR112019005452A2 true BR112019005452A2 (pt) 2019-06-18

Family

ID=61759171

Family Applications (1)

Application Number Title Priority Date Filing Date
BR112019005452A BR112019005452A2 (pt) 2016-10-01 2017-09-28 arquitetura para aumentar dados de vídeo obtidos por um dispositivo cliente com um ou mais efeitos durante renderização

Country Status (11)

Country Link
US (2) US10291678B2 (pt)
EP (1) EP3360338A4 (pt)
JP (1) JP6630463B2 (pt)
KR (1) KR102155490B1 (pt)
CN (1) CN109792557B (pt)
AU (1) AU2017335976B2 (pt)
BR (1) BR112019005452A2 (pt)
CA (1) CA3037585C (pt)
IL (1) IL265184B (pt)
MX (1) MX2019003746A (pt)
WO (1) WO2018064429A1 (pt)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018194273A1 (en) * 2017-04-21 2018-10-25 Samsung Electronics Co., Ltd. Image display apparatus and method
US10848687B2 (en) * 2018-10-05 2020-11-24 Facebook, Inc. Modifying presentation of video data by a receiving client device based on analysis of the video data by another client device capturing the video data
US11347381B2 (en) * 2019-06-13 2022-05-31 International Business Machines Corporation Dynamic synchronized image text localization
US11481941B2 (en) 2020-08-03 2022-10-25 Google Llc Display responsive communication system and method
US11763496B2 (en) 2021-09-30 2023-09-19 Lemon Inc. Social networking based on asset items

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6016380A (en) * 1992-09-24 2000-01-18 Avid Technology, Inc. Template-based edit decision list management system
US20040133924A1 (en) * 2000-12-15 2004-07-08 Wilkins David C. Techniques for syncronizing any of a plurality of associated multimedia assets in a distributed system
KR100486709B1 (ko) * 2002-04-17 2005-05-03 삼성전자주식회사 객체기반 대화형 동영상 서비스 시스템 및 그 방법
US7212730B2 (en) * 2002-06-27 2007-05-01 International Business Machines Corporation System and method for enhanced edit list for recording options
JP2005130356A (ja) * 2003-10-27 2005-05-19 Matsushita Electric Ind Co Ltd テレビ電話システム及びその通信方法、並びに通信端末
CN102905166B (zh) * 2005-07-18 2014-12-31 汤姆森许可贸易公司 使用元数据来处理多个视频流的方法和设备
US8180826B2 (en) 2005-10-31 2012-05-15 Microsoft Corporation Media sharing and authoring on the web
US8214516B2 (en) * 2006-01-06 2012-07-03 Google Inc. Dynamic media serving infrastructure
WO2007103883A2 (en) * 2006-03-07 2007-09-13 Sony Computer Entertainment America Inc. Dynamic replacement and insertion of cinematic stage props in program content
US7873982B2 (en) * 2006-06-22 2011-01-18 Tivo Inc. Method and apparatus for creating and viewing customized multimedia segments
US8208762B1 (en) * 2008-08-12 2012-06-26 Adobe Systems Incorporated Optimizing the performance of an image editing system in a client-server environment
JP2010066844A (ja) * 2008-09-09 2010-03-25 Fujifilm Corp 動画コンテンツの加工方法及び装置、並びに動画コンテンツの加工プログラム
US9502073B2 (en) * 2010-03-08 2016-11-22 Magisto Ltd. System and method for semi-automatic video editing
US8520088B2 (en) 2010-05-25 2013-08-27 Intellectual Ventures Fund 83 Llc Storing a video summary as metadata
KR101763887B1 (ko) * 2011-01-07 2017-08-02 삼성전자주식회사 디바이스간 동기화된 인터랙션을 제공하는 콘텐츠 동기화 장치 및 방법
US9003289B2 (en) 2012-02-23 2015-04-07 Google Inc. Automatic detection of suggested video edits
KR101909030B1 (ko) * 2012-06-08 2018-10-17 엘지전자 주식회사 비디오 편집 방법 및 이를 위한 디지털 디바이스
KR101449838B1 (ko) * 2013-03-18 2014-10-13 그림소프트 주식회사 멀티미디어 콘텐츠 시공간 정보 획득 시스템 및 방법
US9467750B2 (en) 2013-05-31 2016-10-11 Adobe Systems Incorporated Placing unobtrusive overlays in video content
US20180011627A1 (en) * 2014-06-16 2018-01-11 Siracusano Meeting collaboration systems, devices, and methods
US9811933B2 (en) * 2014-06-20 2017-11-07 Google Inc. Image editing using selective editing tools
CN105100869B (zh) * 2015-07-13 2018-09-04 腾讯科技（深圳）有限公司 弹幕显示方法及装置
WO2017077751A1 (ja) * 2015-11-04 2017-05-11 ソニー株式会社 情報処理装置、情報処理方法およびプログラム

Also Published As

Publication number Publication date
IL265184A (en) 2019-05-30
CA3037585A1 (en) 2018-04-05
CN109792557B (zh) 2020-06-16
CA3037585C (en) 2019-11-12
JP2019537298A (ja) 2019-12-19
US20190238610A1 (en) 2019-08-01
WO2018064429A1 (en) 2018-04-05
MX2019003746A (es) 2019-08-12
JP6630463B2 (ja) 2020-01-15
AU2017335976A1 (en) 2019-04-11
KR102155490B1 (ko) 2020-09-14
AU2017335976B2 (en) 2019-05-02
US20180097866A1 (en) 2018-04-05
EP3360338A4 (en) 2019-03-27
EP3360338A1 (en) 2018-08-15
US10977847B2 (en) 2021-04-13
IL265184B (en) 2019-10-31
KR20190039617A (ko) 2019-04-12
CN109792557A (zh) 2019-05-21
US10291678B2 (en) 2019-05-14

Similar Documents

Publication Publication Date Title
BR112019005452A2 (pt) arquitetura para aumentar dados de vídeo obtidos por um dispositivo cliente com um ou mais efeitos durante renderização
BR112016006733A2 (pt) método e aparelho para processamento de vídeo de vigilância
MX2019006588A (es) Sistema y metodo de busqueda por apariencia.
BR112020025390A8 (pt) Sistemas e métodos para treinamento de redes adversárias generativas e uso de redes adversárias generativas treinadas
BR112018073956A2 (pt) sinalização avançada de uma região mais interessada em uma imagem
BR112014011739A2 (pt) método de geração de etiqueta automática e meio legível por computador
WO2015200110A3 (en) Techniques for machine language translation of text from an image based on non-textual context information from the image
BR112018077294A2 (pt) sistemas e métodos para identificação de conteúdo correspondente
BR112017016123A2 (pt) servidor de correspondência para identificação de conteúdo de vídeo que é exibido por um sistema de televisão, método executado por computador, e produto de programa informático concretamente incorporado a um meio de armazenamento de leitura por máquina permanente de um dispositivo de informática
BR112015010384A2 (pt) técnicas de estabilização de imagem para sistemas de vigilância por vídeo
BR112015023345A2 (pt) criação in situ de alvos planos de recurso natural
BR112018006327A2 (pt) sistema e método para usar um símbolo como instrução para iniciar a transferência de informação de identidade autenticada a um sistema alvo
BR112015022788A2 (pt) sistema de determinação de emoção de contexto
BR112015020989A2 (pt) dispositivo de identificação de objeto-alvo, método de identificação de objeto-alvo e programa de identificação de objeto-alvo
BR112016002303A2 (pt) método e dispositivo de gravação de vídeo
BR112015022493A2 (pt) sistema de determinação de contexto demográfico
BR112015025878A2 (pt) método, cliente, servidor e sistema para interação de áudio e video de múltiplas pessoas
BR112013024048A2 (pt) reconhecimento de face com base na proximidade espacial e temporal
EP2833294A3 (en) Device to extract biometric feature vector, method to extract biometric feature vector and program to extract biometric feature vector
BR112017005648A2 (pt) rastreamento de olhar através de óculos
BR112013018142A2 (pt) sistema e método para reconhecimento de itens em dados de mídia e distribuição de informações relacionadas a estes
BR112015018205A2 (pt) método e dispositivo para a formação de modelo de linguagem acústica
BR112019002636A2 (pt) aparelho de processamento de informação, sistema de reconhecimento de fala e método de processamento de informação
BR112014007472A2 (pt) recuperação de imagens
WO2013088637A3 (en) Information processing device, information processing method and program

Legal Events

Date Code Title Description
B11A Dismissal acc. art.33 of ipl - examination not requested within 36 months of filing
B11Y Definitive dismissal - extension of time limit for request of examination expired [chapter 11.1.1 patent gazette]
B350 Update of information on the portal [chapter 15.35 patent gazette]