AR113355A1 - Método y aparato para la entrega y uso eficientes de mensajes de audio para una gran calidad de experiencia - Google Patents

Método y aparato para la entrega y uso eficientes de mensajes de audio para una gran calidad de experiencia

Info

Publication number
AR113355A1
AR113355A1 ARP180102984A ARP180102984A AR113355A1 AR 113355 A1 AR113355 A1 AR 113355A1 AR P180102984 A ARP180102984 A AR P180102984A AR P180102984 A ARP180102984 A AR P180102984A AR 113355 A1 AR113355 A1 AR 113355A1
Authority
AR
Argentina
Prior art keywords
audio
video
reproduced
stream
scene
Prior art date
Application number
ARP180102984A
Other languages
English (en)
Original Assignee
Fraunhofer Ges Forschung
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fraunhofer Ges Forschung filed Critical Fraunhofer Ges Forschung
Publication of AR113355A1 publication Critical patent/AR113355A1/es

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/167—Position within a video image, e.g. region of interest [ROI]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234309—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234318—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by decomposing into objects, e.g. MPEG-4 objects
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H04N21/2353—Processing of additional data, e.g. scrambling of additional data or processing content descriptors specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44213—Monitoring of end-user related data
    • H04N21/44218—Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8106—Monomedia components thereof involving special audio data, e.g. different tracks for different languages
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Abstract

Se describe un método y un sistema para un entorno de realidad virtual, VR, realidad aumentada, AR, realidad mixta, MR o video de 360 grados. El sistema puede estar configurado para: recibir por lo menos un Flujo de Video (106) asociado a una escena de audio y video que se ha de reproducir y recibir por lo menos un primer Flujo de Audio (116, 316) asociado a la escena de audio y video que se ha de reproducir, donde el sistema comprende: por lo menos un decodificador de video de medios (102) configurado para decodificar por lo menos una serial de video a partir de dicho por lo menos un Flujo de Video (106) para la representación de la escena de audio y video a un usuario y por lo menos un decodificador de audio de medios (112) configurado para decodificar por lo menos una señal de Audio a partir de dicho por lo menos un primer Flujo de Audio (116, 316) para la representación de la escena de audio y video al usuario; un procesador de regiones de interés, ROI (120), configurado para: decidir, basándose por lo menos en los datos de la ventana de visualización actual del usuario, y/o de la orientación y/o movimiento de la cabeza (122) y/o metadatos de la ventana de visualización (131) y/o metadatos de mensajes de información de audio (141), si un mensaje de información de audio asociado a la por lo menos una ROI debe ser reproducido o no, donde el mensaje de información de audio es independiente de dicha por lo menos una señal de video y dicha por lo menos una señal de Audio y causar, ante la decisión de que se debe reproducir el mensaje de información, la reproducción del mensaje de información de Audio.
ARP180102984A 2017-10-12 2018-10-12 Método y aparato para la entrega y uso eficientes de mensajes de audio para una gran calidad de experiencia AR113355A1 (es)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
EP17196255.8A EP3470976A1 (en) 2017-10-12 2017-10-12 Method and apparatus for efficient delivery and usage of audio messages for high quality of experience

Publications (1)

Publication Number Publication Date
AR113355A1 true AR113355A1 (es) 2020-04-22

Family

ID=60191106

Family Applications (3)

Application Number Title Priority Date Filing Date
ARP180102984A AR113355A1 (es) 2017-10-12 2018-10-12 Método y aparato para la entrega y uso eficientes de mensajes de audio para una gran calidad de experiencia
ARP220100070A AR124649A2 (es) 2017-10-12 2022-01-14 Sistema de dispositivos de consumo de contenidos y método para un entorno de realidad virtual, vr, realidad aumentada, ar, realidad mixta, mr o video de 360 grados
ARP220100074A AR127089A2 (es) 2017-10-12 2022-01-14 Método y aparato para entrega y uso eficiente de mensajes de audio para calidad alta de experiencia

Family Applications After (2)

Application Number Title Priority Date Filing Date
ARP220100070A AR124649A2 (es) 2017-10-12 2022-01-14 Sistema de dispositivos de consumo de contenidos y método para un entorno de realidad virtual, vr, realidad aumentada, ar, realidad mixta, mr o video de 360 grados
ARP220100074A AR127089A2 (es) 2017-10-12 2022-01-14 Método y aparato para entrega y uso eficiente de mensajes de audio para calidad alta de experiencia

Country Status (18)

Country Link
US (3) US11006181B2 (es)
EP (3) EP3470976A1 (es)
JP (3) JP7072649B2 (es)
KR (2) KR20230112147A (es)
CN (6) CN117596422A (es)
AR (3) AR113355A1 (es)
AU (3) AU2018348713B2 (es)
BR (1) BR112020007617A2 (es)
CA (6) CA3227598A1 (es)
ES (1) ES2892407T3 (es)
MX (1) MX2020003453A (es)
PL (1) PL3695306T3 (es)
PT (1) PT3695306T (es)
RU (1) RU2744969C1 (es)
SG (2) SG11202003222QA (es)
TW (1) TWI701945B (es)
WO (1) WO2019072890A1 (es)
ZA (7) ZA202002059B (es)

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115243075A (zh) * 2014-10-10 2022-10-25 索尼公司 再现装置和再现方法
EP3470976A1 (en) * 2017-10-12 2019-04-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and apparatus for efficient delivery and usage of audio messages for high quality of experience
RU2762400C1 (ru) 2018-02-22 2021-12-21 Долби Интернешнл Аб Способ и устройство обработки вспомогательных потоков медиаданных, встроенных в поток mpeg-h 3d audio
JP7047095B2 (ja) * 2018-02-27 2022-04-04 エルジー エレクトロニクス インコーポレイティド カメラレンズ情報を含む３６０°ビデオを送受信する方法及びその装置
US11967330B2 (en) 2019-08-15 2024-04-23 Dolby International Ab Methods and devices for generation and processing of modified audio bitstreams
KR20220047816A (ko) * 2019-08-15 2022-04-19 돌비 레버러토리즈 라이쎈싱 코오포레이션 수정된 비트스트림들의 생성 및 처리를 위한 방법들 및 디바이스들
WO2021075407A1 (en) * 2019-10-17 2021-04-22 Sharp Kabushiki Kaisha Systems and methods for enabling interactivity for actionable locations in omnidirectional media
US11816757B1 (en) * 2019-12-11 2023-11-14 Meta Platforms Technologies, Llc Device-side capture of data representative of an artificial reality environment
WO2022059858A1 (en) * 2020-09-16 2022-03-24 Samsung Electronics Co., Ltd. Method and system to generate 3d audio from audio-visual multimedia content
CN114051194A (zh) * 2021-10-15 2022-02-15 赛因芯微(北京)电子科技有限公司 一种音频轨道元数据和生成方法、电子设备及存储介质
CN114900506B (zh) * 2022-07-12 2022-09-30 中国科学技术大学 面向用户体验质量的360度视频视口预测方法

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4208533B2 (ja) * 2002-09-19 2009-01-14 キヤノン株式会社 画像処理装置及び画像処理方法
JP4656481B2 (ja) * 2003-09-08 2011-03-23 日本テレビ放送網株式会社 録画再生装置、受信装置及び制御方法と制御プログラム
US7876903B2 (en) * 2006-07-07 2011-01-25 Harris Corporation Method and apparatus for creating a multi-dimensional communication space for use in a binaural audio system
US10440329B2 (en) * 2009-05-22 2019-10-08 Immersive Media Company Hybrid media viewing application including a region of interest within a wide field of view
KR101842411B1 (ko) * 2009-08-14 2018-03-26 디티에스 엘엘씨 오디오 객체들을 적응적으로 스트리밍하기 위한 시스템
RU2595628C2 (ru) * 2010-10-19 2016-08-27 Конинклейке Филипс Электроникс Н.В. Система медицинской визуализации
TW202339510A (zh) * 2011-07-01 2023-10-01 美商杜比實驗室特許公司 用於適應性音頻信號的產生、譯碼與呈現之系統與方法
CA2750287C (en) 2011-08-29 2012-07-03 Microsoft Corporation Gaze detection in a see-through, near-eye, mixed reality display
US20130259312A1 (en) * 2011-09-08 2013-10-03 Kenton M. Lyons Eye Gaze Based Location Selection for Audio Visual Playback
KR20140066258A (ko) 2011-09-26 2014-05-30 마이크로소프트 코포레이션 투시 근안 디스플레이에 대한 센서 입력에 기초한 비디오 디스플레이 수정
JP6407717B2 (ja) * 2011-09-27 2018-10-17 コーニンクレッカ フィリップス エヌ ヴェＫｏｎｉｎｋｌｉｊｋｅ Ｐｈｉｌｉｐｓ Ｎ．Ｖ． 画像のダイナミックレンジ変換のための装置及び方法
US8935057B2 (en) * 2012-01-17 2015-01-13 LimnTech LLC Roadway mark data acquisition and analysis apparatus, systems, and methods
US8964040B2 (en) * 2012-06-06 2015-02-24 Apple Inc. High dynamic range image registration using motion sensor data
GB2504068B (en) * 2012-07-11 2015-03-11 Canon Kk Methods and devices for controlling spatial access granularity in compressed video streams
US9754167B1 (en) * 2014-04-17 2017-09-05 Leap Motion, Inc. Safety for wearable virtual reality devices via object detection and tracking
EP3037915B1 (en) * 2014-12-23 2017-08-16 Nokia Technologies OY Virtual reality content control
US11245939B2 (en) * 2015-06-26 2022-02-08 Samsung Electronics Co., Ltd. Generating and transmitting metadata for virtual reality
WO2017112520A1 (en) 2015-12-22 2017-06-29 Skreens Entertainment Technologies, Inc. Video display system
EP3470976A1 (en) * 2017-10-12 2019-04-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method and apparatus for efficient delivery and usage of audio messages for high quality of experience
US20180140918A1 (en) * 2016-11-21 2018-05-24 Julie Bilbrey System for using vr glasses in sports

Also Published As

Publication number Publication date
ZA202208716B (en) 2023-03-29
JP7072649B2 (ja) 2022-05-20
CN117714733A (zh) 2024-03-15
AU2023274169A1 (en) 2023-12-21
US11617016B2 (en) 2023-03-28
CA3227626A1 (en) 2019-04-18
ZA202208713B (en) 2023-03-29
ZA202208714B (en) 2023-03-29
US11006181B2 (en) 2021-05-11
CN117692673A (zh) 2024-03-12
EP3695306B1 (en) 2021-08-18
ES2892407T3 (es) 2022-02-04
US20230370684A1 (en) 2023-11-16
CA3227600A1 (en) 2019-04-18
US11949957B2 (en) 2024-04-02
US20210306683A1 (en) 2021-09-30
SG11202003222QA (en) 2020-05-28
CA3227601A1 (en) 2019-04-18
TWI701945B (zh) 2020-08-11
AU2018348713B2 (en) 2023-09-28
JP2020537248A (ja) 2020-12-17
SG10202113080PA (en) 2021-12-30
ZA202208737B (en) 2023-03-29
AR127089A2 (es) 2023-12-20
ZA202106705B (en) 2022-07-27
EP3937003A3 (en) 2022-01-26
BR112020007617A2 (pt) 2020-09-29
US20200245032A1 (en) 2020-07-30
CN111542806A (zh) 2020-08-14
AR124649A2 (es) 2023-04-19
ZA202002059B (en) 2023-05-31
RU2744969C1 (ru) 2021-03-17
JP2022106944A (ja) 2022-07-20
AU2018348713A1 (en) 2020-05-07
PT3695306T (pt) 2021-11-23
ZA202208717B (en) 2023-02-22
KR102551081B1 (ko) 2023-07-05
TW201924355A (zh) 2019-06-16
CN111542806B (zh) 2023-11-28
KR20230112147A (ko) 2023-07-26
EP3937003A2 (en) 2022-01-12
CN117640983A (zh) 2024-03-01
AU2023208129A1 (en) 2023-08-17
EP3695306A1 (en) 2020-08-19
CA3227621A1 (en) 2019-04-18
CN117596422A (zh) 2024-02-23
CA3227598A1 (en) 2019-04-18
KR20200068705A (ko) 2020-06-15
JP2024041909A (ja) 2024-03-27
EP3470976A1 (en) 2019-04-17
WO2019072890A1 (en) 2019-04-18
WO2019072890A9 (en) 2020-02-27
CN117579857A (zh) 2024-02-20
MX2020003453A (es) 2020-08-03
CA3083039A1 (en) 2019-04-18
JP7421594B2 (ja) 2024-01-24
PL3695306T3 (pl) 2022-01-10

Similar Documents

Publication Publication Date Title
AR113355A1 (es) Método y aparato para la entrega y uso eficientes de mensajes de audio para una gran calidad de experiencia
AR125884A2 (es) Optimización de difusión de audio para aplicaciones de realidad virtual
ES2719586T3 (es) Creación de puntos de referencia en un flujo multimedia con reconocimiento de contenido automatizado
WO2018160976A3 (en) Coding mcts-nested sei messages
RU2011106942A (ru) Обработка 3d отображения субтитров
US11178377B2 (en) Methods and apparatus for spherical region presentation
MX2020010475A (es) Metadatos de puntos de vista para video omnidireccional.
JP2011529286A5 (es)
US11205456B2 (en) Methods and apparatus for using edit operations to perform temporal track derivations
BR112015004474A2 (pt) método, dispositivo e sistema de gravação de videoconferência
GB2556818A (en) Methods, systems, and media for presenting interactive elements within video content
JP5717629B2 (ja) デジタル映画のための動的表示のための方法および装置
US11508127B2 (en) Capturing augmented reality on a head mounted display
CA2861471C (en) Secure system and method for audio processing
KR102580592B1 (ko) 수어 자막을 포함하는 방송 신호를 제공하는 방법 및 방송 신호 송수신 장치
宁彦铭 Cross-border Movements in Mulholland Drive
Sánchez et al. Cinema and literature in medical education
JP2015065694A (ja) デジタル映画のための動的表示のための方法および装置
Parkes Falling Victim to Consumer Culture: The Commodification of Bodies in'Smart'Films.
Mac Dermott The Audience of Wolves
Beebe ON" ARTISTS'CINEMA" AND" MOVING-IMAGE ART".
TWM469561U (zh) 廣告系統
Goldsmith Engineering Techniques in Motion Pictures and Television
TW201506822A (zh) 廣告系統

Legal Events

Date Code Title Description
FG Grant, registration