MX391360B - Un aparato y métodos asociados - Google Patents

Un aparato y métodos asociados

Info

Publication number
MX391360B
MX391360B MX2018016336A MX2018016336A MX391360B MX 391360 B MX391360 B MX 391360B MX 2018016336 A MX2018016336 A MX 2018016336A MX 2018016336 A MX2018016336 A MX 2018016336A MX 391360 B MX391360 B MX 391360B
Authority
MX
Mexico
Prior art keywords
event
viewing direction
visual
virtual reality
audio
Prior art date
Application number
MX2018016336A
Other languages
English (en)
Other versions
MX2018016336A (es
Inventor
Antti Eronen
Arto Lehtiniemi
Jussi Leppänen
Veli - Matti Kolmonen
Original Assignee
Nokia Technologies Oy
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Nokia Technologies Oy filed Critical Nokia Technologies Oy
Publication of MX2018016336A publication Critical patent/MX2018016336A/es
Publication of MX391360B publication Critical patent/MX391360B/es

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/25—Output arrangements for video game devices
    • A63F13/26—Output arrangements for video game devices having at least one additional display device, e.g. on the game controller or outside a game booth
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • H04N21/4438—Window management, e.g. event handling following interaction with the user interface
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/45—Controlling the progress of the video game
    • A63F13/49—Saving the game status; Pausing or ending the game
    • A63F13/497—Partially or entirely replaying previous game actions
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/537—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
    • A63F13/5375—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/54—Controlling the output signals based on the game progress involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60—Methods for processing data by generating or executing the game program
    • A63F2300/66—Methods for processing data by generating or executing the game program for rendering three dimensional images
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Optics & Photonics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Graphics (AREA)
  • Databases & Information Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

Un aparato configurado para: con respecto al contenido de realidad virtual que comprende imágenes de video y audio espacial en el que la dirección percibida de un evento de audio relacionado con un evento visual en las imágenes de video corresponde a una localización visual de dicho evento visual tal como se presenta en el espacio de realidad virtual; basándose en un cambio en la dirección de visualización de la vista de realidad virtual por el usuario desde una primera dirección de visualización a una segunda dirección de visualización, y en el que dicha segunda dirección de visualización corresponde, dentro de un umbral de dirección, a una dirección de un evento de audio específico; proporcionar la visualización del contenido de eventos perdidos, permitiendo de este modo al usuario ver un evento visual perdido para el que escuchó el evento de audio asociado y reaccionó al mismo cambiando la dirección de visualización.
MX2018016336A 2016-06-27 2017-06-12 Un aparato y métodos asociados MX391360B (es)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP16176504.5A EP3264222B1 (en) 2016-06-27 2016-06-27 An apparatus and associated methods
PCT/FI2017/050432 WO2018002418A1 (en) 2016-06-27 2017-06-12 An apparatus and associated methods

Publications (2)

Publication Number Publication Date
MX2018016336A MX2018016336A (es) 2019-09-04
MX391360B true MX391360B (es) 2025-03-21

Family

ID=56321757

Family Applications (1)

Application Number Title Priority Date Filing Date
MX2018016336A MX391360B (es) 2016-06-27 2017-06-12 Un aparato y métodos asociados

Country Status (6)

Country Link
US (1) US10560752B2 (es)
EP (1) EP3264222B1 (es)
JP (1) JP6703627B2 (es)
CN (1) CN109416562B (es)
MX (1) MX391360B (es)
WO (1) WO2018002418A1 (es)

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107888987B (zh) * 2016-09-29 2019-12-06 华为技术有限公司 一种全景视频播放方法及装置
EP3367383B1 (en) 2017-02-23 2023-12-20 Nokia Technologies Oy Virtual reality
EP3503102A1 (en) * 2017-12-22 2019-06-26 Nokia Technologies Oy An apparatus and associated methods for presentation of captured spatial audio content
JP6801106B2 (ja) * 2018-02-02 2020-12-16 株式会社Ｎｔｔドコモ 情報処理装置
US10812828B2 (en) * 2018-04-10 2020-10-20 At&T Intellectual Property I, L.P. System and method for segmenting immersive video
US11558708B2 (en) * 2018-07-13 2023-01-17 Nokia Technologies Oy Multi-viewpoint multi-user audio user experience
KR102022604B1 (ko) * 2018-09-05 2019-11-04 넷마블 주식회사 주변 오디오를 시각적 표현하는 인터페이스에 기초하여 게임 서비스를 제공하는 게임 서비스 제공 서버 및 방법
EP3664417A1 (en) 2018-12-06 2020-06-10 Nokia Technologies Oy An apparatus and associated methods for presentation of audio content
JP7229040B2 (ja) * 2019-02-15 2023-02-27 キヤノン株式会社 情報処理装置及びその制御方法、プログラム
JP7350510B2 (ja) * 2019-05-14 2023-09-26 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム、及び、記憶媒体
JP7823971B2 (ja) * 2022-02-14 2026-03-04 日本放送協会 再生制御システムおよび再生制御プログラム
US20250008158A1 (en) * 2023-06-29 2025-01-02 Google Llc Efficient transform signaling for small blocks

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8730322B2 (en) * 2004-07-30 2014-05-20 Eyesee360, Inc. Telepresence using panoramic imaging and directional sound and motion
JP2008219286A (ja) * 2007-03-01 2008-09-18 Sharp Corp スライドショー装置
JP5115150B2 (ja) * 2007-11-02 2013-01-09 ソニー株式会社 情報提示装置及び情報提示方法
US9432629B2 (en) * 2008-08-18 2016-08-30 Brigham Young University Interactive viewing of sports video
US9497501B2 (en) 2011-12-06 2016-11-15 Microsoft Technology Licensing, Llc Augmented reality virtual monitor
US8963805B2 (en) * 2012-01-27 2015-02-24 Microsoft Corporation Executable virtual objects associated with real objects
JP5992210B2 (ja) * 2012-06-01 2016-09-14 任天堂株式会社 情報処理プログラム、情報処理装置、情報処理システム、および情報処理方法
JP5954147B2 (ja) * 2012-12-07 2016-07-20 ソニー株式会社 機能制御装置およびプログラム
US9129430B2 (en) 2013-06-25 2015-09-08 Microsoft Technology Licensing, Llc Indicating out-of-view augmented reality images
US20150036999A1 (en) * 2013-07-30 2015-02-05 Texas Instruments Incorporated Viewer Attention Controlled Video Playback
JP6219504B2 (ja) * 2013-10-25 2017-10-25 インテル コーポレイション ユーザ体験をキャプチャおよび生成するための装置及び方法
US9462230B1 (en) * 2014-03-31 2016-10-04 Amazon Technologies Catch-up video buffering
US9852774B2 (en) * 2014-04-30 2017-12-26 Rovi Guides, Inc. Methods and systems for performing playback operations based on the length of time a user is outside a viewing area
US10379614B2 (en) * 2014-05-19 2019-08-13 Immersion Corporation Non-collocated haptic cues in immersive environments
CN106659441B (zh) * 2014-06-17 2019-11-26 皇家飞利浦有限公司 评价医生注意力
US20180124374A1 (en) * 2014-07-31 2018-05-03 Ashcorp Technologies System and Method for Reducing System Requirements for a Virtual Reality 360 Display
KR20160104493A (ko) * 2015-02-26 2016-09-05 삼성전자주식회사 방송 수신 장치 및 그 제어 방법
EP3112985A1 (en) * 2015-06-30 2017-01-04 Nokia Technologies Oy An apparatus for video output and associated methods
US10129579B2 (en) * 2015-10-15 2018-11-13 At&T Mobility Ii Llc Dynamic video image synthesis using multiple cameras and remote control
CN105611481B (zh) * 2015-12-30 2018-04-17 北京时代拓灵科技有限公司 一种基于空间声的人机交互方法和系统
EP3236336B1 (en) 2016-04-21 2019-03-27 Nokia Technologies Oy Virtual reality causal summary content
US20170316806A1 (en) * 2016-05-02 2017-11-02 Facebook, Inc. Systems and methods for presenting content
US10218760B2 (en) * 2016-06-22 2019-02-26 JBF Interlude 2009 LTD Dynamic summary generation for real-time switchable videos
WO2018194954A1 (en) * 2017-04-16 2018-10-25 Visbit Inc. System, algorithms, and designs of view-optimized zoom for 360 degree video

Also Published As

Publication number Publication date
US20190149886A1 (en) 2019-05-16
MX2018016336A (es) 2019-09-04
WO2018002418A1 (en) 2018-01-04
CN109416562A (zh) 2019-03-01
CN109416562B (zh) 2022-03-01
US10560752B2 (en) 2020-02-11
JP6703627B2 (ja) 2020-06-03
EP3264222B1 (en) 2019-04-10
JP2019521440A (ja) 2019-07-25
EP3264222A1 (en) 2018-01-03

Similar Documents

Publication Publication Date Title
MX391360B (es) Un aparato y métodos asociados
EP4443848A3 (en) Virtual vision system
PH12019500411A1 (en) Method and apparatus for controlled observation point and orientation selection audiovisual content
WO2016025811A3 (en) Spatial data visualization
EP3171592A4 (en) Stereoscopic image presentation device, stereoscopic image presentation method, and head-mounted display
MX339988B (es) Sistema de comunicacion.
MX2016016604A (es) Metodo de reproduccion de datos y dispositivo de reproduccion de datos.
EP3312658A4 (en) Virtual image presentation system, image projection device, and virtual image presentation method
EP3136717A4 (en) Video display device, video projection device, dynamic illusion presentation device, video generation device, method thereof, data construct, and program
EP3238445A4 (en) Interactive binocular video display
EP3779559A4 (en) HEAD-MOUNTED DISPLAY AND SCREEN, HEAD-MOUNTED BRACKET AND VIDEO FOR IT
WO2015126643A3 (en) Methods and systems for social sharing head mounted display (hmd) content with a second screen
EP3292431A4 (en) Separated pupil optical systems for virtual and augmented reality and methods for displaying images using same
GB2533524A (en) Video display system
MY177075A (en) Display for immersive window effect
EP3108329A4 (en) Display system for displaying augmented reality image and control method for the same
GB2534821A (en) Analysis and manipulation of objects and layers in surround views
WO2014134107A3 (en) System and method for multi-user control and media streaming to a shared display
MX352489B (es) Metodo y dispositivo para desplegar una fotografia.
BR112014027678A2 (pt) método para a codificação de um sinal dos dados de vídeo para uso em um dispositivo estereoscópico de display multivisão, método para a decodificação de um sinal dos dados de vídeo para uso em um dispositivo estereoscópico de display multivisão, sinal dos dados de vídeo para uso em um dispositivo estereoscópico de display multivisão, portador de dados, codificador para a codificação de um sinal dos dados de vídeo para uso em um dispositivo estereoscópico de display multivisão, decodificador para a decodificação de um sinal dos dados de vídeo para uso em um dispositivo estereoscópico de display multivisão e produto de programa de computador
EP3499296A3 (en) Glasses-free 3d display mobile device, setting method of the same, and using method of the same
EP3564729A4 (en) VIRTUAL REALITY DISPLAY DEVICE
PH12018502547A1 (en) An apparatus and associated methods
WO2016060438A3 (en) Method and apparatus for providing advertising content
EP3882064A4 (en) THREE-DIMENSIONAL DISPLAY DEVICE, THREE-DIMENSIONAL DISPLAY SYSTEM, HEAD-UP DISPLAY AND MOVING OBJECT