KR102511720B1 - 360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법 - Google Patents

360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법 Download PDF

Info

Publication number
KR102511720B1
KR102511720B1 KR1020170162242A KR20170162242A KR102511720B1 KR 102511720 B1 KR102511720 B1 KR 102511720B1 KR 1020170162242 A KR1020170162242 A KR 1020170162242A KR 20170162242 A KR20170162242 A KR 20170162242A KR 102511720 B1 KR102511720 B1 KR 102511720B1
Authority
KR
South Korea
Prior art keywords
speaker
text
screen
processor
area
Prior art date
Application number
KR1020170162242A
Other languages
English (en)
Korean (ko)
Other versions
KR20190063281A (ko
Inventor
권오윤
유이슬
이현주
Original Assignee
삼성전자주식회사
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 삼성전자주식회사 filed Critical 삼성전자주식회사
Priority to KR1020170162242A priority Critical patent/KR102511720B1/ko
Priority to PCT/KR2018/010950 priority patent/WO2019107719A1/fr
Priority to US16/762,006 priority patent/US11570507B2/en
Priority to EP18882409.8A priority patent/EP3697099A4/fr
Publication of KR20190063281A publication Critical patent/KR20190063281A/ko
Application granted granted Critical
Publication of KR102511720B1 publication Critical patent/KR102511720B1/ko

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47217—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4882—Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4888—Data services, e.g. news ticker for displaying teletext characters

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Marketing (AREA)
  • Business, Economics & Management (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)
KR1020170162242A 2017-11-29 2017-11-29 360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법 KR102511720B1 (ko)

Priority Applications (4)

Application Number Priority Date Filing Date Title
KR1020170162242A KR102511720B1 (ko) 2017-11-29 2017-11-29 360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법
PCT/KR2018/010950 WO2019107719A1 (fr) 2017-11-29 2018-09-18 Dispositif et procédé pour afficher visuellement la voix d'un locuteur dans une vidéo à 360 degrés
US16/762,006 US11570507B2 (en) 2017-11-29 2018-09-18 Device and method for visually displaying speaker's voice in 360-degree video
EP18882409.8A EP3697099A4 (fr) 2017-11-29 2018-09-18 Dispositif et procédé pour afficher visuellement la voix d'un locuteur dans une vidéo à 360 degrés

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
KR1020170162242A KR102511720B1 (ko) 2017-11-29 2017-11-29 360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법

Publications (2)

Publication Number Publication Date
KR20190063281A KR20190063281A (ko) 2019-06-07
KR102511720B1 true KR102511720B1 (ko) 2023-03-20

Family

ID=66665157

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020170162242A KR102511720B1 (ko) 2017-11-29 2017-11-29 360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법

Country Status (4)

Country Link
US (1) US11570507B2 (fr)
EP (1) EP3697099A4 (fr)
KR (1) KR102511720B1 (fr)
WO (1) WO2019107719A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109446876B (zh) * 2018-08-31 2020-11-06 百度在线网络技术（北京）有限公司 手语信息处理方法、装置、电子设备和可读存储介质
KR102098734B1 (ko) * 2019-08-06 2020-04-08 전자부품연구원 대화 상대의 외형을 반영한 수어 영상 제공 방법, 장치 및 단말
KR102636238B1 (ko) * 2021-07-30 2024-02-14 주식회사 아모센스 음성 처리 장치를 포함하는 다중 그룹 수업 시스템

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040189868A1 (en) 2003-03-24 2004-09-30 Sony Corporation And Sony Electronics Inc. Position and time sensitive closed captioning
US20130070047A1 (en) * 2011-09-16 2013-03-21 Jay J. DiGIOVANNI Low Scale Production System and Method
US20170139578A1 (en) * 2015-11-18 2017-05-18 Samsung Electronics Co., Ltd System and method for 360-degree video navigation

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009195273A (ja) 2008-02-19 2009-09-03 Sanyo Electric Co Ltd ショーケース
US20100079573A1 (en) 2008-09-26 2010-04-01 Maycel Isaac System and method for video telephony by converting facial motion to text
KR20110018261A (ko) * 2009-08-17 2011-02-23 삼성전자주식회사 텍스트 서브타이틀 데이터 처리 방법 및 재생 장치
US8332530B2 (en) * 2009-12-10 2012-12-11 Hulu Llc User interface including concurrent display of video program, histogram, and transcript
US8183997B1 (en) 2011-11-14 2012-05-22 Google Inc. Displaying sound indications on a wearable computing system
US20150170418A1 (en) * 2012-01-18 2015-06-18 Google Inc. Method to Provide Entry Into a Virtual Map Space Using a Mobile Device's Camera
US20130246967A1 (en) 2012-03-15 2013-09-19 Google Inc. Head-Tracked User Interaction with Graphical Interface
KR101945812B1 (ko) 2012-06-08 2019-02-08 엘지전자 주식회사 이동 단말기, 및 그 동작방법
US20140002582A1 (en) * 2012-06-29 2014-01-02 Monkeymedia, Inc. Portable proprioceptive peripatetic polylinear video player
KR102108893B1 (ko) 2013-07-11 2020-05-11 엘지전자 주식회사 이동 단말기
KR102279674B1 (ko) 2014-09-02 2021-07-20 삼성전자주식회사 전자 장치의 멀티미디어 데이터 처리 방법 및 그 전자 장치
US9984505B2 (en) 2014-09-30 2018-05-29 Sony Interactive Entertainment Inc. Display of text information on a head-mounted display

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040189868A1 (en) 2003-03-24 2004-09-30 Sony Corporation And Sony Electronics Inc. Position and time sensitive closed captioning
US20130070047A1 (en) * 2011-09-16 2013-03-21 Jay J. DiGIOVANNI Low Scale Production System and Method
US20170139578A1 (en) * 2015-11-18 2017-05-18 Samsung Electronics Co., Ltd System and method for 360-degree video navigation

Also Published As

Publication number Publication date
US20210377593A1 (en) 2021-12-02
US11570507B2 (en) 2023-01-31
WO2019107719A1 (fr) 2019-06-06
EP3697099A1 (fr) 2020-08-19
EP3697099A4 (fr) 2020-08-19
KR20190063281A (ko) 2019-06-07

Similar Documents

Publication Publication Date Title
US11366584B2 (en) Method for providing function or content associated with application, and electronic device for carrying out same
US20210042132A1 (en) Electronic device and screen sharing method using same
KR20200067567A (ko) 전자 장치의 상태 정보에 기반하여 동작을 수행하는 전자 장치 및 전자 장치의 동작 방법
US20200186926A1 (en) Method for controlling audio output by application through earphones and electronic device implementing same
US10931880B2 (en) Electronic device and method for providing information thereof
KR20200101630A (ko) 아바타 표시를 제어하기 위한 방법 및 그 전자 장치
KR102508286B1 (ko) 가상 현실에서 정보를 제공하는 전자 장치 및 방법
US11501409B2 (en) Electronic device for image synthesis and operating method thereof
KR102511720B1 (ko) 360 비디오에서 화자의 음성을 시각적으로 표시하기 위한 장치 및 방법
US12056286B2 (en) Electronic device for providing augmented reality service and operating method thereof
KR20200098068A (ko) 단어 추천 방법 및 그 전자 장치
KR20200093094A (ko) 전자 장치 및 그 제어 방법
KR20190021049A (ko) 전자 장치 및 이를 이용하여 관심 영역을 설정하여 오브젝트를 식별하는 방법
KR20200076438A (ko) 사용자의 액티비티를 추적하는 전자 장치 및 전자 장치의 동작 방법
KR102389201B1 (ko) 전자 장치 및 전자 장치의 제어 방법
CN112119372B (zh) 电子设备及其控制方法
US20200356268A1 (en) Screen control method and electronic device supporting same
US11889181B2 (en) Electronic device having plurality of lenses where the device changes a visual object corresponding to a recommended lens
KR102478426B1 (ko) 동영상 콘텐트에 포함된 블랙 영역을 검출하기 위한 방법 및 그 전자 장치
KR20210136659A (ko) 증강 현실 서비스를 제공하기 위한 전자 장치 및 그의 동작 방법
US20200410962A1 (en) Information displaying method and electronic device therefor
CN111367492A (zh) 网页页面展示方法及装置、存储介质
US11144791B2 (en) Electronic apparatus for recognizing user and controlling method thereof
KR20240028263A (ko) 복수의 디스플레이들을 제어하는 방법 및 이를 지원하는 전자 장치

Legal Events

Date Code Title Description
A201 Request for examination
E902 Notification of reason for refusal
E902 Notification of reason for refusal
E701 Decision to grant or registration of patent right
GRNT Written decision to grant