KR20240131376A - 자동 게임 내 자막들 및 폐쇄 자막들 - Google Patents

자동 게임 내 자막들 및 폐쇄 자막들 Download PDF

Info

Publication number
KR20240131376A
KR20240131376A KR1020247024720A KR20247024720A KR20240131376A KR 20240131376 A KR20240131376 A KR 20240131376A KR 1020247024720 A KR1020247024720 A KR 1020247024720A KR 20247024720 A KR20247024720 A KR 20247024720A KR 20240131376 A KR20240131376 A KR 20240131376A
Authority
KR
South Korea
Prior art keywords
game
subtitle
audio
overlay
audio stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
KR1020247024720A
Other languages
English (en)
Korean (ko)
Inventor
웨이 리앙
일리아 블랑크
패트릭 포크
리 장
마이클 쉬미트
Original Assignee
어드밴스드 마이크로 디바이시즈, 인코포레이티드
에이티아이 테크놀로지스 유엘씨
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 어드밴스드 마이크로 디바이시즈, 인코포레이티드, 에이티아이 테크놀로지스 유엘씨 filed Critical 어드밴스드 마이크로 디바이시즈, 인코포레이티드
Publication of KR20240131376A publication Critical patent/KR20240131376A/ko
Pending legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50—Controlling the output signals based on the game progress
    • A63F13/53—Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35—Details of game servers
    • A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
    • A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
    • A63F13/424—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving acoustic input signals, e.g. by using the results of pitch or rhythm extraction or voice recognition
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/85—Providing additional services to players
    • A63F13/87—Communicating with other players during game play, e.g. by e-mail or chat
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/06—Decision making techniques; Pattern matching strategies
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L17/00—Speaker identification or verification techniques
    • G10L17/26—Recognition of special voice characteristics, e.g. for use in lie detectors; Recognition of animal voices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439—Processing of audio elementary streams
    • H04N21/4394—Processing of audio elementary streams involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781—Games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/488—Data services, e.g. news ticker
    • H04N21/4884—Data services, e.g. news ticker for displaying subtitles
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/30—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device
    • A63F2300/303—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by output arrangements for receiving control signals generated by the game device for displaying additional data, e.g. simulating a Head Up Display
    • A—HUMAN NECESSITIES
    • A63—SPORTS; GAMES; AMUSEMENTS
    • A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/57—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of game services offered to the player
    • A63F2300/572—Communication between players during game play of non game information, e.g. e-mail, chat, file transfer, streaming of audio and streaming of video

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Optics & Photonics (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Business, Economics & Management (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Game Theory and Decision Science (AREA)
  • Processing Or Creating Images (AREA)
  • Studio Circuits (AREA)
  • Studio Devices (AREA)
  • User Interface Of Digital Computer (AREA)
KR1020247024720A 2021-12-23 2022-12-01 자동 게임 내 자막들 및 폐쇄 자막들 Pending KR20240131376A (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US17/561,477 2021-12-23
US17/561,477 US11857877B2 (en) 2021-12-23 2021-12-23 Automatic in-game subtitles and closed captions
PCT/US2022/051581 WO2023121850A1 (en) 2021-12-23 2022-12-01 Automatic in-game subtitles and closed captions

Publications (1)

Publication Number Publication Date
KR20240131376A true KR20240131376A (ko) 2024-08-30

Family

ID=86898719

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020247024720A Pending KR20240131376A (ko) 2021-12-23 2022-12-01 자동 게임 내 자막들 및 폐쇄 자막들

Country Status (6)

Country Link
US (2) US11857877B2 (cg-RX-API-DMAC7.html)
EP (1) EP4452432A4 (cg-RX-API-DMAC7.html)
JP (1) JP2025504748A (cg-RX-API-DMAC7.html)
KR (1) KR20240131376A (cg-RX-API-DMAC7.html)
CN (1) CN118414200A (cg-RX-API-DMAC7.html)
WO (1) WO2023121850A1 (cg-RX-API-DMAC7.html)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11857877B2 (en) * 2021-12-23 2024-01-02 Ati Technologies Ulc Automatic in-game subtitles and closed captions
US20240022682A1 (en) * 2022-07-13 2024-01-18 Sony Interactive Entertainment LLC Systems and methods for communicating audio data
US20240390792A1 (en) * 2023-05-24 2024-11-28 Sony Interactive Entertainment Inc. Consumer Device with Dual Wireless Links and Mixer
TWI891080B (zh) * 2023-10-05 2025-07-21 宏碁股份有限公司 電子裝置與其影像片段萃取方法
GB2636197A (en) * 2023-12-05 2025-06-11 Sony Interactive Entertainment Inc Apparatus, systems and methods for visual description

Family Cites Families (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10987597B2 (en) * 2002-12-10 2021-04-27 Sony Interactive Entertainment LLC System and method for managing audio and video channels for video game players and spectators
US8620139B2 (en) * 2011-04-29 2013-12-31 Microsoft Corporation Utilizing subtitles in multiple languages to facilitate second-language learning
EP2525568B1 (en) * 2011-05-19 2017-11-15 EchoStar Technologies L.L.C. Automatic subtitle resizing
US8839292B1 (en) * 2011-12-13 2014-09-16 Google Inc. Systems and methods for rendering multiple applications on television screens
US10304458B1 (en) * 2014-03-06 2019-05-28 Board of Trustees of the University of Alabama and the University of Alabama in Huntsville Systems and methods for transcribing videos using speaker identification
WO2016075780A1 (ja) * 2014-11-12 2016-05-19 富士通株式会社 ウェアラブルデバイス、表示制御方法、及び表示制御プログラム
KR102202576B1 (ko) * 2014-12-12 2021-01-13 삼성전자주식회사 음향 출력을 제어하는 디바이스 및 그 방법
US9922095B2 (en) * 2015-06-02 2018-03-20 Microsoft Technology Licensing, Llc Automated closed captioning using temporal data
US10332506B2 (en) * 2015-09-02 2019-06-25 Oath Inc. Computerized system and method for formatted transcription of multimedia content
KR20170035502A (ko) * 2015-09-23 2017-03-31 삼성전자주식회사 디스플레이 장치 및 이의 제어 방법
US10179291B2 (en) * 2016-12-09 2019-01-15 Microsoft Technology Licensing, Llc Session speech-to-text conversion
KR20180087009A (ko) * 2017-01-24 2018-08-01 주식회사 소리자바 실시간 오디오 스트리밍 분석을 통한 자막 제공 시스템, 단말기 및 자막 서버
US10299008B1 (en) * 2017-11-21 2019-05-21 International Business Machines Corporation Smart closed caption positioning system for video content
CN108491127B (zh) * 2018-03-12 2020-02-07 Oppo广东移动通信有限公司 输入法界面显示方法、装置、终端及存储介质
JP7272356B2 (ja) * 2018-05-29 2023-05-12 ソニーグループ株式会社 画像処理装置、画像処理方法、プログラム
US12451154B2 (en) 2018-08-08 2025-10-21 Comcast Cable Communications, Llc Generating and/or displaying synchronized captions
EP3719613B1 (en) * 2019-04-01 2026-05-06 Nokia Technologies Oy Rendering captions for media content
KR102261597B1 (ko) * 2019-04-23 2021-06-07 주식회사 비포에이 Vr 영상 콘텐츠의 자막 처리 기기
EP3963580B1 (en) * 2019-05-02 2025-10-15 Google LLC Automatically captioning audible parts of content on a computing device
US11094324B2 (en) * 2019-05-14 2021-08-17 Motorola Mobility Llc Accumulative multi-cue activation of domain-specific automatic speech recognition engine
US10885893B2 (en) * 2019-06-06 2021-01-05 Sony Corporation Textual display of aural information broadcast via frequency modulated signals
US20210074298A1 (en) * 2019-09-11 2021-03-11 Soundhound, Inc. Video conference captioning
US11172266B2 (en) * 2019-11-04 2021-11-09 Sling Media, L.L.C. System to correct closed captioning display using context from audio/video
US11295497B2 (en) * 2019-11-25 2022-04-05 International Business Machines Corporation Dynamic subtitle enhancement
CN111556372A (zh) * 2020-04-20 2020-08-18 北京甲骨今声科技有限公司 为视音频节目实时添加字幕的方法和装置
US11557121B2 (en) * 2020-04-26 2023-01-17 Cloudinary Ltd. System, device, and method for generating and utilizing content-aware metadata
US11475895B2 (en) * 2020-07-06 2022-10-18 Meta Platforms, Inc. Caption customization and editing
US20230055421A1 (en) * 2020-09-16 2023-02-23 Meta Platforms, Inc. Caption customization and editing
US11418849B2 (en) * 2020-10-22 2022-08-16 Rovi Guides, Inc. Systems and methods for inserting emoticons within a media asset
WO2022115803A1 (en) * 2020-11-30 2022-06-02 The Regents Of The University Of California Systems and methods for sound-enhanced meeting platforms
US12342102B2 (en) * 2021-11-19 2025-06-24 Apple Inc. Systems and methods for managing captions
US11857877B2 (en) * 2021-12-23 2024-01-02 Ati Technologies Ulc Automatic in-game subtitles and closed captions

Also Published As

Publication number Publication date
EP4452432A4 (en) 2025-12-31
JP2025504748A (ja) 2025-02-19
US12427413B2 (en) 2025-09-30
WO2023121850A1 (en) 2023-06-29
US20240091640A1 (en) 2024-03-21
CN118414200A (zh) 2024-07-30
US20230201717A1 (en) 2023-06-29
US11857877B2 (en) 2024-01-02
EP4452432A1 (en) 2024-10-30

Similar Documents

Publication Publication Date Title
US11857877B2 (en) Automatic in-game subtitles and closed captions
US11386903B2 (en) Methods and systems for speech presentation based on simulated binaural audio signals
US11514924B2 (en) Dynamic creation and insertion of content
CN108596107A (zh) 基于ar设备的唇语识别方法及其装置、ar设备
US20210042507A1 (en) Determining and presenting user emotion
US20240046914A1 (en) Assisted speech
JP2025504748A5 (cg-RX-API-DMAC7.html)
US20250037339A1 (en) System and methods for resolving audio conflicts in extended reality environments
US12293759B2 (en) Method and device for presenting a CGR environment based on audio data and lyric data
JP2024521795A (ja) 分配された入力の感情分析によるライブイベントのクラウドノイズのシミュレーション
CN110488973B (zh) 一种虚拟互动留言系统及方法
US20250356842A1 (en) Voice chat translation
JP2023184519A (ja) 情報処理システム、情報処理方法およびコンピュータプログラム
JP7225642B2 (ja) コミュニケーションロボット、制御方法及び制御プログラム
CN116582664A (zh) 一种基于裸眼3d的智能交互虚拟展示系统
KR102616058B1 (ko) 음성 기록을 시각화하여 재연하는 방법, 컴퓨터 장치, 및 컴퓨터 프로그램
WO2010140254A1 (ja) 映像音声出力装置及び音声定位方法
US20220319516A1 (en) Conversation method, conversation system, conversation apparatus, and program
US20250118287A1 (en) Sonifying Visual Content For Vision-Impaired Users
WO2025025564A1 (zh) 一种虚拟形象控制方法、装置及相关设备
US12119021B1 (en) Situational awareness for head mounted devices
US12407998B2 (en) Audio streams in mixed voice chat in a virtual environment
US12555379B2 (en) Computer vision to determine when video conference participant is off task
US20220351727A1 (en) Conversaton method, conversation system, conversation apparatus, and program
JP2024161861A (ja) 情報処理装置及び情報処理方法

Legal Events

Date Code Title Description
PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E13 Pre-grant limitation requested

Free format text: ST27 STATUS EVENT CODE: A-2-3-E10-E13-LIM-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11 Amendment of application requested

Free format text: ST27 STATUS EVENT CODE: A-2-2-P10-P11-NAP-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000