EP3808096A4 - Audiovisual livestream system and method with latency management and social media-type user interface mechanics - Google Patents

Audiovisual livestream system and method with latency management and social media-type user interface mechanics Download PDF

Info

Publication number
EP3808096A4
EP3808096A4 EP19819554.7A EP19819554A EP3808096A4 EP 3808096 A4 EP3808096 A4 EP 3808096A4 EP 19819554 A EP19819554 A EP 19819554A EP 3808096 A4 EP3808096 A4 EP 3808096A4
Authority
EP
European Patent Office
Prior art keywords
livestream
audiovisual
user interface
social media
type user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP19819554.7A
Other languages
German (de)
French (fr)
Other versions
EP3808096A1 (en
Inventor
Anton Holmberg
Benjamin HERSH
Jeannie Yang
Yuning Woo
Wang Liang
Perry R. Cook
Jeffrey C. Smith
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Smule Inc
Original Assignee
Smule Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Smule Inc filed Critical Smule Inc
Publication of EP3808096A1 publication Critical patent/EP3808096A1/en
Publication of EP3808096A4 publication Critical patent/EP3808096A4/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/36—Accompaniment arrangements
    • G10H1/361—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
    • G10H1/366—Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems with means for modifying or correcting the external signal, e.g. pitch correction, reverberation, changing a singer's voice
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0008—Associated control or indicating means
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H1/00—Details of electrophonic musical instruments
    • G10H1/0033—Recording/reproducing or transmission of music for electrophonic musical instruments
    • G10H1/0041—Recording/reproducing or transmission of music for electrophonic musical instruments in coded form
    • G10H1/0058—Transmission between separate instruments or between individual components of a musical system
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/155—Musical effects
    • G10H2210/245—Ensemble, i.e. adding one or more voices, also instrumental voices
    • G10H2210/251—Chorus, i.e. automatic generation of two or more extra voices added to the melody, e.g. by a chorus effect processor or multiple voice harmonizer, to produce a chorus or unison effect, wherein individual sounds from multiple sources with roughly the same timbre converge and are perceived as one
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2210/00—Aspects or methods of musical processing having intrinsic musical character, i.e. involving musical theory or musical parameters or relying on musical knowledge, as applied in electrophonic musical tools or instruments
    • G10H2210/325—Musical pitch modification
    • G10H2210/331—Note pitch correction, i.e. modifying a note pitch or replacing it by the closest one in a given scale
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/175—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments for jam sessions or musical collaboration through a network, e.g. for composition, ensemble playing or repeating; Compensation of network or internet delays therefor
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10H—ELECTROPHONIC MUSICAL INSTRUMENTS; INSTRUMENTS IN WHICH THE TONES ARE GENERATED BY ELECTROMECHANICAL MEANS OR ELECTRONIC GENERATORS, OR IN WHICH THE TONES ARE SYNTHESISED FROM A DATA STORE
    • G10H2240/00—Data organisation or data communication aspects, specifically adapted for electrophonic musical tools or instruments
    • G10H2240/171—Transmission of musical instrument data, control or status information; Transmission, remote access or control of music data for electrophonic musical instruments
    • G10H2240/201—Physical layer or hardware aspects of transmission to or from an electrophonic musical instrument, e.g. voltage levels, bit streams, code words or symbols over a physical link connecting network nodes or instruments
    • G10H2240/241—Telephone transmission, i.e. using twisted pair telephone lines or any type of telephone network
    • G10H2240/251—Mobile telephone transmission, i.e. transmitting, accessing or controlling music data wirelessly via a wireless or mobile telephone receiver, analog or digital, e.g. DECT GSM, UMTS
EP19819554.7A 2018-06-15 2019-06-17 Audiovisual livestream system and method with latency management and social media-type user interface mechanics Pending EP3808096A4 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201862685727P 2018-06-15 2018-06-15
PCT/US2019/037479 WO2019241778A1 (en) 2018-06-15 2019-06-17 Audiovisual livestream system and method with latency management and social media-type user interface mechanics

Publications (2)

Publication Number Publication Date
EP3808096A1 EP3808096A1 (en) 2021-04-21
EP3808096A4 true EP3808096A4 (en) 2022-06-15

Family

ID=68842358

Family Applications (1)

Application Number Title Priority Date Filing Date
EP19819554.7A Pending EP3808096A4 (en) 2018-06-15 2019-06-17 Audiovisual livestream system and method with latency management and social media-type user interface mechanics

Country Status (3)

Country Link
EP (1) EP3808096A4 (en)
CN (1) CN112567758A (en)
WO (1) WO2019241778A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11250825B2 (en) * 2018-05-21 2022-02-15 Smule, Inc. Audiovisual collaboration system and method with seed/join mechanic
WO2020117823A1 (en) 2018-12-03 2020-06-11 Smule, Inc. Augmented reality filters for captured audiovisual performances
CN114072872A (en) * 2019-04-29 2022-02-18 保罗·安德森 System and method for providing electronic music score

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102456340A (en) * 2010-10-19 2012-05-16 盛大计算机（上海）有限公司 Karaoke in-pair singing method based on internet and system thereof
WO2015103415A1 (en) * 2013-12-31 2015-07-09 Smule, Inc. Computationally-assisted musical sequencing and/or composition techniques for social music challenge or competition
US20160057316A1 (en) * 2011-04-12 2016-02-25 Smule, Inc. Coordinating and mixing audiovisual content captured from geographically distributed performers

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8234395B2 (en) * 2003-07-28 2012-07-31 Sonos, Inc. System and method for synchronizing operations among a plurality of independently clocked digital data processing devices
KR100748060B1 (en) * 2005-08-05 2007-08-09 주식회사 오아시스미디어 Internet broadcasting system of Real-time multilayer multimedia image integrated system and Method thereof
US8019815B2 (en) * 2006-04-24 2011-09-13 Keener Jr Ellis Barlow Interactive audio/video method on the internet
US20090113022A1 (en) * 2007-10-24 2009-04-30 Yahoo! Inc. Facilitating music collaborations among remote musicians
CN101853498B (en) * 2009-03-31 2012-01-11 华为技术有限公司 Image synthetizing method and image processing device
GB2506404B (en) * 2012-09-28 2015-03-18 Memeplex Ltd Automatic audio mixing
ITMI20121617A1 (en) * 2012-09-28 2014-03-29 St Microelectronics Srl METHOD AND SYSTEM FOR SIMULTANEOUS PLAYING OF AUDIO TRACKS FROM A PLURALITY OF DIGITAL DEVICES.
WO2014175482A1 (en) * 2013-04-24 2014-10-30 (주)씨어스테크놀로지 Musical accompaniment device and musical accompaniment system using ethernet audio transmission function
US9331799B2 (en) * 2013-10-07 2016-05-03 Bose Corporation Synchronous audio playback
KR101605497B1 (en) * 2014-11-13 2016-03-22 유영재 A Method of collaboration using apparatus for musical accompaniment
KR102573612B1 (en) * 2015-06-03 2023-08-31 스뮬, 인코포레이티드 A technique for automatically generating orchestrated audiovisual works based on captured content from geographically dispersed performers.
CN106601220A (en) * 2016-12-08 2017-04-26 天脉聚源(北京)传媒科技有限公司 Method and device for recording antiphonal singing of multiple persons

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102456340A (en) * 2010-10-19 2012-05-16 盛大计算机（上海）有限公司 Karaoke in-pair singing method based on internet and system thereof
US20160057316A1 (en) * 2011-04-12 2016-02-25 Smule, Inc. Coordinating and mixing audiovisual content captured from geographically distributed performers
WO2015103415A1 (en) * 2013-12-31 2015-07-09 Smule, Inc. Computationally-assisted musical sequencing and/or composition techniques for social music challenge or competition

Also Published As

Publication number Publication date
CN112567758A (en) 2021-03-26
EP3808096A1 (en) 2021-04-21
WO2019241778A1 (en) 2019-12-19

Similar Documents

Publication Publication Date Title
EP3756125A4 (en) Systems and methods for managing digital identities associated with users
EP3611904A4 (en) Data buffering method and session management functional entity
EP3487120A4 (en) Charging management method, user plane function, and control plane function
EP3836577A4 (en) Session management method and device for user groups
EP3831165A4 (en) User plane system selection based on latency
TWI800613B (en) Store management device and store management method
EP3733436A4 (en) Battery management device and method
EP3610357A4 (en) System and method for managing user interactions with a blockchain
EP3598839A4 (en) Method and system for managing user information
EP3808096A4 (en) Audiovisual livestream system and method with latency management and social media-type user interface mechanics
EP3755014A4 (en) Charging method and device and session management entity
EP3750094A4 (en) Systems and methods for use in managing digital identities
EP3815343A4 (en) Low latency datagram-responsive computer network protocol
EP3806732A4 (en) Virtual user interface system and methods for use thereof
EP3881254A4 (en) Systems and methods for selective and real-time user interface display
EP3779852A4 (en) Construction management device and construction management system
EP3000021A4 (en) Deformable user interface apparatus and associated methods
EP3345534A4 (en) User terminal and sleep management method
EP3586521A4 (en) Identifying device state changes using power data and network data
EP3871118A4 (en) Methods and systems for interactive data management
EP3870038A4 (en) Empathic computing system and methods for improved human interactions with digital content experiences
EP3795424A4 (en) Video output device, video output method, and computer program
EP3704699A4 (en) Memory devices with multiple sets of latencies and methods for operating the same
EP3798829A4 (en) Terminal user interface display method and terminal
EP3264826A4 (en) Small cell and small cell user management method

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20201221

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
RIC1 Information provided on ipc code assigned before grant

Ipc: G10H 1/36 20060101ALI20220209BHEP

Ipc: H04N 21/2187 20110101ALI20220209BHEP

Ipc: H04N 21/485 20110101ALI20220209BHEP

Ipc: H04N 21/472 20110101ALI20220209BHEP

Ipc: H04N 21/434 20110101ALI20220209BHEP

Ipc: H04N 21/43 20110101ALI20220209BHEP

Ipc: G11B 27/031 20060101AFI20220209BHEP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R079

Free format text: PREVIOUS MAIN CLASS: H04N0021430000

Ipc: G11B0027031000

A4 Supplementary search report drawn up and despatched

Effective date: 20220516

RIC1 Information provided on ipc code assigned before grant

Ipc: G10H 1/36 20060101ALI20220510BHEP

Ipc: H04N 21/2187 20110101ALI20220510BHEP

Ipc: H04N 21/485 20110101ALI20220510BHEP

Ipc: H04N 21/472 20110101ALI20220510BHEP

Ipc: H04N 21/434 20110101ALI20220510BHEP

Ipc: H04N 21/43 20110101ALI20220510BHEP

Ipc: G11B 27/031 20060101AFI20220510BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230908