WO2021090256A1 - Système électronique pour synchroniser des événements avec le son d'une composition musicale entre un dispositif électronique de lecture et une pluralité de dispositifs électroniques mobiles connectés à un réseau de télécommunications à moyenne-longue distance et son procédé de synchronisation - Google Patents

Système électronique pour synchroniser des événements avec le son d'une composition musicale entre un dispositif électronique de lecture et une pluralité de dispositifs électroniques mobiles connectés à un réseau de télécommunications à moyenne-longue distance et son procédé de synchronisation Download PDF

Info

Publication number
WO2021090256A1
WO2021090256A1 PCT/IB2020/060456 IB2020060456W WO2021090256A1 WO 2021090256 A1 WO2021090256 A1 WO 2021090256A1 IB 2020060456 W IB2020060456 W IB 2020060456W WO 2021090256 A1 WO2021090256 A1 WO 2021090256A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
mobile electronic
lyrics
web server
universal
Prior art date
Application number
PCT/IB2020/060456
Other languages
English (en)
Inventor
Marco CIMA
Stefano DELLA CHIARA
Roberto MORINI
Marco Marinoni
Original Assignee
M-Live S.R.L.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by M-Live S.R.L. filed Critical M-Live S.R.L.
Publication of WO2021090256A1 publication Critical patent/WO2021090256A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00—Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/16—Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
    • H04L69/169—Special adaptations of TCP, UDP or IP for interworking of IP based networks with other networks 
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel

Definitions

  • the present invention generally relates to the field of music playing for a musical show.
  • the present invention concerns an electronic system for synchronizing events (such as lyrics and/or notes/chords) with the sound of a musical composition between a player electronic device and a plurality of mobile electronic devices connected to a medium-long distance telecommunications network.
  • events such as lyrics and/or notes/chords
  • Music player devices providing assistance to musicians during a musical show in which there are many spectators, such as for example concerts in a hall or in a stadium are known; these player devices are capable of playing many musical bases and comprise audio mixers and equalizers.
  • karaoke consists in the playing of a song together with the lyrics thereof, which are displayed on a screen so that the words of the song are colored in sync with the sound of the song: in this way a non-professional singer can be guided in singing the song using the microphone and tracking the lyrics of the song that are colored time after time.
  • US 2018/0052648 discloses a method for synchronizing a plurality of mobile electronic devices on the occasion of an event with many spectators (for example, a musical show or a sporting event), in order to perform specific actions simultaneously, such as for example playing a multimedia file, switching on a light, playing a particular sound or displaying lyrics.
  • US 2018/0052648 discloses the use of a wireless local network (typically of the Wi-Fi type) to connect the mobile devices via radio and to exchange information to perform said synchronization.
  • a wireless local network typically of the Wi-Fi type
  • US 2018/0052648 discloses the use of the multicast protocol UDP (User Datagram Protocol) to perform a point-to-multipoint transmission of multimedia data in streaming from a controller application to all the connected mobile electronic devices.
  • US 2018/0052648 further discloses that the controller application transmits a sequence of commands to the mobile electronic devices by means of the UDP protocol, wherein each command comprises the current time and the time to execute the command; each mobile electronic device receives the commands and the mobile application of each mobile electronic device adds a local timestamp to each command received, thus calculates the current execution time of the command as a function of the difference between the local timestamp and the time received by the controller application.
  • UDP User Datagram Protocol
  • US 2018/0052648 has the disadvantage of using a local (i.e. short-distance) network (e.g. Wi-fi) of the wireless type to connect the controller application with the mobile application of the mobile electronic devices, therefore it requires the use of a dedicated hardware device for the generation of the wireless local network.
  • a local network e.g. Wi-fi
  • the synchronization method of US 2018/0052648 is not able to guarantee a perfect synchronization between the music being performed and the messages or images received by the mobile electronic devices, as the UDP protocol used does not ensure that the synchronization messages sent by the controller applications are actually received by the electronic devices.
  • the synchronization method of US 2018/0052648 is not able to guarantee a sufficient reliability of a particular event at a precise point in the musical track, such as (in the case of a karaoke) coloring a particular syllable at the precise moment in which the singer has to sing it, either display or highlight a musical note or a chord at the precise moment in which the music track is playing said note or said chord.
  • US 2014/0360343 A1 discloses a method and system for synchronizing the sound of a song with the lyrics of the song thereof in order to display the lyrics on a client device.
  • a client device 304 for example, a mobile phone
  • the client device 304 comprises a microphone acquiring a sample of the song and transmits it to a server 306 through a communication network.
  • the server 306 is connected to a database 312 which stores a multitude of published songs and the corresponding lyrics.
  • the server 306 thus receives the sample of the song and identifies therefrom, by means of suitable algorithms, the type of song emitted by the source 302, thus it reads the lyrics corresponding to the identified song from the database 314 and transmits a time- annotated text 316 to the client device 314, that is it includes information of the time positions of the song per line or words of lyrics.
  • the present invention relates to a method for synchronizing events (for example lyrics and/or notes/chords) with a musical composition between a player electronic device and one or more mobile electronic devices connected to a medium-long distance telecommunications network, wherein the synchronization method is defined in appended claim 1 and by preferred embodiments thereof described in the dependent claims 2 to 5.
  • the basic idea is to use a player device that manages centrally the synchronization between the musical composition and the events played on one or more mobile electronic devices, thus to synchronize the clocks of the player electronic device and of the mobile electronic devices with a universal clock (typically UTC) and to use a dedicated data communication channel (typically a TCP/IP connection with WebSocket) to distribute events (e.g., lyrics and/or notes/chords) from the central player electronic device to the various mobile electronic devices connected by means of a dedicated data communication channel.
  • a universal clock typically UTC
  • a dedicated data communication channel typically a TCP/IP connection with WebSocket
  • the electronic synchronization system in accordance with the present invention has the following advantages: it guarantees an excellent and reliable synchronization between the musical composition being executed (for example, the sound of a played song or played live) and the lyrics/syllables and/or notes/chords/scores of the same musical composition displayed on a respective screen of one or more mobile electronic devices, that is a perfect synchronism with the musical base of lyrics, chords or scores towards one or more mobile electronic devices; it guarantees a good precision of an event (display of a particular syllable of the song lyrics, or display of a note of a musical score) in a precise point of the musical composition during the execution thereof; it allows a perfect synchronization between the musical composition and the events played on two or more mobile electronic devices; it allows the synchronization of an published or unpublished musical composition; it allows the musical composition which is customized for each mobile electronic device to be played; it does not require the use of a dedicated device for the generation of a wireless local network; it allows the
  • It is also an object of the present invention a computer program comprising software code portions adapted to perform the steps g), h), i) of the method according to claim 1 , the step a2) of claim 3 and the step g 1 ) of claim 2, when said program is run on at least one computer.
  • Figure 1 shows a block diagram of an electronic system for synchronizing events (for example, lyrics and/or notes/chords) with the sound of a musical composition according to the invention
  • Figures 2A-2B schematically show two examples of data structures shared between a player electronic device and a plurality of mobile electronic devices
  • Figures 3A-3B schematically show the time diagram of the information exchanged between the player electronic device, a web server and a plurality of mobile electronic devices during the execution of the method for synchronizing events (for example, lyrics and/or notes/chords) with the sound of a musical composition according to the invention.
  • FIG. 1 shows an electronic system 1 for synchronizing events with the sound of a musical composition.
  • vents means: a plurality of successive lyrics lines into which the lyrics of a vocal musical composition is divided; a plurality of syllables into which each lyrics line is divided;
  • the electronic system 1 comprises: a player electronic device 2; a web server 3; two mobile electronic devices 4-1 , 4-2; a medium-long distance telecommunications network 10 to connect the player electronic device 2 with each of the two mobile electronic devices 4-1 , 4-2 crossing the web server 3.
  • musical composition means: a vocal musical composition performed by means of the human voice emitting sounds representative of lyrics (that is a song recorded or performed live, or an opera or an operetta), together with a musical accompaniment generated by means of one or more musical instruments; or an instrumental musical composition performed only by means of sounds emitted by one or more musical instruments, which is typically represented with a sequence of notes and/or chords on a stave.
  • the sound of the musical composition can be generated by means of the player electronic device 2 and the loudspeaker 5, wherein a local memory at the player electronic device 2 stores data representative of the sound of the instrumental musical composition and (in the case of a vocal instrumental composition) data representative of the lyrics and of the musical accompaniment.
  • the sound of the musical composition is generated live by a singer who is synchronized with the player electronic device 2, by a musician who plays a musical instrument synchronized with the player electronic device 2 or by an orchestra comprising several musical instruments which are synchronized with the player electronic device 2, wherein the synchronization between the singer and the musical instruments is executed for example with a metronome performing the rhythmic scan.
  • the synchronization between the sound of the musical composition generated live by a singer and the musical instruments can also be executed with an electronic synchronization device comprising a processing unit running a software program that implements a suitable synchronization algorithm: in this case the player electronic device 2 is replaced by the electronic synchronization device.
  • the synchronization algorithm (executed on the processing unit of the player electronic device 2) has thus the function of tracking an instrument playing live in order to identify the point of the playing of the musical composition that the musician of that instrument has reached, in order to identify in real time the time position in which the musical composition is currently situated (i.e. the point of the score that the musician of said instrument has reached).
  • NTP Universal Time Coordinated
  • Figure 1 shows only one server NTP 6, but more generally the presence of two or more server NTPs is possible.
  • Each of the mobile electronic devices 4-1 , 4-2 can be, for example, a smartphone (for example, an iPhone) or a tablet (for example, an iPad) or any other electronic device equipped with a wireless connection and a screen.
  • the player electronic device 2 can be an electronic audio player device having the function of playing the sound of a vocal musical or musical composition, by means of the loudspeaker 5.
  • the player electronic device 2 can also be replaced by an electronic synchronization device generating a suitable synchronism signal (by means of a metronome or a suitable synchronization algorithm) with which the orchestra that is performing live an instrumental vocal composition is synchronized or with which the voice of a singer who is performing a live song is synchronized.
  • the player electronic device 2 is controlled by the musician who is performing the musical show or by a director of an orchestra.
  • the player electronic device 2 also has the function of storing and transmitting a data structure associated with the vocal musical or musical composition, as will be explained in more detail below in the description of Figures 2A-2B.
  • the player electronic device 2 thus comprises a non-volatile memory configured to store a configuration data structure associated with the lyrics (in particular, lyrics lines or syllables) of the vocal musical composition and/or associated with the notes/chords of the instrumental or vocal musical composition; more specifically, said data structure is representative of the time evolution of the lyrics (in particular, lyrics lines or syllables of lyrics lines) and/or of the time evolution of the notes/chords of the vocal musical or musical composition considered, as will be illustrated in detail below with reference to the description of Figures 2A-B.
  • a configuration data structure associated with the lyrics (in particular, lyrics lines or syllables) of the vocal musical composition and/or associated with the notes/chords of the instrumental or vocal musical composition
  • said data structure is representative of the time evolution of the lyrics (in particular, lyrics lines or syllables of lyrics lines) and/or of the time evolution of the notes/chords of the vocal musical or musical composition considered, as will be illustrated in detail below with reference to the description
  • the player electronic device 2 further comprises a signal transceiver configured to transmit the configuration data structure to the web server 3 in an initial configuration step of the synchronization method of the invention.
  • the player electronic device 2 comprises a suitable hardware and software means configured to play a song, which is diffused, by means of one or more loudspeakers 5, inside the limited environment 50, which can be for example a stadium or a dance club or a theatre.
  • the player electronic device 2 is thus an electronic audio player device which comprises an audio mixer and an equalizer and it is capable of playing the sound of famous songs.
  • the player electronic device 2 can be a dedicated device which comprises the loudspeaker 5, a signal transceiver (typically an Ethernet interface) and a processing unit.
  • a signal transceiver typically an Ethernet interface
  • the loudspeaker 5 can also be external to the player electronic device 2, but electrically connected thereto: in this case the player electronic device 2 comprises a suitable electronic driving circuit having the function of generating a signal for driving the loudspeaker 5.
  • the player electronic device 2 can be an electronic processor (for example, a personal computer) running a suitable software program and equipped with the loudspeaker 5, a signal transceiver (typically an Ethernet interface) and a processing unit.
  • limited environment 50 means a space delimited by a closed surface defining a perimeter outside which the web server 3 and at least a portion of the medium- long distance telecommunications network 10 are positioned.
  • the player electronic device 2 and the two mobile electronic devices 4-1 , 4-2 are positioned within said limited environment 50, so that the users of the mobile electronic devices 4-1 , 4-2 can listen to the music diffused by the loudspeaker 3 inside the environment 50.
  • the medium-long distance telecommunications network 10 comprises a mobile radio access network of type 3G (UMTS and WiMAX), 3.5G (HSPA), 4G (LTE/HSOPA) or 5G and also comprises a transport network of fixed type (typically in optical fiber).
  • UMTS and WiMAX mobile radio access network of type 3G
  • HSPA 3.5G
  • 4G Long Term Evolution/High Speed Packet Access
  • 5G transport network of fixed type (typically in optical fiber).
  • the mobile electronic devices 4-1 , 4-2 are connected to the medium-long distance telecommunications network 10 by means of a respective medium-long distance wireless signal S1_r_ld, S2_r_ld, for example of type 3G, 3.5G, 4G or 5G or later; in particular, each of the mobile electronic devices 4-1 , 4-2 is connected to the player electronic device 2 by means of the web server 3, using a dedicated data communication channel between the player electronic device 2 and the web server 3 and using a dedicated data communication channel between the web server 3 and each of the mobile electronic devices 4-1.
  • the term "medium-long distance" telecommunications network 10 means that the telecommunications network 10 includes at least one geographical portion outside the limited environment 50 (concert hall, stadium) in which the player electronic device 2 and the two mobile electronic devices 4-1 , 4-2 are situated.
  • the medium-long distance telecommunications network 10 includes at least one geographical portion outside the limited environment 50 within which the player electronic device 2 and the mobile electronic devices 4-1 , 4-2 are positioned.
  • the medium-long distance telecommunications network 10 comprises a mobile radio access network of 3G (UMTS and WiMAX), 3.5G (HSPA), 4G (LTE/HSOPA), 5G type or later and also comprises a transport network of fixed type (typically in optical fiber).
  • 3G UMTS and WiMAX
  • 3.5G HSPA
  • 4G LTE/HSOPA
  • 5G type or later
  • transport network typically in optical fiber
  • the telecommunications network 10 is the Internet network using the TCP/IP protocol, wherein TCP (Transmission Control Protocol) and IP (Internet Protocol) are respectively the level 4 and 3 protocols on which the operation of the Internet network is based.
  • TCP Transmission Control Protocol
  • IP Internet Protocol
  • the term "dedicated data communication channel” means a communication channel that is able to transmit data (typically arranged in packets or frames) with a continuous succession over time in a certain direction, which can be: the transmission direction from the web server 3 towards each of the two mobile electronic devices 4-1 , 4-2; the transmission direction from the web server 3 towards the player electronic device
  • TCP/IP connection possibly with WebSocket
  • lyrics possibly with WebSocket
  • notes/chords of the instrumental or vocal musical composition from the player electronic device 2 to each of the mobile electronic devices 4-1 , 4-2; moreover, the transmission of the sequence start commands with the WebSocket to the web server 3 guarantees a minimum propagation delay between the player electronic device 2 and each of the mobile electronic devices 4-1 , 4-2.
  • WebSocket is not essential for the purposes of the invention, i.e. other protocols can also be used (such as for example the Comet technique) that allow the continuous transmission of data from the web server 3 to the mobile electronic devices 4-1 , 4-2, without the web server 3 receiving an explicit request from the mobile electronic devices 4-1 , 4-2.
  • the mobile electronic device 4-1 comprises a medium-long distance wireless signal transceiver (typically mobile radio of 3G, 3.5G, 4G or 5G type) configured to exchange messages with the web server 3 (and possibly with the server NTP 6) through the telecommunications network 10; advantageously, the transceiver of the mobile electronic device 4-1 is configured to exchange messages with the server NTP 6 in order to synchronize its local clock with a universal clock UTC using the NTP protocol, as will be explained in more detail below.
  • a medium-long distance wireless signal transceiver typically mobile radio of 3G, 3.5G, 4G or 5G type
  • the transceiver of the mobile electronic device 4-1 is configured to exchange messages with the server NTP 6 in order to synchronize its local clock with a universal clock UTC using the NTP protocol, as will be explained in more detail below.
  • the mobile electronic device 4-1 further comprises a local memory configured to store the configuration data structure associated with the lyrics (in particular, lyrics lines or syllables) and/or notes/chords of the instrumental or vocal musical composition, as will be explained in more detail below with reference to the description of the data structures 70 and 71 of Figures 2A-2B.
  • the mobile electronic device 4-1 further comprises a screen for displaying successively lyrics lines (or syllables of lyrics lines) and/or notes/chords of the musical composition, so that said lyrics lines (or syllables) and/or notes/chords are temporally synchronized with the sound of the same musical composition, wherein the sound can be generated by means of the player electronic device 2 and the loudspeaker 5 or it can be generated live by a singer, a musician or an orchestra.
  • the screen of the mobile electronic device 4-1 displays, alternatively: a time sequence of lyrics lines of a song, in which each lyrics line is switched on (or colored) in a time instant which is synchronized with the sound generated by means of the player electronic device 2; a time sequence of syllables of each lyrics line of a song, in which each syllable is switched on (or colored) in a time instant which is synchronized with the sound generated by means of the player electronic device 2; a time sequence of notes and/or chords representative of a musical score of the song, in which each note is switched on (or colored) in a time instant which is synchronized with the sound generated by means of the player electronic device 2; a sequence of musical scores associated with a song; a sequence of images and/or videos, which are displayed in time instants depending on the sound generated by means of the player electronic device 2; a sequence of lights that are switched on or off in time instants depending on the sound generated by the player electronic device 2.
  • the mobile electronic device 4-1 further comprises a processing unit (for example, a microprocessor) electrically connected to the transceiver, to the local memory and to the screen, which runs a suitable software program to perform the functions illustrated below.
  • a processing unit for example, a microprocessor
  • the processing unit of the mobile electronic device 4-1 is configured to synchronize the local clock of the mobile electronic device 4-1 with a universal clock.
  • the processing unit of the mobile electronic device 4-1 is configured to calculate an estimation of the propagation delay D ⁇ between the web server 3 and the mobile electronic device 4-1 crossing the telecommunications network 10, as a function of a universal timestamp received from the web server 3 and as a function of the local clock thereof synchronized with the universal clock.
  • said universal clock is the Universal Time Coordinated (abbreviated to UTC) defined in the ITU-R TF 460-6 standard and on the basis of which the time and the clocks on the planet Earth are regulated.
  • UTC Universal Time Coordinated
  • the universal clock UTC is generated by means of the Network Time Protocol (NTP) used between the mobile electronic device 4-1 and the server NTP 6.
  • NTP Network Time Protocol
  • the processing unit of the mobile electronic device 4-1 is thus configured to calculate an estimation ⁇ Pi> of an initial synchronization time instant in which to start displaying the lyrics (lyrics line or syllable of the lyrics line) and/or note/chord on the screen of the mobile electronic device 4-1 , as will be explained in more detail below with reference to the description of the operation of the electronic system 1 in Figure 3A.
  • the processing unit of the mobile electronic device 4-1 is configured to calculate an estimation ⁇ Pj> of an update synchronization time instant in which to periodically update the display of the lyrics (successive lyrics line or syllable of the lyrics line) and/or successive note/chord on the screen of the mobile electronic device 4-1 , as will be explained in more detail below with reference to the description of the operation of the electronic system 1 in Figure 3B.
  • the processing unit of the mobile electronic device 4-1 is configured to execute the protocols of the ISO/OS I stack, in particular the TCP/IP protocol and the WebSocket protocol, in order to receive in real time from the player electronic device 2 (through the web server 3) the lyrics (lyrics lines or syllables of lyrics lines) and/or the notes/chords of the instrumental or vocal musical composition during its execution.
  • the protocols of the ISO/OS I stack in particular the TCP/IP protocol and the WebSocket protocol
  • the foregoing considerations relating to the mobile electronic device 4-1 are similarly applicable also to the mobile electronic device 4-2, comprising a wireless signal transceiver, a local memory, a screen and a processing unit, which have the same functions illustrated above.
  • the web server 3 is an electronic device positioned within the medium-long distance telecommunications network 10.
  • the web server 3 has the function of receiving, from the player electronic device 2, the configuration data structure 70 (and/or 71) and forwarding it to the mobile electronic devices 4-1 , 4-2 that have performed a request for opening a dedicated data communication channel.
  • the web server 3 comprises one or more processing units (for example, one or more microprocessors) and suitable fixed type signal transceivers (electrical and/or optical, for example Ethernet, SDH/Sonet, OTN, WAN) to exchange data with the player electronic device 2 and with the mobile electronic devices 4-1 , 4-2.
  • processing units for example, one or more microprocessors
  • suitable fixed type signal transceivers electrical and/or optical, for example Ethernet, SDH/Sonet, OTN, WAN
  • the web server 3 comprises a memory for storing the configuration data structure 70 (and/or 71), so as to transmit it to the mobile electronic devices requesting the connection to the player electronic device 2 after the instant the playing of the musical track is started.
  • the processing unit of the web server 3 is configured to execute the protocols of the ISO/OSI stack, in particular the TCP/IP level 4 and 3 protocol and the WebSocket level 7 protocol, in order to transmit in time real to the mobile electronic devices 4-1 , 4-2 the lyrics (lyrics lines or syllables of lyrics lines) and/or the notes/chords of the instrumental or vocal musical composition during its execution.
  • the protocols of the ISO/OSI stack in particular the TCP/IP level 4 and 3 protocol and the WebSocket level 7 protocol, in order to transmit in time real to the mobile electronic devices 4-1 , 4-2 the lyrics (lyrics lines or syllables of lyrics lines) and/or the notes/chords of the instrumental or vocal musical composition during its execution.
  • the processing unit of the web server 3 is also configured to synchronize the local clock of the web server 3 with the same universal clock with which the mobile electronic devices 4-1 , 4-2 are synchronized.
  • the processing unit of the web server 3 is also configured to generate a timestamp by means of the local clock synchronized with the same universal clock used by mobile electronic devices 4-1 , 4-2: this timestamp will be used (together with a time position Pi) by the mobile electronic device 4-1 (and by the mobile electronic device 4-2) to make an estimation and compensation of the propagation delay (of the lyrics and/or notes/chords) between the web server 3 and the mobile electronic device 4-1 (or 4-2).
  • said universal clock is the Universal Time Coordinated (abbreviated to UTC) defined in the ITU-R TF.460-6 standard and on the basis of which the time and the clocks on the planet Earth are regulated, therefore a UTC timestamp is generated for the web server 3.
  • UTC Universal Time Coordinated
  • the web server 3 also has the function of receiving, from the electronic audio player device 2, a time position Pi indicative of the lyrics line or syllable of the lyrics line and/or chords/notes of the musical track being performed at the electronic audio player device 2, thus the web server 3 has the function of forwarding the received time position to the connected mobile electronic devices 4-1 , 4-2, together with the universal timestamp associated with the received time position.
  • the synchronization at the web server 3 and at the mobile electronic devices 4-1 , 4-2 of the local clocks with a single universal clock (typically UTC) - together with the use of a dedicated data communication channel (typically a TCP/IP connection with WebSocket) - allows obtaining an excellent and reliable synchronization between the lyrics (lyrics lines or syllables of lyrics lines) and/or notes/chords of the musical composition displayed on the screens of the mobile electronic devices 4-1 , 4-2 and the sound of the music composition, as it can be ensured that all mobile electronic devices receive the synchronization signal and a maximum synchronization delay of about 30 milliseconds [ms] (in some cases up to 20 ms) can be achieved.
  • a single universal clock typically UTC
  • a dedicated data communication channel typically a TCP/IP connection with WebSocket
  • the universal clock UTC is generated by means of the Network Time Protocol (NTP) used between the web server 3 and the server NTP 6.
  • NTP Network Time Protocol
  • the NTP protocol defines a timestamp consisting of 64 bits, of which 32 bits are used to define the seconds and another 32 bits to define the decimal part of the second.
  • the NTP protocol is defined in the following standards:
  • RFC 1305 version 3
  • the timestamp is made up of 128 bits, of which 64 bits are used to define the seconds and another 64 bits to define the decimal part of the second.
  • the web server 3 implements the NTP protocol (in one of the versions indicated above) by means of a suitable software code run on the processing unit of the web server 3.
  • the web server 3 sends a request to the server NTP 6 through the telecommunications network 10, thus it receives a response from the server NTP 6 and the processing unit of the web server 3 synchronizes its internal clock with the universal clock, by calculating the difference of time between that of the internal clock at the web server 3 and that of the universal clock of the server NTP 6, thus obtaining a local clock at the web server 3 that is synchronous with the universal clock of the server NTP 6.
  • the web server 3 Each time the web server 3 receives a message from the player electronic device 2, the web server 3 associates a timestamp to each received message, which contains inside the time position Pi provided for by the execution of the considered musical track.
  • the mobile devices 4-1 and 4-2 make similar requests to the server NTP 6 and calculate the difference of time between that of the internal clock at the respective mobile device and that of the universal clock of the server NTP 6, thus obtaining a local clock at the respective mobile device that is synchronous with the universal clock of the server NTP 6.
  • the mobile devices 4-1 and 4-2 When the mobile devices 4-1 and 4-2 receive a message from the web server 3, they calculate the difference D ⁇ between the time indicated on the above packet and the actual time of their clock, which has already been synchronized previously with the server NTP 6.
  • FIG. 2A shows a Table 1 which shows a first example of data structure 70 shared between the player electronic device 2 and the mobile electronic devices 4-1 , 4-2, wherein it is considered the case of lyrics of a song stored in a memory of the player electronic device 2 and which is played by means of the player electronic device 2 and wherein a plurality of lyrics lines of the song are displayed sequentially on a respective screen of the electronic devices mobile 4-1 , 4-2 (for example, a smartphone or tablet), so that the instant in which a lyrics line is displayed is synchronized with the sound generated by means of the loudspeaker 5.
  • the electronic devices mobile 4-1 , 4-2 for example, a smartphone or tablet
  • the lyrics of the song are thus divided into a plurality of lyrics lines (i.e. portions of lyrics) separated from each other, each of which must be displayed in a respective nominal time position P0, P1 , P2, P3, P4, ...P21 (for example expressed in milliseconds), thus defining a time sequence of successive lyrics lines that must be displayed on the screens of the mobile electronic devices 4-1 , 4-2 at the respective nominal time positions P0, P1 , P2, P3, P4, ... P21 , so that each lyrics line is synchronized with the sound generated by the player electronic device 2 and the loudspeaker 5.
  • D equal for example to 10 ms
  • the data structure 70 comprises a first column indicating the plurality of lyrics lines and a corresponding second column indicating the different successive nominal time positions in which the lyrics lines must be displayed successively in the theoretical case in which the propagation delay between the web server 3 and the mobile electronic devices 4- 1 , 4-2 is null.
  • the second line of the data structure 70 contains a second lyrics line (subsequent to the first one) of the considered song, wherein the second lyrics line must be displayed on a respective screen of the mobile electronic device 4-1 and/or 4-2 at a time instant P1 subsequent to P0 of the value D (i.e.
  • the fourth line of the data structure 70 contains a fourth lyrics line (subsequent to the third one) of the considered song, wherein the fourth lyrics line must be displayed on a respective screen of the mobile electronic device 4-1 and/or 4-2 at a time instant P3 subsequent to P2 of the value D (i.e.
  • the sixth line of the data structure 70 contains a sixth lyrics line (subsequent to the fifth one) of the song considered, wherein the sixth lyrics line must be displayed on a respective screen of the mobile electronic device 4-1 and/or 4-2 at a time instant P5 subsequent to P4 of the value D (i.e.
  • P11 R10+D
  • lyrics portion of a musical song is the following, extracted from the famous Beatles song "Yesterday”:
  • lyrics line 1 An example of division into lines of the above indicated lyrics of the song “Yesterday” is as follows: lyrics line 1 :
  • FIG. 2B shows a Table 2 which illustrates a second example of data structure 71 shared between the player electronic device 2 and the mobile electronic devices 4-1 , 4-2, wherein it is considered the case of lyrics of a song that is played by means of the player electronic device 2 and wherein successive lyrics lines of the song are displayed on a respective screen of the mobile electronic devices 4-1 , 4-2, wherein the different syllables of the lyrics lines displayed are colored (or are switched on) on the screen during the execution of the song (karaoke), so that each syllable is synchronized with the sound of the song generated by means of the speaker 5, that is in such a way that the instant in which a syllable is colored is synchronized with the sound of the song generated by means of the player electronic device 2 and of the loudspeaker 5.
  • the lyrics of the song is first divided into a plurality of lyrics lines (that is portions) separated from each other, then each lyrics line is in turn divided into a plurality of syllables, so that the sum of the duration of the syllables of a lyrics line is less than the length of the line itself.
  • lyrics means a portion or sub-part of a lyrics line.
  • Each syllable is colored (or is switched on) in a respective nominal time position P0.1 , P0.2, P0.3, P1.1 , P1.2, ... P21.1 , P21.2, P21.3, P21.4, thus defining a time sequence of successive syllables that must be colored during the display of lyrics lines on the screens of the mobile electronic devices 4-1 , 4-2 so that each syllable is synchronized with the sound of the song generated by the loudspeaker 5.
  • each lyrics line can be divided into a maximum of 10 syllables.
  • the data structure 71 comprises three columns: a first column indicating the different syllables of the plurality of lyrics lines of the song; a second column indicating the number of the lyrics line to which the syllable considered in the first column refers; a third column indicating the various successive nominal time positions in which the syllables of the lyrics lines must be displayed and colored (or switched on) successively, in the theoretical case in which the propagation delay between the web server 3 and the mobile electronic devices 4-1 , 4-2 is null.
  • the data structure 71 comprises: the lines from 1 to 3 contain respectively the syllables from 1 to 3 of the first lyrics line of the considered song, wherein the syllable 1 can be colored (or switched on) on a respective screen of the mobile electronic device 4-1 and/or 4 -2 at an initial time instant P0.1 , the syllable 2 can be colored (or switched on) on a respective screen of the mobile electronic device 4-1 and/or 4-2 at a time instant P0.2 and the syllable 3 can be colored (or switched on) on a respective screen of the mobile electronic device 4-1 and/or 4-2 at a time instant P0.3; the lines 4 and 5 contain respectively the syllables 1 and 2 of the second lyrics line of the considered song, wherein the syllable 1 can be colored (or switched on) on a respective screen of the mobile electronic device 4-1 and/or 4-2 at a time instant P1 .1 and the syllable 2 can be colored on a respective screen of the mobile electronic
  • the data structure 70 (or 71) constitutes a configuration information which is defined in advance for each possible song that can be played by the player electronic device 2 and thus the data structure 70 (or 71) is stored in a local memory of the player electronic device 2.
  • the data structure 70 (or 71) is transmitted from the player electronic device 2 to the web server 3, which in turn forwards it to the mobile electronic devices 4-1 , 4-2 requesting it, which store the received data structure 70 (or 71) in a respective local memory: in this way the mobile electronic devices 4-1 , 4-2 are able to know what the time evolution of the lyrics lines (or of the syllables of the lyrics lines) to be displayed will be, starting from an initial instant (and possibly from intermediate time instants subsequent to the initial one) which will be calculated with accuracy by means of the synchronization method according to the invention, that is by means of the timestamp with universal clock (for example UTC) and using a dedicated data communication channel (for example a TCP/IP connection with Websocket).
  • the timestamp with universal clock (for example UTC) and using a dedicated data communication channel (for example a TCP/IP connection with Websocket).
  • a musical score of a vocal musical composition comprising a succession of musical notes represented on the stave; in this example the musical notes are transmitted from the player electronic device 2 to the mobile electronic device 4-1 and/or 4-2 through the web server 3, so that the instant in which a note is colored (or switched on) is synchronized (by means of the synchronization method of the invention) with the audio generated by means of the player device 2 and of the loudspeaker 5 or by means of a musical instrument.
  • a musician (or a music student) is performing an instrumental musical composition using a piano and is using the mobile electronic device 4-1 (for example, a tablet) so that the musical notes representative of the musical composition can be displayed on his screen, in which the notes light up (or are colored) in the instant in which they are to be played by means of the piano, thus providing assistance to the musician (or to the music student) during the execution of the instrumental musical composition with the piano.
  • the mobile electronic device 4-1 for example, a tablet
  • a configuration data structure 70 from the player electronic device 2 to the web server 3 has been considered, but it is also possible to transmit two or more different configuration data structures, for example in case it is necessary to transmit different lyrics and/or scores corresponding to different musical instruments, but belonging to the same arrangement.
  • the electronic system 1 will be able to track the execution of the same orchestra in real time, showing the notes of the scores at the right moment at which they must be executed by the various instrumentalists and/or singers.
  • the peculiarity of the method and system according to the invention is that the display of the different scores will be optimally synchronized to the music being executed regardless of the musical interpretation which could be not aligned with a previously prepared and stored timeline. It will be described the operation of the synchronization system 1 , with reference also to Figures 3A-3B.
  • the synchronization method of the invention is carried out in part by means of software run on the processing unit of the player electronic device 2, in part by means of software run on the processing unit of the web server 3, in part by means of software run on the processing unit of the mobile electronic device 4-,1 in part by means of software run on the processing unit of the mobile electronic device 4-2 and in part by means of software run on the processing unit of the server NTP 6.
  • a song is played by means of the player electronic device 2 and the sound of the song is diffused in a room 50 by means of one or more loudspeakers 5;
  • the data structure 70 is used in which the song lyrics has been divided into successive separate lyrics lines distant between them by the same time interval D;
  • the telecommunications network 10 is Internet which uses the TCP/IP protocol and thus the messages exchanged between the player electronic device 2 and the web server 3 and between the web server 3 and the mobile electronic devices 4-1 , 4-2 are IP packets; it is used a dedicated bidirectional (i.e. full-duplex) data communication channel implemented by means of a TCP/IP connection with Websocket.
  • the method comprises three steps: a first configuration step, comprised between the initial instant tO and t25; a second step (subsequent to the first one) of first synchronism and normal operation, comprised between the instant t26 and the instant t45; a third step (subsequent to the second one) for updating synchronism and normal operation, comprised between the instant t50 and the instant t65.
  • the Figure 3A shows the configuration step and the initial synchronization step between the sound generated by means of the player electronic device 2 and the first three lines of song lyrics displayed on the mobile electronic device 4-1 and the first two lyrics lines of the song displayed on the mobile electronic device 4-2.
  • a dedicated bi-directional (i.e. full-duplex) data communication channel is established, in particular a TCP/IP connection with WebSocket, between the player device 2 and the mobile electronic devices 4-1 and 4-2, by means of the web server 3.
  • the first configuration step it is performed the transmission of the configuration data structure 70 from the player electronic device 2 to the mobile electronic devices 4-1 and 4-2.
  • the second step it is performed the first synchronization of the lyrics displayed at the mobile electronic device 4-1 and at the mobile electronic device 4-2 with the sound of the song played by means of the player electronic device 2.
  • the third step it is performed an update of the synchronism of the lyrics displayed at the mobile electronic device 4-1 and at the mobile electronic device 4-2 with the sound of the song played by means of the player electronic device 2.
  • the player electronic device 2 transmits towards the web server 3 a message requesting the opening of a dedicated bi-directional (i.e. full-duplex) data communication channel, in particular a TCP/IP connection with WebSocket, between the player electronic device 2 and the web server 3.
  • a dedicated bi-directional (i.e. full-duplex) data communication channel in particular a TCP/IP connection with WebSocket
  • the web server 3 receives the request message and transmits towards the player electronic device 2 a message confirming the opening of the dedicated data communication channel, in particular a TCP/IP connection with WebSocket; at the instant t3 the player electronic device 2 receives the confirmation message and thus the dedicated data communication channel is established (in particular, a TCP/IP connection with WebSocket) between the player electronic device 2 and the web server 3.
  • the mobile electronic device 4-1 transmits towards the web server 3 a message requesting the opening of a dedicated bi-directional (i.e. full-duplex) data communication channel, in particular a TCP/IP connection with WebSocket between the mobile electronic device 4-1 and the web server 3.
  • a dedicated bi-directional (i.e. full-duplex) data communication channel in particular a TCP/IP connection with WebSocket between the mobile electronic device 4-1 and the web server 3.
  • the web server 3 receives the request message and transmits towards the mobile electronic device 4-1 a message confirming the opening of the dedicated data communication channel, in particular a TCP/IP connection with WebSocket; at the instant t6 the mobile electronic device 4-1 receives the confirmation message and thus the dedicated data communication channel is established (in particular a TCP/IP connection with WebSocket) between the web server 3 and the mobile electronic device 4-1.
  • the web server 3 synchronizes its internal clock with a universal clock UTC, thus obtaining a local clock synchronized with the universal clock UTC.
  • said synchronization is carried out by means of the exchange of messages between the web server 3 and the server NTP 6, using the NTP protocol.
  • the local clock of the web server 3 advances in time, keeping itself synchronized with the universal clock UTC of the server NTP 6.
  • the mobile electronic device 4-2 transmits towards the web server 3 a message requesting the opening of a dedicated bi-directional (i.e. full-duplex) data communication channel (in particular a TCP/IP connection with WebSocket) between the mobile electronic device 4-2 and the web server 3.
  • the web server 3 receives the request message and transmits towards the mobile electronic device 4-2 a message confirming the opening of the dedicated data communication channel, in particular a TCP/IP connection with WebSocket; at the instant t11 the mobile electronic device 4-2 receives the confirmation message and thus the dedicated data communication channel is established (in particular a TCP/IP connection with WebSocket) between the web server 3 and the mobile electronic device 4-2.
  • the player electronic device 2 transmits towards the web server 3 a message carrying the configuration data structure 70 associated with the lyrics of a song as illustrated above, that is the time evolution of the lyrics of the song divided into lyrics lines and the respective nominal time positions PO, P1 , P2, P3, P4, ...P21 , in order to display the lyrics of the song successively on a screen of the mobile electronic devices 4-1 , 4-2.
  • the web server 3 receives the message carrying the configuration data structure 70 and forwards it to the mobile electronic device 4-1 and 4-2.
  • the web server 3 saves the configuration data structure 70, so as to make it available to other mobile electronic devices which subsequently request the connection to the player electronic device 2, that is after the initial instant tO.
  • the mobile electronic device 4-1 receives the message carrying the data structure 70 and stores it in a local memory.
  • the mobile electronic device 4-2 receives the message carrying the data structure 70 and stores it in a local memory.
  • the web server 3 receives the message carrying said initial nominal time position P0 and generates a UTC timestamp (indicated with UTC_0), by means of its local clock synchronized with the universal clock UTC; furthermore, an association of the timestamp UTC_0 to the initial nominal time position P0 is made at the web server 3.
  • the timestamp UTC_0 also represents the initial instant in which the player electronic device 2 started playing the sound of the musical composition.
  • the web server 3 exchanges messages with the server NTP 6 using the NTP protocol, thus generating the timestamp UTC_0 by means of the NTP protocol.
  • the mobile electronic device 4-1 synchronizes its internal clock with the universal clock UTC, thus obtaining a local clock of the mobile electronic device 4-1 synchronized with the universal clock UTC.
  • said synchronization is carried out by means of the exchange of messages between the mobile electronic device 4-1 and the server NTP 6, using the NTP protocol.
  • the local clock of the mobile electronic device 4-1 advances in time, keeping itself synchronized with the universal clock UTC of the server NTP 6.
  • the mobile electronic device 4-2 synchronizes its internal clock with the universal clock UTC (for example by means of the exchange of messages between the mobile electronic device 4-2 and the server NTP 6), thus obtaining a local clock of the mobile electronic device 4-2 synchronized with the universal clock UTC; therefore starting from the instant t29 the local clock of the mobile electronic device 4-2 advances in time, keeping itself synchronized with the universal clock UTC of the server NTP 6.
  • the mobile electronic devices 4-1 , 4-2 synchronize their respective internal clocks with the universal clock UTC after receiving the data structure, but it is sufficient for said synchronization of the internal clocks to be carried out before the reception of the initial time position P0, for example also before the respective reception of the data structure.
  • the web server 3 transmits towards the mobile electronic device 4-1 and towards the mobile electronic device 4-2 a message carrying the initial nominal time position P0 and the value of the universal timestamp UTC_0 associated therewith.
  • the mobile electronic device 4-1 receives the message carrying the initial nominal time position P0 and the value of the universal timestamp UTC_0 associated therewith and then it generates (by means of its local clock synchronized with the universal clock UTC) the value of the current time instant indicated below with UTC_1.1 , thus associating UTC_1 .1 to the time instant of reception at the mobile electronic device 4-1 of the initial nominal time position P0.
  • the time interval D between successive lyrics lines i.e. the duration of each lyrics line
  • the lyrics line 4 associated with the nominal time position P3 (fourth line of Table 1) is displayed on the screen of the mobile electronic device 4-1 , because the mobile electronic device 4-1 receives the synchronization delayed by 30 ms with respect to the sound emitted by means of the player electronic device 2, due to the delay introduced by the telecommunications network 10.
  • the operation of the mobile electronic device 4-1 continues in a similar way for the successive instants which are at a distance of the time interval D with respect to the previous one, that is at the instant t44 (which is at a distance of the time interval D with respect to t40 and is at a distance of the time interval 2D with respect to t32) the lyrics line 6 associated with the nominal time position P5 is displayed, at the instant which is at a distance of the time interval D with respect to the previous one t44 the lyrics line 7 associated with the nominal time position P6 is displayed, and so on until the first synchronization update which will be illustrated below in Figure 3B.
  • the above considerations relating to the operation of the mobile electronic device 4-1 are similarly applicable to the second mobile electronic device 4-2, with the following differences: at the mobile electronic device 4-2 a different value of the current time instant UTC_1.2 is generated at the instant t33 and a propagation delay D4 greater than D3 is calculated; at the mobile electronic device 4-2 an estimation ⁇ P4> of the synchronization time instant at which to start displaying a lyrics line on the screen of the mobile electronic device 4-2 is calculated, which is assumed to be equal to the value of the nominal time position P4 at which the lyrics line 5 of the song being performed in the room 50 must be displayed; at the instant t41 on the screen of the mobile electronic device 4-2 the lyrics line 5 associated with the nominal time position P4 is displayed; at the instant t45 (which is at a distance from the instant t41 of the time interval D, i.e.
  • the synchronization system 1 allows the synchronization with the sound of a song that can also be unpublished (i.e. the lyrics of the song played by the player electronic device 2 is not public), because the lyrics (divided into lines) is transmitted (by means of the data structure 70) from the player electronic device 2 to all the mobile electronic devices 4-1 and 4-2; furthermore, the synchronization system 1 according to the invention allows the synchronization for any song, both published and unpublished.
  • the synchronization system 1 allows the synchronization with the sound of a song that can also have been rearranged, that is modified with respect to the original version, since the rearranged lyrics (divided into lines) is transmitted (by means of the data structure 70) from the player electronic device 2 to all the mobile electronic devices 4-1 and 4-2.
  • the solution described in US 2014/0360343 does not allow a synchronization between the sound of a song generated by the source 302 and two or more client devices similar to 304, because each client device is independent of the others, i.e. each client device captures a sample of the song and it is synchronized to the sound of the song after it has been recognized.
  • a player electronic device 2 which centrally distributes the lyrics (divided into lines in the data structure 70) of the song that it is playing to all the mobile electronic devices 4-1 , 4-2, ... of the users interested in participating in the concert, allows having a perfect synchronization of the sound of the song between all the mobile electronic devices 4-1 , 4-2, ...
  • Figure 3B shows a second synchronization between the sound generated by means of the player electronic device 2 and the successive lyrics lines of the song displayed on the mobile electronic devices 4-1 and 4-2.
  • the web server 3 receives the message carrying a nominal time position P10 (see Table 1 in Fig. 2A) which is temporally at a distance of 10D from the initial time position P0 and generates a universal timestamp UTC_10 at the instant of reception of the nominal time position P10, thus associating a universal timestamp UTC_10 to the nominal time position P10; at the instant t55 the web server 3 transmits towards the mobile electronic device 4-1 and towards the mobile electronic device 4-2 a message carrying the nominal time position P10 and the value of the universal timestamp UTC_10 associated therewith; at the instant t56 the mobile electronic device 4-1 receives the message carrying the nominal time position P10 and the value of the universal timestamp UTC_10 associated therewith and then generates (by means of its local clock synchronized with the universal clock UTC) the value of the current time instant indicated with UTC_10.1 , thus associating the time instant
  • the time distance DT between the first synchronization (instant t27) and the second synchronization (instant t51) is chosen for example as a function of the value of the time interval D and the possible values of the propagation delays of the telecommunications network 10, such that it is neither too small nor too big.
  • the time distance DT between the first and the second synchronization is of the order of seconds (for example 5 seconds).
  • the electronic system 1 performs a periodic update of the synchronization of lyrics (lyrics lines or syllables of lyrics lines) and/or notes/chords with the sound of a vocal or instrumental musical composition, i.e. the value DT is substantially constant over time.
  • an update (preferably periodic) of the synchronization instant allows avoiding synchronization drifts of the local clocks that can be accumulated over time and cause the loss of synchronization between the lyrics lines/syllables of lyrics lines and/or notes/chords and the sound generated by means of the player electronic device 2.
  • an update of the synchronization instant allows one or more other mobile electronic devices to subsequently be inserted in the electronic system 1 and obtaining a quick synchronization of lyrics lines/syllables of lyrics lines and/or notes /chords displayed on the respective screens with the sound generated by means of the player electronic device 2.
  • the invention is not limited to electronic devices 4-1 , 4-2 of the mobile type, but more generally it is also possible to use electronic devices 4-1 and/or 4-2 of fixed type, i.e. that are connected to the medium-long distance telecommunications network 10 by means of a wired connection (for example, of the Ethernet type).
  • a medium-long distance telecommunications network (10) in particular of TCP/IP type.
  • the reception method comprises the steps of: a1) receiving a second message and generating a time instant of reception of the second message by means of a local clock of the mobile electronic device synchronized with said universal clock, wherein the second message carries an initial nominal time position and a first universal timestamp, the initial nominal time position being indicative of the initial nominal time instant in which to display a lyrics line or a syllable of the lyrics line and/or a note/chord on a screen of the mobile electronic device and the first universal timestamp being generated by means of a local clock of a web server synchronized with a universal clock; b1) calculating an estimation of an initial synchronization time instant as a function of the difference between said time instant of reception of the second message and the first universal timestamp; c1) calculating a time position indicative of the time instant in which to start displaying the lyrics line/syllable of the lyrics line and/or note/chord on the screen of the mobile electronic device, wherein said time position is calculated as a function of said estimation of
  • It is also an object of the present invention a mobile electronic device comprising a screen and a processing unit configured to run a software program performing the steps of the reception method illustrated above.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Electrophonic Musical Instruments (AREA)

Abstract

L'invention concerne un procédé de synchronisation de paroles et/ou de notes/accords avec le son d'une composition musicale entre un dispositif électronique de lecture (2) et un dispositif électronique mobile (4-1) connecté au dispositif électronique de lecture au moyen d'un réseau de télécommunications à moyenne-longue distance (10) de type TCP/IP. Le procédé comprend les étapes suivantes : a) transmettre, depuis le dispositif électronique de lecture vers un serveur web (3) du réseau de télécommunications à moyenne-longue distance, au moyen d'un canal de communication de données TCP/IP dédié, un premier message portant une position temporelle nominale initiale (P0) indicative du moment nominal initial auquel afficher une première ligne de paroles ou une première syllabe de la première ligne de paroles et/ou une première note/accord sur un écran du dispositif électronique mobile ; b) recevoir, au niveau du serveur web, le premier message et générer une première estampille temporelle universelle (UTC_0) au moyen d'une horloge locale du serveur web synchronisée avec une horloge universelle, associant ainsi la première estampille temporelle universelle à la position temporelle nominale initiale ; c) transmettre, depuis le serveur web vers le dispositif électronique mobile au moyen d'un canal de communication de données TCP/IP dédié, un second message portant la position temporelle nominale initiale et la première estampille temporelle universelle ; d) recevoir, au niveau du dispositif électronique mobile, le second message et générer, au moyen d'une horloge locale du dispositif électronique mobile synchronisée avec ladite horloge universelle, un moment de réception (UTC_1. 1) du second message au niveau du dispositif électronique mobile ; e) calculer, au niveau du dispositif électronique mobile, une estimation (<P3>) d'un moment initial de synchronisation en fonction de la différence (Δ3) entre ledit moment de réception du second message au niveau du dispositif électronique mobile et la première horloge universelle ; f) calculer une position temporelle (P3) indicative de moment actuel auquel commencer à afficher la ligne de paroles/syllabes de la ligne de paroles et/ou note/accord sur l'écran du dispositif électronique mobile, dans lequel ladite position temporelle est calculée en fonction de ladite estimation du moment de synchronisation initial et est sélectionnée parmi une pluralité de positions temporelles nominales successives (P1, P2, P3, P4, P5,. ... P11, P12, P13, .... P21), chaque position temporelle nominale étant indicative d'un moment temporel nominal respectif auquel afficher la ligne de paroles/syllabes respective de la ligne de paroles et/ou la note/accord sur l'écran du dispositif électronique mobile.
PCT/IB2020/060456 2019-11-08 2020-11-06 Système électronique pour synchroniser des événements avec le son d'une composition musicale entre un dispositif électronique de lecture et une pluralité de dispositifs électroniques mobiles connectés à un réseau de télécommunications à moyenne-longue distance et son procédé de synchronisation WO2021090256A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT102019000020626A IT201900020626A1 (it) 2019-11-08 2019-11-08 Sistema elettronico per la sincronizzazione di eventi con il suono di una composizione musicale fra un dispositivo elettronico di riproduzione ed una pluralità di dispositivi elettronici mobili collegati al dispositivo elettronico di riproduzione per mezzo di una rete di telecomunicazioni a media-lunga distanza e relativo metodo di sincronizzazione
IT102019000020626 2019-11-08

Publications (1)

Publication Number Publication Date
WO2021090256A1 true WO2021090256A1 (fr) 2021-05-14

Family

ID=69811723

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2020/060456 WO2021090256A1 (fr) 2019-11-08 2020-11-06 Système électronique pour synchroniser des événements avec le son d'une composition musicale entre un dispositif électronique de lecture et une pluralité de dispositifs électroniques mobiles connectés à un réseau de télécommunications à moyenne-longue distance et son procédé de synchronisation

Country Status (2)

Country Link
IT (1) IT201900020626A1 (fr)
WO (1) WO2021090256A1 (fr)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140360343A1 (en) * 2010-05-04 2014-12-11 Shazam Entertainment Limited Methods and Systems for Disambiguation of an Identification of a Sample of a Media Stream
US20180052648A1 (en) * 2015-03-13 2018-02-22 Funtoad Inc. A method of controlling mobile devices in concert during a mass spectators event
US20180196393A1 (en) * 2017-01-06 2018-07-12 The Trustees Of Princeton University Global time server for high accuracy musical tempo and event synchronization

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140360343A1 (en) * 2010-05-04 2014-12-11 Shazam Entertainment Limited Methods and Systems for Disambiguation of an Identification of a Sample of a Media Stream
US20180052648A1 (en) * 2015-03-13 2018-02-22 Funtoad Inc. A method of controlling mobile devices in concert during a mass spectators event
US20180196393A1 (en) * 2017-01-06 2018-07-12 The Trustees Of Princeton University Global time server for high accuracy musical tempo and event synchronization

Also Published As

Publication number Publication date
IT201900020626A1 (it) 2021-05-08

Similar Documents

Publication Publication Date Title
CN110692252B (zh) 具有用于广域广播的延迟管理的视听协作方法
US11683536B2 (en) Audiovisual collaboration system and method with latency management for wide-area broadcast and social media-type user interface mechanics
Rofe et al. Telematic performance and the challenge of latency
Carôt et al. Results of the fast-music project—five contributions to the domain of distributed music
JP6457326B2 (ja) 歌唱音声の伝送遅延に対応したカラオケシステム
CN112567758A (zh) 具有时延管理和社交媒体类型用户界面机构的视听实况流系统和方法
JP4259329B2 (ja) 演奏装置および合奏システム
WO2021090256A1 (fr) Système électronique pour synchroniser des événements avec le son d&#39;une composition musicale entre un dispositif électronique de lecture et une pluralité de dispositifs électroniques mobiles connectés à un réseau de télécommunications à moyenne-longue distance et son procédé de synchronisation
KR20210108715A (ko) 네트워크에 기반한 합동 공연을 제공하는 장치 및 그 방법
CN102394860A (zh) 信号传送系统、方法、电脑程序产品及电脑可读取储存媒体
EP1784049A1 (fr) Procédé et système de reproduction sonore, et produit de programme informatique
CN114072872A (zh) 用于提供电子乐谱的系统和方法
US10917465B2 (en) Synchronization setting device and distribution system
JP2008304821A (ja) 楽曲合奏公開システム
CN116962747A (zh) 基于网络直播的实时合唱同步方法、装置及网络直播系统
JP2005195507A (ja) ネットワークを介した時刻同期方法
KR101205342B1 (ko) 노래방 음원 영상과 가수 녹음 음원 매칭 시스템 및 그 방법
JP2007041320A (ja) ネットワークを用いた遠隔多地点合奏システム
JP6208439B2 (ja) ネットワーク合唱における演奏キーのマッチングシステム
JP2003085068A (ja) ライブ情報提供サーバ、情報通信端末、ライブ情報提供システムおよびライブ情報提供方法
US10999424B2 (en) Method of controlling mobile devices in concert during a mass spectators event
Dannenberg et al. Scaling up live internet performance with the global net orchestra
WO2023184032A1 (fr) Procédé et système pour fournir un environnement de studio virtuel sur internet
KR20200096447A (ko) 데이터 그룹 재생 처리시스템
KR20190100723A (ko) 듀엣 모드 및 동시 음향 모드 제공 기반 방송 송출 시스템 및 그 방법

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20816591

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20816591

Country of ref document: EP

Kind code of ref document: A1